Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchh+cfg-codec-hr3)

Failing for the past 52 builds (Since #751 )
Took 1 min 5 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f710c6fa488>, timeout=10, timestep=1} [trial-802↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-802 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py
----------------------------------------------
07:41:52.129886 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:41:52.142317 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1)
07:41:52.295719 tst              mo_mt_call_osmux.py: using LAC 7161
07:41:52.430083 tst              mo_mt_call_osmux.py: using RAC 21
07:41:52.563837 tst              mo_mt_call_osmux.py: using CellId 7161
07:41:52.691562 tst              mo_mt_call_osmux.py: using BVCI 7157
07:41:52.716981 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:41:52.728695 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:41:52.740173 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:41:52.751651 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:41:52.763138 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:41:52.774695 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
07:41:52.876114 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
07:41:53.066040 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
07:41:53.560944 run         create_hlr_db(pid=19379): Launched
07:41:53.742770 bus                        /sierra_1: Setting Powered False
07:41:54.764050 run         create_hlr_db(pid=19379): Terminated: ok {rc=0}
07:41:55.210098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19381): Launched
07:41:55.545702 run   osmo-hlr_10.42.42.2(pid=19382): Launched
07:41:55.666614 run              osmo-stp_10.42.42.5: Starting osmo-stp
07:41:56.245245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19383): Launched
07:41:56.579697 run   osmo-stp_10.42.42.5(pid=19384): Launched
07:41:56.698381 run              osmo-msc_10.42.42.6: Starting osmo-msc
07:41:57.305334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19385): Launched
07:41:57.638920 run   osmo-msc_10.42.42.6(pid=19386): Launched
07:42:00.814626 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
07:42:01.401917 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19396): Launched
07:42:01.735097 run   osmo-mgw_10.42.42.3(pid=19397): Launched
07:42:01.853390 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
07:42:02.419578 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19398): Launched
07:42:02.751636 run   osmo-mgw_10.42.42.4(pid=19399): Launched
07:42:02.870237 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
07:42:03.561079 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19400): Launched
07:42:03.895140 run   osmo-bsc_10.42.42.7(pid=19401): Launched
07:42:10.175753 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
07:42:10.769261 run         rm-remote-dir(pid=19402): Launched
07:42:12.973221 run         rm-remote-dir(pid=19402): Terminated: ok {rc=0}
07:42:13.330292 run         mk-remote-dir(pid=19403): Launched
07:42:14.533115 run         mk-remote-dir(pid=19403): Terminated: ok {rc=0}
07:42:14.834681 run    scp-inst-to-remote(pid=19404): Launched
07:42:28.056567 run    scp-inst-to-remote(pid=19404): Terminated: ok {rc=0}
07:42:28.406755 run         mk-remote-dir(pid=19406): Launched
07:42:30.608741 run         mk-remote-dir(pid=19406): Terminated: ok {rc=0}
07:42:30.911395 run     scp-cfg-to-remote(pid=19407): Launched
07:42:32.112512 run     scp-cfg-to-remote(pid=19407): Terminated: ok {rc=0}
07:42:32.458425 run   reload-dsp-firmware(pid=19409): Launched
07:42:35.659281 run   reload-dsp-firmware(pid=19409): Terminated: ok {rc=0}
07:42:35.997987 run        osmo-bts-sysmo(pid=19410): Launched
07:42:40.244946 tst              mo_mt_call_osmux.py: using MSISDN 4628
07:42:40.427238 bus                        /sierra_1: Setting Powered True
07:42:43.908502 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4628', subscriber_id=1}
07:42:44.050842 tst              mo_mt_call_osmux.py: using MSISDN 4629
07:42:44.233525 bus                        /sierra_2: Setting Powered True
07:42:56.589056 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f710c6fa488&gt;, timeout=10, timestep=1} [trial-802↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-802↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8]
07:42:56.596480 tst            mo_mt_call_osmux.py:8: Test FAILED (64.5 sec)
07:42:56.630264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19381): Terminating (SIGTERM)
07:42:56.670203 run   osmo-hlr_10.42.42.2(pid=19382): Terminating (SIGTERM)
07:42:56.710655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19383): Terminating (SIGTERM)
07:42:56.755438 run   osmo-stp_10.42.42.5(pid=19384): Terminating (SIGTERM)
07:42:56.799518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19385): Terminating (SIGTERM)
07:42:56.842751 run   osmo-msc_10.42.42.6(pid=19386): Terminating (SIGTERM)
07:42:56.887879 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19396): Terminating (SIGTERM)
07:42:56.927383 run   osmo-mgw_10.42.42.3(pid=19397): Terminating (SIGTERM)
07:42:56.967423 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19398): Terminating (SIGTERM)
07:42:57.006786 run   osmo-mgw_10.42.42.4(pid=19399): Terminating (SIGTERM)
07:42:57.047192 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19400): Terminating (SIGTERM)
07:42:57.086736 run   osmo-bsc_10.42.42.7(pid=19401): Terminating (SIGTERM)
07:42:57.126415 run        osmo-bts-sysmo(pid=19410): Terminating (SIGTERM)
07:42:57.135836 ---      ParallelTerminationStrategy: PID 19381 died...
07:42:57.191437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19381): Terminated: ok {rc=0}
07:42:57.202206 ---      ParallelTerminationStrategy: PID 19382 died...
07:42:57.257908 run   osmo-hlr_10.42.42.2(pid=19382): Terminated: ok {rc=0}
07:42:57.268307 ---      ParallelTerminationStrategy: PID 19383 died...
07:42:57.322168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19383): Terminated: ok {rc=0}
07:42:57.331869 ---      ParallelTerminationStrategy: PID 19384 died...
07:42:57.384825 run   osmo-stp_10.42.42.5(pid=19384): Terminated: ok {rc=0}
07:42:57.394444 ---      ParallelTerminationStrategy: PID 19385 died...
07:42:57.447648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19385): Terminated: ok {rc=0}
07:42:57.457485 ---      ParallelTerminationStrategy: PID 19396 died...
07:42:57.510667 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19396): Terminated: ok {rc=0}
07:42:57.520371 ---      ParallelTerminationStrategy: PID 19397 died...
07:42:57.573308 run   osmo-mgw_10.42.42.3(pid=19397): Terminated {rc=15}
07:42:57.583052 ---      ParallelTerminationStrategy: PID 19398 died...
07:42:57.636363 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19398): Terminated: ok {rc=0}
07:42:57.646118 ---      ParallelTerminationStrategy: PID 19399 died...
07:42:57.699161 run   osmo-mgw_10.42.42.4(pid=19399): Terminated {rc=15}
07:42:57.708821 ---      ParallelTerminationStrategy: PID 19400 died...
07:42:57.763114 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19400): Terminated: ok {rc=0}
07:42:57.773872 ---      ParallelTerminationStrategy: PID 19401 died...
07:42:57.829607 run   osmo-bsc_10.42.42.7(pid=19401): Terminated: ok {rc=0}
07:42:57.840236 ---      ParallelTerminationStrategy: PID 19410 died...
07:42:57.896222 run        osmo-bts-sysmo(pid=19410): Terminated: ok {rc=0}
07:42:57.906015 ---      ParallelTerminationStrategy: PID 19386 died...
07:42:57.960306 run   osmo-msc_10.42.42.6(pid=19386): Terminated: ok {rc=0}
07:42:58.067123 bus                        /sierra_2: Setting Online False
07:42:59.150086 bus                        /sierra_2: Setting Powered False
07:43:04.961594 bus                        /sierra_2: Setting Powered False
07:43:06.068383 bus                        /sierra_2: Setting Powered False
07:43:07.194588 bus                        /sierra_1: Setting Online False
07:43:08.280229 bus                        /sierra_1: Setting Powered False
07:43:13.969669 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f710c6fa488>, timeout=10, timestep=1} [trial-802↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]