Skip to content

Failed

voice:sysmo+mod-bts0-dynts-osmo.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-dynts-osmo)

Failing for the past 77 builds (Since #751 )
Took 1 min 8 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f0b542697b8>, timeout=10, timestep=1} [trial-827↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-827 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py
----------------------------------------------
12:47:57.117766 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
12:47:57.129329 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1)
12:47:57.288450 tst              mo_mt_call_osmux.py: using LAC 9165
12:47:57.417024 tst              mo_mt_call_osmux.py: using RAC 240
12:47:57.545432 tst              mo_mt_call_osmux.py: using CellId 9165
12:47:57.668599 tst              mo_mt_call_osmux.py: using BVCI 9161
12:47:57.692796 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
12:47:57.703774 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
12:47:57.714512 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
12:47:57.725372 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
12:47:57.736091 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
12:47:57.747168 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
12:47:57.847051 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
12:47:58.045275 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
12:47:58.581675 run         create_hlr_db(pid=23203): Launched
12:47:58.775465 bus                        /sierra_1: Setting Powered False
12:47:59.796346 run         create_hlr_db(pid=23203): Terminated: ok {rc=0}
12:48:00.219775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23205): Launched
12:48:00.545088 run   osmo-hlr_10.42.42.2(pid=23206): Launched
12:48:00.668957 run              osmo-stp_10.42.42.5: Starting osmo-stp
12:48:01.251607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23207): Launched
12:48:01.586451 run   osmo-stp_10.42.42.5(pid=23208): Launched
12:48:01.705833 run              osmo-msc_10.42.42.6: Starting osmo-msc
12:48:02.315067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23209): Launched
12:48:02.653359 run   osmo-msc_10.42.42.6(pid=23210): Launched
12:48:05.832877 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
12:48:06.414114 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=23211): Launched
12:48:06.750585 run   osmo-mgw_10.42.42.3(pid=23212): Launched
12:48:06.870112 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
12:48:07.439700 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23213): Launched
12:48:07.776847 run   osmo-mgw_10.42.42.4(pid=23214): Launched
12:48:07.899452 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
12:48:08.596309 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=23215): Launched
12:48:08.935273 run   osmo-bsc_10.42.42.7(pid=23216): Launched
12:48:15.212742 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
12:48:15.776043 run         rm-remote-dir(pid=23217): Launched
12:48:17.974508 run         rm-remote-dir(pid=23217): Terminated: ok {rc=0}
12:48:18.311214 run         mk-remote-dir(pid=23218): Launched
12:48:20.504234 run         mk-remote-dir(pid=23218): Terminated: ok {rc=0}
12:48:20.788810 run    scp-inst-to-remote(pid=23219): Launched
12:48:34.009926 run    scp-inst-to-remote(pid=23219): Terminated: ok {rc=0}
12:48:34.362483 run         mk-remote-dir(pid=23221): Launched
12:48:36.564923 run         mk-remote-dir(pid=23221): Terminated: ok {rc=0}
12:48:36.867109 run     scp-cfg-to-remote(pid=23222): Launched
12:48:40.071610 run     scp-cfg-to-remote(pid=23222): Terminated: ok {rc=0}
12:48:40.421559 run   reload-dsp-firmware(pid=23224): Launched
12:48:43.621693 run   reload-dsp-firmware(pid=23224): Terminated: ok {rc=0}
12:48:43.962389 run        osmo-bts-sysmo(pid=23225): Launched
12:48:48.237805 tst              mo_mt_call_osmux.py: using MSISDN 5961
12:48:48.413098 bus                        /sierra_1: Setting Powered True
12:48:51.935714 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5961', subscriber_id=1}
12:48:52.082651 tst              mo_mt_call_osmux.py: using MSISDN 5962
12:48:52.257676 bus                        /sierra_2: Setting Powered True
12:49:04.604907 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f0b542697b8&gt;, timeout=10, timestep=1} [trial-827↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-827↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8]
12:49:04.612368 tst            mo_mt_call_osmux.py:8: Test FAILED (67.5 sec)
12:49:04.647168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23205): Terminating (SIGTERM)
12:49:04.686934 run   osmo-hlr_10.42.42.2(pid=23206): Terminating (SIGTERM)
12:49:04.727391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23207): Terminating (SIGTERM)
12:49:04.771045 run   osmo-stp_10.42.42.5(pid=23208): Terminating (SIGTERM)
12:49:04.812971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23209): Terminating (SIGTERM)
12:49:04.855993 run   osmo-msc_10.42.42.6(pid=23210): Terminating (SIGTERM)
12:49:04.898991 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=23211): Terminating (SIGTERM)
12:49:04.942531 run   osmo-mgw_10.42.42.3(pid=23212): Terminating (SIGTERM)
12:49:04.985567 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23213): Terminating (SIGTERM)
12:49:05.027953 run   osmo-mgw_10.42.42.4(pid=23214): Terminating (SIGTERM)
12:49:05.071373 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=23215): Terminating (SIGTERM)
12:49:05.111352 run   osmo-bsc_10.42.42.7(pid=23216): Terminating (SIGTERM)
12:49:05.151459 run        osmo-bts-sysmo(pid=23225): Terminating (SIGTERM)
12:49:05.160821 ---      ParallelTerminationStrategy: PID 23205 died...
12:49:05.215953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23205): Terminated: ok {rc=0}
12:49:05.227017 ---      ParallelTerminationStrategy: PID 23206 died...
12:49:05.282624 run   osmo-hlr_10.42.42.2(pid=23206): Terminated: ok {rc=0}
12:49:05.293113 ---      ParallelTerminationStrategy: PID 23207 died...
12:49:05.347798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23207): Terminated: ok {rc=0}
12:49:05.358066 ---      ParallelTerminationStrategy: PID 23208 died...
12:49:05.411754 run   osmo-stp_10.42.42.5(pid=23208): Terminated: ok {rc=0}
12:49:05.421541 ---      ParallelTerminationStrategy: PID 23209 died...
12:49:05.474875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23209): Terminated: ok {rc=0}
12:49:05.484956 ---      ParallelTerminationStrategy: PID 23210 died...
12:49:05.538295 run   osmo-msc_10.42.42.6(pid=23210): Terminated: ok {rc=0}
12:49:05.548360 ---      ParallelTerminationStrategy: PID 23211 died...
12:49:05.601284 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=23211): Terminated: ok {rc=0}
12:49:05.611016 ---      ParallelTerminationStrategy: PID 23212 died...
12:49:05.663816 run   osmo-mgw_10.42.42.3(pid=23212): Terminated {rc=15}
12:49:05.673752 ---      ParallelTerminationStrategy: PID 23213 died...
12:49:05.727389 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23213): Terminated: ok {rc=0}
12:49:05.737499 ---      ParallelTerminationStrategy: PID 23214 died...
12:49:05.791268 run   osmo-mgw_10.42.42.4(pid=23214): Terminated {rc=15}
12:49:05.800803 ---      ParallelTerminationStrategy: PID 23215 died...
12:49:05.854296 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=23215): Terminated: ok {rc=0}
12:49:05.864412 ---      ParallelTerminationStrategy: PID 23216 died...
12:49:05.917874 run   osmo-bsc_10.42.42.7(pid=23216): Terminated: ok {rc=0}
12:49:05.927653 ---      ParallelTerminationStrategy: PID 23225 died...
12:49:05.981187 run        osmo-bts-sysmo(pid=23225): Terminated: ok {rc=0}
12:49:06.091261 bus                        /sierra_2: Setting Online False
12:49:07.175344 bus                        /sierra_2: Setting Powered False
12:49:12.965839 bus                        /sierra_2: Setting Powered False
12:49:14.069423 bus                        /sierra_2: Setting Powered False
12:49:15.202479 bus                        /sierra_1: Setting Online False
12:49:16.287155 bus                        /sierra_1: Setting Powered False
12:49:21.972504 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f0b542697b8>, timeout=10, timestep=1} [trial-827↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]