Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchf+cfg-codec-fr1)

Failing for the past 50 builds (Since #751 )
Took 1 min 5 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f602ce33730>, timeout=10, timestep=1} [trial-800↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-800 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py
----------------------------------------------
05:34:05.126861 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6)
05:34:05.139110 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1)
05:34:05.296058 tst              mo_mt_call_osmux.py: using LAC 6993
05:34:05.428059 tst              mo_mt_call_osmux.py: using RAC 108
05:34:05.561098 tst              mo_mt_call_osmux.py: using CellId 6993
05:34:05.694526 tst              mo_mt_call_osmux.py: using BVCI 6989
05:34:05.720062 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6)
05:34:05.731651 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6)
05:34:05.743086 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6)
05:34:05.754480 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6)
05:34:05.765855 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6)
05:34:05.777300 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2)
05:34:05.879070 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2)
05:34:06.077560 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
05:34:06.612063 run         create_hlr_db(pid=13276): Launched
05:34:06.804169 bus                        /sierra_1: Setting Powered False
05:34:07.826181 run         create_hlr_db(pid=13276): Terminated: ok {rc=0}
05:34:08.254683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13278): Launched
05:34:08.590502 run   osmo-hlr_10.42.42.2(pid=13279): Launched
05:34:08.711272 run              osmo-stp_10.42.42.5: Starting osmo-stp
05:34:09.292638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13280): Launched
05:34:09.627203 run   osmo-stp_10.42.42.5(pid=13281): Launched
05:34:09.746500 run              osmo-msc_10.42.42.6: Starting osmo-msc
05:34:10.358688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13282): Launched
05:34:10.695774 run   osmo-msc_10.42.42.6(pid=13283): Launched
05:34:13.874135 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
05:34:14.454736 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13284): Launched
05:34:14.791611 run   osmo-mgw_10.42.42.3(pid=13285): Launched
05:34:14.910885 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
05:34:15.483506 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13286): Launched
05:34:15.820507 run   osmo-mgw_10.42.42.4(pid=13287): Launched
05:34:15.940622 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
05:34:16.638613 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13288): Launched
05:34:16.975568 run   osmo-bsc_10.42.42.7(pid=13289): Launched
05:34:23.260283 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
05:34:23.858813 run         rm-remote-dir(pid=13290): Launched
05:34:26.064325 run         rm-remote-dir(pid=13290): Terminated: ok {rc=0}
05:34:26.423477 run         mk-remote-dir(pid=13291): Launched
05:34:27.627157 run         mk-remote-dir(pid=13291): Terminated: ok {rc=0}
05:34:27.927723 run    scp-inst-to-remote(pid=13292): Launched
05:34:41.149198 run    scp-inst-to-remote(pid=13292): Terminated: ok {rc=0}
05:34:41.503401 run         mk-remote-dir(pid=13294): Launched
05:34:43.705994 run         mk-remote-dir(pid=13294): Terminated: ok {rc=0}
05:34:44.009026 run     scp-cfg-to-remote(pid=13295): Launched
05:34:45.210351 run     scp-cfg-to-remote(pid=13295): Terminated: ok {rc=0}
05:34:45.557696 run   reload-dsp-firmware(pid=13297): Launched
05:34:48.758967 run   reload-dsp-firmware(pid=13297): Terminated: ok {rc=0}
05:34:49.098625 run        osmo-bts-sysmo(pid=13298): Launched
05:34:53.344364 tst              mo_mt_call_osmux.py: using MSISDN 4506
05:34:53.531854 bus                        /sierra_1: Setting Powered True
05:34:57.010810 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4506', subscriber_id=1}
05:34:57.156102 tst              mo_mt_call_osmux.py: using MSISDN 4507
05:34:57.338847 bus                        /sierra_2: Setting Powered True
05:35:09.699163 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f602ce33730&gt;, timeout=10, timestep=1} [trial-800↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-800↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8]
05:35:09.707431 tst            mo_mt_call_osmux.py:8: Test FAILED (64.6 sec)
05:35:09.744236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13278): Terminating (SIGTERM)
05:35:09.785904 run   osmo-hlr_10.42.42.2(pid=13279): Terminating (SIGTERM)
05:35:09.829476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13280): Terminating (SIGTERM)
05:35:09.874704 run   osmo-stp_10.42.42.5(pid=13281): Terminating (SIGTERM)
05:35:09.935499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13282): Terminating (SIGTERM)
05:35:09.981838 run   osmo-msc_10.42.42.6(pid=13283): Terminating (SIGTERM)
05:35:10.025310 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13284): Terminating (SIGTERM)
05:35:10.071698 run   osmo-mgw_10.42.42.3(pid=13285): Terminating (SIGTERM)
05:35:10.115423 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13286): Terminating (SIGTERM)
05:35:10.159977 run   osmo-mgw_10.42.42.4(pid=13287): Terminating (SIGTERM)
05:35:10.215528 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13288): Terminating (SIGTERM)
05:35:10.255355 run   osmo-bsc_10.42.42.7(pid=13289): Terminating (SIGTERM)
05:35:10.295575 run        osmo-bts-sysmo(pid=13298): Terminating (SIGTERM)
05:35:10.304755 ---      ParallelTerminationStrategy: PID 13278 died...
05:35:10.358127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13278): Terminated: ok {rc=0}
05:35:10.368159 ---      ParallelTerminationStrategy: PID 13279 died...
05:35:10.421552 run   osmo-hlr_10.42.42.2(pid=13279): Terminated: ok {rc=0}
05:35:10.431218 ---      ParallelTerminationStrategy: PID 13280 died...
05:35:10.484824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13280): Terminated: ok {rc=0}
05:35:10.494578 ---      ParallelTerminationStrategy: PID 13281 died...
05:35:10.547935 run   osmo-stp_10.42.42.5(pid=13281): Terminated: ok {rc=0}
05:35:10.557619 ---      ParallelTerminationStrategy: PID 13282 died...
05:35:10.611390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13282): Terminated: ok {rc=0}
05:35:10.621079 ---      ParallelTerminationStrategy: PID 13283 died...
05:35:10.674879 run   osmo-msc_10.42.42.6(pid=13283): Terminated: ok {rc=0}
05:35:10.684632 ---      ParallelTerminationStrategy: PID 13284 died...
05:35:10.739472 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13284): Terminated: ok {rc=0}
05:35:10.749731 ---      ParallelTerminationStrategy: PID 13285 died...
05:35:10.809630 run   osmo-mgw_10.42.42.3(pid=13285): Terminated {rc=15}
05:35:10.820456 ---      ParallelTerminationStrategy: PID 13286 died...
05:35:10.876122 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13286): Terminated: ok {rc=0}
05:35:10.886370 ---      ParallelTerminationStrategy: PID 13287 died...
05:35:10.940157 run   osmo-mgw_10.42.42.4(pid=13287): Terminated {rc=15}
05:35:10.949976 ---      ParallelTerminationStrategy: PID 13288 died...
05:35:11.003496 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13288): Terminated: ok {rc=0}
05:35:11.013712 ---      ParallelTerminationStrategy: PID 13289 died...
05:35:11.066723 run   osmo-bsc_10.42.42.7(pid=13289): Terminated: ok {rc=0}
05:35:11.076810 ---      ParallelTerminationStrategy: PID 13298 died...
05:35:11.130127 run        osmo-bts-sysmo(pid=13298): Terminated: ok {rc=0}
05:35:11.239435 bus                        /sierra_2: Setting Online False
05:35:12.323356 bus                        /sierra_2: Setting Powered False
05:35:17.963647 bus                        /sierra_2: Setting Powered False
05:35:19.066322 bus                        /sierra_2: Setting Powered False
05:35:20.194474 bus                        /sierra_1: Setting Online False
05:35:21.282186 bus                        /sierra_1: Setting Powered False
05:35:26.966219 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f602ce33730>, timeout=10, timestep=1} [trial-800↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]