Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchh+cfg-codec-hr3)

Failing for the past 67 builds (Since #751 )
Took 1 min 7 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f28b44ecd90>, timeout=10, timestep=1} [trial-817↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-817 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py
----------------------------------------------
01:27:02.125734 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
01:27:02.137931 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1)
01:27:02.294936 tst              mo_mt_call_osmux.py: using LAC 8361
01:27:02.427324 tst              mo_mt_call_osmux.py: using RAC 201
01:27:02.557849 tst              mo_mt_call_osmux.py: using CellId 8361
01:27:02.694487 tst              mo_mt_call_osmux.py: using BVCI 8357
01:27:02.720054 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
01:27:02.731686 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
01:27:02.743203 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
01:27:02.755663 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
01:27:02.767285 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
01:27:02.778834 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
01:27:02.882861 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
01:27:03.082583 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
01:27:03.617832 run         create_hlr_db(pid=31626): Launched
01:27:03.810481 bus                        /sierra_1: Setting Powered False
01:27:04.831155 run         create_hlr_db(pid=31626): Terminated: ok {rc=0}
01:27:05.251872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31628): Launched
01:27:05.565323 run   osmo-hlr_10.42.42.2(pid=31629): Launched
01:27:05.677121 run              osmo-stp_10.42.42.5: Starting osmo-stp
01:27:06.220225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31630): Launched
01:27:06.536357 run   osmo-stp_10.42.42.5(pid=31631): Launched
01:27:06.647346 run              osmo-msc_10.42.42.6: Starting osmo-msc
01:27:07.218002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31632): Launched
01:27:07.534340 run   osmo-msc_10.42.42.6(pid=31633): Launched
01:27:10.701731 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
01:27:11.252299 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31634): Launched
01:27:11.590682 run   osmo-mgw_10.42.42.3(pid=31635): Launched
01:27:11.710526 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
01:27:12.280499 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31636): Launched
01:27:12.617586 run   osmo-mgw_10.42.42.4(pid=31637): Launched
01:27:12.737530 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
01:27:13.432529 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31638): Launched
01:27:13.770073 run   osmo-bsc_10.42.42.7(pid=31639): Launched
01:27:20.053707 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
01:27:20.654592 run         rm-remote-dir(pid=31641): Launched
01:27:22.861427 run         rm-remote-dir(pid=31641): Terminated: ok {rc=0}
01:27:23.219929 run         mk-remote-dir(pid=31642): Launched
01:27:25.425121 run         mk-remote-dir(pid=31642): Terminated: ok {rc=0}
01:27:25.726937 run    scp-inst-to-remote(pid=31643): Launched
01:27:38.949465 run    scp-inst-to-remote(pid=31643): Terminated: ok {rc=0}
01:27:39.304829 run         mk-remote-dir(pid=31645): Launched
01:27:41.508307 run         mk-remote-dir(pid=31645): Terminated: ok {rc=0}
01:27:41.811339 run     scp-cfg-to-remote(pid=31646): Launched
01:27:44.015256 run     scp-cfg-to-remote(pid=31646): Terminated: ok {rc=0}
01:27:44.364048 run   reload-dsp-firmware(pid=31648): Launched
01:27:46.563728 run   reload-dsp-firmware(pid=31648): Terminated: ok {rc=0}
01:27:46.906245 run        osmo-bts-sysmo(pid=31649): Launched
01:27:52.160087 tst              mo_mt_call_osmux.py: using MSISDN 5423
01:27:52.334939 bus                        /sierra_1: Setting Powered True
01:27:55.798585 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5423', subscriber_id=1}
01:27:55.940129 tst              mo_mt_call_osmux.py: using MSISDN 5424
01:27:56.123985 bus                        /sierra_2: Setting Powered True
01:28:08.494047 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f28b44ecd90&gt;, timeout=10, timestep=1} [trial-817↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-817↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8]
01:28:08.502373 tst            mo_mt_call_osmux.py:8: Test FAILED (66.4 sec)
01:28:08.538357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31628): Terminating (SIGTERM)
01:28:08.580402 run   osmo-hlr_10.42.42.2(pid=31629): Terminating (SIGTERM)
01:28:08.624197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31630): Terminating (SIGTERM)
01:28:08.669567 run   osmo-stp_10.42.42.5(pid=31631): Terminating (SIGTERM)
01:28:08.735221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31632): Terminating (SIGTERM)
01:28:08.782832 run   osmo-msc_10.42.42.6(pid=31633): Terminating (SIGTERM)
01:28:08.824853 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31634): Terminating (SIGTERM)
01:28:08.866829 run   osmo-mgw_10.42.42.3(pid=31635): Terminating (SIGTERM)
01:28:08.909270 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31636): Terminating (SIGTERM)
01:28:08.950938 run   osmo-mgw_10.42.42.4(pid=31637): Terminating (SIGTERM)
01:28:08.993302 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31638): Terminating (SIGTERM)
01:28:09.035158 run   osmo-bsc_10.42.42.7(pid=31639): Terminating (SIGTERM)
01:28:09.076840 run        osmo-bts-sysmo(pid=31649): Terminating (SIGTERM)
01:28:09.086792 ---      ParallelTerminationStrategy: PID 31628 died...
01:28:09.143385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31628): Terminated: ok {rc=0}
01:28:09.153968 ---      ParallelTerminationStrategy: PID 31629 died...
01:28:09.209593 run   osmo-hlr_10.42.42.2(pid=31629): Terminated: ok {rc=0}
01:28:09.219880 ---      ParallelTerminationStrategy: PID 31630 died...
01:28:09.275948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31630): Terminated: ok {rc=0}
01:28:09.286213 ---      ParallelTerminationStrategy: PID 31631 died...
01:28:09.342156 run   osmo-stp_10.42.42.5(pid=31631): Terminated: ok {rc=0}
01:28:09.352541 ---      ParallelTerminationStrategy: PID 31632 died...
01:28:09.408652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31632): Terminated: ok {rc=0}
01:28:09.419017 ---      ParallelTerminationStrategy: PID 31634 died...
01:28:09.475556 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31634): Terminated: ok {rc=0}
01:28:09.486298 ---      ParallelTerminationStrategy: PID 31635 died...
01:28:09.543112 run   osmo-mgw_10.42.42.3(pid=31635): Terminated {rc=15}
01:28:09.554344 ---      ParallelTerminationStrategy: PID 31636 died...
01:28:09.611973 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31636): Terminated: ok {rc=0}
01:28:09.625398 ---      ParallelTerminationStrategy: PID 31637 died...
01:28:09.684292 run   osmo-mgw_10.42.42.4(pid=31637): Terminated {rc=15}
01:28:09.695519 ---      ParallelTerminationStrategy: PID 31638 died...
01:28:09.781126 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31638): Terminated: ok {rc=0}
01:28:09.792544 ---      ParallelTerminationStrategy: PID 31639 died...
01:28:09.853027 run   osmo-bsc_10.42.42.7(pid=31639): Terminated: ok {rc=0}
01:28:09.863437 ---      ParallelTerminationStrategy: PID 31633 died...
01:28:09.919465 run   osmo-msc_10.42.42.6(pid=31633): Terminated: ok {rc=0}
01:28:09.930286 ---      ParallelTerminationStrategy: PID 31649 died...
01:28:09.986285 run        osmo-bts-sysmo(pid=31649): Terminated: ok {rc=0}
01:28:10.093745 bus                        /sierra_2: Setting Online False
01:28:11.181225 bus                        /sierra_2: Setting Powered False
01:28:16.972544 bus                        /sierra_2: Setting Powered False
01:28:18.077001 bus                        /sierra_2: Setting Powered False
01:28:19.203714 bus                        /sierra_1: Setting Online False
01:28:20.290990 bus                        /sierra_1: Setting Powered False
01:28:25.971744 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f28b44ecd90>, timeout=10, timestep=1} [trial-817↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]