Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3.mo_mt_call.py (from voice_sysmo+mod-bts0-ts-tchf+cfg-codec-fr3)

Failing for the past 75 builds (Since #751 )
Took 1 min 8 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f428da50b70>, timeout=10, timestep=1} [trial-825↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-825 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py
----------------------------------------------
10:35:43.993516 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
10:35:44.004803 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1)
10:35:44.155130 tst                    mo_mt_call.py: using LAC 8996
10:35:44.282165 tst                    mo_mt_call.py: using RAC 71
10:35:44.408222 tst                    mo_mt_call.py: using CellId 8996
10:35:44.535075 tst                    mo_mt_call.py: using BVCI 8992
10:35:44.559420 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
10:35:44.570591 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
10:35:44.582998 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
10:35:44.596047 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
10:35:44.607540 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
10:35:44.619132 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
10:35:44.721770 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
10:35:44.920007 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
10:35:45.420875 run         create_hlr_db(pid=18200): Launched
10:35:45.604093 bus                        /sierra_1: Setting Powered False
10:35:46.629211 run         create_hlr_db(pid=18200): Terminated: ok {rc=0}
10:35:47.081277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18202): Launched
10:35:47.421950 run   osmo-hlr_10.42.42.2(pid=18203): Launched
10:35:47.543984 run              osmo-stp_10.42.42.5: Starting osmo-stp
10:35:48.131168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18204): Launched
10:35:48.470262 run   osmo-stp_10.42.42.5(pid=18205): Launched
10:35:48.590880 run              osmo-msc_10.42.42.6: Starting osmo-msc
10:35:49.209407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18206): Launched
10:35:49.550484 run   osmo-msc_10.42.42.6(pid=18207): Launched
10:35:52.722255 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
10:35:53.275567 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=18208): Launched
10:35:53.595933 run   osmo-mgw_10.42.42.3(pid=18209): Launched
10:35:53.710503 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
10:35:54.255596 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18210): Launched
10:35:54.578631 run   osmo-mgw_10.42.42.4(pid=18211): Launched
10:35:54.692923 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
10:35:55.359970 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=18212): Launched
10:35:55.682605 run   osmo-bsc_10.42.42.7(pid=18213): Launched
10:36:01.952671 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
10:36:02.526059 run         rm-remote-dir(pid=18214): Launched
10:36:04.723448 run         rm-remote-dir(pid=18214): Terminated: ok {rc=0}
10:36:05.067253 run         mk-remote-dir(pid=18215): Launched
10:36:07.263141 run         mk-remote-dir(pid=18215): Terminated: ok {rc=0}
10:36:07.564540 run    scp-inst-to-remote(pid=18216): Launched
10:36:20.786269 run    scp-inst-to-remote(pid=18216): Terminated: ok {rc=0}
10:36:21.144705 run         mk-remote-dir(pid=18218): Launched
10:36:23.349137 run         mk-remote-dir(pid=18218): Terminated: ok {rc=0}
10:36:23.655730 run     scp-cfg-to-remote(pid=18219): Launched
10:36:25.862361 run     scp-cfg-to-remote(pid=18219): Terminated: ok {rc=0}
10:36:26.217489 run   reload-dsp-firmware(pid=18221): Launched
10:36:29.421417 run   reload-dsp-firmware(pid=18221): Terminated: ok {rc=0}
10:36:29.766187 run        osmo-bts-sysmo(pid=18222): Launched
10:36:35.022597 tst                    mo_mt_call.py: using MSISDN 5837
10:36:35.208457 bus                        /sierra_1: Setting Powered True
10:36:38.704641 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5837', subscriber_id=1}
10:36:38.853986 tst                    mo_mt_call.py: using MSISDN 5838
10:36:39.030449 bus                        /sierra_2: Setting Powered True
10:36:51.374532 tst                  mo_mt_call.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f428da50b70&gt;, timeout=10, timestep=1} [trial-825↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]  [trial-825↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8]
10:36:51.381922 tst                  mo_mt_call.py:8: Test FAILED (67.4 sec)
10:36:51.416815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18202): Terminating (SIGTERM)
10:36:51.456938 run   osmo-hlr_10.42.42.2(pid=18203): Terminating (SIGTERM)
10:36:51.499692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18204): Terminating (SIGTERM)
10:36:51.542179 run   osmo-stp_10.42.42.5(pid=18205): Terminating (SIGTERM)
10:36:51.585954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18206): Terminating (SIGTERM)
10:36:51.630450 run   osmo-msc_10.42.42.6(pid=18207): Terminating (SIGTERM)
10:36:51.674074 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=18208): Terminating (SIGTERM)
10:36:51.718192 run   osmo-mgw_10.42.42.3(pid=18209): Terminating (SIGTERM)
10:36:51.760515 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18210): Terminating (SIGTERM)
10:36:51.803008 run   osmo-mgw_10.42.42.4(pid=18211): Terminating (SIGTERM)
10:36:51.844746 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=18212): Terminating (SIGTERM)
10:36:51.884741 run   osmo-bsc_10.42.42.7(pid=18213): Terminating (SIGTERM)
10:36:51.924996 run        osmo-bts-sysmo(pid=18222): Terminating (SIGTERM)
10:36:51.934572 ---      ParallelTerminationStrategy: PID 18202 died...
10:36:51.988486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18202): Terminated: ok {rc=0}
10:36:51.998159 ---      ParallelTerminationStrategy: PID 18203 died...
10:36:52.051928 run   osmo-hlr_10.42.42.2(pid=18203): Terminated: ok {rc=0}
10:36:52.061898 ---      ParallelTerminationStrategy: PID 18204 died...
10:36:52.115774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18204): Terminated: ok {rc=0}
10:36:52.125625 ---      ParallelTerminationStrategy: PID 18205 died...
10:36:52.179592 run   osmo-stp_10.42.42.5(pid=18205): Terminated: ok {rc=0}
10:36:52.189363 ---      ParallelTerminationStrategy: PID 18206 died...
10:36:52.243271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18206): Terminated: ok {rc=0}
10:36:52.252963 ---      ParallelTerminationStrategy: PID 18207 died...
10:36:52.306847 run   osmo-msc_10.42.42.6(pid=18207): Terminated: ok {rc=0}
10:36:52.316490 ---      ParallelTerminationStrategy: PID 18208 died...
10:36:52.370367 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=18208): Terminated: ok {rc=0}
10:36:52.380023 ---      ParallelTerminationStrategy: PID 18209 died...
10:36:52.433793 run   osmo-mgw_10.42.42.3(pid=18209): Terminated {rc=15}
10:36:52.444162 ---      ParallelTerminationStrategy: PID 18210 died...
10:36:52.499853 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18210): Terminated: ok {rc=0}
10:36:52.510677 ---      ParallelTerminationStrategy: PID 18211 died...
10:36:52.566359 run   osmo-mgw_10.42.42.4(pid=18211): Terminated {rc=15}
10:36:52.576692 ---      ParallelTerminationStrategy: PID 18212 died...
10:36:52.630940 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=18212): Terminated: ok {rc=0}
10:36:52.640896 ---      ParallelTerminationStrategy: PID 18213 died...
10:36:52.695554 run   osmo-bsc_10.42.42.7(pid=18213): Terminated: ok {rc=0}
10:36:52.705500 ---      ParallelTerminationStrategy: PID 18222 died...
10:36:52.759093 run        osmo-bts-sysmo(pid=18222): Terminated: ok {rc=0}
10:36:52.870136 bus                        /sierra_2: Setting Online False
10:36:53.954755 bus                        /sierra_2: Setting Powered False
10:36:59.959466 bus                        /sierra_2: Setting Powered False
10:37:01.066491 bus                        /sierra_2: Setting Powered False
10:37:02.200769 bus                        /sierra_1: Setting Online False
10:37:03.286338 bus                        /sierra_1: Setting Powered False
10:37:08.971324 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call.py", line 8, in <module>
    test_mo_mt_call(False, False)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f428da50b70>, timeout=10, timestep=1} [trial-825↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]