Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3.mo_mt_call.py (from voice_sysmo+mod-bts0-ts-tchh+cfg-codec-hr3)

Failing for the past 75 builds (Since #751 )
Took 1 min 8 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f428d8cd048>, timeout=10, timestep=1} [trial-825↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-825 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py
----------------------------------------------
10:41:29.992493 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
10:41:30.003835 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1)
10:41:30.152717 tst                    mo_mt_call.py: using LAC 9000
10:41:30.277265 tst                    mo_mt_call.py: using RAC 75
10:41:30.408049 tst                    mo_mt_call.py: using CellId 9000
10:41:30.532952 tst                    mo_mt_call.py: using BVCI 8996
10:41:30.557381 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
10:41:30.568340 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
10:41:30.579152 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
10:41:30.590366 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
10:41:30.601508 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
10:41:30.612671 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
10:41:30.716795 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
10:41:30.910601 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
10:41:31.413835 run         create_hlr_db(pid=18327): Launched
10:41:31.596963 bus                        /sierra_1: Setting Powered False
10:41:32.618780 run         create_hlr_db(pid=18327): Terminated: ok {rc=0}
10:41:33.070862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18329): Launched
10:41:33.412603 run   osmo-hlr_10.42.42.2(pid=18330): Launched
10:41:33.535697 run              osmo-stp_10.42.42.5: Starting osmo-stp
10:41:34.125724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18331): Launched
10:41:34.467021 run   osmo-stp_10.42.42.5(pid=18332): Launched
10:41:34.587404 run              osmo-msc_10.42.42.6: Starting osmo-msc
10:41:35.206185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18333): Launched
10:41:35.548319 run   osmo-msc_10.42.42.6(pid=18334): Launched
10:41:38.727731 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
10:41:39.316889 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=18335): Launched
10:41:39.658020 run   osmo-mgw_10.42.42.3(pid=18336): Launched
10:41:39.778571 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
10:41:40.355496 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18337): Launched
10:41:40.698216 run   osmo-mgw_10.42.42.4(pid=18338): Launched
10:41:40.821767 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
10:41:41.527369 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=18339): Launched
10:41:41.868452 run   osmo-bsc_10.42.42.7(pid=18340): Launched
10:41:48.141768 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
10:41:48.711926 run         rm-remote-dir(pid=18341): Launched
10:41:50.910341 run         rm-remote-dir(pid=18341): Terminated: ok {rc=0}
10:41:51.254553 run         mk-remote-dir(pid=18342): Launched
10:41:53.450632 run         mk-remote-dir(pid=18342): Terminated: ok {rc=0}
10:41:53.741491 run    scp-inst-to-remote(pid=18343): Launched
10:42:06.965502 run    scp-inst-to-remote(pid=18343): Terminated: ok {rc=0}
10:42:07.324587 run         mk-remote-dir(pid=18348): Launched
10:42:09.530714 run         mk-remote-dir(pid=18348): Terminated: ok {rc=0}
10:42:09.837546 run     scp-cfg-to-remote(pid=18349): Launched
10:42:12.043795 run     scp-cfg-to-remote(pid=18349): Terminated: ok {rc=0}
10:42:12.398320 run   reload-dsp-firmware(pid=18351): Launched
10:42:15.602392 run   reload-dsp-firmware(pid=18351): Terminated: ok {rc=0}
10:42:15.949715 run        osmo-bts-sysmo(pid=18352): Launched
10:42:21.209593 tst                    mo_mt_call.py: using MSISDN 5845
10:42:21.386719 bus                        /sierra_1: Setting Powered True
10:42:24.866734 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5845', subscriber_id=1}
10:42:25.004028 tst                    mo_mt_call.py: using MSISDN 5846
10:42:25.177978 bus                        /sierra_2: Setting Powered True
10:42:37.541785 tst                  mo_mt_call.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f428d8cd048&gt;, timeout=10, timestep=1} [trial-825↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]  [trial-825↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8]
10:42:37.548982 tst                  mo_mt_call.py:8: Test FAILED (67.6 sec)
10:42:37.584224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18329): Terminating (SIGTERM)
10:42:37.624528 run   osmo-hlr_10.42.42.2(pid=18330): Terminating (SIGTERM)
10:42:37.665994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18331): Terminating (SIGTERM)
10:42:37.709761 run   osmo-stp_10.42.42.5(pid=18332): Terminating (SIGTERM)
10:42:37.754030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18333): Terminating (SIGTERM)
10:42:37.798610 run   osmo-msc_10.42.42.6(pid=18334): Terminating (SIGTERM)
10:42:37.841888 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=18335): Terminating (SIGTERM)
10:42:37.886948 run   osmo-mgw_10.42.42.3(pid=18336): Terminating (SIGTERM)
10:42:37.944393 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18337): Terminating (SIGTERM)
10:42:37.986784 run   osmo-mgw_10.42.42.4(pid=18338): Terminating (SIGTERM)
10:42:38.028292 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=18339): Terminating (SIGTERM)
10:42:38.068682 run   osmo-bsc_10.42.42.7(pid=18340): Terminating (SIGTERM)
10:42:38.109585 run        osmo-bts-sysmo(pid=18352): Terminating (SIGTERM)
10:42:38.121240 ---      ParallelTerminationStrategy: PID 18329 died...
10:42:38.178157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18329): Terminated: ok {rc=0}
10:42:38.188841 ---      ParallelTerminationStrategy: PID 18330 died...
10:42:38.244488 run   osmo-hlr_10.42.42.2(pid=18330): Terminated: ok {rc=0}
10:42:38.256143 ---      ParallelTerminationStrategy: PID 18331 died...
10:42:38.310560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18331): Terminated: ok {rc=0}
10:42:38.320547 ---      ParallelTerminationStrategy: PID 18332 died...
10:42:38.374350 run   osmo-stp_10.42.42.5(pid=18332): Terminated: ok {rc=0}
10:42:38.384254 ---      ParallelTerminationStrategy: PID 18333 died...
10:42:38.438384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18333): Terminated: ok {rc=0}
10:42:38.448718 ---      ParallelTerminationStrategy: PID 18334 died...
10:42:38.502394 run   osmo-msc_10.42.42.6(pid=18334): Terminated: ok {rc=0}
10:42:38.512523 ---      ParallelTerminationStrategy: PID 18335 died...
10:42:38.566719 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=18335): Terminated: ok {rc=0}
10:42:38.576763 ---      ParallelTerminationStrategy: PID 18336 died...
10:42:38.630715 run   osmo-mgw_10.42.42.3(pid=18336): Terminated {rc=15}
10:42:38.640747 ---      ParallelTerminationStrategy: PID 18337 died...
10:42:38.695053 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18337): Terminated: ok {rc=0}
10:42:38.705103 ---      ParallelTerminationStrategy: PID 18338 died...
10:42:38.759444 run   osmo-mgw_10.42.42.4(pid=18338): Terminated {rc=15}
10:42:38.769419 ---      ParallelTerminationStrategy: PID 18339 died...
10:42:38.823288 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=18339): Terminated: ok {rc=0}
10:42:38.833469 ---      ParallelTerminationStrategy: PID 18340 died...
10:42:38.888197 run   osmo-bsc_10.42.42.7(pid=18340): Terminated: ok {rc=0}
10:42:38.898381 ---      ParallelTerminationStrategy: PID 18352 died...
10:42:38.952437 run        osmo-bts-sysmo(pid=18352): Terminated: ok {rc=0}
10:42:39.062860 bus                        /sierra_2: Setting Online False
10:42:40.146723 bus                        /sierra_2: Setting Powered False
10:42:45.973622 bus                        /sierra_2: Setting Powered False
10:42:47.077135 bus                        /sierra_2: Setting Powered False
10:42:48.210371 bus                        /sierra_1: Setting Online False
10:42:49.294942 bus                        /sierra_1: Setting Powered False
10:42:54.972862 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call.py", line 8, in <module>
    test_mo_mt_call(False, False)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f428d8cd048>, timeout=10, timestep=1} [trial-825↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]