Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchf+cfg-codec-fr3)

Failing for the past 85 builds (Since #751 )
Took 1 min 9 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6c943ef1e0>, timeout=10, timestep=1} [trial-835↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-835 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py
----------------------------------------------
22:42:55.122283 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
22:42:55.134237 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1)
22:42:55.287016 tst              mo_mt_call_osmux.py: using LAC 9797
22:42:55.410286 tst              mo_mt_call_osmux.py: using RAC 107
22:42:55.532077 tst              mo_mt_call_osmux.py: using CellId 9797
22:42:55.653875 tst              mo_mt_call_osmux.py: using BVCI 9793
22:42:55.676892 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
22:42:55.687857 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
22:42:55.698612 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
22:42:55.710093 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
22:42:55.721633 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
22:42:55.732935 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
22:42:55.839066 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
22:42:56.034441 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
22:42:56.552670 run         create_hlr_db(pid=14596): Launched
22:42:56.739899 bus                        /sierra_1: Setting Powered False
22:42:57.760778 run         create_hlr_db(pid=14596): Terminated: ok {rc=0}
22:42:58.170051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14598): Launched
22:42:58.480081 run   osmo-hlr_10.42.42.2(pid=14599): Launched
22:42:58.589512 run              osmo-stp_10.42.42.5: Starting osmo-stp
22:42:59.114025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14600): Launched
22:42:59.419259 run   osmo-stp_10.42.42.5(pid=14601): Launched
22:42:59.526472 run              osmo-msc_10.42.42.6: Starting osmo-msc
22:43:00.078939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14602): Launched
22:43:00.383808 run   osmo-msc_10.42.42.6(pid=14603): Launched
22:43:03.549826 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
22:43:04.080485 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14604): Launched
22:43:04.392056 run   osmo-mgw_10.42.42.3(pid=14605): Launched
22:43:04.502319 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
22:43:05.031406 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14606): Launched
22:43:05.348756 run   osmo-mgw_10.42.42.4(pid=14607): Launched
22:43:05.460629 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
22:43:06.116495 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14608): Launched
22:43:06.434826 run   osmo-bsc_10.42.42.7(pid=14609): Launched
22:43:12.700251 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
22:43:13.298189 run         rm-remote-dir(pid=14613): Launched
22:43:15.492872 run         rm-remote-dir(pid=14613): Terminated: ok {rc=0}
22:43:15.829976 run         mk-remote-dir(pid=14614): Launched
22:43:18.022777 run         mk-remote-dir(pid=14614): Terminated: ok {rc=0}
22:43:18.307181 run    scp-inst-to-remote(pid=14615): Launched
22:43:31.529503 run    scp-inst-to-remote(pid=14615): Terminated: ok {rc=0}
22:43:31.882872 run         mk-remote-dir(pid=14617): Launched
22:43:35.085751 run         mk-remote-dir(pid=14617): Terminated: ok {rc=0}
22:43:35.387738 run     scp-cfg-to-remote(pid=14618): Launched
22:43:37.581299 run     scp-cfg-to-remote(pid=14618): Terminated: ok {rc=0}
22:43:37.909343 run   reload-dsp-firmware(pid=14620): Launched
22:43:42.100083 run   reload-dsp-firmware(pid=14620): Terminated: ok {rc=0}
22:43:42.419743 run        osmo-bts-sysmo(pid=14621): Launched
22:43:47.660132 tst              mo_mt_call_osmux.py: using MSISDN 6369
22:43:47.842794 bus                        /sierra_1: Setting Powered True
22:43:51.329422 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6369', subscriber_id=1}
22:43:51.466713 tst              mo_mt_call_osmux.py: using MSISDN 6370
22:43:51.648646 bus                        /sierra_2: Setting Powered True
22:44:03.996231 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f6c943ef1e0&gt;, timeout=10, timestep=1} [trial-835↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-835↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8]
22:44:04.003559 tst            mo_mt_call_osmux.py:8: Test FAILED (68.9 sec)
22:44:04.037884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14598): Terminating (SIGTERM)
22:44:04.077228 run   osmo-hlr_10.42.42.2(pid=14599): Terminating (SIGTERM)
22:44:04.118657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14600): Terminating (SIGTERM)
22:44:04.159796 run   osmo-stp_10.42.42.5(pid=14601): Terminating (SIGTERM)
22:44:04.211094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14602): Terminating (SIGTERM)
22:44:04.252429 run   osmo-msc_10.42.42.6(pid=14603): Terminating (SIGTERM)
22:44:04.295636 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14604): Terminating (SIGTERM)
22:44:04.334728 run   osmo-mgw_10.42.42.3(pid=14605): Terminating (SIGTERM)
22:44:04.375426 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14606): Terminating (SIGTERM)
22:44:04.414986 run   osmo-mgw_10.42.42.4(pid=14607): Terminating (SIGTERM)
22:44:04.454986 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14608): Terminating (SIGTERM)
22:44:04.499272 run   osmo-bsc_10.42.42.7(pid=14609): Terminating (SIGTERM)
22:44:04.541386 run        osmo-bts-sysmo(pid=14621): Terminating (SIGTERM)
22:44:04.551194 ---      ParallelTerminationStrategy: PID 14598 died...
22:44:04.620026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14598): Terminated: ok {rc=0}
22:44:04.630589 ---      ParallelTerminationStrategy: PID 14599 died...
22:44:04.685907 run   osmo-hlr_10.42.42.2(pid=14599): Terminated: ok {rc=0}
22:44:04.696266 ---      ParallelTerminationStrategy: PID 14600 died...
22:44:04.751275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14600): Terminated: ok {rc=0}
22:44:04.760843 ---      ParallelTerminationStrategy: PID 14601 died...
22:44:04.813408 run   osmo-stp_10.42.42.5(pid=14601): Terminated: ok {rc=0}
22:44:04.823258 ---      ParallelTerminationStrategy: PID 14602 died...
22:44:04.875945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14602): Terminated: ok {rc=0}
22:44:04.885843 ---      ParallelTerminationStrategy: PID 14603 died...
22:44:04.939406 run   osmo-msc_10.42.42.6(pid=14603): Terminated: ok {rc=0}
22:44:04.949411 ---      ParallelTerminationStrategy: PID 14604 died...
22:44:05.002210 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14604): Terminated: ok {rc=0}
22:44:05.012055 ---      ParallelTerminationStrategy: PID 14605 died...
22:44:05.064739 run   osmo-mgw_10.42.42.3(pid=14605): Terminated {rc=15}
22:44:05.074448 ---      ParallelTerminationStrategy: PID 14606 died...
22:44:05.127076 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14606): Terminated: ok {rc=0}
22:44:05.136928 ---      ParallelTerminationStrategy: PID 14607 died...
22:44:05.189763 run   osmo-mgw_10.42.42.4(pid=14607): Terminated {rc=15}
22:44:05.199673 ---      ParallelTerminationStrategy: PID 14608 died...
22:44:05.252529 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14608): Terminated: ok {rc=0}
22:44:05.262395 ---      ParallelTerminationStrategy: PID 14609 died...
22:44:05.314753 run   osmo-bsc_10.42.42.7(pid=14609): Terminated: ok {rc=0}
22:44:05.324477 ---      ParallelTerminationStrategy: PID 14621 died...
22:44:05.377173 run        osmo-bts-sysmo(pid=14621): Terminated: ok {rc=0}
22:44:05.479019 bus                        /sierra_2: Setting Online False
22:44:06.564185 bus                        /sierra_2: Setting Powered False
22:44:11.965310 bus                        /sierra_2: Setting Powered False
22:44:13.067432 bus                        /sierra_2: Setting Powered False
22:44:14.199408 bus                        /sierra_1: Setting Online False
22:44:15.283748 bus                        /sierra_1: Setting Powered False
22:44:20.961407 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6c943ef1e0>, timeout=10, timestep=1} [trial-835↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]