Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchh+cfg-codec-hr3)

Failing for the past 97 builds (Since #751 )
Took 1 min 11 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f5ab02e8f28>, timeout=10, timestep=1} [trial-847↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-847 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py
----------------------------------------------
13:20:20.127054 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
13:20:20.139358 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1)
13:20:20.290309 tst              mo_mt_call_osmux.py: using LAC 10761
13:20:20.422080 tst              mo_mt_call_osmux.py: using RAC 51
13:20:20.554613 tst              mo_mt_call_osmux.py: using CellId 10761
13:20:20.687128 tst              mo_mt_call_osmux.py: using BVCI 10757
13:20:20.713029 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
13:20:20.724561 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
13:20:20.735961 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
13:20:20.747416 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
13:20:20.758808 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
13:20:20.770232 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
13:20:20.874089 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
13:20:21.072998 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
13:20:21.580074 run         create_hlr_db(pid=22651): Launched
13:20:21.764584 bus                        /sierra_1: Setting Powered False
13:20:22.784861 run         create_hlr_db(pid=22651): Terminated: ok {rc=0}
13:20:23.234855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22653): Launched
13:20:23.579741 run   osmo-hlr_10.42.42.2(pid=22654): Launched
13:20:23.702981 run              osmo-stp_10.42.42.5: Starting osmo-stp
13:20:24.291079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22655): Launched
13:20:24.630268 run   osmo-stp_10.42.42.5(pid=22656): Launched
13:20:24.751349 run              osmo-msc_10.42.42.6: Starting osmo-msc
13:20:25.370776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22657): Launched
13:20:25.711862 run   osmo-msc_10.42.42.6(pid=22658): Launched
13:20:28.893603 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
13:20:29.483086 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22659): Launched
13:20:29.823398 run   osmo-mgw_10.42.42.3(pid=22660): Launched
13:20:29.944514 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
13:20:30.523844 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22661): Launched
13:20:30.863153 run   osmo-mgw_10.42.42.4(pid=22662): Launched
13:20:30.981852 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
13:20:31.649248 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22663): Launched
13:20:31.972311 run   osmo-bsc_10.42.42.7(pid=22664): Launched
13:20:38.245733 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
13:20:38.819568 run         rm-remote-dir(pid=22665): Launched
13:20:41.016096 run         rm-remote-dir(pid=22665): Terminated: ok {rc=0}
13:20:41.359362 run         mk-remote-dir(pid=22666): Launched
13:20:43.555280 run         mk-remote-dir(pid=22666): Terminated: ok {rc=0}
13:20:43.844457 run    scp-inst-to-remote(pid=22667): Launched
13:20:58.069604 run    scp-inst-to-remote(pid=22667): Terminated: ok {rc=0}
13:20:58.425825 run         mk-remote-dir(pid=22669): Launched
13:21:01.631121 run         mk-remote-dir(pid=22669): Terminated: ok {rc=0}
13:21:01.936286 run     scp-cfg-to-remote(pid=22670): Launched
13:21:04.142084 run     scp-cfg-to-remote(pid=22670): Terminated: ok {rc=0}
13:21:04.494921 run   reload-dsp-firmware(pid=22673): Launched
13:21:08.699017 run   reload-dsp-firmware(pid=22673): Terminated: ok {rc=0}
13:21:09.043446 run        osmo-bts-sysmo(pid=22674): Launched
13:21:14.292219 tst              mo_mt_call_osmux.py: using MSISDN 7013
13:21:14.469090 bus                        /sierra_1: Setting Powered True
13:21:17.965658 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='7013', subscriber_id=1}
13:21:18.104474 tst              mo_mt_call_osmux.py: using MSISDN 7014
13:21:18.278368 bus                        /sierra_2: Setting Powered True
13:21:30.640098 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f5ab02e8f28&gt;, timeout=10, timestep=1} [trial-847↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-847↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8]
13:21:30.647465 tst            mo_mt_call_osmux.py:8: Test FAILED (70.6 sec)
13:21:30.682214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22653): Terminating (SIGTERM)
13:21:30.722029 run   osmo-hlr_10.42.42.2(pid=22654): Terminating (SIGTERM)
13:21:30.762989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22655): Terminating (SIGTERM)
13:21:30.806840 run   osmo-stp_10.42.42.5(pid=22656): Terminating (SIGTERM)
13:21:30.850292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22657): Terminating (SIGTERM)
13:21:30.892334 run   osmo-msc_10.42.42.6(pid=22658): Terminating (SIGTERM)
13:21:30.936423 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22659): Terminating (SIGTERM)
13:21:30.979075 run   osmo-mgw_10.42.42.3(pid=22660): Terminating (SIGTERM)
13:21:31.036442 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22661): Terminating (SIGTERM)
13:21:31.078393 run   osmo-mgw_10.42.42.4(pid=22662): Terminating (SIGTERM)
13:21:31.118996 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22663): Terminating (SIGTERM)
13:21:31.158454 run   osmo-bsc_10.42.42.7(pid=22664): Terminating (SIGTERM)
13:21:31.198454 run        osmo-bts-sysmo(pid=22674): Terminating (SIGTERM)
13:21:31.208283 ---      ParallelTerminationStrategy: PID 22653 died...
13:21:31.263005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22653): Terminated: ok {rc=0}
13:21:31.273099 ---      ParallelTerminationStrategy: PID 22654 died...
13:21:31.327518 run   osmo-hlr_10.42.42.2(pid=22654): Terminated: ok {rc=0}
13:21:31.337722 ---      ParallelTerminationStrategy: PID 22655 died...
13:21:31.390920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22655): Terminated: ok {rc=0}
13:21:31.400594 ---      ParallelTerminationStrategy: PID 22656 died...
13:21:31.453889 run   osmo-stp_10.42.42.5(pid=22656): Terminated: ok {rc=0}
13:21:31.463825 ---      ParallelTerminationStrategy: PID 22657 died...
13:21:31.517116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22657): Terminated: ok {rc=0}
13:21:31.527052 ---      ParallelTerminationStrategy: PID 22658 died...
13:21:31.580191 run   osmo-msc_10.42.42.6(pid=22658): Terminated: ok {rc=0}
13:21:31.590217 ---      ParallelTerminationStrategy: PID 22659 died...
13:21:31.643182 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22659): Terminated: ok {rc=0}
13:21:31.653250 ---      ParallelTerminationStrategy: PID 22660 died...
13:21:31.706241 run   osmo-mgw_10.42.42.3(pid=22660): Terminated {rc=15}
13:21:31.716048 ---      ParallelTerminationStrategy: PID 22661 died...
13:21:31.769174 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22661): Terminated: ok {rc=0}
13:21:31.778948 ---      ParallelTerminationStrategy: PID 22662 died...
13:21:31.832047 run   osmo-mgw_10.42.42.4(pid=22662): Terminated {rc=15}
13:21:31.841984 ---      ParallelTerminationStrategy: PID 22663 died...
13:21:31.894905 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22663): Terminated: ok {rc=0}
13:21:31.904866 ---      ParallelTerminationStrategy: PID 22664 died...
13:21:31.958015 run   osmo-bsc_10.42.42.7(pid=22664): Terminated: ok {rc=0}
13:21:31.967799 ---      ParallelTerminationStrategy: PID 22674 died...
13:21:32.020806 run        osmo-bts-sysmo(pid=22674): Terminated: ok {rc=0}
13:21:32.123498 bus                        /sierra_2: Setting Online False
13:21:33.210227 bus                        /sierra_2: Setting Powered False
13:21:38.966999 bus                        /sierra_2: Setting Powered False
13:21:40.069642 bus                        /sierra_2: Setting Powered False
13:21:41.203220 bus                        /sierra_1: Setting Online False
13:21:42.286116 bus                        /sierra_1: Setting Powered False
13:21:47.960479 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f5ab02e8f28>, timeout=10, timestep=1} [trial-847↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]