Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchh+cfg-codec-hr3)

Failing for the past 92 builds (Since #751 )
Took 1 min 11 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f1919c096a8>, timeout=10, timestep=1} [trial-842↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-842 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py
----------------------------------------------
07:46:18.130646 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:46:18.142599 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1)
07:46:18.290289 tst              mo_mt_call_osmux.py: using LAC 10361
07:46:18.421741 tst              mo_mt_call_osmux.py: using RAC 161
07:46:18.554837 tst              mo_mt_call_osmux.py: using CellId 10361
07:46:18.686163 tst              mo_mt_call_osmux.py: using BVCI 10357
07:46:18.711792 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:46:18.723686 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:46:18.735392 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:46:18.747430 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:46:18.759114 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:46:18.770871 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
07:46:18.875848 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
07:46:19.075016 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
07:46:19.607661 run         create_hlr_db(pid=31673): Launched
07:46:19.799998 bus                        /sierra_1: Setting Powered False
07:46:20.820830 run         create_hlr_db(pid=31673): Terminated: ok {rc=0}
07:46:21.245702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31675): Launched
07:46:21.560323 run   osmo-hlr_10.42.42.2(pid=31676): Launched
07:46:21.673698 run              osmo-stp_10.42.42.5: Starting osmo-stp
07:46:22.218528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31677): Launched
07:46:22.533290 run   osmo-stp_10.42.42.5(pid=31678): Launched
07:46:22.644855 run              osmo-msc_10.42.42.6: Starting osmo-msc
07:46:23.216466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31679): Launched
07:46:23.531987 run   osmo-msc_10.42.42.6(pid=31680): Launched
07:46:26.707023 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
07:46:27.284527 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31681): Launched
07:46:27.617441 run   osmo-mgw_10.42.42.3(pid=31682): Launched
07:46:27.735898 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
07:46:28.302567 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31683): Launched
07:46:28.635811 run   osmo-mgw_10.42.42.4(pid=31684): Launched
07:46:28.751555 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
07:46:29.414898 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31685): Launched
07:46:29.731125 run   osmo-bsc_10.42.42.7(pid=31686): Launched
07:46:35.996417 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
07:46:36.557599 run         rm-remote-dir(pid=31687): Launched
07:46:38.753060 run         rm-remote-dir(pid=31687): Terminated: ok {rc=0}
07:46:39.090462 run         mk-remote-dir(pid=31688): Launched
07:46:41.283687 run         mk-remote-dir(pid=31688): Terminated: ok {rc=0}
07:46:41.567798 run    scp-inst-to-remote(pid=31689): Launched
07:46:55.791044 run    scp-inst-to-remote(pid=31689): Terminated: ok {rc=0}
07:46:56.146120 run         mk-remote-dir(pid=31691): Launched
07:46:58.338943 run         mk-remote-dir(pid=31691): Terminated: ok {rc=0}
07:46:58.627434 run     scp-cfg-to-remote(pid=31692): Launched
07:47:01.830486 run     scp-cfg-to-remote(pid=31692): Terminated: ok {rc=0}
07:47:02.179795 run   reload-dsp-firmware(pid=31694): Launched
07:47:05.371959 run   reload-dsp-firmware(pid=31694): Terminated: ok {rc=0}
07:47:05.690832 run        osmo-bts-sysmo(pid=31695): Launched
07:47:11.946428 tst              mo_mt_call_osmux.py: using MSISDN 6748
07:47:12.130245 bus                        /sierra_1: Setting Powered True
07:47:15.610411 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6748', subscriber_id=1}
07:47:15.747253 tst              mo_mt_call_osmux.py: using MSISDN 6749
07:47:15.918948 bus                        /sierra_2: Setting Powered True
07:47:28.283146 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f1919c096a8&gt;, timeout=10, timestep=1} [trial-842↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-842↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8]
07:47:28.290649 tst            mo_mt_call_osmux.py:8: Test FAILED (70.2 sec)
07:47:28.324810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31675): Terminating (SIGTERM)
07:47:28.364972 run   osmo-hlr_10.42.42.2(pid=31676): Terminating (SIGTERM)
07:47:28.405612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31677): Terminating (SIGTERM)
07:47:28.449911 run   osmo-stp_10.42.42.5(pid=31678): Terminating (SIGTERM)
07:47:28.493103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31679): Terminating (SIGTERM)
07:47:28.535772 run   osmo-msc_10.42.42.6(pid=31680): Terminating (SIGTERM)
07:47:28.579088 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31681): Terminating (SIGTERM)
07:47:28.622795 run   osmo-mgw_10.42.42.3(pid=31682): Terminating (SIGTERM)
07:47:28.665212 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31683): Terminating (SIGTERM)
07:47:28.708375 run   osmo-mgw_10.42.42.4(pid=31684): Terminating (SIGTERM)
07:47:28.750681 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31685): Terminating (SIGTERM)
07:47:28.790015 run   osmo-bsc_10.42.42.7(pid=31686): Terminating (SIGTERM)
07:47:28.829702 run        osmo-bts-sysmo(pid=31695): Terminating (SIGTERM)
07:47:28.839273 ---      ParallelTerminationStrategy: PID 31675 died...
07:47:28.892793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31675): Terminated: ok {rc=0}
07:47:28.902516 ---      ParallelTerminationStrategy: PID 31676 died...
07:47:28.956574 run   osmo-hlr_10.42.42.2(pid=31676): Terminated: ok {rc=0}
07:47:28.966808 ---      ParallelTerminationStrategy: PID 31677 died...
07:47:29.021825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31677): Terminated: ok {rc=0}
07:47:29.032069 ---      ParallelTerminationStrategy: PID 31678 died...
07:47:29.087166 run   osmo-stp_10.42.42.5(pid=31678): Terminated: ok {rc=0}
07:47:29.097564 ---      ParallelTerminationStrategy: PID 31679 died...
07:47:29.151455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31679): Terminated: ok {rc=0}
07:47:29.161535 ---      ParallelTerminationStrategy: PID 31680 died...
07:47:29.215545 run   osmo-msc_10.42.42.6(pid=31680): Terminated: ok {rc=0}
07:47:29.225635 ---      ParallelTerminationStrategy: PID 31681 died...
07:47:29.279077 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31681): Terminated: ok {rc=0}
07:47:29.288888 ---      ParallelTerminationStrategy: PID 31682 died...
07:47:29.342058 run   osmo-mgw_10.42.42.3(pid=31682): Terminated {rc=15}
07:47:29.351972 ---      ParallelTerminationStrategy: PID 31683 died...
07:47:29.405097 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31683): Terminated: ok {rc=0}
07:47:29.415109 ---      ParallelTerminationStrategy: PID 31684 died...
07:47:29.468622 run   osmo-mgw_10.42.42.4(pid=31684): Terminated {rc=15}
07:47:29.478381 ---      ParallelTerminationStrategy: PID 31685 died...
07:47:29.531559 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31685): Terminated: ok {rc=0}
07:47:29.541635 ---      ParallelTerminationStrategy: PID 31686 died...
07:47:29.594996 run   osmo-bsc_10.42.42.7(pid=31686): Terminated: ok {rc=0}
07:47:29.604731 ---      ParallelTerminationStrategy: PID 31695 died...
07:47:29.658200 run        osmo-bts-sysmo(pid=31695): Terminated: ok {rc=0}
07:47:29.766096 bus                        /sierra_2: Setting Online False
07:47:30.849633 bus                        /sierra_2: Setting Powered False
07:47:36.197517 bus                        /sierra_2: Setting Powered False
07:47:37.301276 bus                        /sierra_2: Setting Powered False
07:47:38.427051 bus                        /sierra_1: Setting Online False
07:47:39.512196 bus                        /sierra_1: Setting Powered False
07:47:44.970176 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f1919c096a8>, timeout=10, timestep=1} [trial-842↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]