Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchf+cfg-codec-fr2)

Failing for the past 85 builds (Since #751 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6c943297b8>, timeout=10, timestep=1} [trial-835↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-835 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py
----------------------------------------------
22:39:59.132809 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6)
22:39:59.145036 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1)
22:39:59.301044 tst              mo_mt_call_osmux.py: using LAC 9795
22:39:59.434503 tst              mo_mt_call_osmux.py: using RAC 105
22:39:59.564833 tst              mo_mt_call_osmux.py: using CellId 9795
22:39:59.698489 tst              mo_mt_call_osmux.py: using BVCI 9791
22:39:59.723997 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6)
22:39:59.735597 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6)
22:39:59.747145 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6)
22:39:59.758547 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6)
22:39:59.769983 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6)
22:39:59.781474 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2)
22:39:59.883983 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2)
22:40:00.074356 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
22:40:00.573976 run         create_hlr_db(pid=14528): Launched
22:40:00.755254 bus                        /sierra_1: Setting Powered False
22:40:01.776449 run         create_hlr_db(pid=14528): Terminated: ok {rc=0}
22:40:02.199249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14533): Launched
22:40:02.522021 run   osmo-hlr_10.42.42.2(pid=14534): Launched
22:40:02.634563 run              osmo-stp_10.42.42.5: Starting osmo-stp
22:40:03.183311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14535): Launched
22:40:03.501682 run   osmo-stp_10.42.42.5(pid=14536): Launched
22:40:03.613746 run              osmo-msc_10.42.42.6: Starting osmo-msc
22:40:04.190563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14537): Launched
22:40:04.510859 run   osmo-msc_10.42.42.6(pid=14538): Launched
22:40:07.678813 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
22:40:08.229112 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14539): Launched
22:40:08.552998 run   osmo-mgw_10.42.42.3(pid=14540): Launched
22:40:08.665491 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
22:40:09.205565 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14541): Launched
22:40:09.524580 run   osmo-mgw_10.42.42.4(pid=14542): Launched
22:40:09.636981 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
22:40:10.299230 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14543): Launched
22:40:10.619664 run   osmo-bsc_10.42.42.7(pid=14544): Launched
22:40:16.889047 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
22:40:17.458747 run         rm-remote-dir(pid=14545): Launched
22:40:19.655111 run         rm-remote-dir(pid=14545): Terminated: ok {rc=0}
22:40:19.998627 run         mk-remote-dir(pid=14546): Launched
22:40:22.193716 run         mk-remote-dir(pid=14546): Terminated: ok {rc=0}
22:40:22.481390 run    scp-inst-to-remote(pid=14547): Launched
22:40:35.704153 run    scp-inst-to-remote(pid=14547): Terminated: ok {rc=0}
22:40:36.060254 run         mk-remote-dir(pid=14549): Launched
22:40:39.265964 run         mk-remote-dir(pid=14549): Terminated: ok {rc=0}
22:40:39.570847 run     scp-cfg-to-remote(pid=14550): Launched
22:40:41.776215 run     scp-cfg-to-remote(pid=14550): Terminated: ok {rc=0}
22:40:42.127412 run   reload-dsp-firmware(pid=14552): Launched
22:40:46.332074 run   reload-dsp-firmware(pid=14552): Terminated: ok {rc=0}
22:40:46.674075 run        osmo-bts-sysmo(pid=14553): Launched
22:40:51.929845 tst              mo_mt_call_osmux.py: using MSISDN 6365
22:40:52.106092 bus                        /sierra_1: Setting Powered True
22:40:55.595372 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6365', subscriber_id=1}
22:40:55.743171 tst              mo_mt_call_osmux.py: using MSISDN 6366
22:40:55.926030 bus                        /sierra_2: Setting Powered True
22:41:08.278603 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f6c943297b8&gt;, timeout=10, timestep=1} [trial-835↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-835↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8]
22:41:08.286475 tst            mo_mt_call_osmux.py:8: Test FAILED (69.2 sec)
22:41:08.321828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14533): Terminating (SIGTERM)
22:41:08.362836 run   osmo-hlr_10.42.42.2(pid=14534): Terminating (SIGTERM)
22:41:08.404904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14535): Terminating (SIGTERM)
22:41:08.447996 run   osmo-stp_10.42.42.5(pid=14536): Terminating (SIGTERM)
22:41:08.508021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14537): Terminating (SIGTERM)
22:41:08.564079 run   osmo-msc_10.42.42.6(pid=14538): Terminating (SIGTERM)
22:41:08.606256 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14539): Terminating (SIGTERM)
22:41:08.653577 run   osmo-mgw_10.42.42.3(pid=14540): Terminating (SIGTERM)
22:41:08.697101 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14541): Terminating (SIGTERM)
22:41:08.739832 run   osmo-mgw_10.42.42.4(pid=14542): Terminating (SIGTERM)
22:41:08.783395 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14543): Terminating (SIGTERM)
22:41:08.827587 run   osmo-bsc_10.42.42.7(pid=14544): Terminating (SIGTERM)
22:41:08.869762 run        osmo-bts-sysmo(pid=14553): Terminating (SIGTERM)
22:41:08.881090 ---      ParallelTerminationStrategy: PID 14533 died...
22:41:08.937041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14533): Terminated: ok {rc=0}
22:41:08.947059 ---      ParallelTerminationStrategy: PID 14534 died...
22:41:09.002345 run   osmo-hlr_10.42.42.2(pid=14534): Terminated: ok {rc=0}
22:41:09.012659 ---      ParallelTerminationStrategy: PID 14535 died...
22:41:09.068047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14535): Terminated: ok {rc=0}
22:41:09.078084 ---      ParallelTerminationStrategy: PID 14536 died...
22:41:09.132748 run   osmo-stp_10.42.42.5(pid=14536): Terminated: ok {rc=0}
22:41:09.142758 ---      ParallelTerminationStrategy: PID 14537 died...
22:41:09.197679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14537): Terminated: ok {rc=0}
22:41:09.207695 ---      ParallelTerminationStrategy: PID 14538 died...
22:41:09.262645 run   osmo-msc_10.42.42.6(pid=14538): Terminated: ok {rc=0}
22:41:09.272609 ---      ParallelTerminationStrategy: PID 14539 died...
22:41:09.327604 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14539): Terminated: ok {rc=0}
22:41:09.338020 ---      ParallelTerminationStrategy: PID 14540 died...
22:41:09.392637 run   osmo-mgw_10.42.42.3(pid=14540): Terminated {rc=15}
22:41:09.402628 ---      ParallelTerminationStrategy: PID 14541 died...
22:41:09.457669 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14541): Terminated: ok {rc=0}
22:41:09.467591 ---      ParallelTerminationStrategy: PID 14542 died...
22:41:09.522716 run   osmo-mgw_10.42.42.4(pid=14542): Terminated {rc=15}
22:41:09.532681 ---      ParallelTerminationStrategy: PID 14543 died...
22:41:09.587658 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14543): Terminated: ok {rc=0}
22:41:09.598072 ---      ParallelTerminationStrategy: PID 14553 died...
22:41:09.652860 run        osmo-bts-sysmo(pid=14553): Terminated: ok {rc=0}
22:41:09.831200 ---      ParallelTerminationStrategy: PID 14544 died...
22:41:09.888678 run   osmo-bsc_10.42.42.7(pid=14544): Terminated: ok {rc=0}
22:41:09.993884 bus                        /sierra_2: Setting Online False
22:41:11.080776 bus                        /sierra_2: Setting Powered False
22:41:16.962727 bus                        /sierra_2: Setting Powered False
22:41:18.067755 bus                        /sierra_2: Setting Powered False
22:41:19.194161 bus                        /sierra_1: Setting Online False
22:41:20.280057 bus                        /sierra_1: Setting Powered False
22:41:25.962909 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6c943297b8>, timeout=10, timestep=1} [trial-835↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]