Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchf+cfg-codec-fr3)

Failing for the past 60 builds (Since #751 )
Took 1 min 6 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fbb3456d730>, timeout=10, timestep=1} [trial-810↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-810 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py
----------------------------------------------
15:48:54.162064 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
15:48:54.174013 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1)
15:48:54.322622 tst              mo_mt_call_osmux.py: using LAC 7797
15:48:54.448882 tst              mo_mt_call_osmux.py: using RAC 147
15:48:54.578224 tst              mo_mt_call_osmux.py: using CellId 7797
15:48:54.704310 tst              mo_mt_call_osmux.py: using BVCI 7793
15:48:54.728566 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
15:48:54.739802 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
15:48:54.750848 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
15:48:54.761949 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
15:48:54.773082 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
15:48:54.784292 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
15:48:54.890652 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
15:48:55.092525 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
15:48:55.635102 run          create_hlr_db(pid=6860): Launched
15:48:55.831567 bus                        /sierra_1: Setting Powered False
15:48:56.852308 run          create_hlr_db(pid=6860): Terminated: ok {rc=0}
15:48:57.281210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6862): Launched
15:48:57.600649 run    osmo-hlr_10.42.42.2(pid=6863): Launched
15:48:57.714627 run              osmo-stp_10.42.42.5: Starting osmo-stp
15:48:58.269801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6864): Launched
15:48:58.587083 run    osmo-stp_10.42.42.5(pid=6865): Launched
15:48:58.700474 run              osmo-msc_10.42.42.6: Starting osmo-msc
15:48:59.282921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6866): Launched
15:48:59.603690 run    osmo-msc_10.42.42.6(pid=6867): Launched
15:49:02.774012 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
15:49:03.328154 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=6868): Launched
15:49:03.648176 run    osmo-mgw_10.42.42.3(pid=6869): Launched
15:49:03.761500 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
15:49:04.304059 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6870): Launched
15:49:04.624428 run    osmo-mgw_10.42.42.4(pid=6871): Launched
15:49:04.737515 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
15:49:05.403689 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=6872): Launched
15:49:05.723732 run    osmo-bsc_10.42.42.7(pid=6873): Launched
15:49:11.995232 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
15:49:12.565894 run          rm-remote-dir(pid=6874): Launched
15:49:14.763164 run          rm-remote-dir(pid=6874): Terminated: ok {rc=0}
15:49:15.106538 run          mk-remote-dir(pid=6875): Launched
15:49:16.301113 run          mk-remote-dir(pid=6875): Terminated: ok {rc=0}
15:49:16.591474 run     scp-inst-to-remote(pid=6876): Launched
15:49:29.815231 run     scp-inst-to-remote(pid=6876): Terminated: ok {rc=0}
15:49:30.172751 run          mk-remote-dir(pid=6878): Launched
15:49:32.378867 run          mk-remote-dir(pid=6878): Terminated: ok {rc=0}
15:49:32.685317 run      scp-cfg-to-remote(pid=6879): Launched
15:49:34.892234 run      scp-cfg-to-remote(pid=6879): Terminated: ok {rc=0}
15:49:35.245091 run    reload-dsp-firmware(pid=6881): Launched
15:49:38.449448 run    reload-dsp-firmware(pid=6881): Terminated: ok {rc=0}
15:49:38.794554 run         osmo-bts-sysmo(pid=6882): Launched
15:49:43.049663 tst              mo_mt_call_osmux.py: using MSISDN 5044
15:49:43.227209 bus                        /sierra_1: Setting Powered True
15:49:46.716627 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5044', subscriber_id=1}
15:49:46.864456 tst              mo_mt_call_osmux.py: using MSISDN 5045
15:49:47.050327 bus                        /sierra_2: Setting Powered True
15:49:59.427292 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fbb3456d730&gt;, timeout=10, timestep=1} [trial-810↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-810↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8]
15:49:59.435142 tst            mo_mt_call_osmux.py:8: Test FAILED (65.3 sec)
15:49:59.471828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6862): Terminating (SIGTERM)
15:49:59.514380 run    osmo-hlr_10.42.42.2(pid=6863): Terminating (SIGTERM)
15:49:59.558321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6864): Terminating (SIGTERM)
15:49:59.603792 run    osmo-stp_10.42.42.5(pid=6865): Terminating (SIGTERM)
15:49:59.670274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6866): Terminating (SIGTERM)
15:49:59.717993 run    osmo-msc_10.42.42.6(pid=6867): Terminating (SIGTERM)
15:49:59.760060 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=6868): Terminating (SIGTERM)
15:49:59.802061 run    osmo-mgw_10.42.42.3(pid=6869): Terminating (SIGTERM)
15:49:59.844452 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6870): Terminating (SIGTERM)
15:49:59.886408 run    osmo-mgw_10.42.42.4(pid=6871): Terminating (SIGTERM)
15:49:59.928911 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=6872): Terminating (SIGTERM)
15:49:59.970896 run    osmo-bsc_10.42.42.7(pid=6873): Terminating (SIGTERM)
15:50:00.012861 run         osmo-bts-sysmo(pid=6882): Terminating (SIGTERM)
15:50:00.022689 ---      ParallelTerminationStrategy: PID 6862 died...
15:50:00.079656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6862): Terminated: ok {rc=0}
15:50:00.089951 ---      ParallelTerminationStrategy: PID 6863 died...
15:50:00.146211 run    osmo-hlr_10.42.42.2(pid=6863): Terminated: ok {rc=0}
15:50:00.156345 ---      ParallelTerminationStrategy: PID 6864 died...
15:50:00.212767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6864): Terminated: ok {rc=0}
15:50:00.222974 ---      ParallelTerminationStrategy: PID 6865 died...
15:50:00.279061 run    osmo-stp_10.42.42.5(pid=6865): Terminated: ok {rc=0}
15:50:00.289400 ---      ParallelTerminationStrategy: PID 6866 died...
15:50:00.345465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6866): Terminated: ok {rc=0}
15:50:00.356277 ---      ParallelTerminationStrategy: PID 6868 died...
15:50:00.417876 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=6868): Terminated: ok {rc=0}
15:50:00.428597 ---      ParallelTerminationStrategy: PID 6869 died...
15:50:00.486017 run    osmo-mgw_10.42.42.3(pid=6869): Terminated {rc=15}
15:50:00.496732 ---      ParallelTerminationStrategy: PID 6870 died...
15:50:00.554432 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6870): Terminated: ok {rc=0}
15:50:00.565225 ---      ParallelTerminationStrategy: PID 6871 died...
15:50:00.622554 run    osmo-mgw_10.42.42.4(pid=6871): Terminated {rc=15}
15:50:00.632934 ---      ParallelTerminationStrategy: PID 6872 died...
15:50:00.690207 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=6872): Terminated: ok {rc=0}
15:50:00.701088 ---      ParallelTerminationStrategy: PID 6873 died...
15:50:00.758489 run    osmo-bsc_10.42.42.7(pid=6873): Terminated: ok {rc=0}
15:50:00.769307 ---      ParallelTerminationStrategy: PID 6882 died...
15:50:00.827083 run         osmo-bts-sysmo(pid=6882): Terminated: ok {rc=0}
15:50:01.006077 ---      ParallelTerminationStrategy: PID 6867 died...
15:50:01.063672 run    osmo-msc_10.42.42.6(pid=6867): Terminated: ok {rc=0}
15:50:01.171379 bus                        /sierra_2: Setting Online False
15:50:02.253534 bus                        /sierra_2: Setting Powered False
15:50:07.963539 bus                        /sierra_2: Setting Powered False
15:50:09.071610 bus                        /sierra_2: Setting Powered False
15:50:10.201270 bus                        /sierra_1: Setting Online False
15:50:11.288579 bus                        /sierra_1: Setting Powered False
15:50:16.970988 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fbb3456d730>, timeout=10, timestep=1} [trial-810↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]