Skip to content

Failed

voice:sysmo+mod-bts0-dynts-osmo.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-dynts-osmo)

Failing for the past 49 builds (Since #751 )
Took 1 min 5 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f8aaca3aae8>, timeout=10, timestep=1} [trial-799↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-799 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py
----------------------------------------------
03:31:43.126880 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
03:31:43.138568 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1)
03:31:43.300891 tst              mo_mt_call_osmux.py: using LAC 6925
03:31:43.430253 tst              mo_mt_call_osmux.py: using RAC 40
03:31:43.558478 tst              mo_mt_call_osmux.py: using CellId 6925
03:31:43.688615 tst              mo_mt_call_osmux.py: using BVCI 6921
03:31:43.714186 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
03:31:43.725716 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
03:31:43.737038 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
03:31:43.748353 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
03:31:43.759696 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
03:31:43.771210 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
03:31:43.871942 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
03:31:44.058328 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
03:31:44.551007 run         create_hlr_db(pid=11139): Launched
03:31:44.731945 bus                        /sierra_1: Setting Powered False
03:31:45.752371 run         create_hlr_db(pid=11139): Terminated: ok {rc=0}
03:31:46.194832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11141): Launched
03:31:46.530108 run   osmo-hlr_10.42.42.2(pid=11142): Launched
03:31:46.650930 run              osmo-stp_10.42.42.5: Starting osmo-stp
03:31:47.228740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11143): Launched
03:31:47.562548 run   osmo-stp_10.42.42.5(pid=11144): Launched
03:31:47.680812 run              osmo-msc_10.42.42.6: Starting osmo-msc
03:31:48.285027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11145): Launched
03:31:48.620606 run   osmo-msc_10.42.42.6(pid=11146): Launched
03:31:51.797660 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
03:31:52.377679 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11147): Launched
03:31:52.712293 run   osmo-mgw_10.42.42.3(pid=11148): Launched
03:31:52.831967 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
03:31:53.400790 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11149): Launched
03:31:53.735227 run   osmo-mgw_10.42.42.4(pid=11150): Launched
03:31:53.854877 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
03:31:54.550316 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11151): Launched
03:31:54.886303 run   osmo-bsc_10.42.42.7(pid=11152): Launched
03:32:01.159915 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
03:32:01.721421 run         rm-remote-dir(pid=11153): Launched
03:32:03.916230 run         rm-remote-dir(pid=11153): Terminated: ok {rc=0}
03:32:04.254135 run         mk-remote-dir(pid=11154): Launched
03:32:05.444935 run         mk-remote-dir(pid=11154): Terminated: ok {rc=0}
03:32:05.728949 run    scp-inst-to-remote(pid=11155): Launched
03:32:18.948055 run    scp-inst-to-remote(pid=11155): Terminated: ok {rc=0}
03:32:19.299768 run         mk-remote-dir(pid=11160): Launched
03:32:21.490803 run         mk-remote-dir(pid=11160): Terminated: ok {rc=0}
03:32:21.774103 run     scp-cfg-to-remote(pid=11161): Launched
03:32:22.964397 run     scp-cfg-to-remote(pid=11161): Terminated: ok {rc=0}
03:32:23.290249 run   reload-dsp-firmware(pid=11163): Launched
03:32:26.477408 run   reload-dsp-firmware(pid=11163): Terminated: ok {rc=0}
03:32:26.797646 run        osmo-bts-sysmo(pid=11164): Launched
03:32:31.037314 tst              mo_mt_call_osmux.py: using MSISDN 4477
03:32:31.210297 bus                        /sierra_1: Setting Powered True
03:32:34.681694 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4477', subscriber_id=1}
03:32:34.816714 tst              mo_mt_call_osmux.py: using MSISDN 4478
03:32:34.987946 bus                        /sierra_2: Setting Powered True
03:32:47.334465 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f8aaca3aae8&gt;, timeout=10, timestep=1} [trial-799↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-799↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8]
03:32:47.341899 tst            mo_mt_call_osmux.py:8: Test FAILED (64.3 sec)
03:32:47.376964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11141): Terminating (SIGTERM)
03:32:47.416223 run   osmo-hlr_10.42.42.2(pid=11142): Terminating (SIGTERM)
03:32:47.456021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11143): Terminating (SIGTERM)
03:32:47.499055 run   osmo-stp_10.42.42.5(pid=11144): Terminating (SIGTERM)
03:32:47.549684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11145): Terminating (SIGTERM)
03:32:47.593039 run   osmo-msc_10.42.42.6(pid=11146): Terminating (SIGTERM)
03:32:47.637346 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11147): Terminating (SIGTERM)
03:32:47.676775 run   osmo-mgw_10.42.42.3(pid=11148): Terminating (SIGTERM)
03:32:47.716735 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11149): Terminating (SIGTERM)
03:32:47.756375 run   osmo-mgw_10.42.42.4(pid=11150): Terminating (SIGTERM)
03:32:47.797013 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11151): Terminating (SIGTERM)
03:32:47.837418 run   osmo-bsc_10.42.42.7(pid=11152): Terminating (SIGTERM)
03:32:47.879180 run        osmo-bts-sysmo(pid=11164): Terminating (SIGTERM)
03:32:47.888534 ---      ParallelTerminationStrategy: PID 11141 died...
03:32:47.941377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11141): Terminated: ok {rc=0}
03:32:47.950912 ---      ParallelTerminationStrategy: PID 11142 died...
03:32:48.004108 run   osmo-hlr_10.42.42.2(pid=11142): Terminated: ok {rc=0}
03:32:48.014207 ---      ParallelTerminationStrategy: PID 11143 died...
03:32:48.068554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11143): Terminated: ok {rc=0}
03:32:48.078499 ---      ParallelTerminationStrategy: PID 11144 died...
03:32:48.132306 run   osmo-stp_10.42.42.5(pid=11144): Terminated: ok {rc=0}
03:32:48.142619 ---      ParallelTerminationStrategy: PID 11145 died...
03:32:48.195360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11145): Terminated: ok {rc=0}
03:32:48.205187 ---      ParallelTerminationStrategy: PID 11146 died...
03:32:48.258157 run   osmo-msc_10.42.42.6(pid=11146): Terminated: ok {rc=0}
03:32:48.267700 ---      ParallelTerminationStrategy: PID 11147 died...
03:32:48.320450 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11147): Terminated: ok {rc=0}
03:32:48.330121 ---      ParallelTerminationStrategy: PID 11148 died...
03:32:48.382840 run   osmo-mgw_10.42.42.3(pid=11148): Terminated {rc=15}
03:32:48.392481 ---      ParallelTerminationStrategy: PID 11149 died...
03:32:48.444958 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11149): Terminated: ok {rc=0}
03:32:48.454614 ---      ParallelTerminationStrategy: PID 11150 died...
03:32:48.507077 run   osmo-mgw_10.42.42.4(pid=11150): Terminated {rc=15}
03:32:48.516461 ---      ParallelTerminationStrategy: PID 11151 died...
03:32:48.569835 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11151): Terminated: ok {rc=0}
03:32:48.579381 ---      ParallelTerminationStrategy: PID 11152 died...
03:32:48.631630 run   osmo-bsc_10.42.42.7(pid=11152): Terminated: ok {rc=0}
03:32:48.641329 ---      ParallelTerminationStrategy: PID 11164 died...
03:32:48.693565 run        osmo-bts-sysmo(pid=11164): Terminated: ok {rc=0}
03:32:48.801368 bus                        /sierra_2: Setting Online False
03:32:49.884886 bus                        /sierra_2: Setting Powered False
03:32:55.958033 bus                        /sierra_2: Setting Powered False
03:32:57.058793 bus                        /sierra_2: Setting Powered False
03:32:58.190772 bus                        /sierra_1: Setting Online False
03:32:59.274737 bus                        /sierra_1: Setting Powered False
03:33:04.969727 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f8aaca3aae8>, timeout=10, timestep=1} [trial-799↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]