Skip to content

Failed

voice:sysmo+mod-bts0-dynts-osmo.mo_mt_call.py (from voice_sysmo+mod-bts0-dynts-osmo)

Failing for the past 50 builds (Since #751 )
Took 1 min 5 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f602df2a488>, timeout=10, timestep=1} [trial-800↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-800 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py
----------------------------------------------
05:49:18.983018 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
05:49:18.994490 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1)
05:49:19.151154 tst                    mo_mt_call.py: using LAC 7004
05:49:19.281909 tst                    mo_mt_call.py: using RAC 119
05:49:19.414476 tst                    mo_mt_call.py: using CellId 7004
05:49:19.546078 tst                    mo_mt_call.py: using BVCI 7000
05:49:19.571711 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
05:49:19.583180 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
05:49:19.594492 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
05:49:19.605762 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
05:49:19.616950 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
05:49:19.628258 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
05:49:19.731001 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
05:49:19.930515 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
05:49:20.466276 run         create_hlr_db(pid=13632): Launched
05:49:20.659144 bus                        /sierra_1: Setting Powered False
05:49:21.681256 run         create_hlr_db(pid=13632): Terminated: ok {rc=0}
05:49:22.126308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13634): Launched
05:49:22.461586 run   osmo-hlr_10.42.42.2(pid=13635): Launched
05:49:22.582572 run              osmo-stp_10.42.42.5: Starting osmo-stp
05:49:23.162837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13636): Launched
05:49:23.499404 run   osmo-stp_10.42.42.5(pid=13637): Launched
05:49:23.618796 run              osmo-msc_10.42.42.6: Starting osmo-msc
05:49:24.234332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13638): Launched
05:49:24.569548 run   osmo-msc_10.42.42.6(pid=13639): Launched
05:49:27.747155 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
05:49:28.329967 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13640): Launched
05:49:28.667750 run   osmo-mgw_10.42.42.3(pid=13641): Launched
05:49:28.787017 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
05:49:29.359790 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13642): Launched
05:49:29.697378 run   osmo-mgw_10.42.42.4(pid=13643): Launched
05:49:29.817545 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
05:49:30.596157 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13644): Launched
05:49:30.928239 run   osmo-bsc_10.42.42.7(pid=13645): Launched
05:49:37.210140 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
05:49:37.802496 run         rm-remote-dir(pid=13646): Launched
05:49:40.005648 run         rm-remote-dir(pid=13646): Terminated: ok {rc=0}
05:49:40.360012 run         mk-remote-dir(pid=13647): Launched
05:49:41.561211 run         mk-remote-dir(pid=13647): Terminated: ok {rc=0}
05:49:41.860808 run    scp-inst-to-remote(pid=13648): Launched
05:49:55.082003 run    scp-inst-to-remote(pid=13648): Terminated: ok {rc=0}
05:49:55.430751 run         mk-remote-dir(pid=13650): Launched
05:49:57.629935 run         mk-remote-dir(pid=13650): Terminated: ok {rc=0}
05:49:57.929973 run     scp-cfg-to-remote(pid=13651): Launched
05:49:59.128817 run     scp-cfg-to-remote(pid=13651): Terminated: ok {rc=0}
05:49:59.473704 run   reload-dsp-firmware(pid=13653): Launched
05:50:02.672418 run   reload-dsp-firmware(pid=13653): Terminated: ok {rc=0}
05:50:03.009012 run        osmo-bts-sysmo(pid=13657): Launched
05:50:07.257907 tst                    mo_mt_call.py: using MSISDN 4528
05:50:07.438228 bus                        /sierra_1: Setting Powered True
05:50:10.952351 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4528', subscriber_id=1}
05:50:11.086499 tst                    mo_mt_call.py: using MSISDN 4529
05:50:11.257257 bus                        /sierra_2: Setting Powered True
05:50:23.597777 tst                  mo_mt_call.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f602df2a488&gt;, timeout=10, timestep=1} [trial-800↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]  [trial-800↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8]
05:50:23.605075 tst                  mo_mt_call.py:8: Test FAILED (64.7 sec)
05:50:23.639931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13634): Terminating (SIGTERM)
05:50:23.679177 run   osmo-hlr_10.42.42.2(pid=13635): Terminating (SIGTERM)
05:50:23.719327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13636): Terminating (SIGTERM)
05:50:23.762968 run   osmo-stp_10.42.42.5(pid=13637): Terminating (SIGTERM)
05:50:23.806341 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13638): Terminating (SIGTERM)
05:50:23.850278 run   osmo-msc_10.42.42.6(pid=13639): Terminating (SIGTERM)
05:50:23.892291 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13640): Terminating (SIGTERM)
05:50:23.936191 run   osmo-mgw_10.42.42.3(pid=13641): Terminating (SIGTERM)
05:50:23.977773 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13642): Terminating (SIGTERM)
05:50:24.021516 run   osmo-mgw_10.42.42.4(pid=13643): Terminating (SIGTERM)
05:50:24.063323 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13644): Terminating (SIGTERM)
05:50:24.102849 run   osmo-bsc_10.42.42.7(pid=13645): Terminating (SIGTERM)
05:50:24.142528 run        osmo-bts-sysmo(pid=13657): Terminating (SIGTERM)
05:50:24.152064 ---      ParallelTerminationStrategy: PID 13634 died...
05:50:24.210712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13634): Terminated: ok {rc=0}
05:50:24.220954 ---      ParallelTerminationStrategy: PID 13635 died...
05:50:24.275553 run   osmo-hlr_10.42.42.2(pid=13635): Terminated: ok {rc=0}
05:50:24.286156 ---      ParallelTerminationStrategy: PID 13636 died...
05:50:24.340491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13636): Terminated: ok {rc=0}
05:50:24.350644 ---      ParallelTerminationStrategy: PID 13637 died...
05:50:24.404570 run   osmo-stp_10.42.42.5(pid=13637): Terminated: ok {rc=0}
05:50:24.414376 ---      ParallelTerminationStrategy: PID 13638 died...
05:50:24.468543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13638): Terminated: ok {rc=0}
05:50:24.478373 ---      ParallelTerminationStrategy: PID 13639 died...
05:50:24.531785 run   osmo-msc_10.42.42.6(pid=13639): Terminated: ok {rc=0}
05:50:24.542095 ---      ParallelTerminationStrategy: PID 13640 died...
05:50:24.595618 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13640): Terminated: ok {rc=0}
05:50:24.605546 ---      ParallelTerminationStrategy: PID 13641 died...
05:50:24.658863 run   osmo-mgw_10.42.42.3(pid=13641): Terminated {rc=15}
05:50:24.668834 ---      ParallelTerminationStrategy: PID 13642 died...
05:50:24.722106 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13642): Terminated: ok {rc=0}
05:50:24.732139 ---      ParallelTerminationStrategy: PID 13643 died...
05:50:24.785873 run   osmo-mgw_10.42.42.4(pid=13643): Terminated {rc=15}
05:50:24.795759 ---      ParallelTerminationStrategy: PID 13644 died...
05:50:24.849074 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13644): Terminated: ok {rc=0}
05:50:24.858888 ---      ParallelTerminationStrategy: PID 13645 died...
05:50:24.912075 run   osmo-bsc_10.42.42.7(pid=13645): Terminated: ok {rc=0}
05:50:24.921663 ---      ParallelTerminationStrategy: PID 13657 died...
05:50:24.975154 run        osmo-bts-sysmo(pid=13657): Terminated: ok {rc=0}
05:50:25.083960 bus                        /sierra_2: Setting Online False
05:50:26.168010 bus                        /sierra_2: Setting Powered False
05:50:31.965390 bus                        /sierra_2: Setting Powered False
05:50:33.068191 bus                        /sierra_2: Setting Powered False
05:50:34.198762 bus                        /sierra_1: Setting Online False
05:50:35.282536 bus                        /sierra_1: Setting Powered False
05:50:40.967916 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call.py", line 8, in <module>
    test_mo_mt_call(False, False)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f602df2a488>, timeout=10, timestep=1} [trial-800↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]