Skip to content

Failed

voice:sysmo+mod-bts0-dynts-osmo.mo_mt_call.py (from voice_sysmo+mod-bts0-dynts-osmo)

Failing for the past 61 builds (Since #751 )
Took 1 min 5 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f82f229d0d0>, timeout=10, timestep=1} [trial-811↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-811 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py
----------------------------------------------
17:31:41.063719 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
17:31:41.075003 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1)
17:31:41.231896 tst                    mo_mt_call.py: using LAC 7884
17:31:41.358752 tst                    mo_mt_call.py: using RAC 234
17:31:41.485332 tst                    mo_mt_call.py: using CellId 7884
17:31:41.612469 tst                    mo_mt_call.py: using BVCI 7880
17:31:41.637734 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
17:31:41.648989 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
17:31:41.660019 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
17:31:41.671133 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
17:31:41.682193 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
17:31:41.693275 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
17:31:41.793771 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
17:31:41.985698 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
17:31:42.486968 run         create_hlr_db(pid=11633): Launched
17:31:42.677957 bus                        /sierra_1: Setting Powered False
17:31:43.698618 run         create_hlr_db(pid=11633): Terminated: ok {rc=0}
17:31:44.112769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11635): Launched
17:31:44.423531 run   osmo-hlr_10.42.42.2(pid=11636): Launched
17:31:44.538033 run              osmo-stp_10.42.42.5: Starting osmo-stp
17:31:45.071110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11637): Launched
17:31:45.379715 run   osmo-stp_10.42.42.5(pid=11638): Launched
17:31:45.489272 run              osmo-msc_10.42.42.6: Starting osmo-msc
17:31:46.054212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11639): Launched
17:31:46.365536 run   osmo-msc_10.42.42.6(pid=11640): Launched
17:31:49.531846 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
17:31:50.068972 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11641): Launched
17:31:50.379533 run   osmo-mgw_10.42.42.3(pid=11642): Launched
17:31:50.489219 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
17:31:51.013499 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11643): Launched
17:31:51.322229 run   osmo-mgw_10.42.42.4(pid=11644): Launched
17:31:51.431885 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
17:31:52.079129 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11645): Launched
17:31:52.393681 run   osmo-bsc_10.42.42.7(pid=11646): Launched
17:31:58.659410 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
17:31:59.214790 run         rm-remote-dir(pid=11647): Launched
17:32:01.406773 run         rm-remote-dir(pid=11647): Terminated: ok {rc=0}
17:32:01.739365 run         mk-remote-dir(pid=11648): Launched
17:32:03.930678 run         mk-remote-dir(pid=11648): Terminated: ok {rc=0}
17:32:04.213823 run    scp-inst-to-remote(pid=11649): Launched
17:32:16.430214 run    scp-inst-to-remote(pid=11649): Terminated: ok {rc=0}
17:32:16.780527 run         mk-remote-dir(pid=11654): Launched
17:32:18.981995 run         mk-remote-dir(pid=11654): Terminated: ok {rc=0}
17:32:19.281239 run     scp-cfg-to-remote(pid=11655): Launched
17:32:21.483295 run     scp-cfg-to-remote(pid=11655): Terminated: ok {rc=0}
17:32:21.828284 run   reload-dsp-firmware(pid=11657): Launched
17:32:25.027739 run   reload-dsp-firmware(pid=11657): Terminated: ok {rc=0}
17:32:25.363314 run        osmo-bts-sysmo(pid=11658): Launched
17:32:29.608184 tst                    mo_mt_call.py: using MSISDN 5111
17:32:29.779102 bus                        /sierra_1: Setting Powered True
17:32:33.275085 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5111', subscriber_id=1}
17:32:33.412543 tst                    mo_mt_call.py: using MSISDN 5112
17:32:33.583058 bus                        /sierra_2: Setting Powered True
17:32:45.922779 tst                  mo_mt_call.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f82f229d0d0&gt;, timeout=10, timestep=1} [trial-811↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]  [trial-811↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8]
17:32:45.930996 tst                  mo_mt_call.py:8: Test FAILED (64.9 sec)
17:32:45.966864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11635): Terminating (SIGTERM)
17:32:46.008425 run   osmo-hlr_10.42.42.2(pid=11636): Terminating (SIGTERM)
17:32:46.051811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11637): Terminating (SIGTERM)
17:32:46.095352 run   osmo-stp_10.42.42.5(pid=11638): Terminating (SIGTERM)
17:32:46.157289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11639): Terminating (SIGTERM)
17:32:46.208509 run   osmo-msc_10.42.42.6(pid=11640): Terminating (SIGTERM)
17:32:46.252584 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11641): Terminating (SIGTERM)
17:32:46.296550 run   osmo-mgw_10.42.42.3(pid=11642): Terminating (SIGTERM)
17:32:46.355099 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11643): Terminating (SIGTERM)
17:32:46.398163 run   osmo-mgw_10.42.42.4(pid=11644): Terminating (SIGTERM)
17:32:46.439969 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11645): Terminating (SIGTERM)
17:32:46.480350 run   osmo-bsc_10.42.42.7(pid=11646): Terminating (SIGTERM)
17:32:46.521104 run        osmo-bts-sysmo(pid=11658): Terminating (SIGTERM)
17:32:46.530727 ---      ParallelTerminationStrategy: PID 11635 died...
17:32:46.584588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11635): Terminated: ok {rc=0}
17:32:46.594524 ---      ParallelTerminationStrategy: PID 11636 died...
17:32:46.650500 run   osmo-hlr_10.42.42.2(pid=11636): Terminated: ok {rc=0}
17:32:46.661680 ---      ParallelTerminationStrategy: PID 11637 died...
17:32:46.718567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11637): Terminated: ok {rc=0}
17:32:46.729420 ---      ParallelTerminationStrategy: PID 11638 died...
17:32:46.784315 run   osmo-stp_10.42.42.5(pid=11638): Terminated: ok {rc=0}
17:32:46.794142 ---      ParallelTerminationStrategy: PID 11639 died...
17:32:46.848265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11639): Terminated: ok {rc=0}
17:32:46.858033 ---      ParallelTerminationStrategy: PID 11640 died...
17:32:46.912090 run   osmo-msc_10.42.42.6(pid=11640): Terminated: ok {rc=0}
17:32:46.922065 ---      ParallelTerminationStrategy: PID 11641 died...
17:32:46.976335 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11641): Terminated: ok {rc=0}
17:32:46.986054 ---      ParallelTerminationStrategy: PID 11642 died...
17:32:47.039438 run   osmo-mgw_10.42.42.3(pid=11642): Terminated {rc=15}
17:32:47.049323 ---      ParallelTerminationStrategy: PID 11643 died...
17:32:47.103318 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11643): Terminated: ok {rc=0}
17:32:47.112987 ---      ParallelTerminationStrategy: PID 11644 died...
17:32:47.166604 run   osmo-mgw_10.42.42.4(pid=11644): Terminated {rc=15}
17:32:47.176508 ---      ParallelTerminationStrategy: PID 11645 died...
17:32:47.230298 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11645): Terminated: ok {rc=0}
17:32:47.240289 ---      ParallelTerminationStrategy: PID 11646 died...
17:32:47.294174 run   osmo-bsc_10.42.42.7(pid=11646): Terminated: ok {rc=0}
17:32:47.303823 ---      ParallelTerminationStrategy: PID 11658 died...
17:32:47.357538 run        osmo-bts-sysmo(pid=11658): Terminated: ok {rc=0}
17:32:47.465932 bus                        /sierra_2: Setting Online False
17:32:48.549834 bus                        /sierra_2: Setting Powered False
17:32:53.968689 bus                        /sierra_2: Setting Powered False
17:32:55.070902 bus                        /sierra_2: Setting Powered False
17:32:56.203951 bus                        /sierra_1: Setting Online False
17:32:57.289537 bus                        /sierra_1: Setting Powered False
17:33:02.965240 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call.py", line 8, in <module>
    test_mo_mt_call(False, False)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f82f229d0d0>, timeout=10, timestep=1} [trial-811↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]