Skip to content

Failed

voice:sysmo+mod-bts0-dynts-osmo.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-dynts-osmo)

Failing for the past 87 builds (Since #751 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f112fea4e18>, timeout=10, timestep=1} [trial-837↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-837 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py
----------------------------------------------
01:34:33.132068 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
01:34:33.144061 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1)
01:34:33.307246 tst              mo_mt_call_osmux.py: using LAC 9965
01:34:33.434376 tst              mo_mt_call_osmux.py: using RAC 20
01:34:33.561328 tst              mo_mt_call_osmux.py: using CellId 9965
01:34:33.692713 tst              mo_mt_call_osmux.py: using BVCI 9961
01:34:33.717518 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
01:34:33.728888 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
01:34:33.739972 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
01:34:33.751121 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
01:34:33.762235 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
01:34:33.773375 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
01:34:33.875241 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
01:34:34.070664 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
01:34:34.592304 run         create_hlr_db(pid=19755): Launched
01:34:34.780675 bus                        /sierra_1: Setting Powered False
01:34:35.802683 run         create_hlr_db(pid=19755): Terminated: ok {rc=0}
01:34:36.237541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19757): Launched
01:34:36.564436 run   osmo-hlr_10.42.42.2(pid=19758): Launched
01:34:36.682451 run              osmo-stp_10.42.42.5: Starting osmo-stp
01:34:37.246016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19759): Launched
01:34:37.572150 run   osmo-stp_10.42.42.5(pid=19760): Launched
01:34:37.688762 run              osmo-msc_10.42.42.6: Starting osmo-msc
01:34:38.280295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19761): Launched
01:34:38.607837 run   osmo-msc_10.42.42.6(pid=19762): Launched
01:34:41.783343 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
01:34:42.349606 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19763): Launched
01:34:42.676134 run   osmo-mgw_10.42.42.3(pid=19764): Launched
01:34:42.793363 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
01:34:43.348484 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19765): Launched
01:34:43.676281 run   osmo-mgw_10.42.42.4(pid=19766): Launched
01:34:43.792991 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
01:34:44.471596 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19767): Launched
01:34:44.799344 run   osmo-bsc_10.42.42.7(pid=19768): Launched
01:34:51.077322 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
01:34:51.660855 run         rm-remote-dir(pid=19769): Launched
01:34:53.854511 run         rm-remote-dir(pid=19769): Terminated: ok {rc=0}
01:34:54.182573 run         mk-remote-dir(pid=19770): Launched
01:34:56.372463 run         mk-remote-dir(pid=19770): Terminated: ok {rc=0}
01:34:56.649797 run    scp-inst-to-remote(pid=19771): Launched
01:35:10.866976 run    scp-inst-to-remote(pid=19771): Terminated: ok {rc=0}
01:35:11.210629 run         mk-remote-dir(pid=19776): Launched
01:35:13.410280 run         mk-remote-dir(pid=19776): Terminated: ok {rc=0}
01:35:13.703444 run     scp-cfg-to-remote(pid=19777): Launched
01:35:16.902912 run     scp-cfg-to-remote(pid=19777): Terminated: ok {rc=0}
01:35:17.241111 run   reload-dsp-firmware(pid=19779): Launched
01:35:20.439257 run   reload-dsp-firmware(pid=19779): Terminated: ok {rc=0}
01:35:20.770439 run        osmo-bts-sysmo(pid=19780): Launched
01:35:26.005317 tst              mo_mt_call_osmux.py: using MSISDN 6491
01:35:26.183787 bus                        /sierra_1: Setting Powered True
01:35:29.658854 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6491', subscriber_id=1}
01:35:29.798981 tst              mo_mt_call_osmux.py: using MSISDN 6492
01:35:29.967256 bus                        /sierra_2: Setting Powered True
01:35:42.328899 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f112fea4e18&gt;, timeout=10, timestep=1} [trial-837↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-837↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8]
01:35:42.336309 tst            mo_mt_call_osmux.py:8: Test FAILED (69.2 sec)
01:35:42.370288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19757): Terminating (SIGTERM)
01:35:42.409137 run   osmo-hlr_10.42.42.2(pid=19758): Terminating (SIGTERM)
01:35:42.449489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19759): Terminating (SIGTERM)
01:35:42.490147 run   osmo-stp_10.42.42.5(pid=19760): Terminating (SIGTERM)
01:35:42.542280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19761): Terminating (SIGTERM)
01:35:42.585118 run   osmo-msc_10.42.42.6(pid=19762): Terminating (SIGTERM)
01:35:42.628499 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19763): Terminating (SIGTERM)
01:35:42.670359 run   osmo-mgw_10.42.42.3(pid=19764): Terminating (SIGTERM)
01:35:42.714665 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19765): Terminating (SIGTERM)
01:35:42.757928 run   osmo-mgw_10.42.42.4(pid=19766): Terminating (SIGTERM)
01:35:42.800542 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19767): Terminating (SIGTERM)
01:35:42.844004 run   osmo-bsc_10.42.42.7(pid=19768): Terminating (SIGTERM)
01:35:42.888250 run        osmo-bts-sysmo(pid=19780): Terminating (SIGTERM)
01:35:42.899065 ---      ParallelTerminationStrategy: PID 19757 died...
01:35:42.974807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19757): Terminated: ok {rc=0}
01:35:42.985280 ---      ParallelTerminationStrategy: PID 19758 died...
01:35:43.046022 run   osmo-hlr_10.42.42.2(pid=19758): Terminated: ok {rc=0}
01:35:43.056419 ---      ParallelTerminationStrategy: PID 19759 died...
01:35:43.114757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19759): Terminated: ok {rc=0}
01:35:43.125313 ---      ParallelTerminationStrategy: PID 19760 died...
01:35:43.182229 run   osmo-stp_10.42.42.5(pid=19760): Terminated: ok {rc=0}
01:35:43.192479 ---      ParallelTerminationStrategy: PID 19761 died...
01:35:43.248487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19761): Terminated: ok {rc=0}
01:35:43.259310 ---      ParallelTerminationStrategy: PID 19762 died...
01:35:43.316169 run   osmo-msc_10.42.42.6(pid=19762): Terminated: ok {rc=0}
01:35:43.326475 ---      ParallelTerminationStrategy: PID 19763 died...
01:35:43.382264 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19763): Terminated: ok {rc=0}
01:35:43.392155 ---      ParallelTerminationStrategy: PID 19764 died...
01:35:43.447376 run   osmo-mgw_10.42.42.3(pid=19764): Terminated {rc=15}
01:35:43.457435 ---      ParallelTerminationStrategy: PID 19765 died...
01:35:43.513408 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19765): Terminated: ok {rc=0}
01:35:43.523628 ---      ParallelTerminationStrategy: PID 19766 died...
01:35:43.579487 run   osmo-mgw_10.42.42.4(pid=19766): Terminated {rc=15}
01:35:43.589729 ---      ParallelTerminationStrategy: PID 19767 died...
01:35:43.645032 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19767): Terminated: ok {rc=0}
01:35:43.655376 ---      ParallelTerminationStrategy: PID 19768 died...
01:35:43.711087 run   osmo-bsc_10.42.42.7(pid=19768): Terminated: ok {rc=0}
01:35:43.721032 ---      ParallelTerminationStrategy: PID 19780 died...
01:35:43.776384 run        osmo-bts-sysmo(pid=19780): Terminated: ok {rc=0}
01:35:43.881882 bus                        /sierra_2: Setting Online False
01:35:44.967281 bus                        /sierra_2: Setting Powered False
01:35:50.964107 bus                        /sierra_2: Setting Powered False
01:35:52.068840 bus                        /sierra_2: Setting Powered False
01:35:53.195087 bus                        /sierra_1: Setting Online False
01:35:54.281597 bus                        /sierra_1: Setting Powered False
01:35:59.970997 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f112fea4e18>, timeout=10, timestep=1} [trial-837↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]