Skip to content

Failed

voice:sysmo+mod-bts0-dynts-osmo.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-dynts-osmo)

Failing for the past 81 builds (Since #751 )
Took 1 min 9 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fd81c66ad08>, timeout=10, timestep=1} [trial-831↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-831 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py
----------------------------------------------
18:53:31.123869 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
18:53:31.135577 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1)
18:53:31.286051 tst              mo_mt_call_osmux.py: using LAC 9485
18:53:31.407330 tst              mo_mt_call_osmux.py: using RAC 50
18:53:31.538862 tst              mo_mt_call_osmux.py: using CellId 9485
18:53:31.670113 tst              mo_mt_call_osmux.py: using BVCI 9481
18:53:31.695723 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
18:53:31.707510 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
18:53:31.719145 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
18:53:31.731372 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
18:53:31.743510 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
18:53:31.755490 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
18:53:31.857611 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
18:53:32.052862 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
18:53:32.544881 run          create_hlr_db(pid=5941): Launched
18:53:32.725454 bus                        /sierra_1: Setting Powered False
18:53:33.745888 run          create_hlr_db(pid=5941): Terminated: ok {rc=0}
18:53:34.190257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5943): Launched
18:53:34.529440 run    osmo-hlr_10.42.42.2(pid=5944): Launched
18:53:34.651172 run              osmo-stp_10.42.42.5: Starting osmo-stp
18:53:35.231926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5945): Launched
18:53:35.569986 run    osmo-stp_10.42.42.5(pid=5946): Launched
18:53:35.689074 run              osmo-msc_10.42.42.6: Starting osmo-msc
18:53:36.304225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5947): Launched
18:53:36.642232 run    osmo-msc_10.42.42.6(pid=5948): Launched
18:53:39.820743 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
18:53:40.401628 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5949): Launched
18:53:40.739321 run    osmo-mgw_10.42.42.3(pid=5950): Launched
18:53:40.858528 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
18:53:41.431799 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5951): Launched
18:53:41.772822 run    osmo-mgw_10.42.42.4(pid=5952): Launched
18:53:41.893646 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
18:53:42.593196 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5953): Launched
18:53:42.929220 run    osmo-bsc_10.42.42.7(pid=5954): Launched
18:53:49.213270 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
18:53:49.812591 run          rm-remote-dir(pid=5955): Launched
18:53:52.020043 run          rm-remote-dir(pid=5955): Terminated: ok {rc=0}
18:53:52.377669 run          mk-remote-dir(pid=5956): Launched
18:53:54.582072 run          mk-remote-dir(pid=5956): Terminated: ok {rc=0}
18:53:54.884423 run     scp-inst-to-remote(pid=5957): Launched
18:54:08.096175 run     scp-inst-to-remote(pid=5957): Terminated: ok {rc=0}
18:54:08.430203 run          mk-remote-dir(pid=5959): Launched
18:54:11.622059 run          mk-remote-dir(pid=5959): Terminated: ok {rc=0}
18:54:11.908127 run      scp-cfg-to-remote(pid=5960): Launched
18:54:14.100079 run      scp-cfg-to-remote(pid=5960): Terminated: ok {rc=0}
18:54:14.427423 run    reload-dsp-firmware(pid=5962): Launched
18:54:17.618314 run    reload-dsp-firmware(pid=5962): Terminated: ok {rc=0}
18:54:17.936399 run         osmo-bts-sysmo(pid=5963): Launched
18:54:23.179704 tst              mo_mt_call_osmux.py: using MSISDN 6173
18:54:23.353022 bus                        /sierra_1: Setting Powered True
18:54:26.841406 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6173', subscriber_id=1}
18:54:26.983811 tst              mo_mt_call_osmux.py: using MSISDN 6174
18:54:27.159366 bus                        /sierra_2: Setting Powered True
18:54:39.527839 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fd81c66ad08&gt;, timeout=10, timestep=1} [trial-831↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-831↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8]
18:54:39.535403 tst            mo_mt_call_osmux.py:8: Test FAILED (68.4 sec)
18:54:39.570275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5943): Terminating (SIGTERM)
18:54:39.610430 run    osmo-hlr_10.42.42.2(pid=5944): Terminating (SIGTERM)
18:54:39.654084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5945): Terminating (SIGTERM)
18:54:39.701291 run    osmo-stp_10.42.42.5(pid=5946): Terminating (SIGTERM)
18:54:39.753510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5947): Terminating (SIGTERM)
18:54:39.800885 run    osmo-msc_10.42.42.6(pid=5948): Terminating (SIGTERM)
18:54:39.845859 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5949): Terminating (SIGTERM)
18:54:39.891700 run    osmo-mgw_10.42.42.3(pid=5950): Terminating (SIGTERM)
18:54:39.949620 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5951): Terminating (SIGTERM)
18:54:39.993677 run    osmo-mgw_10.42.42.4(pid=5952): Terminating (SIGTERM)
18:54:40.035103 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5953): Terminating (SIGTERM)
18:54:40.075116 run    osmo-bsc_10.42.42.7(pid=5954): Terminating (SIGTERM)
18:54:40.115387 run         osmo-bts-sysmo(pid=5963): Terminating (SIGTERM)
18:54:40.124567 ---      ParallelTerminationStrategy: PID 5943 died...
18:54:40.178577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5943): Terminated: ok {rc=0}
18:54:40.188563 ---      ParallelTerminationStrategy: PID 5944 died...
18:54:40.243610 run    osmo-hlr_10.42.42.2(pid=5944): Terminated: ok {rc=0}
18:54:40.253639 ---      ParallelTerminationStrategy: PID 5945 died...
18:54:40.308641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5945): Terminated: ok {rc=0}
18:54:40.318724 ---      ParallelTerminationStrategy: PID 5946 died...
18:54:40.372442 run    osmo-stp_10.42.42.5(pid=5946): Terminated: ok {rc=0}
18:54:40.382272 ---      ParallelTerminationStrategy: PID 5947 died...
18:54:40.435846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5947): Terminated: ok {rc=0}
18:54:40.445803 ---      ParallelTerminationStrategy: PID 5948 died...
18:54:40.499193 run    osmo-msc_10.42.42.6(pid=5948): Terminated: ok {rc=0}
18:54:40.508806 ---      ParallelTerminationStrategy: PID 5949 died...
18:54:40.562098 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5949): Terminated: ok {rc=0}
18:54:40.571932 ---      ParallelTerminationStrategy: PID 5950 died...
18:54:40.625349 run    osmo-mgw_10.42.42.3(pid=5950): Terminated {rc=15}
18:54:40.634877 ---      ParallelTerminationStrategy: PID 5951 died...
18:54:40.688104 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5951): Terminated: ok {rc=0}
18:54:40.698052 ---      ParallelTerminationStrategy: PID 5952 died...
18:54:40.751856 run    osmo-mgw_10.42.42.4(pid=5952): Terminated {rc=15}
18:54:40.761618 ---      ParallelTerminationStrategy: PID 5953 died...
18:54:40.815925 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5953): Terminated: ok {rc=0}
18:54:40.825717 ---      ParallelTerminationStrategy: PID 5954 died...
18:54:40.878879 run    osmo-bsc_10.42.42.7(pid=5954): Terminated: ok {rc=0}
18:54:40.888640 ---      ParallelTerminationStrategy: PID 5963 died...
18:54:40.941809 run         osmo-bts-sysmo(pid=5963): Terminated: ok {rc=0}
18:54:41.051035 bus                        /sierra_2: Setting Online False
18:54:42.135039 bus                        /sierra_2: Setting Powered False
18:54:47.970791 bus                        /sierra_2: Setting Powered False
18:54:49.072699 bus                        /sierra_2: Setting Powered False
18:54:50.199698 bus                        /sierra_1: Setting Online False
18:54:51.286421 bus                        /sierra_1: Setting Powered False
18:54:56.970465 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fd81c66ad08>, timeout=10, timestep=1} [trial-831↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]