Skip to content

Failed

voice:sysmo+mod-bts0-dynts-osmo.mo_mt_call.py (from voice_sysmo+mod-bts0-dynts-osmo)

Failing for the past 92 builds (Since #751 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f1918aee0d0>, timeout=10, timestep=1} [trial-842↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-842 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py
----------------------------------------------
07:50:44.056428 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:50:44.067472 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1)
07:50:44.218941 tst                    mo_mt_call.py: using LAC 10364
07:50:44.349806 tst                    mo_mt_call.py: using RAC 164
07:50:44.481219 tst                    mo_mt_call.py: using CellId 10364
07:50:44.606542 tst                    mo_mt_call.py: using BVCI 10360
07:50:44.631277 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:50:44.642805 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:50:44.654084 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:50:44.665312 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:50:44.676521 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:50:44.687694 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
07:50:44.787916 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
07:50:44.980553 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
07:50:45.495700 run         create_hlr_db(pid=31771): Launched
07:50:45.682941 bus                        /sierra_1: Setting Powered False
07:50:46.704351 run         create_hlr_db(pid=31771): Terminated: ok {rc=0}
07:50:47.114425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31773): Launched
07:50:47.419217 run   osmo-hlr_10.42.42.2(pid=31774): Launched
07:50:47.533108 run              osmo-stp_10.42.42.5: Starting osmo-stp
07:50:48.061695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31775): Launched
07:50:48.365752 run   osmo-stp_10.42.42.5(pid=31776): Launched
07:50:48.473524 run              osmo-msc_10.42.42.6: Starting osmo-msc
07:50:49.029765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31777): Launched
07:50:49.337373 run   osmo-msc_10.42.42.6(pid=31778): Launched
07:50:52.501634 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
07:50:53.031636 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31780): Launched
07:50:53.338485 run   osmo-mgw_10.42.42.3(pid=31781): Launched
07:50:53.450520 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
07:50:53.971867 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31782): Launched
07:50:54.277865 run   osmo-mgw_10.42.42.4(pid=31783): Launched
07:50:54.386859 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
07:50:55.027920 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31784): Launched
07:50:55.335847 run   osmo-bsc_10.42.42.7(pid=31785): Launched
07:51:01.597329 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
07:51:02.145323 run         rm-remote-dir(pid=31786): Launched
07:51:04.336663 run         rm-remote-dir(pid=31786): Terminated: ok {rc=0}
07:51:04.668647 run         mk-remote-dir(pid=31787): Launched
07:51:06.858123 run         mk-remote-dir(pid=31787): Terminated: ok {rc=0}
07:51:07.135093 run    scp-inst-to-remote(pid=31788): Launched
07:51:21.352068 run    scp-inst-to-remote(pid=31788): Terminated: ok {rc=0}
07:51:21.697262 run         mk-remote-dir(pid=31790): Launched
07:51:23.896645 run         mk-remote-dir(pid=31790): Terminated: ok {rc=0}
07:51:24.191960 run     scp-cfg-to-remote(pid=31791): Launched
07:51:27.392439 run     scp-cfg-to-remote(pid=31791): Terminated: ok {rc=0}
07:51:27.733285 run   reload-dsp-firmware(pid=31793): Launched
07:51:30.930985 run   reload-dsp-firmware(pid=31793): Terminated: ok {rc=0}
07:51:31.263131 run        osmo-bts-sysmo(pid=31794): Launched
07:51:37.506060 tst                    mo_mt_call.py: using MSISDN 6754
07:51:37.684565 bus                        /sierra_1: Setting Powered True
07:51:41.175218 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6754', subscriber_id=1}
07:51:41.316252 tst                    mo_mt_call.py: using MSISDN 6755
07:51:41.488643 bus                        /sierra_2: Setting Powered True
07:51:53.867284 tst                  mo_mt_call.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f1918aee0d0&gt;, timeout=10, timestep=1} [trial-842↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]  [trial-842↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8]
07:51:53.875201 tst                  mo_mt_call.py:8: Test FAILED (69.9 sec)
07:51:53.910829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31773): Terminating (SIGTERM)
07:51:53.952005 run   osmo-hlr_10.42.42.2(pid=31774): Terminating (SIGTERM)
07:51:53.994807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31775): Terminating (SIGTERM)
07:51:54.043081 run   osmo-stp_10.42.42.5(pid=31776): Terminating (SIGTERM)
07:51:54.109433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31777): Terminating (SIGTERM)
07:51:54.155924 run   osmo-msc_10.42.42.6(pid=31778): Terminating (SIGTERM)
07:51:54.198991 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31780): Terminating (SIGTERM)
07:51:54.244560 run   osmo-mgw_10.42.42.3(pid=31781): Terminating (SIGTERM)
07:51:54.287821 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31782): Terminating (SIGTERM)
07:51:54.331950 run   osmo-mgw_10.42.42.4(pid=31783): Terminating (SIGTERM)
07:51:54.374986 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31784): Terminating (SIGTERM)
07:51:54.419051 run   osmo-bsc_10.42.42.7(pid=31785): Terminating (SIGTERM)
07:51:54.461030 run        osmo-bts-sysmo(pid=31794): Terminating (SIGTERM)
07:51:54.470595 ---      ParallelTerminationStrategy: PID 31773 died...
07:51:54.527682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31773): Terminated: ok {rc=0}
07:51:54.538507 ---      ParallelTerminationStrategy: PID 31774 died...
07:51:54.594955 run   osmo-hlr_10.42.42.2(pid=31774): Terminated: ok {rc=0}
07:51:54.605884 ---      ParallelTerminationStrategy: PID 31775 died...
07:51:54.662058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31775): Terminated: ok {rc=0}
07:51:54.672412 ---      ParallelTerminationStrategy: PID 31776 died...
07:51:54.728485 run   osmo-stp_10.42.42.5(pid=31776): Terminated: ok {rc=0}
07:51:54.739030 ---      ParallelTerminationStrategy: PID 31777 died...
07:51:54.794558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31777): Terminated: ok {rc=0}
07:51:54.804586 ---      ParallelTerminationStrategy: PID 31778 died...
07:51:54.859747 run   osmo-msc_10.42.42.6(pid=31778): Terminated: ok {rc=0}
07:51:54.869782 ---      ParallelTerminationStrategy: PID 31780 died...
07:51:54.924794 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31780): Terminated: ok {rc=0}
07:51:54.934806 ---      ParallelTerminationStrategy: PID 31781 died...
07:51:54.989494 run   osmo-mgw_10.42.42.3(pid=31781): Terminated {rc=15}
07:51:54.999353 ---      ParallelTerminationStrategy: PID 31782 died...
07:51:55.055937 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31782): Terminated: ok {rc=0}
07:51:55.068616 ---      ParallelTerminationStrategy: PID 31783 died...
07:51:55.122181 run   osmo-mgw_10.42.42.4(pid=31783): Terminated {rc=15}
07:51:55.132534 ---      ParallelTerminationStrategy: PID 31784 died...
07:51:55.186690 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31784): Terminated: ok {rc=0}
07:51:55.196593 ---      ParallelTerminationStrategy: PID 31785 died...
07:51:55.251030 run   osmo-bsc_10.42.42.7(pid=31785): Terminated: ok {rc=0}
07:51:55.260618 ---      ParallelTerminationStrategy: PID 31794 died...
07:51:55.315279 run        osmo-bts-sysmo(pid=31794): Terminated: ok {rc=0}
07:51:55.422090 bus                        /sierra_2: Setting Online False
07:51:56.506677 bus                        /sierra_2: Setting Powered False
07:52:01.958587 bus                        /sierra_2: Setting Powered False
07:52:03.063714 bus                        /sierra_2: Setting Powered False
07:52:04.193865 bus                        /sierra_1: Setting Online False
07:52:05.281337 bus                        /sierra_1: Setting Powered False
07:52:10.957760 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call.py", line 8, in <module>
    test_mo_mt_call(False, False)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f1918aee0d0>, timeout=10, timestep=1} [trial-842↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]