Skip to content

Failed

voice:sysmo+mod-bts0-dynts-osmo.mo_mt_call.py (from voice_sysmo+mod-bts0-dynts-osmo)

Failing for the past 60 builds (Since #751 )
Took 1 min 6 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fbb3460e730>, timeout=10, timestep=1} [trial-810↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-810 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py
----------------------------------------------
15:58:45.072305 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
15:58:45.083410 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1)
15:58:45.231843 tst                    mo_mt_call.py: using LAC 7804
15:58:45.356726 tst                    mo_mt_call.py: using RAC 154
15:58:45.481276 tst                    mo_mt_call.py: using CellId 7804
15:58:45.606456 tst                    mo_mt_call.py: using BVCI 7800
15:58:45.630460 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
15:58:45.641401 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
15:58:45.652077 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
15:58:45.663181 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
15:58:45.674312 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
15:58:45.686008 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
15:58:45.787106 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
15:58:45.978095 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
15:58:46.473117 run          create_hlr_db(pid=7084): Launched
15:58:46.654436 bus                        /sierra_1: Setting Powered False
15:58:47.678062 run          create_hlr_db(pid=7084): Terminated: ok {rc=0}
15:58:48.125876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7086): Launched
15:58:48.460734 run    osmo-hlr_10.42.42.2(pid=7087): Launched
15:58:48.582820 run              osmo-stp_10.42.42.5: Starting osmo-stp
15:58:49.162890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7088): Launched
15:58:49.499173 run    osmo-stp_10.42.42.5(pid=7089): Launched
15:58:49.618274 run              osmo-msc_10.42.42.6: Starting osmo-msc
15:58:50.230167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7091): Launched
15:58:50.566951 run    osmo-msc_10.42.42.6(pid=7092): Launched
15:58:53.746400 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
15:58:54.329037 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=7093): Launched
15:58:54.663405 run    osmo-mgw_10.42.42.3(pid=7094): Launched
15:58:54.782150 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
15:58:55.352773 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7095): Launched
15:58:55.675981 run    osmo-mgw_10.42.42.4(pid=7096): Launched
15:58:55.789440 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
15:58:56.449397 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=7097): Launched
15:58:56.767517 run    osmo-bsc_10.42.42.7(pid=7098): Launched
15:59:03.038445 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
15:59:03.604541 run          rm-remote-dir(pid=7099): Launched
15:59:05.800611 run          rm-remote-dir(pid=7099): Terminated: ok {rc=0}
15:59:06.140691 run          mk-remote-dir(pid=7100): Launched
15:59:08.333983 run          mk-remote-dir(pid=7100): Terminated: ok {rc=0}
15:59:08.619291 run     scp-inst-to-remote(pid=7101): Launched
15:59:20.839147 run     scp-inst-to-remote(pid=7101): Terminated: ok {rc=0}
15:59:21.194613 run          mk-remote-dir(pid=7103): Launched
15:59:23.397398 run          mk-remote-dir(pid=7103): Terminated: ok {rc=0}
15:59:23.699242 run      scp-cfg-to-remote(pid=7104): Launched
15:59:25.902324 run      scp-cfg-to-remote(pid=7104): Terminated: ok {rc=0}
15:59:26.254593 run    reload-dsp-firmware(pid=7106): Launched
15:59:29.456806 run    reload-dsp-firmware(pid=7106): Terminated: ok {rc=0}
15:59:29.796607 run         osmo-bts-sysmo(pid=7107): Launched
15:59:34.058609 tst                    mo_mt_call.py: using MSISDN 5058
15:59:34.244587 bus                        /sierra_1: Setting Powered True
15:59:37.730685 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5058', subscriber_id=1}
15:59:37.869403 tst                    mo_mt_call.py: using MSISDN 5059
15:59:38.042691 bus                        /sierra_2: Setting Powered True
15:59:50.407059 tst                  mo_mt_call.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fbb3460e730&gt;, timeout=10, timestep=1} [trial-810↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]  [trial-810↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8]
15:59:50.414328 tst                  mo_mt_call.py:8: Test FAILED (65.4 sec)
15:59:50.449638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7086): Terminating (SIGTERM)
15:59:50.490634 run    osmo-hlr_10.42.42.2(pid=7087): Terminating (SIGTERM)
15:59:50.533422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7088): Terminating (SIGTERM)
15:59:50.578334 run    osmo-stp_10.42.42.5(pid=7089): Terminating (SIGTERM)
15:59:50.622970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7091): Terminating (SIGTERM)
15:59:50.667906 run    osmo-msc_10.42.42.6(pid=7092): Terminating (SIGTERM)
15:59:50.714472 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=7093): Terminating (SIGTERM)
15:59:50.757120 run    osmo-mgw_10.42.42.3(pid=7094): Terminating (SIGTERM)
15:59:50.833772 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7095): Terminating (SIGTERM)
15:59:50.887683 run    osmo-mgw_10.42.42.4(pid=7096): Terminating (SIGTERM)
15:59:50.931398 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=7097): Terminating (SIGTERM)
15:59:50.975519 run    osmo-bsc_10.42.42.7(pid=7098): Terminating (SIGTERM)
15:59:51.019050 run         osmo-bts-sysmo(pid=7107): Terminating (SIGTERM)
15:59:51.029077 ---      ParallelTerminationStrategy: PID 7086 died...
15:59:51.087701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7086): Terminated: ok {rc=0}
15:59:51.098107 ---      ParallelTerminationStrategy: PID 7087 died...
15:59:51.157264 run    osmo-hlr_10.42.42.2(pid=7087): Terminated: ok {rc=0}
15:59:51.167949 ---      ParallelTerminationStrategy: PID 7088 died...
15:59:51.230549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7088): Terminated: ok {rc=0}
15:59:51.241398 ---      ParallelTerminationStrategy: PID 7089 died...
15:59:51.300081 run    osmo-stp_10.42.42.5(pid=7089): Terminated: ok {rc=0}
15:59:51.310794 ---      ParallelTerminationStrategy: PID 7091 died...
15:59:51.370290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7091): Terminated: ok {rc=0}
15:59:51.380713 ---      ParallelTerminationStrategy: PID 7092 died...
15:59:51.438173 run    osmo-msc_10.42.42.6(pid=7092): Terminated: ok {rc=0}
15:59:51.448457 ---      ParallelTerminationStrategy: PID 7093 died...
15:59:51.505714 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=7093): Terminated: ok {rc=0}
15:59:51.516023 ---      ParallelTerminationStrategy: PID 7094 died...
15:59:51.573046 run    osmo-mgw_10.42.42.3(pid=7094): Terminated {rc=15}
15:59:51.583417 ---      ParallelTerminationStrategy: PID 7095 died...
15:59:51.640463 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7095): Terminated: ok {rc=0}
15:59:51.650824 ---      ParallelTerminationStrategy: PID 7096 died...
15:59:51.707685 run    osmo-mgw_10.42.42.4(pid=7096): Terminated {rc=15}
15:59:51.717926 ---      ParallelTerminationStrategy: PID 7097 died...
15:59:51.774985 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=7097): Terminated: ok {rc=0}
15:59:51.785458 ---      ParallelTerminationStrategy: PID 7098 died...
15:59:51.842575 run    osmo-bsc_10.42.42.7(pid=7098): Terminated: ok {rc=0}
15:59:51.852761 ---      ParallelTerminationStrategy: PID 7107 died...
15:59:51.909937 run         osmo-bts-sysmo(pid=7107): Terminated: ok {rc=0}
15:59:52.019179 bus                        /sierra_2: Setting Online False
15:59:53.103265 bus                        /sierra_2: Setting Powered False
15:59:58.963511 bus                        /sierra_2: Setting Powered False
16:00:00.071490 bus                        /sierra_2: Setting Powered False
16:00:01.200416 bus                        /sierra_1: Setting Online False
16:00:02.287816 bus                        /sierra_1: Setting Powered False
16:00:07.962043 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call.py", line 8, in <module>
    test_mo_mt_call(False, False)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fbb3460e730>, timeout=10, timestep=1} [trial-810↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]