Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 73 builds (Since #751 )
Took 1 min 8 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fc0b42f5620>, timeout=10, timestep=1} [trial-823↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-823 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
08:51:00.013277 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
08:51:00.024280 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
08:51:00.154840 tst          emergency_mo_mt_call.py: using LAC 8846
08:51:00.278879 tst          emergency_mo_mt_call.py: using RAC 176
08:51:00.400437 tst          emergency_mo_mt_call.py: using CellId 8846
08:51:00.520662 tst          emergency_mo_mt_call.py: using BVCI 8842
08:51:00.543827 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
08:51:00.554601 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
08:51:00.565064 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
08:51:00.575709 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
08:51:00.586790 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
08:51:00.597414 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
08:51:00.696683 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
08:51:00.881112 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
08:51:01.362301 run         create_hlr_db(pid=14301): Launched
08:51:01.538707 bus                        /sierra_1: Setting Powered False
08:51:02.570830 run         create_hlr_db(pid=14301): Terminated: ok {rc=0}
08:51:03.005231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14303): Launched
08:51:03.332099 run   osmo-hlr_10.42.42.2(pid=14304): Launched
08:51:03.449624 run              osmo-stp_10.42.42.5: Starting osmo-stp
08:51:04.014170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14305): Launched
08:51:04.341566 run   osmo-stp_10.42.42.5(pid=14306): Launched
08:51:04.470844 tst          emergency_mo_mt_call.py: using MSISDN 5751
08:51:04.631594 run              osmo-msc_10.42.42.6: Starting osmo-msc
08:51:05.225708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14307): Launched
08:51:05.553766 run   osmo-msc_10.42.42.6(pid=14308): Launched
08:51:08.727157 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
08:51:09.291724 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14309): Launched
08:51:09.619650 run   osmo-mgw_10.42.42.3(pid=14310): Launched
08:51:09.735407 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
08:51:10.289576 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14311): Launched
08:51:10.616847 run   osmo-mgw_10.42.42.4(pid=14312): Launched
08:51:10.732823 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
08:51:11.413967 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14313): Launched
08:51:11.742571 run   osmo-bsc_10.42.42.7(pid=14314): Launched
08:51:18.006536 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
08:51:18.554906 run         rm-remote-dir(pid=14315): Launched
08:51:20.747017 run         rm-remote-dir(pid=14315): Terminated: ok {rc=0}
08:51:21.079051 run         mk-remote-dir(pid=14316): Launched
08:51:23.269376 run         mk-remote-dir(pid=14316): Terminated: ok {rc=0}
08:51:23.548840 run    scp-inst-to-remote(pid=14317): Launched
08:51:36.765366 run    scp-inst-to-remote(pid=14317): Terminated: ok {rc=0}
08:51:37.112651 run         mk-remote-dir(pid=14319): Launched
08:51:39.311067 run         mk-remote-dir(pid=14319): Terminated: ok {rc=0}
08:51:39.607361 run     scp-cfg-to-remote(pid=14320): Launched
08:51:41.807602 run     scp-cfg-to-remote(pid=14320): Terminated: ok {rc=0}
08:51:42.147772 run   reload-dsp-firmware(pid=14322): Launched
08:51:45.343805 run   reload-dsp-firmware(pid=14322): Terminated: ok {rc=0}
08:51:45.676787 run        osmo-bts-sysmo(pid=14323): Launched
08:51:50.926841 tst          emergency_mo_mt_call.py: using MSISDN 5752
08:51:51.106471 bus                        /sierra_1: Setting Powered True
08:51:54.606682 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5752', subscriber_id=1}
08:51:54.797113 bus                        /sierra_2: Setting Powered True
08:52:07.160247 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fc0b42f5620&gt;, timeout=10, timestep=1} [trial-823↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-823↪emergency:sysmo↪emergency_mo_mt_call.py:31]
08:52:07.167549 tst       emergency_mo_mt_call.py:31: Test FAILED (67.1 sec)
08:52:07.204231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14303): Terminating (SIGTERM)
08:52:07.249488 run   osmo-hlr_10.42.42.2(pid=14304): Terminating (SIGTERM)
08:52:07.291010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14305): Terminating (SIGTERM)
08:52:07.335978 run   osmo-stp_10.42.42.5(pid=14306): Terminating (SIGTERM)
08:52:07.387550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14307): Terminating (SIGTERM)
08:52:07.432030 run   osmo-msc_10.42.42.6(pid=14308): Terminating (SIGTERM)
08:52:07.480719 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14309): Terminating (SIGTERM)
08:52:07.524518 run   osmo-mgw_10.42.42.3(pid=14310): Terminating (SIGTERM)
08:52:07.576415 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14311): Terminating (SIGTERM)
08:52:07.622353 run   osmo-mgw_10.42.42.4(pid=14312): Terminating (SIGTERM)
08:52:07.675948 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14313): Terminating (SIGTERM)
08:52:07.716558 run   osmo-bsc_10.42.42.7(pid=14314): Terminating (SIGTERM)
08:52:07.758025 run        osmo-bts-sysmo(pid=14323): Terminating (SIGTERM)
08:52:07.768013 ---      ParallelTerminationStrategy: PID 14303 died...
08:52:07.823562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14303): Terminated: ok {rc=0}
08:52:07.833483 ---      ParallelTerminationStrategy: PID 14304 died...
08:52:07.889926 run   osmo-hlr_10.42.42.2(pid=14304): Terminated: ok {rc=0}
08:52:07.900212 ---      ParallelTerminationStrategy: PID 14305 died...
08:52:07.957095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14305): Terminated: ok {rc=0}
08:52:07.967431 ---      ParallelTerminationStrategy: PID 14306 died...
08:52:08.023056 run   osmo-stp_10.42.42.5(pid=14306): Terminated: ok {rc=0}
08:52:08.033762 ---      ParallelTerminationStrategy: PID 14307 died...
08:52:08.088217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14307): Terminated: ok {rc=0}
08:52:08.099267 ---      ParallelTerminationStrategy: PID 14308 died...
08:52:08.154670 run   osmo-msc_10.42.42.6(pid=14308): Terminated: ok {rc=0}
08:52:08.164543 ---      ParallelTerminationStrategy: PID 14309 died...
08:52:08.219154 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14309): Terminated: ok {rc=0}
08:52:08.228788 ---      ParallelTerminationStrategy: PID 14310 died...
08:52:08.283223 run   osmo-mgw_10.42.42.3(pid=14310): Terminated {rc=15}
08:52:08.293424 ---      ParallelTerminationStrategy: PID 14311 died...
08:52:08.347796 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14311): Terminated: ok {rc=0}
08:52:08.358187 ---      ParallelTerminationStrategy: PID 14312 died...
08:52:08.412383 run   osmo-mgw_10.42.42.4(pid=14312): Terminated {rc=15}
08:52:08.422515 ---      ParallelTerminationStrategy: PID 14313 died...
08:52:08.477038 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14313): Terminated: ok {rc=0}
08:52:08.486828 ---      ParallelTerminationStrategy: PID 14314 died...
08:52:08.541361 run   osmo-bsc_10.42.42.7(pid=14314): Terminated: ok {rc=0}
08:52:08.551261 ---      ParallelTerminationStrategy: PID 14323 died...
08:52:08.605719 run        osmo-bts-sysmo(pid=14323): Terminated: ok {rc=0}
08:52:08.715379 bus                        /sierra_2: Setting Online False
08:52:09.800042 bus                        /sierra_2: Setting Powered False
08:52:15.147067 bus                        /sierra_2: Setting Powered False
08:52:16.253941 bus                        /sierra_2: Setting Powered False
08:52:17.388166 bus                        /sierra_1: Setting Online False
08:52:18.474126 bus                        /sierra_1: Setting Powered False
08:52:23.958794 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fc0b42f5620>, timeout=10, timestep=1} [trial-823↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]