Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 88 builds (Since #751 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f428af11378>, timeout=10, timestep=1} [trial-838↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-838 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
02:36:20.983269 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
02:36:20.994528 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
02:36:21.128859 tst          emergency_mo_mt_call.py: using LAC 10046
02:36:21.250920 tst          emergency_mo_mt_call.py: using RAC 101
02:36:21.373791 tst          emergency_mo_mt_call.py: using CellId 10046
02:36:21.493993 tst          emergency_mo_mt_call.py: using BVCI 10042
02:36:21.517523 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
02:36:21.528185 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
02:36:21.538874 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
02:36:21.549678 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
02:36:21.560931 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
02:36:21.571687 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
02:36:21.671186 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
02:36:21.872038 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
02:36:22.397724 run         create_hlr_db(pid=22119): Launched
02:36:22.578528 bus                        /sierra_1: Setting Powered False
02:36:23.598771 run         create_hlr_db(pid=22119): Terminated: ok {rc=0}
02:36:24.018838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22121): Launched
02:36:24.350081 run   osmo-hlr_10.42.42.2(pid=22122): Launched
02:36:24.473963 run              osmo-stp_10.42.42.5: Starting osmo-stp
02:36:25.051105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22123): Launched
02:36:25.381357 run   osmo-stp_10.42.42.5(pid=22124): Launched
02:36:25.517500 tst          emergency_mo_mt_call.py: using MSISDN 6546
02:36:25.681574 run              osmo-msc_10.42.42.6: Starting osmo-msc
02:36:26.283285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22125): Launched
02:36:26.614349 run   osmo-msc_10.42.42.6(pid=22126): Launched
02:36:29.789423 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
02:36:30.361304 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22127): Launched
02:36:30.690344 run   osmo-mgw_10.42.42.3(pid=22128): Launched
02:36:30.807918 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
02:36:31.370837 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22129): Launched
02:36:31.701848 run   osmo-mgw_10.42.42.4(pid=22130): Launched
02:36:31.820298 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
02:36:32.506646 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22131): Launched
02:36:32.837853 run   osmo-bsc_10.42.42.7(pid=22132): Launched
02:36:39.115725 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
02:36:39.672305 run         rm-remote-dir(pid=22133): Launched
02:36:41.864012 run         rm-remote-dir(pid=22133): Terminated: ok {rc=0}
02:36:42.194789 run         mk-remote-dir(pid=22134): Launched
02:36:44.385981 run         mk-remote-dir(pid=22134): Terminated: ok {rc=0}
02:36:44.666071 run    scp-inst-to-remote(pid=22135): Launched
02:36:58.880408 run    scp-inst-to-remote(pid=22135): Terminated: ok {rc=0}
02:36:59.226692 run         mk-remote-dir(pid=22137): Launched
02:37:01.427028 run         mk-remote-dir(pid=22137): Terminated: ok {rc=0}
02:37:01.724816 run     scp-cfg-to-remote(pid=22138): Launched
02:37:04.927496 run     scp-cfg-to-remote(pid=22138): Terminated: ok {rc=0}
02:37:05.270141 run   reload-dsp-firmware(pid=22140): Launched
02:37:08.459794 run   reload-dsp-firmware(pid=22140): Terminated: ok {rc=0}
02:37:08.775756 run        osmo-bts-sysmo(pid=22141): Launched
02:37:14.024586 tst          emergency_mo_mt_call.py: using MSISDN 6547
02:37:14.197862 bus                        /sierra_1: Setting Powered True
02:37:17.692591 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6547', subscriber_id=1}
02:37:17.875886 bus                        /sierra_2: Setting Powered True
02:37:30.225512 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f428af11378&gt;, timeout=10, timestep=1} [trial-838↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-838↪emergency:sysmo↪emergency_mo_mt_call.py:31]
02:37:30.232804 tst       emergency_mo_mt_call.py:31: Test FAILED (69.2 sec)
02:37:30.268577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22121): Terminating (SIGTERM)
02:37:30.310413 run   osmo-hlr_10.42.42.2(pid=22122): Terminating (SIGTERM)
02:37:30.353713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22123): Terminating (SIGTERM)
02:37:30.397261 run   osmo-stp_10.42.42.5(pid=22124): Terminating (SIGTERM)
02:37:30.472352 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22125): Terminating (SIGTERM)
02:37:30.521047 run   osmo-msc_10.42.42.6(pid=22126): Terminating (SIGTERM)
02:37:30.561622 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22127): Terminating (SIGTERM)
02:37:30.601890 run   osmo-mgw_10.42.42.3(pid=22128): Terminating (SIGTERM)
02:37:30.643002 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22129): Terminating (SIGTERM)
02:37:30.683426 run   osmo-mgw_10.42.42.4(pid=22130): Terminating (SIGTERM)
02:37:30.731291 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22131): Terminating (SIGTERM)
02:37:30.774937 run   osmo-bsc_10.42.42.7(pid=22132): Terminating (SIGTERM)
02:37:30.818772 run        osmo-bts-sysmo(pid=22141): Terminating (SIGTERM)
02:37:30.829709 ---      ParallelTerminationStrategy: PID 22121 died...
02:37:30.887996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22121): Terminated: ok {rc=0}
02:37:30.898545 ---      ParallelTerminationStrategy: PID 22122 died...
02:37:30.969288 run   osmo-hlr_10.42.42.2(pid=22122): Terminated: ok {rc=0}
02:37:30.979760 ---      ParallelTerminationStrategy: PID 22123 died...
02:37:31.039376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22123): Terminated: ok {rc=0}
02:37:31.049963 ---      ParallelTerminationStrategy: PID 22124 died...
02:37:31.107639 run   osmo-stp_10.42.42.5(pid=22124): Terminated: ok {rc=0}
02:37:31.118379 ---      ParallelTerminationStrategy: PID 22125 died...
02:37:31.176247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22125): Terminated: ok {rc=0}
02:37:31.186529 ---      ParallelTerminationStrategy: PID 22126 died...
02:37:31.243731 run   osmo-msc_10.42.42.6(pid=22126): Terminated: ok {rc=0}
02:37:31.254024 ---      ParallelTerminationStrategy: PID 22127 died...
02:37:31.311082 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22127): Terminated: ok {rc=0}
02:37:31.321398 ---      ParallelTerminationStrategy: PID 22128 died...
02:37:31.378138 run   osmo-mgw_10.42.42.3(pid=22128): Terminated {rc=15}
02:37:31.388200 ---      ParallelTerminationStrategy: PID 22129 died...
02:37:31.445065 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22129): Terminated: ok {rc=0}
02:37:31.455252 ---      ParallelTerminationStrategy: PID 22130 died...
02:37:31.511483 run   osmo-mgw_10.42.42.4(pid=22130): Terminated {rc=15}
02:37:31.521586 ---      ParallelTerminationStrategy: PID 22131 died...
02:37:31.579343 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22131): Terminated: ok {rc=0}
02:37:31.590275 ---      ParallelTerminationStrategy: PID 22132 died...
02:37:31.647455 run   osmo-bsc_10.42.42.7(pid=22132): Terminated: ok {rc=0}
02:37:31.657793 ---      ParallelTerminationStrategy: PID 22141 died...
02:37:31.714886 run        osmo-bts-sysmo(pid=22141): Terminated: ok {rc=0}
02:37:31.821700 bus                        /sierra_2: Setting Online False
02:37:32.908688 bus                        /sierra_2: Setting Powered False
02:37:38.967256 bus                        /sierra_2: Setting Powered False
02:37:40.068980 bus                        /sierra_2: Setting Powered False
02:37:41.196737 bus                        /sierra_1: Setting Online False
02:37:42.283701 bus                        /sierra_1: Setting Powered False
02:37:47.962931 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f428af11378>, timeout=10, timestep=1} [trial-838↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]