Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 53 builds (Since #751 )
Took 1 min 5 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6ea0073ea0>, timeout=10, timestep=1} [trial-803↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-803 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
08:47:04.993698 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
08:47:05.004693 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
08:47:05.135204 tst          emergency_mo_mt_call.py: using LAC 7246
08:47:05.267408 tst          emergency_mo_mt_call.py: using RAC 106
08:47:05.388652 tst          emergency_mo_mt_call.py: using CellId 7246
08:47:05.508126 tst          emergency_mo_mt_call.py: using BVCI 7242
08:47:05.531881 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
08:47:05.542836 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
08:47:05.553598 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
08:47:05.564217 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
08:47:05.574919 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
08:47:05.585778 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
08:47:05.691551 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
08:47:05.881128 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
08:47:06.362089 run         create_hlr_db(pid=22417): Launched
08:47:06.540364 bus                        /sierra_1: Setting Powered False
08:47:07.561975 run         create_hlr_db(pid=22417): Terminated: ok {rc=0}
08:47:07.997224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22419): Launched
08:47:08.324010 run   osmo-hlr_10.42.42.2(pid=22420): Launched
08:47:08.442070 run              osmo-stp_10.42.42.5: Starting osmo-stp
08:47:09.007158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22421): Launched
08:47:09.332958 run   osmo-stp_10.42.42.5(pid=22422): Launched
08:47:09.460558 tst          emergency_mo_mt_call.py: using MSISDN 4691
08:47:09.622297 run              osmo-msc_10.42.42.6: Starting osmo-msc
08:47:10.218320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22423): Launched
08:47:10.544780 run   osmo-msc_10.42.42.6(pid=22424): Launched
08:47:13.710404 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
08:47:14.241293 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22425): Launched
08:47:14.552703 run   osmo-mgw_10.42.42.3(pid=22426): Launched
08:47:14.661744 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
08:47:15.179688 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22427): Launched
08:47:15.485402 run   osmo-mgw_10.42.42.4(pid=22428): Launched
08:47:15.594690 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
08:47:16.263699 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22430): Launched
08:47:16.594282 run   osmo-bsc_10.42.42.7(pid=22431): Launched
08:47:22.872017 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
08:47:23.455422 run         rm-remote-dir(pid=22432): Launched
08:47:25.657452 run         rm-remote-dir(pid=22432): Terminated: ok {rc=0}
08:47:26.006685 run         mk-remote-dir(pid=22433): Launched
08:47:27.205206 run         mk-remote-dir(pid=22433): Terminated: ok {rc=0}
08:47:27.501712 run    scp-inst-to-remote(pid=22434): Launched
08:47:40.719103 run    scp-inst-to-remote(pid=22434): Terminated: ok {rc=0}
08:47:41.064386 run         mk-remote-dir(pid=22436): Launched
08:47:43.263338 run         mk-remote-dir(pid=22436): Terminated: ok {rc=0}
08:47:43.559521 run     scp-cfg-to-remote(pid=22437): Launched
08:47:44.757788 run     scp-cfg-to-remote(pid=22437): Terminated: ok {rc=0}
08:47:45.099438 run   reload-dsp-firmware(pid=22439): Launched
08:47:48.295681 run   reload-dsp-firmware(pid=22439): Terminated: ok {rc=0}
08:47:48.629455 run        osmo-bts-sysmo(pid=22440): Launched
08:47:52.878158 tst          emergency_mo_mt_call.py: using MSISDN 4692
08:47:53.049636 bus                        /sierra_1: Setting Powered True
08:47:56.524961 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4692', subscriber_id=1}
08:47:56.705466 bus                        /sierra_2: Setting Powered True
08:48:09.057986 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f6ea0073ea0&gt;, timeout=10, timestep=1} [trial-803↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-803↪emergency:sysmo↪emergency_mo_mt_call.py:31]
08:48:09.065317 tst       emergency_mo_mt_call.py:31: Test FAILED (64.1 sec)
08:48:09.101402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22419): Terminating (SIGTERM)
08:48:09.143149 run   osmo-hlr_10.42.42.2(pid=22420): Terminating (SIGTERM)
08:48:09.186406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22421): Terminating (SIGTERM)
08:48:09.230824 run   osmo-stp_10.42.42.5(pid=22422): Terminating (SIGTERM)
08:48:09.279686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22423): Terminating (SIGTERM)
08:48:09.332800 run   osmo-msc_10.42.42.6(pid=22424): Terminating (SIGTERM)
08:48:09.376643 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22425): Terminating (SIGTERM)
08:48:09.420063 run   osmo-mgw_10.42.42.3(pid=22426): Terminating (SIGTERM)
08:48:09.478426 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22427): Terminating (SIGTERM)
08:48:09.520595 run   osmo-mgw_10.42.42.4(pid=22428): Terminating (SIGTERM)
08:48:09.561316 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22430): Terminating (SIGTERM)
08:48:09.602578 run   osmo-bsc_10.42.42.7(pid=22431): Terminating (SIGTERM)
08:48:09.644243 run        osmo-bts-sysmo(pid=22440): Terminating (SIGTERM)
08:48:09.653651 ---      ParallelTerminationStrategy: PID 22419 died...
08:48:09.709465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22419): Terminated: ok {rc=0}
08:48:09.719811 ---      ParallelTerminationStrategy: PID 22420 died...
08:48:09.775555 run   osmo-hlr_10.42.42.2(pid=22420): Terminated: ok {rc=0}
08:48:09.785703 ---      ParallelTerminationStrategy: PID 22421 died...
08:48:09.841938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22421): Terminated: ok {rc=0}
08:48:09.851785 ---      ParallelTerminationStrategy: PID 22422 died...
08:48:09.906002 run   osmo-stp_10.42.42.5(pid=22422): Terminated: ok {rc=0}
08:48:09.916450 ---      ParallelTerminationStrategy: PID 22423 died...
08:48:09.970644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22423): Terminated: ok {rc=0}
08:48:09.981234 ---      ParallelTerminationStrategy: PID 22424 died...
08:48:10.036057 run   osmo-msc_10.42.42.6(pid=22424): Terminated: ok {rc=0}
08:48:10.046075 ---      ParallelTerminationStrategy: PID 22425 died...
08:48:10.100648 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22425): Terminated: ok {rc=0}
08:48:10.110466 ---      ParallelTerminationStrategy: PID 22426 died...
08:48:10.164562 run   osmo-mgw_10.42.42.3(pid=22426): Terminated {rc=15}
08:48:10.174996 ---      ParallelTerminationStrategy: PID 22427 died...
08:48:10.228982 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22427): Terminated: ok {rc=0}
08:48:10.239400 ---      ParallelTerminationStrategy: PID 22428 died...
08:48:10.294089 run   osmo-mgw_10.42.42.4(pid=22428): Terminated {rc=15}
08:48:10.303772 ---      ParallelTerminationStrategy: PID 22430 died...
08:48:10.357699 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22430): Terminated: ok {rc=0}
08:48:10.368151 ---      ParallelTerminationStrategy: PID 22431 died...
08:48:10.422897 run   osmo-bsc_10.42.42.7(pid=22431): Terminated: ok {rc=0}
08:48:10.432628 ---      ParallelTerminationStrategy: PID 22440 died...
08:48:10.486676 run        osmo-bts-sysmo(pid=22440): Terminated: ok {rc=0}
08:48:10.595906 bus                        /sierra_2: Setting Online False
08:48:11.680330 bus                        /sierra_2: Setting Powered False
08:48:17.003437 bus                        /sierra_2: Setting Powered False
08:48:18.108600 bus                        /sierra_2: Setting Powered False
08:48:19.236801 bus                        /sierra_1: Setting Online False
08:48:20.320348 bus                        /sierra_1: Setting Powered False
08:48:25.965542 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6ea0073ea0>, timeout=10, timestep=1} [trial-803↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]