Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 71 builds (Since #751 )
Took 1 min 7 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f9c689e1bf8>, timeout=10, timestep=1} [trial-821↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-821 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
06:52:05.023224 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
06:52:05.034560 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
06:52:05.166196 tst          emergency_mo_mt_call.py: using LAC 8686
06:52:05.295104 tst          emergency_mo_mt_call.py: using RAC 16
06:52:05.424840 tst          emergency_mo_mt_call.py: using CellId 8686
06:52:05.558709 tst          emergency_mo_mt_call.py: using BVCI 8682
06:52:05.584075 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
06:52:05.595233 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
06:52:05.606448 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
06:52:05.617365 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
06:52:05.628745 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
06:52:05.639868 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
06:52:05.743009 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
06:52:05.933921 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
06:52:06.428546 run         create_hlr_db(pid=10121): Launched
06:52:06.610535 bus                        /sierra_1: Setting Powered False
06:52:07.635062 run         create_hlr_db(pid=10121): Terminated: ok {rc=0}
06:52:08.074640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10123): Launched
06:52:08.388938 run   osmo-hlr_10.42.42.2(pid=10124): Launched
06:52:08.500045 run              osmo-stp_10.42.42.5: Starting osmo-stp
06:52:09.043055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10125): Launched
06:52:09.357993 run   osmo-stp_10.42.42.5(pid=10126): Launched
06:52:09.480385 tst          emergency_mo_mt_call.py: using MSISDN 5645
06:52:09.634976 run              osmo-msc_10.42.42.6: Starting osmo-msc
06:52:10.204881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10127): Launched
06:52:10.518429 run   osmo-msc_10.42.42.6(pid=10128): Launched
06:52:13.684974 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
06:52:14.229338 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10129): Launched
06:52:14.544346 run   osmo-mgw_10.42.42.3(pid=10130): Launched
06:52:14.655426 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
06:52:15.189807 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10131): Launched
06:52:15.506239 run   osmo-mgw_10.42.42.4(pid=10132): Launched
06:52:15.617695 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
06:52:16.274412 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=10136): Launched
06:52:16.591195 run   osmo-bsc_10.42.42.7(pid=10137): Launched
06:52:22.859006 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
06:52:23.421332 run         rm-remote-dir(pid=10138): Launched
06:52:25.616314 run         rm-remote-dir(pid=10138): Terminated: ok {rc=0}
06:52:25.952433 run         mk-remote-dir(pid=10139): Launched
06:52:28.145680 run         mk-remote-dir(pid=10139): Terminated: ok {rc=0}
06:52:28.431541 run    scp-inst-to-remote(pid=10140): Launched
06:52:41.639571 run    scp-inst-to-remote(pid=10140): Terminated: ok {rc=0}
06:52:41.976079 run         mk-remote-dir(pid=10142): Launched
06:52:44.166987 run         mk-remote-dir(pid=10142): Terminated: ok {rc=0}
06:52:44.452373 run     scp-cfg-to-remote(pid=10143): Launched
06:52:46.643483 run     scp-cfg-to-remote(pid=10143): Terminated: ok {rc=0}
06:52:46.973253 run   reload-dsp-firmware(pid=10145): Launched
06:52:50.164645 run   reload-dsp-firmware(pid=10145): Terminated: ok {rc=0}
06:52:50.486427 run        osmo-bts-sysmo(pid=10146): Launched
06:52:55.724624 tst          emergency_mo_mt_call.py: using MSISDN 5646
06:52:55.897412 bus                        /sierra_1: Setting Powered True
06:52:59.388603 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5646', subscriber_id=1}
06:52:59.587940 bus                        /sierra_2: Setting Powered True
06:53:11.952800 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f9c689e1bf8&gt;, timeout=10, timestep=1} [trial-821↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-821↪emergency:sysmo↪emergency_mo_mt_call.py:31]
06:53:11.960096 tst       emergency_mo_mt_call.py:31: Test FAILED (66.9 sec)
06:53:11.996904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10123): Terminating (SIGTERM)
06:53:12.039724 run   osmo-hlr_10.42.42.2(pid=10124): Terminating (SIGTERM)
06:53:12.084319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10125): Terminating (SIGTERM)
06:53:12.128893 run   osmo-stp_10.42.42.5(pid=10126): Terminating (SIGTERM)
06:53:12.195847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10127): Terminating (SIGTERM)
06:53:12.240368 run   osmo-msc_10.42.42.6(pid=10128): Terminating (SIGTERM)
06:53:12.286430 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10129): Terminating (SIGTERM)
06:53:12.331972 run   osmo-mgw_10.42.42.3(pid=10130): Terminating (SIGTERM)
06:53:12.387917 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10131): Terminating (SIGTERM)
06:53:12.433702 run   osmo-mgw_10.42.42.4(pid=10132): Terminating (SIGTERM)
06:53:12.477853 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=10136): Terminating (SIGTERM)
06:53:12.526671 run   osmo-bsc_10.42.42.7(pid=10137): Terminating (SIGTERM)
06:53:12.569539 run        osmo-bts-sysmo(pid=10146): Terminating (SIGTERM)
06:53:12.579442 ---      ParallelTerminationStrategy: PID 10123 died...
06:53:12.637395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10123): Terminated: ok {rc=0}
06:53:12.647658 ---      ParallelTerminationStrategy: PID 10124 died...
06:53:12.705600 run   osmo-hlr_10.42.42.2(pid=10124): Terminated: ok {rc=0}
06:53:12.716351 ---      ParallelTerminationStrategy: PID 10125 died...
06:53:12.774066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10125): Terminated: ok {rc=0}
06:53:12.784663 ---      ParallelTerminationStrategy: PID 10126 died...
06:53:12.842901 run   osmo-stp_10.42.42.5(pid=10126): Terminated: ok {rc=0}
06:53:12.853840 ---      ParallelTerminationStrategy: PID 10127 died...
06:53:12.911642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10127): Terminated: ok {rc=0}
06:53:12.922341 ---      ParallelTerminationStrategy: PID 10128 died...
06:53:12.979505 run   osmo-msc_10.42.42.6(pid=10128): Terminated: ok {rc=0}
06:53:12.989907 ---      ParallelTerminationStrategy: PID 10129 died...
06:53:13.046707 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10129): Terminated: ok {rc=0}
06:53:13.056892 ---      ParallelTerminationStrategy: PID 10130 died...
06:53:13.114076 run   osmo-mgw_10.42.42.3(pid=10130): Terminated {rc=15}
06:53:13.124340 ---      ParallelTerminationStrategy: PID 10131 died...
06:53:13.181092 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10131): Terminated: ok {rc=0}
06:53:13.191398 ---      ParallelTerminationStrategy: PID 10132 died...
06:53:13.248497 run   osmo-mgw_10.42.42.4(pid=10132): Terminated {rc=15}
06:53:13.258827 ---      ParallelTerminationStrategy: PID 10136 died...
06:53:13.315637 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=10136): Terminated: ok {rc=0}
06:53:13.325950 ---      ParallelTerminationStrategy: PID 10137 died...
06:53:13.382901 run   osmo-bsc_10.42.42.7(pid=10137): Terminated: ok {rc=0}
06:53:13.393372 ---      ParallelTerminationStrategy: PID 10146 died...
06:53:13.450529 run        osmo-bts-sysmo(pid=10146): Terminated: ok {rc=0}
06:53:13.559391 bus                        /sierra_2: Setting Online False
06:53:14.646628 bus                        /sierra_2: Setting Powered False
06:53:19.995496 bus                        /sierra_2: Setting Powered False
06:53:21.099274 bus                        /sierra_2: Setting Powered False
06:53:22.234946 bus                        /sierra_1: Setting Online False
06:53:23.322666 bus                        /sierra_1: Setting Powered False
06:53:28.969135 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f9c689e1bf8>, timeout=10, timestep=1} [trial-821↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]