Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 49 builds (Since #751 )
Took 1 min 5 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f8aaca3a9d8>, timeout=10, timestep=1} [trial-799↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-799 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
03:33:07.014648 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
03:33:07.025748 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
03:33:07.156274 tst          emergency_mo_mt_call.py: using LAC 6926
03:33:07.283101 tst          emergency_mo_mt_call.py: using RAC 41
03:33:07.409659 tst          emergency_mo_mt_call.py: using CellId 6926
03:33:07.538393 tst          emergency_mo_mt_call.py: using BVCI 6922
03:33:07.563154 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
03:33:07.574336 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
03:33:07.585355 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
03:33:07.596230 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
03:33:07.607207 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
03:33:07.618107 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
03:33:07.717766 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
03:33:07.902854 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
03:33:08.387770 run         create_hlr_db(pid=11174): Launched
03:33:08.565474 bus                        /sierra_1: Setting Powered False
03:33:09.585762 run         create_hlr_db(pid=11174): Terminated: ok {rc=0}
03:33:10.020836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11176): Launched
03:33:10.347453 run   osmo-hlr_10.42.42.2(pid=11177): Launched
03:33:10.465012 run              osmo-stp_10.42.42.5: Starting osmo-stp
03:33:11.033906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11178): Launched
03:33:11.359863 run   osmo-stp_10.42.42.5(pid=11179): Launched
03:33:11.488524 tst          emergency_mo_mt_call.py: using MSISDN 4479
03:33:11.640920 run              osmo-msc_10.42.42.6: Starting osmo-msc
03:33:12.201862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11180): Launched
03:33:12.509035 run   osmo-msc_10.42.42.6(pid=11181): Launched
03:33:15.672322 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
03:33:16.207394 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11182): Launched
03:33:16.517461 run   osmo-mgw_10.42.42.3(pid=11183): Launched
03:33:16.626604 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
03:33:17.152923 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11184): Launched
03:33:17.464372 run   osmo-mgw_10.42.42.4(pid=11185): Launched
03:33:17.573834 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
03:33:18.218104 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11186): Launched
03:33:18.528538 run   osmo-bsc_10.42.42.7(pid=11187): Launched
03:33:24.806218 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
03:33:25.391603 run         rm-remote-dir(pid=11188): Launched
03:33:27.594905 run         rm-remote-dir(pid=11188): Terminated: ok {rc=0}
03:33:27.947329 run         mk-remote-dir(pid=11189): Launched
03:33:29.147010 run         mk-remote-dir(pid=11189): Terminated: ok {rc=0}
03:33:29.444399 run    scp-inst-to-remote(pid=11190): Launched
03:33:42.664189 run    scp-inst-to-remote(pid=11190): Terminated: ok {rc=0}
03:33:43.012128 run         mk-remote-dir(pid=11192): Launched
03:33:45.211205 run         mk-remote-dir(pid=11192): Terminated: ok {rc=0}
03:33:45.508962 run     scp-cfg-to-remote(pid=11193): Launched
03:33:46.707410 run     scp-cfg-to-remote(pid=11193): Terminated: ok {rc=0}
03:33:47.050069 run   reload-dsp-firmware(pid=11195): Launched
03:33:50.247217 run   reload-dsp-firmware(pid=11195): Terminated: ok {rc=0}
03:33:50.580150 run        osmo-bts-sysmo(pid=11196): Launched
03:33:54.818432 tst          emergency_mo_mt_call.py: using MSISDN 4480
03:33:54.998727 bus                        /sierra_1: Setting Powered True
03:33:58.496295 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4480', subscriber_id=1}
03:33:58.687416 bus                        /sierra_2: Setting Powered True
03:34:11.048975 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f8aaca3a9d8&gt;, timeout=10, timestep=1} [trial-799↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-799↪emergency:sysmo↪emergency_mo_mt_call.py:31]
03:34:11.055612 tst       emergency_mo_mt_call.py:31: Test FAILED (64.0 sec)
03:34:11.089796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11176): Terminating (SIGTERM)
03:34:11.129261 run   osmo-hlr_10.42.42.2(pid=11177): Terminating (SIGTERM)
03:34:11.169874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11178): Terminating (SIGTERM)
03:34:11.214011 run   osmo-stp_10.42.42.5(pid=11179): Terminating (SIGTERM)
03:34:11.257554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11180): Terminating (SIGTERM)
03:34:11.301020 run   osmo-msc_10.42.42.6(pid=11181): Terminating (SIGTERM)
03:34:11.348514 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11182): Terminating (SIGTERM)
03:34:11.393760 run   osmo-mgw_10.42.42.3(pid=11183): Terminating (SIGTERM)
03:34:11.449530 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11184): Terminating (SIGTERM)
03:34:11.492954 run   osmo-mgw_10.42.42.4(pid=11185): Terminating (SIGTERM)
03:34:11.548369 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11186): Terminating (SIGTERM)
03:34:11.590076 run   osmo-bsc_10.42.42.7(pid=11187): Terminating (SIGTERM)
03:34:11.633312 run        osmo-bts-sysmo(pid=11196): Terminating (SIGTERM)
03:34:11.643130 ---      ParallelTerminationStrategy: PID 11176 died...
03:34:11.699503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11176): Terminated: ok {rc=0}
03:34:11.710496 ---      ParallelTerminationStrategy: PID 11177 died...
03:34:11.766285 run   osmo-hlr_10.42.42.2(pid=11177): Terminated: ok {rc=0}
03:34:11.776896 ---      ParallelTerminationStrategy: PID 11178 died...
03:34:11.834182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11178): Terminated: ok {rc=0}
03:34:11.844607 ---      ParallelTerminationStrategy: PID 11179 died...
03:34:11.900022 run   osmo-stp_10.42.42.5(pid=11179): Terminated: ok {rc=0}
03:34:11.910306 ---      ParallelTerminationStrategy: PID 11180 died...
03:34:11.965700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11180): Terminated: ok {rc=0}
03:34:11.975803 ---      ParallelTerminationStrategy: PID 11181 died...
03:34:12.031181 run   osmo-msc_10.42.42.6(pid=11181): Terminated: ok {rc=0}
03:34:12.041623 ---      ParallelTerminationStrategy: PID 11182 died...
03:34:12.096983 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11182): Terminated: ok {rc=0}
03:34:12.107184 ---      ParallelTerminationStrategy: PID 11183 died...
03:34:12.162559 run   osmo-mgw_10.42.42.3(pid=11183): Terminated {rc=15}
03:34:12.172652 ---      ParallelTerminationStrategy: PID 11184 died...
03:34:12.227980 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11184): Terminated: ok {rc=0}
03:34:12.238164 ---      ParallelTerminationStrategy: PID 11185 died...
03:34:12.293298 run   osmo-mgw_10.42.42.4(pid=11185): Terminated {rc=15}
03:34:12.303337 ---      ParallelTerminationStrategy: PID 11186 died...
03:34:12.358686 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11186): Terminated: ok {rc=0}
03:34:12.368744 ---      ParallelTerminationStrategy: PID 11187 died...
03:34:12.424081 run   osmo-bsc_10.42.42.7(pid=11187): Terminated: ok {rc=0}
03:34:12.434220 ---      ParallelTerminationStrategy: PID 11196 died...
03:34:12.489569 run        osmo-bts-sysmo(pid=11196): Terminated: ok {rc=0}
03:34:12.593899 bus                        /sierra_2: Setting Online False
03:34:13.679402 bus                        /sierra_2: Setting Powered False
03:34:19.035000 bus                        /sierra_2: Setting Powered False
03:34:20.134507 bus                        /sierra_2: Setting Powered False
03:34:21.265916 bus                        /sierra_1: Setting Online False
03:34:22.349380 bus                        /sierra_1: Setting Powered False
03:34:27.965559 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f8aaca3a9d8>, timeout=10, timestep=1} [trial-799↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]