Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 68 builds (Since #751 )
Took 1 min 7 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fec7ca958c8>, timeout=10, timestep=1} [trial-818↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-818 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
02:33:11.008063 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
02:33:11.019547 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
02:33:11.151335 tst          emergency_mo_mt_call.py: using LAC 8446
02:33:11.280515 tst          emergency_mo_mt_call.py: using RAC 31
02:33:11.407090 tst          emergency_mo_mt_call.py: using CellId 8446
02:33:11.536565 tst          emergency_mo_mt_call.py: using BVCI 8442
02:33:11.561445 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
02:33:11.572534 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
02:33:11.583656 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
02:33:11.594725 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
02:33:11.605750 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
02:33:11.616725 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
02:33:11.720659 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
02:33:11.917028 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
02:33:12.438576 run          create_hlr_db(pid=2225): Launched
02:33:12.628164 bus                        /sierra_1: Setting Powered False
02:33:13.648485 run          create_hlr_db(pid=2225): Terminated: ok {rc=0}
02:33:14.063778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2227): Launched
02:33:14.372811 run    osmo-hlr_10.42.42.2(pid=2228): Launched
02:33:14.483985 run              osmo-stp_10.42.42.5: Starting osmo-stp
02:33:15.016109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2229): Launched
02:33:15.323194 run    osmo-stp_10.42.42.5(pid=2230): Launched
02:33:15.444916 tst          emergency_mo_mt_call.py: using MSISDN 5486
02:33:15.597067 run              osmo-msc_10.42.42.6: Starting osmo-msc
02:33:16.164526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2231): Launched
02:33:16.475388 run    osmo-msc_10.42.42.6(pid=2232): Launched
02:33:19.647407 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
02:33:20.215171 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=2233): Launched
02:33:20.543596 run    osmo-mgw_10.42.42.3(pid=2234): Launched
02:33:20.659349 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
02:33:21.216524 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2235): Launched
02:33:21.544883 run    osmo-mgw_10.42.42.4(pid=2236): Launched
02:33:21.661513 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
02:33:22.343330 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=2237): Launched
02:33:22.673218 run    osmo-bsc_10.42.42.7(pid=2238): Launched
02:33:28.950465 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
02:33:29.531928 run          rm-remote-dir(pid=2239): Launched
02:33:31.724948 run          rm-remote-dir(pid=2239): Terminated: ok {rc=0}
02:33:32.055308 run          mk-remote-dir(pid=2240): Launched
02:33:34.244207 run          mk-remote-dir(pid=2240): Terminated: ok {rc=0}
02:33:34.523153 run     scp-inst-to-remote(pid=2241): Launched
02:33:47.736386 run     scp-inst-to-remote(pid=2241): Terminated: ok {rc=0}
02:33:48.081757 run          mk-remote-dir(pid=2243): Launched
02:33:50.280245 run          mk-remote-dir(pid=2243): Terminated: ok {rc=0}
02:33:50.576942 run      scp-cfg-to-remote(pid=2244): Launched
02:33:52.774432 run      scp-cfg-to-remote(pid=2244): Terminated: ok {rc=0}
02:33:53.115786 run    reload-dsp-firmware(pid=2246): Launched
02:33:56.312752 run    reload-dsp-firmware(pid=2246): Terminated: ok {rc=0}
02:33:56.644016 run         osmo-bts-sysmo(pid=2247): Launched
02:34:00.894860 tst          emergency_mo_mt_call.py: using MSISDN 5487
02:34:01.074606 bus                        /sierra_1: Setting Powered True
02:34:04.555029 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5487', subscriber_id=1}
02:34:04.734897 bus                        /sierra_2: Setting Powered True
02:34:17.088823 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fec7ca958c8&gt;, timeout=10, timestep=1} [trial-818↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-818↪emergency:sysmo↪emergency_mo_mt_call.py:31]
02:34:17.096291 tst       emergency_mo_mt_call.py:31: Test FAILED (66.1 sec)
02:34:17.132582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2227): Terminating (SIGTERM)
02:34:17.174946 run    osmo-hlr_10.42.42.2(pid=2228): Terminating (SIGTERM)
02:34:17.218537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2229): Terminating (SIGTERM)
02:34:17.263898 run    osmo-stp_10.42.42.5(pid=2230): Terminating (SIGTERM)
02:34:17.312847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2231): Terminating (SIGTERM)
02:34:17.358815 run    osmo-msc_10.42.42.6(pid=2232): Terminating (SIGTERM)
02:34:17.407907 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=2233): Terminating (SIGTERM)
02:34:17.454691 run    osmo-mgw_10.42.42.3(pid=2234): Terminating (SIGTERM)
02:34:17.497312 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2235): Terminating (SIGTERM)
02:34:17.543296 run    osmo-mgw_10.42.42.4(pid=2236): Terminating (SIGTERM)
02:34:17.599894 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=2237): Terminating (SIGTERM)
02:34:17.639872 run    osmo-bsc_10.42.42.7(pid=2238): Terminating (SIGTERM)
02:34:17.680135 run         osmo-bts-sysmo(pid=2247): Terminating (SIGTERM)
02:34:17.689411 ---      ParallelTerminationStrategy: PID 2227 died...
02:34:17.743136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2227): Terminated: ok {rc=0}
02:34:17.753522 ---      ParallelTerminationStrategy: PID 2228 died...
02:34:17.809744 run    osmo-hlr_10.42.42.2(pid=2228): Terminated: ok {rc=0}
02:34:17.820194 ---      ParallelTerminationStrategy: PID 2229 died...
02:34:17.876392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2229): Terminated: ok {rc=0}
02:34:17.886880 ---      ParallelTerminationStrategy: PID 2230 died...
02:34:17.940722 run    osmo-stp_10.42.42.5(pid=2230): Terminated: ok {rc=0}
02:34:17.950333 ---      ParallelTerminationStrategy: PID 2231 died...
02:34:18.003699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2231): Terminated: ok {rc=0}
02:34:18.013679 ---      ParallelTerminationStrategy: PID 2232 died...
02:34:18.067028 run    osmo-msc_10.42.42.6(pid=2232): Terminated: ok {rc=0}
02:34:18.076523 ---      ParallelTerminationStrategy: PID 2233 died...
02:34:18.130173 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=2233): Terminated: ok {rc=0}
02:34:18.139772 ---      ParallelTerminationStrategy: PID 2234 died...
02:34:18.192938 run    osmo-mgw_10.42.42.3(pid=2234): Terminated {rc=15}
02:34:18.202454 ---      ParallelTerminationStrategy: PID 2235 died...
02:34:18.255658 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2235): Terminated: ok {rc=0}
02:34:18.265121 ---      ParallelTerminationStrategy: PID 2236 died...
02:34:18.318032 run    osmo-mgw_10.42.42.4(pid=2236): Terminated {rc=15}
02:34:18.327833 ---      ParallelTerminationStrategy: PID 2237 died...
02:34:18.381320 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=2237): Terminated: ok {rc=0}
02:34:18.390921 ---      ParallelTerminationStrategy: PID 2238 died...
02:34:18.444713 run    osmo-bsc_10.42.42.7(pid=2238): Terminated: ok {rc=0}
02:34:18.454369 ---      ParallelTerminationStrategy: PID 2247 died...
02:34:18.507727 run         osmo-bts-sysmo(pid=2247): Terminated: ok {rc=0}
02:34:18.610785 bus                        /sierra_2: Setting Online False
02:34:19.697968 bus                        /sierra_2: Setting Powered False
02:34:25.041753 bus                        /sierra_2: Setting Powered False
02:34:26.147525 bus                        /sierra_2: Setting Powered False
02:34:27.280445 bus                        /sierra_1: Setting Online False
02:34:28.367547 bus                        /sierra_1: Setting Powered False
02:34:33.965369 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fec7ca958c8>, timeout=10, timestep=1} [trial-818↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]