Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 62 builds (Since #751 )
Took 1 min 5 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fe8393b5598>, timeout=10, timestep=1} [trial-812↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-812 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
18:33:10.006924 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
18:33:10.018223 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
18:33:10.147711 tst          emergency_mo_mt_call.py: using LAC 7966
18:33:10.270064 tst          emergency_mo_mt_call.py: using RAC 61
18:33:10.388944 tst          emergency_mo_mt_call.py: using CellId 7966
18:33:10.514081 tst          emergency_mo_mt_call.py: using BVCI 7962
18:33:10.537305 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
18:33:10.547815 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
18:33:10.558462 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
18:33:10.569075 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
18:33:10.579681 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
18:33:10.590352 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
18:33:10.693541 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
18:33:10.879421 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
18:33:11.357535 run         create_hlr_db(pid=14609): Launched
18:33:11.535156 bus                        /sierra_1: Setting Powered False
18:33:12.555578 run         create_hlr_db(pid=14609): Terminated: ok {rc=0}
18:33:12.982371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14611): Launched
18:33:13.290836 run   osmo-hlr_10.42.42.2(pid=14612): Launched
18:33:13.400080 run              osmo-stp_10.42.42.5: Starting osmo-stp
18:33:13.930513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14613): Launched
18:33:14.237455 run   osmo-stp_10.42.42.5(pid=14614): Launched
18:33:14.357458 tst          emergency_mo_mt_call.py: using MSISDN 5168
18:33:14.508817 run              osmo-msc_10.42.42.6: Starting osmo-msc
18:33:15.066223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14615): Launched
18:33:15.372469 run   osmo-msc_10.42.42.6(pid=14616): Launched
18:33:18.535855 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
18:33:19.065935 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14617): Launched
18:33:19.374701 run   osmo-mgw_10.42.42.3(pid=14618): Launched
18:33:19.483303 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
18:33:20.003597 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14619): Launched
18:33:20.310529 run   osmo-mgw_10.42.42.4(pid=14620): Launched
18:33:20.419743 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
18:33:21.059506 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14621): Launched
18:33:21.366817 run   osmo-bsc_10.42.42.7(pid=14622): Launched
18:33:27.628325 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
18:33:28.174326 run         rm-remote-dir(pid=14623): Launched
18:33:30.373706 run         rm-remote-dir(pid=14623): Terminated: ok {rc=0}
18:33:30.724443 run         mk-remote-dir(pid=14624): Launched
18:33:32.924195 run         mk-remote-dir(pid=14624): Terminated: ok {rc=0}
18:33:33.219706 run    scp-inst-to-remote(pid=14625): Launched
18:33:45.434778 run    scp-inst-to-remote(pid=14625): Terminated: ok {rc=0}
18:33:45.782192 run         mk-remote-dir(pid=14627): Launched
18:33:47.979662 run         mk-remote-dir(pid=14627): Terminated: ok {rc=0}
18:33:48.274807 run     scp-cfg-to-remote(pid=14628): Launched
18:33:50.473313 run     scp-cfg-to-remote(pid=14628): Terminated: ok {rc=0}
18:33:50.813070 run   reload-dsp-firmware(pid=14630): Launched
18:33:54.008237 run   reload-dsp-firmware(pid=14630): Terminated: ok {rc=0}
18:33:54.339346 run        osmo-bts-sysmo(pid=14631): Launched
18:33:58.590459 tst          emergency_mo_mt_call.py: using MSISDN 5169
18:33:58.761625 bus                        /sierra_1: Setting Powered True
18:34:02.244669 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5169', subscriber_id=1}
18:34:02.435468 bus                        /sierra_2: Setting Powered True
18:34:14.802780 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fe8393b5598&gt;, timeout=10, timestep=1} [trial-812↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-812↪emergency:sysmo↪emergency_mo_mt_call.py:31]
18:34:14.810112 tst       emergency_mo_mt_call.py:31: Test FAILED (64.8 sec)
18:34:14.846395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14611): Terminating (SIGTERM)
18:34:14.888423 run   osmo-hlr_10.42.42.2(pid=14612): Terminating (SIGTERM)
18:34:14.932691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14613): Terminating (SIGTERM)
18:34:14.977043 run   osmo-stp_10.42.42.5(pid=14614): Terminating (SIGTERM)
18:34:15.043625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14615): Terminating (SIGTERM)
18:34:15.095689 run   osmo-msc_10.42.42.6(pid=14616): Terminating (SIGTERM)
18:34:15.144629 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14617): Terminating (SIGTERM)
18:34:15.187603 run   osmo-mgw_10.42.42.3(pid=14618): Terminating (SIGTERM)
18:34:15.229728 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14619): Terminating (SIGTERM)
18:34:15.273425 run   osmo-mgw_10.42.42.4(pid=14620): Terminating (SIGTERM)
18:34:15.314722 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14621): Terminating (SIGTERM)
18:34:15.359805 run   osmo-bsc_10.42.42.7(pid=14622): Terminating (SIGTERM)
18:34:15.402632 run        osmo-bts-sysmo(pid=14631): Terminating (SIGTERM)
18:34:15.412286 ---      ParallelTerminationStrategy: PID 14611 died...
18:34:15.471049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14611): Terminated: ok {rc=0}
18:34:15.485643 ---      ParallelTerminationStrategy: PID 14612 died...
18:34:15.542777 run   osmo-hlr_10.42.42.2(pid=14612): Terminated: ok {rc=0}
18:34:15.553290 ---      ParallelTerminationStrategy: PID 14613 died...
18:34:15.611801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14613): Terminated: ok {rc=0}
18:34:15.622368 ---      ParallelTerminationStrategy: PID 14614 died...
18:34:15.679510 run   osmo-stp_10.42.42.5(pid=14614): Terminated: ok {rc=0}
18:34:15.690032 ---      ParallelTerminationStrategy: PID 14615 died...
18:34:15.747582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14615): Terminated: ok {rc=0}
18:34:15.757845 ---      ParallelTerminationStrategy: PID 14616 died...
18:34:15.816325 run   osmo-msc_10.42.42.6(pid=14616): Terminated: ok {rc=0}
18:34:15.826664 ---      ParallelTerminationStrategy: PID 14617 died...
18:34:15.883114 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14617): Terminated: ok {rc=0}
18:34:15.893295 ---      ParallelTerminationStrategy: PID 14618 died...
18:34:15.949451 run   osmo-mgw_10.42.42.3(pid=14618): Terminated {rc=15}
18:34:15.959565 ---      ParallelTerminationStrategy: PID 14619 died...
18:34:16.015791 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14619): Terminated: ok {rc=0}
18:34:16.026006 ---      ParallelTerminationStrategy: PID 14620 died...
18:34:16.082499 run   osmo-mgw_10.42.42.4(pid=14620): Terminated {rc=15}
18:34:16.092612 ---      ParallelTerminationStrategy: PID 14621 died...
18:34:16.148955 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14621): Terminated: ok {rc=0}
18:34:16.159119 ---      ParallelTerminationStrategy: PID 14622 died...
18:34:16.215749 run   osmo-bsc_10.42.42.7(pid=14622): Terminated: ok {rc=0}
18:34:16.225933 ---      ParallelTerminationStrategy: PID 14631 died...
18:34:16.282387 run        osmo-bts-sysmo(pid=14631): Terminated: ok {rc=0}
18:34:16.391220 bus                        /sierra_2: Setting Online False
18:34:17.476103 bus                        /sierra_2: Setting Powered False
18:34:22.960148 bus                        /sierra_2: Setting Powered False
18:34:24.067091 bus                        /sierra_2: Setting Powered False
18:34:25.196204 bus                        /sierra_1: Setting Online False
18:34:26.284345 bus                        /sierra_1: Setting Powered False
18:34:31.959551 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fe8393b5598>, timeout=10, timestep=1} [trial-812↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]