Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 55 builds (Since #751 )
Took 1 min 4 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f871992bc80>, timeout=10, timestep=1} [trial-805↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-805 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
10:43:56.015237 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
10:43:56.026228 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
10:43:56.158035 tst          emergency_mo_mt_call.py: using LAC 7406
10:43:56.284901 tst          emergency_mo_mt_call.py: using RAC 11
10:43:56.411231 tst          emergency_mo_mt_call.py: using CellId 7406
10:43:56.537906 tst          emergency_mo_mt_call.py: using BVCI 7402
10:43:56.562524 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
10:43:56.573626 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
10:43:56.584516 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
10:43:56.595341 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
10:43:56.606261 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
10:43:56.617076 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
10:43:56.718976 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
10:43:56.905738 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
10:43:57.390003 run         create_hlr_db(pid=27198): Launched
10:43:57.568775 bus                        /sierra_1: Setting Powered False
10:43:58.588637 run         create_hlr_db(pid=27198): Terminated: ok {rc=0}
10:43:58.996068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27200): Launched
10:43:59.303265 run   osmo-hlr_10.42.42.2(pid=27201): Launched
10:43:59.412848 run              osmo-stp_10.42.42.5: Starting osmo-stp
10:43:59.945639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27202): Launched
10:44:00.253652 run   osmo-stp_10.42.42.5(pid=27203): Launched
10:44:00.374922 tst          emergency_mo_mt_call.py: using MSISDN 4797
10:44:00.527118 run              osmo-msc_10.42.42.6: Starting osmo-msc
10:44:01.087994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27204): Launched
10:44:01.396998 run   osmo-msc_10.42.42.6(pid=27205): Launched
10:44:04.561774 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
10:44:05.102207 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27206): Launched
10:44:05.427565 run   osmo-mgw_10.42.42.3(pid=27207): Launched
10:44:05.544516 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
10:44:06.100095 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27208): Launched
10:44:06.427552 run   osmo-mgw_10.42.42.4(pid=27209): Launched
10:44:06.544761 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
10:44:07.225089 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27210): Launched
10:44:07.554042 run   osmo-bsc_10.42.42.7(pid=27211): Launched
10:44:13.832310 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
10:44:14.416243 run         rm-remote-dir(pid=27212): Launched
10:44:16.619803 run         rm-remote-dir(pid=27212): Terminated: ok {rc=0}
10:44:16.970345 run         mk-remote-dir(pid=27213): Launched
10:44:18.169878 run         mk-remote-dir(pid=27213): Terminated: ok {rc=0}
10:44:18.465035 run    scp-inst-to-remote(pid=27214): Launched
10:44:31.685273 run    scp-inst-to-remote(pid=27214): Terminated: ok {rc=0}
10:44:32.031292 run         mk-remote-dir(pid=27216): Launched
10:44:34.231291 run         mk-remote-dir(pid=27216): Terminated: ok {rc=0}
10:44:34.527931 run     scp-cfg-to-remote(pid=27217): Launched
10:44:35.716051 run     scp-cfg-to-remote(pid=27217): Terminated: ok {rc=0}
10:44:36.039264 run   reload-dsp-firmware(pid=27219): Launched
10:44:39.226060 run   reload-dsp-firmware(pid=27219): Terminated: ok {rc=0}
10:44:39.542576 run        osmo-bts-sysmo(pid=27220): Launched
10:44:43.790172 tst          emergency_mo_mt_call.py: using MSISDN 4798
10:44:43.962881 bus                        /sierra_1: Setting Powered True
10:44:47.450575 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4798', subscriber_id=1}
10:44:47.630852 bus                        /sierra_2: Setting Powered True
10:44:59.984309 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f871992bc80&gt;, timeout=10, timestep=1} [trial-805↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-805↪emergency:sysmo↪emergency_mo_mt_call.py:31]
10:44:59.990973 tst       emergency_mo_mt_call.py:31: Test FAILED (64.0 sec)
10:45:00.026333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27200): Terminating (SIGTERM)
10:45:00.067034 run   osmo-hlr_10.42.42.2(pid=27201): Terminating (SIGTERM)
10:45:00.107901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27202): Terminating (SIGTERM)
10:45:00.150071 run   osmo-stp_10.42.42.5(pid=27203): Terminating (SIGTERM)
10:45:00.199041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27204): Terminating (SIGTERM)
10:45:00.243760 run   osmo-msc_10.42.42.6(pid=27205): Terminating (SIGTERM)
10:45:00.285967 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27206): Terminating (SIGTERM)
10:45:00.328681 run   osmo-mgw_10.42.42.3(pid=27207): Terminating (SIGTERM)
10:45:00.387506 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27208): Terminating (SIGTERM)
10:45:00.428797 run   osmo-mgw_10.42.42.4(pid=27209): Terminating (SIGTERM)
10:45:00.469545 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27210): Terminating (SIGTERM)
10:45:00.509719 run   osmo-bsc_10.42.42.7(pid=27211): Terminating (SIGTERM)
10:45:00.550485 run        osmo-bts-sysmo(pid=27220): Terminating (SIGTERM)
10:45:00.559962 ---      ParallelTerminationStrategy: PID 27200 died...
10:45:00.615391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27200): Terminated: ok {rc=0}
10:45:00.625541 ---      ParallelTerminationStrategy: PID 27201 died...
10:45:00.680844 run   osmo-hlr_10.42.42.2(pid=27201): Terminated: ok {rc=0}
10:45:00.690593 ---      ParallelTerminationStrategy: PID 27202 died...
10:45:00.744529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27202): Terminated: ok {rc=0}
10:45:00.754217 ---      ParallelTerminationStrategy: PID 27203 died...
10:45:00.807739 run   osmo-stp_10.42.42.5(pid=27203): Terminated: ok {rc=0}
10:45:00.817605 ---      ParallelTerminationStrategy: PID 27204 died...
10:45:00.871371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27204): Terminated: ok {rc=0}
10:45:00.881012 ---      ParallelTerminationStrategy: PID 27205 died...
10:45:00.934720 run   osmo-msc_10.42.42.6(pid=27205): Terminated: ok {rc=0}
10:45:00.944522 ---      ParallelTerminationStrategy: PID 27206 died...
10:45:00.998978 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27206): Terminated: ok {rc=0}
10:45:01.008634 ---      ParallelTerminationStrategy: PID 27207 died...
10:45:01.062678 run   osmo-mgw_10.42.42.3(pid=27207): Terminated {rc=15}
10:45:01.072624 ---      ParallelTerminationStrategy: PID 27208 died...
10:45:01.126584 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27208): Terminated: ok {rc=0}
10:45:01.136294 ---      ParallelTerminationStrategy: PID 27209 died...
10:45:01.190087 run   osmo-mgw_10.42.42.4(pid=27209): Terminated {rc=15}
10:45:01.199818 ---      ParallelTerminationStrategy: PID 27210 died...
10:45:01.257259 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27210): Terminated: ok {rc=0}
10:45:01.266957 ---      ParallelTerminationStrategy: PID 27211 died...
10:45:01.320848 run   osmo-bsc_10.42.42.7(pid=27211): Terminated: ok {rc=0}
10:45:01.330582 ---      ParallelTerminationStrategy: PID 27220 died...
10:45:01.384546 run        osmo-bts-sysmo(pid=27220): Terminated: ok {rc=0}
10:45:01.494883 bus                        /sierra_2: Setting Online False
10:45:02.581272 bus                        /sierra_2: Setting Powered False
10:45:07.962999 bus                        /sierra_2: Setting Powered False
10:45:09.066452 bus                        /sierra_2: Setting Powered False
10:45:10.194253 bus                        /sierra_1: Setting Online False
10:45:11.282018 bus                        /sierra_1: Setting Powered False
10:45:16.965728 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f871992bc80>, timeout=10, timestep=1} [trial-805↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]