Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 52 builds (Since #751 )
Took 1 min 5 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f710c70a158>, timeout=10, timestep=1} [trial-802↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-802 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
07:48:48.004880 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
07:48:48.016024 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
07:48:48.148150 tst          emergency_mo_mt_call.py: using LAC 7166
07:48:48.272521 tst          emergency_mo_mt_call.py: using RAC 26
07:48:48.397123 tst          emergency_mo_mt_call.py: using CellId 7166
07:48:48.523356 tst          emergency_mo_mt_call.py: using BVCI 7162
07:48:48.547909 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
07:48:48.559052 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
07:48:48.570072 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
07:48:48.580919 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
07:48:48.591846 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
07:48:48.602867 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
07:48:48.701260 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
07:48:48.891459 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
07:48:49.372156 run         create_hlr_db(pid=19546): Launched
07:48:49.549303 bus                        /sierra_1: Setting Powered False
07:48:50.573411 run         create_hlr_db(pid=19546): Terminated: ok {rc=0}
07:48:51.003945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19548): Launched
07:48:51.329129 run   osmo-hlr_10.42.42.2(pid=19549): Launched
07:48:51.446236 run              osmo-stp_10.42.42.5: Starting osmo-stp
07:48:52.008348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19550): Launched
07:48:52.333431 run   osmo-stp_10.42.42.5(pid=19551): Launched
07:48:52.460238 tst          emergency_mo_mt_call.py: using MSISDN 4638
07:48:52.621023 run              osmo-msc_10.42.42.6: Starting osmo-msc
07:48:53.214182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19552): Launched
07:48:53.540553 run   osmo-msc_10.42.42.6(pid=19553): Launched
07:48:56.712908 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
07:48:57.276310 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19554): Launched
07:48:57.600435 run   osmo-mgw_10.42.42.3(pid=19555): Launched
07:48:57.715804 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
07:48:58.267994 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19560): Launched
07:48:58.594183 run   osmo-mgw_10.42.42.4(pid=19561): Launched
07:48:58.710112 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
07:48:59.387787 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19562): Launched
07:48:59.713902 run   osmo-bsc_10.42.42.7(pid=19563): Launched
07:49:05.989939 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
07:49:06.573013 run         rm-remote-dir(pid=19564): Launched
07:49:08.775745 run         rm-remote-dir(pid=19564): Terminated: ok {rc=0}
07:49:09.126160 run         mk-remote-dir(pid=19565): Launched
07:49:10.325015 run         mk-remote-dir(pid=19565): Terminated: ok {rc=0}
07:49:10.621898 run    scp-inst-to-remote(pid=19566): Launched
07:49:23.829928 run    scp-inst-to-remote(pid=19566): Terminated: ok {rc=0}
07:49:24.154583 run         mk-remote-dir(pid=19568): Launched
07:49:26.341601 run         mk-remote-dir(pid=19568): Terminated: ok {rc=0}
07:49:26.619222 run     scp-cfg-to-remote(pid=19569): Launched
07:49:27.806593 run     scp-cfg-to-remote(pid=19569): Terminated: ok {rc=0}
07:49:28.126008 run   reload-dsp-firmware(pid=19571): Launched
07:49:31.313500 run   reload-dsp-firmware(pid=19571): Terminated: ok {rc=0}
07:49:31.622918 run        osmo-bts-sysmo(pid=19572): Launched
07:49:35.855562 tst          emergency_mo_mt_call.py: using MSISDN 4639
07:49:36.034830 bus                        /sierra_1: Setting Powered True
07:49:39.530138 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4639', subscriber_id=1}
07:49:39.713402 bus                        /sierra_2: Setting Powered True
07:49:52.060160 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f710c70a158&gt;, timeout=10, timestep=1} [trial-802↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-802↪emergency:sysmo↪emergency_mo_mt_call.py:31]
07:49:52.067518 tst       emergency_mo_mt_call.py:31: Test FAILED (64.1 sec)
07:49:52.102973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19548): Terminating (SIGTERM)
07:49:52.144271 run   osmo-hlr_10.42.42.2(pid=19549): Terminating (SIGTERM)
07:49:52.190622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19550): Terminating (SIGTERM)
07:49:52.234419 run   osmo-stp_10.42.42.5(pid=19551): Terminating (SIGTERM)
07:49:52.294462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19552): Terminating (SIGTERM)
07:49:52.342439 run   osmo-msc_10.42.42.6(pid=19553): Terminating (SIGTERM)
07:49:52.386773 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19554): Terminating (SIGTERM)
07:49:52.428868 run   osmo-mgw_10.42.42.3(pid=19555): Terminating (SIGTERM)
07:49:52.482697 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19560): Terminating (SIGTERM)
07:49:52.525264 run   osmo-mgw_10.42.42.4(pid=19561): Terminating (SIGTERM)
07:49:52.579270 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19562): Terminating (SIGTERM)
07:49:52.620310 run   osmo-bsc_10.42.42.7(pid=19563): Terminating (SIGTERM)
07:49:52.661491 run        osmo-bts-sysmo(pid=19572): Terminating (SIGTERM)
07:49:52.670916 ---      ParallelTerminationStrategy: PID 19548 died...
07:49:52.726508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19548): Terminated: ok {rc=0}
07:49:52.736291 ---      ParallelTerminationStrategy: PID 19549 died...
07:49:52.790986 run   osmo-hlr_10.42.42.2(pid=19549): Terminated: ok {rc=0}
07:49:52.800766 ---      ParallelTerminationStrategy: PID 19550 died...
07:49:52.862883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19550): Terminated: ok {rc=0}
07:49:52.873515 ---      ParallelTerminationStrategy: PID 19551 died...
07:49:52.929660 run   osmo-stp_10.42.42.5(pid=19551): Terminated: ok {rc=0}
07:49:52.941462 ---      ParallelTerminationStrategy: PID 19552 died...
07:49:52.997956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19552): Terminated: ok {rc=0}
07:49:53.007658 ---      ParallelTerminationStrategy: PID 19553 died...
07:49:53.060933 run   osmo-msc_10.42.42.6(pid=19553): Terminated: ok {rc=0}
07:49:53.071191 ---      ParallelTerminationStrategy: PID 19554 died...
07:49:53.125242 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19554): Terminated: ok {rc=0}
07:49:53.134970 ---      ParallelTerminationStrategy: PID 19555 died...
07:49:53.188793 run   osmo-mgw_10.42.42.3(pid=19555): Terminated {rc=15}
07:49:53.198864 ---      ParallelTerminationStrategy: PID 19560 died...
07:49:53.252371 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19560): Terminated: ok {rc=0}
07:49:53.262692 ---      ParallelTerminationStrategy: PID 19561 died...
07:49:53.316264 run   osmo-mgw_10.42.42.4(pid=19561): Terminated {rc=15}
07:49:53.326704 ---      ParallelTerminationStrategy: PID 19562 died...
07:49:53.380992 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19562): Terminated: ok {rc=0}
07:49:53.390773 ---      ParallelTerminationStrategy: PID 19563 died...
07:49:53.444782 run   osmo-bsc_10.42.42.7(pid=19563): Terminated: ok {rc=0}
07:49:53.454385 ---      ParallelTerminationStrategy: PID 19572 died...
07:49:53.507760 run        osmo-bts-sysmo(pid=19572): Terminated: ok {rc=0}
07:49:53.610816 bus                        /sierra_2: Setting Online False
07:49:54.695975 bus                        /sierra_2: Setting Powered False
07:50:00.033263 bus                        /sierra_2: Setting Powered False
07:50:01.139134 bus                        /sierra_2: Setting Powered False
07:50:02.300840 bus                        /sierra_1: Setting Online False
07:50:03.390483 bus                        /sierra_1: Setting Powered False
07:50:08.970778 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f710c70a158>, timeout=10, timestep=1} [trial-802↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]