Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 51 builds (Since #751 )
Took 1 min 5 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f2e11fd92f0>, timeout=10, timestep=1} [trial-801↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-801 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
06:50:26.011031 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
06:50:26.022238 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
06:50:26.151501 tst          emergency_mo_mt_call.py: using LAC 7086
06:50:26.275551 tst          emergency_mo_mt_call.py: using RAC 201
06:50:26.402907 tst          emergency_mo_mt_call.py: using CellId 7086
06:50:26.526918 tst          emergency_mo_mt_call.py: using BVCI 7082
06:50:26.550611 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
06:50:26.561630 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
06:50:26.572369 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
06:50:26.583895 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
06:50:26.595471 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
06:50:26.607308 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
06:50:26.708100 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
06:50:26.896216 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
06:50:27.383299 run         create_hlr_db(pid=16683): Launched
06:50:27.564374 bus                        /sierra_1: Setting Powered False
06:50:28.584622 run         create_hlr_db(pid=16683): Terminated: ok {rc=0}
06:50:29.023358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16685): Launched
06:50:29.353540 run   osmo-hlr_10.42.42.2(pid=16686): Launched
06:50:29.472477 run              osmo-stp_10.42.42.5: Starting osmo-stp
06:50:30.043131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16687): Launched
06:50:30.373454 run   osmo-stp_10.42.42.5(pid=16688): Launched
06:50:30.504472 tst          emergency_mo_mt_call.py: using MSISDN 4585
06:50:30.668010 run              osmo-msc_10.42.42.6: Starting osmo-msc
06:50:31.266986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16689): Launched
06:50:31.596969 run   osmo-msc_10.42.42.6(pid=16690): Launched
06:50:34.772681 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
06:50:35.343423 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=16691): Launched
06:50:35.673449 run   osmo-mgw_10.42.42.3(pid=16692): Launched
06:50:35.790537 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
06:50:36.350758 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16693): Launched
06:50:36.680963 run   osmo-mgw_10.42.42.4(pid=16694): Launched
06:50:36.798399 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
06:50:37.483248 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=16695): Launched
06:50:37.813793 run   osmo-bsc_10.42.42.7(pid=16696): Launched
06:50:44.087539 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
06:50:44.641051 run         rm-remote-dir(pid=16697): Launched
06:50:46.833724 run         rm-remote-dir(pid=16697): Terminated: ok {rc=0}
06:50:47.167205 run         mk-remote-dir(pid=16698): Launched
06:50:48.357140 run         mk-remote-dir(pid=16698): Terminated: ok {rc=0}
06:50:48.643243 run    scp-inst-to-remote(pid=16699): Launched
06:51:01.859661 run    scp-inst-to-remote(pid=16699): Terminated: ok {rc=0}
06:51:02.206182 run         mk-remote-dir(pid=16701): Launched
06:51:04.406088 run         mk-remote-dir(pid=16701): Terminated: ok {rc=0}
06:51:04.702986 run     scp-cfg-to-remote(pid=16702): Launched
06:51:05.901642 run     scp-cfg-to-remote(pid=16702): Terminated: ok {rc=0}
06:51:06.246184 run   reload-dsp-firmware(pid=16704): Launched
06:51:09.444195 run   reload-dsp-firmware(pid=16704): Terminated: ok {rc=0}
06:51:09.778939 run        osmo-bts-sysmo(pid=16705): Launched
06:51:14.031219 tst          emergency_mo_mt_call.py: using MSISDN 4586
06:51:14.212901 bus                        /sierra_1: Setting Powered True
06:51:17.692858 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4586', subscriber_id=1}
06:51:17.894735 bus                        /sierra_2: Setting Powered True
06:51:30.252190 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f2e11fd92f0&gt;, timeout=10, timestep=1} [trial-801↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-801↪emergency:sysmo↪emergency_mo_mt_call.py:31]
06:51:30.258871 tst       emergency_mo_mt_call.py:31: Test FAILED (64.2 sec)
06:51:30.293933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16685): Terminating (SIGTERM)
06:51:30.334170 run   osmo-hlr_10.42.42.2(pid=16686): Terminating (SIGTERM)
06:51:30.379121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16687): Terminating (SIGTERM)
06:51:30.422817 run   osmo-stp_10.42.42.5(pid=16688): Terminating (SIGTERM)
06:51:30.466213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16689): Terminating (SIGTERM)
06:51:30.510338 run   osmo-msc_10.42.42.6(pid=16690): Terminating (SIGTERM)
06:51:30.556540 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=16691): Terminating (SIGTERM)
06:51:30.602691 run   osmo-mgw_10.42.42.3(pid=16692): Terminating (SIGTERM)
06:51:30.647356 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16693): Terminating (SIGTERM)
06:51:30.693312 run   osmo-mgw_10.42.42.4(pid=16694): Terminating (SIGTERM)
06:51:30.737955 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=16695): Terminating (SIGTERM)
06:51:30.782822 run   osmo-bsc_10.42.42.7(pid=16696): Terminating (SIGTERM)
06:51:30.826154 run        osmo-bts-sysmo(pid=16705): Terminating (SIGTERM)
06:51:30.836157 ---      ParallelTerminationStrategy: PID 16685 died...
06:51:30.894408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16685): Terminated: ok {rc=0}
06:51:30.904809 ---      ParallelTerminationStrategy: PID 16686 died...
06:51:30.963206 run   osmo-hlr_10.42.42.2(pid=16686): Terminated: ok {rc=0}
06:51:30.973894 ---      ParallelTerminationStrategy: PID 16687 died...
06:51:31.032927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16687): Terminated: ok {rc=0}
06:51:31.043897 ---      ParallelTerminationStrategy: PID 16688 died...
06:51:31.103218 run   osmo-stp_10.42.42.5(pid=16688): Terminated: ok {rc=0}
06:51:31.114114 ---      ParallelTerminationStrategy: PID 16689 died...
06:51:31.176524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16689): Terminated: ok {rc=0}
06:51:31.186971 ---      ParallelTerminationStrategy: PID 16690 died...
06:51:31.244325 run   osmo-msc_10.42.42.6(pid=16690): Terminated: ok {rc=0}
06:51:31.254629 ---      ParallelTerminationStrategy: PID 16691 died...
06:51:31.311378 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=16691): Terminated: ok {rc=0}
06:51:31.321845 ---      ParallelTerminationStrategy: PID 16692 died...
06:51:31.377828 run   osmo-mgw_10.42.42.3(pid=16692): Terminated {rc=15}
06:51:31.388068 ---      ParallelTerminationStrategy: PID 16693 died...
06:51:31.444304 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16693): Terminated: ok {rc=0}
06:51:31.454479 ---      ParallelTerminationStrategy: PID 16694 died...
06:51:31.510891 run   osmo-mgw_10.42.42.4(pid=16694): Terminated {rc=15}
06:51:31.521035 ---      ParallelTerminationStrategy: PID 16695 died...
06:51:31.577675 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=16695): Terminated: ok {rc=0}
06:51:31.587871 ---      ParallelTerminationStrategy: PID 16696 died...
06:51:31.644358 run   osmo-bsc_10.42.42.7(pid=16696): Terminated: ok {rc=0}
06:51:31.654552 ---      ParallelTerminationStrategy: PID 16705 died...
06:51:31.710785 run        osmo-bts-sysmo(pid=16705): Terminated: ok {rc=0}
06:51:31.818353 bus                        /sierra_2: Setting Online False
06:51:32.905824 bus                        /sierra_2: Setting Powered False
06:51:38.964364 bus                        /sierra_2: Setting Powered False
06:51:40.066015 bus                        /sierra_2: Setting Powered False
06:51:41.200226 bus                        /sierra_1: Setting Online False
06:51:42.284035 bus                        /sierra_1: Setting Powered False
06:51:47.970179 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f2e11fd92f0>, timeout=10, timestep=1} [trial-801↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]