Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 82 builds (Since #751 )
Took 1 min 9 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f11a41cc158>, timeout=10, timestep=1} [trial-832↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-832 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
19:55:01.019415 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
19:55:01.030710 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
19:55:01.166246 tst          emergency_mo_mt_call.py: using LAC 9566
19:55:01.297808 tst          emergency_mo_mt_call.py: using RAC 131
19:55:01.423299 tst          emergency_mo_mt_call.py: using CellId 9566
19:55:01.546551 tst          emergency_mo_mt_call.py: using BVCI 9562
19:55:01.570270 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
19:55:01.580843 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
19:55:01.591458 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
19:55:01.602235 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
19:55:01.613004 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
19:55:01.623701 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
19:55:01.727158 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
19:55:01.924258 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
19:55:02.454198 run          create_hlr_db(pid=8284): Launched
19:55:02.646934 bus                        /sierra_1: Setting Powered False
19:55:03.666535 run          create_hlr_db(pid=8284): Terminated: ok {rc=0}
19:55:04.084629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8286): Launched
19:55:04.396936 run    osmo-hlr_10.42.42.2(pid=8287): Launched
19:55:04.509141 run              osmo-stp_10.42.42.5: Starting osmo-stp
19:55:05.048522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8288): Launched
19:55:05.359475 run    osmo-stp_10.42.42.5(pid=8289): Launched
19:55:05.489818 tst          emergency_mo_mt_call.py: using MSISDN 6228
19:55:05.656083 run              osmo-msc_10.42.42.6: Starting osmo-msc
19:55:06.259492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8290): Launched
19:55:06.590466 run    osmo-msc_10.42.42.6(pid=8291): Launched
19:55:09.768156 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
19:55:10.342166 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=8292): Launched
19:55:10.673719 run    osmo-mgw_10.42.42.3(pid=8293): Launched
19:55:10.791852 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
19:55:11.355492 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8294): Launched
19:55:11.686404 run    osmo-mgw_10.42.42.4(pid=8295): Launched
19:55:11.804692 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
19:55:12.494777 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=8296): Launched
19:55:12.827050 run    osmo-bsc_10.42.42.7(pid=8297): Launched
19:55:19.110689 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
19:55:19.704764 run          rm-remote-dir(pid=8298): Launched
19:55:21.910863 run          rm-remote-dir(pid=8298): Terminated: ok {rc=0}
19:55:22.268723 run          mk-remote-dir(pid=8299): Launched
19:55:24.473970 run          mk-remote-dir(pid=8299): Terminated: ok {rc=0}
19:55:24.775707 run     scp-inst-to-remote(pid=8300): Launched
19:55:38.000481 run     scp-inst-to-remote(pid=8300): Terminated: ok {rc=0}
19:55:38.351611 run          mk-remote-dir(pid=8302): Launched
19:55:41.544611 run          mk-remote-dir(pid=8302): Terminated: ok {rc=0}
19:55:41.827864 run      scp-cfg-to-remote(pid=8303): Launched
19:55:44.019731 run      scp-cfg-to-remote(pid=8303): Terminated: ok {rc=0}
19:55:44.352709 run    reload-dsp-firmware(pid=8305): Launched
19:55:47.552034 run    reload-dsp-firmware(pid=8305): Terminated: ok {rc=0}
19:55:47.889543 run         osmo-bts-sysmo(pid=8306): Launched
19:55:53.144068 tst          emergency_mo_mt_call.py: using MSISDN 6229
19:55:53.319093 bus                        /sierra_1: Setting Powered True
19:55:56.801690 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6229', subscriber_id=1}
19:55:56.985197 bus                        /sierra_2: Setting Powered True
19:56:09.338046 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f11a41cc158&gt;, timeout=10, timestep=1} [trial-832↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-832↪emergency:sysmo↪emergency_mo_mt_call.py:31]
19:56:09.344864 tst       emergency_mo_mt_call.py:31: Test FAILED (68.3 sec)
19:56:09.379636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8286): Terminating (SIGTERM)
19:56:09.419939 run    osmo-hlr_10.42.42.2(pid=8287): Terminating (SIGTERM)
19:56:09.461557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8288): Terminating (SIGTERM)
19:56:09.503471 run    osmo-stp_10.42.42.5(pid=8289): Terminating (SIGTERM)
19:56:09.545827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8290): Terminating (SIGTERM)
19:56:09.589299 run    osmo-msc_10.42.42.6(pid=8291): Terminating (SIGTERM)
19:56:09.637012 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=8292): Terminating (SIGTERM)
19:56:09.680272 run    osmo-mgw_10.42.42.3(pid=8293): Terminating (SIGTERM)
19:56:09.740261 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8294): Terminating (SIGTERM)
19:56:09.782339 run    osmo-mgw_10.42.42.4(pid=8295): Terminating (SIGTERM)
19:56:09.822995 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=8296): Terminating (SIGTERM)
19:56:09.863099 run    osmo-bsc_10.42.42.7(pid=8297): Terminating (SIGTERM)
19:56:09.903344 run         osmo-bts-sysmo(pid=8306): Terminating (SIGTERM)
19:56:09.912852 ---      ParallelTerminationStrategy: PID 8286 died...
19:56:09.969293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8286): Terminated: ok {rc=0}
19:56:09.979697 ---      ParallelTerminationStrategy: PID 8287 died...
19:56:10.035851 run    osmo-hlr_10.42.42.2(pid=8287): Terminated: ok {rc=0}
19:56:10.046433 ---      ParallelTerminationStrategy: PID 8288 died...
19:56:10.102587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8288): Terminated: ok {rc=0}
19:56:10.112276 ---      ParallelTerminationStrategy: PID 8289 died...
19:56:10.165827 run    osmo-stp_10.42.42.5(pid=8289): Terminated: ok {rc=0}
19:56:10.175632 ---      ParallelTerminationStrategy: PID 8290 died...
19:56:10.229650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8290): Terminated: ok {rc=0}
19:56:10.239322 ---      ParallelTerminationStrategy: PID 8291 died...
19:56:10.292904 run    osmo-msc_10.42.42.6(pid=8291): Terminated: ok {rc=0}
19:56:10.302667 ---      ParallelTerminationStrategy: PID 8292 died...
19:56:10.356779 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=8292): Terminated: ok {rc=0}
19:56:10.366482 ---      ParallelTerminationStrategy: PID 8293 died...
19:56:10.419649 run    osmo-mgw_10.42.42.3(pid=8293): Terminated {rc=15}
19:56:10.429723 ---      ParallelTerminationStrategy: PID 8294 died...
19:56:10.483869 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8294): Terminated: ok {rc=0}
19:56:10.493603 ---      ParallelTerminationStrategy: PID 8295 died...
19:56:10.546791 run    osmo-mgw_10.42.42.4(pid=8295): Terminated {rc=15}
19:56:10.556621 ---      ParallelTerminationStrategy: PID 8296 died...
19:56:10.610265 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=8296): Terminated: ok {rc=0}
19:56:10.620167 ---      ParallelTerminationStrategy: PID 8297 died...
19:56:10.673651 run    osmo-bsc_10.42.42.7(pid=8297): Terminated: ok {rc=0}
19:56:10.683577 ---      ParallelTerminationStrategy: PID 8306 died...
19:56:10.737260 run         osmo-bts-sysmo(pid=8306): Terminated: ok {rc=0}
19:56:10.846332 bus                        /sierra_2: Setting Online False
19:56:11.930316 bus                        /sierra_2: Setting Powered False
19:56:17.958517 bus                        /sierra_2: Setting Powered False
19:56:19.059567 bus                        /sierra_2: Setting Powered False
19:56:20.192397 bus                        /sierra_1: Setting Online False
19:56:21.275896 bus                        /sierra_1: Setting Powered False
19:56:26.961584 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f11a41cc158>, timeout=10, timestep=1} [trial-832↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]