Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 97 builds (Since #751 )
Took 1 min 11 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f5ab03b77b8>, timeout=10, timestep=1} [trial-847↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-847 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
13:27:46.997571 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
13:27:47.009044 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
13:27:47.144989 tst          emergency_mo_mt_call.py: using LAC 10766
13:27:47.275208 tst          emergency_mo_mt_call.py: using RAC 56
13:27:47.406352 tst          emergency_mo_mt_call.py: using CellId 10766
13:27:47.537118 tst          emergency_mo_mt_call.py: using BVCI 10762
13:27:47.562376 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
13:27:47.573362 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
13:27:47.584147 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
13:27:47.595011 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
13:27:47.605984 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
13:27:47.616763 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
13:27:47.719364 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
13:27:47.908631 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
13:27:48.396709 run         create_hlr_db(pid=22815): Launched
13:27:48.578083 bus                        /sierra_1: Setting Powered False
13:27:49.596921 run         create_hlr_db(pid=22815): Terminated: ok {rc=0}
13:27:50.035634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22817): Launched
13:27:50.366861 run   osmo-hlr_10.42.42.2(pid=22818): Launched
13:27:50.486836 run              osmo-stp_10.42.42.5: Starting osmo-stp
13:27:51.059775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22819): Launched
13:27:51.389815 run   osmo-stp_10.42.42.5(pid=22820): Launched
13:27:51.519595 tst          emergency_mo_mt_call.py: using MSISDN 7023
13:27:51.683156 run              osmo-msc_10.42.42.6: Starting osmo-msc
13:27:52.285689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22821): Launched
13:27:52.617047 run   osmo-msc_10.42.42.6(pid=22822): Launched
13:27:55.792832 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
13:27:56.367469 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22823): Launched
13:27:56.697284 run   osmo-mgw_10.42.42.3(pid=22824): Launched
13:27:56.815244 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
13:27:57.380141 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22825): Launched
13:27:57.715995 run   osmo-mgw_10.42.42.4(pid=22826): Launched
13:27:57.834036 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
13:27:58.523195 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22827): Launched
13:27:58.855963 run   osmo-bsc_10.42.42.7(pid=22828): Launched
13:28:05.136072 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
13:28:05.727753 run         rm-remote-dir(pid=22829): Launched
13:28:07.933217 run         rm-remote-dir(pid=22829): Terminated: ok {rc=0}
13:28:08.290226 run         mk-remote-dir(pid=22830): Launched
13:28:10.493624 run         mk-remote-dir(pid=22830): Terminated: ok {rc=0}
13:28:10.794650 run    scp-inst-to-remote(pid=22831): Launched
13:28:25.017993 run    scp-inst-to-remote(pid=22831): Terminated: ok {rc=0}
13:28:25.369874 run         mk-remote-dir(pid=22833): Launched
13:28:28.572384 run         mk-remote-dir(pid=22833): Terminated: ok {rc=0}
13:28:28.871314 run     scp-cfg-to-remote(pid=22834): Launched
13:28:31.072075 run     scp-cfg-to-remote(pid=22834): Terminated: ok {rc=0}
13:28:31.419394 run   reload-dsp-firmware(pid=22836): Launched
13:28:35.621323 run   reload-dsp-firmware(pid=22836): Terminated: ok {rc=0}
13:28:35.960701 run        osmo-bts-sysmo(pid=22837): Launched
13:28:41.213047 tst          emergency_mo_mt_call.py: using MSISDN 7024
13:28:41.387608 bus                        /sierra_1: Setting Powered True
13:28:44.863599 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='7024', subscriber_id=1}
13:28:45.046226 bus                        /sierra_2: Setting Powered True
13:28:57.425390 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f5ab03b77b8&gt;, timeout=10, timestep=1} [trial-847↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-847↪emergency:sysmo↪emergency_mo_mt_call.py:31]
13:28:57.431984 tst       emergency_mo_mt_call.py:31: Test FAILED (70.4 sec)
13:28:57.466550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22817): Terminating (SIGTERM)
13:28:57.506221 run   osmo-hlr_10.42.42.2(pid=22818): Terminating (SIGTERM)
13:28:57.547484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22819): Terminating (SIGTERM)
13:28:57.588511 run   osmo-stp_10.42.42.5(pid=22820): Terminating (SIGTERM)
13:28:57.638766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22821): Terminating (SIGTERM)
13:28:57.681911 run   osmo-msc_10.42.42.6(pid=22822): Terminating (SIGTERM)
13:28:57.728341 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22823): Terminating (SIGTERM)
13:28:57.771993 run   osmo-mgw_10.42.42.3(pid=22824): Terminating (SIGTERM)
13:28:57.815173 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22825): Terminating (SIGTERM)
13:28:57.859693 run   osmo-mgw_10.42.42.4(pid=22826): Terminating (SIGTERM)
13:28:57.902530 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22827): Terminating (SIGTERM)
13:28:57.942238 run   osmo-bsc_10.42.42.7(pid=22828): Terminating (SIGTERM)
13:28:57.982104 run        osmo-bts-sysmo(pid=22837): Terminating (SIGTERM)
13:28:57.991522 ---      ParallelTerminationStrategy: PID 22817 died...
13:28:58.044491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22817): Terminated: ok {rc=0}
13:28:58.054440 ---      ParallelTerminationStrategy: PID 22818 died...
13:28:58.107988 run   osmo-hlr_10.42.42.2(pid=22818): Terminated: ok {rc=0}
13:28:58.118129 ---      ParallelTerminationStrategy: PID 22819 died...
13:28:58.172579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22819): Terminated: ok {rc=0}
13:28:58.182933 ---      ParallelTerminationStrategy: PID 22820 died...
13:28:58.237281 run   osmo-stp_10.42.42.5(pid=22820): Terminated: ok {rc=0}
13:28:58.247675 ---      ParallelTerminationStrategy: PID 22821 died...
13:28:58.300845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22821): Terminated: ok {rc=0}
13:28:58.310560 ---      ParallelTerminationStrategy: PID 22822 died...
13:28:58.363219 run   osmo-msc_10.42.42.6(pid=22822): Terminated: ok {rc=0}
13:28:58.373046 ---      ParallelTerminationStrategy: PID 22823 died...
13:28:58.426009 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22823): Terminated: ok {rc=0}
13:28:58.435669 ---      ParallelTerminationStrategy: PID 22824 died...
13:28:58.488640 run   osmo-mgw_10.42.42.3(pid=22824): Terminated {rc=15}
13:28:58.498242 ---      ParallelTerminationStrategy: PID 22825 died...
13:28:58.551157 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22825): Terminated: ok {rc=0}
13:28:58.560653 ---      ParallelTerminationStrategy: PID 22826 died...
13:28:58.613379 run   osmo-mgw_10.42.42.4(pid=22826): Terminated {rc=15}
13:28:58.622952 ---      ParallelTerminationStrategy: PID 22827 died...
13:28:58.675914 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22827): Terminated: ok {rc=0}
13:28:58.686120 ---      ParallelTerminationStrategy: PID 22828 died...
13:28:58.739508 run   osmo-bsc_10.42.42.7(pid=22828): Terminated: ok {rc=0}
13:28:58.749572 ---      ParallelTerminationStrategy: PID 22837 died...
13:28:58.803378 run        osmo-bts-sysmo(pid=22837): Terminated: ok {rc=0}
13:28:58.911534 bus                        /sierra_2: Setting Online False
13:28:59.995307 bus                        /sierra_2: Setting Powered False
13:29:05.960063 bus                        /sierra_2: Setting Powered False
13:29:07.064224 bus                        /sierra_2: Setting Powered False
13:29:08.190679 bus                        /sierra_1: Setting Online False
13:29:09.276302 bus                        /sierra_1: Setting Powered False
13:29:14.967913 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f5ab03b77b8>, timeout=10, timestep=1} [trial-847↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]