Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 65 builds (Since #751 )
Took 1 min 6 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fa2e00c3400>, timeout=10, timestep=1} [trial-815↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-815 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
23:12:32.006488 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
23:12:32.017190 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
23:12:32.145562 tst          emergency_mo_mt_call.py: using LAC 8206
23:12:32.267670 tst          emergency_mo_mt_call.py: using RAC 46
23:12:32.389608 tst          emergency_mo_mt_call.py: using CellId 8206
23:12:32.508683 tst          emergency_mo_mt_call.py: using BVCI 8202
23:12:32.532133 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
23:12:32.542781 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
23:12:32.553355 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
23:12:32.564011 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
23:12:32.574746 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
23:12:32.585406 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
23:12:32.691939 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
23:12:32.880748 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
23:12:33.372091 run         create_hlr_db(pid=22636): Launched
23:12:33.551859 bus                        /sierra_1: Setting Powered False
23:12:34.581227 run         create_hlr_db(pid=22636): Terminated: ok {rc=0}
23:12:35.020424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22638): Launched
23:12:35.351416 run   osmo-hlr_10.42.42.2(pid=22639): Launched
23:12:35.470381 run              osmo-stp_10.42.42.5: Starting osmo-stp
23:12:36.043190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22640): Launched
23:12:36.375059 run   osmo-stp_10.42.42.5(pid=22641): Launched
23:12:36.500967 tst          emergency_mo_mt_call.py: using MSISDN 5327
23:12:36.654813 run              osmo-msc_10.42.42.6: Starting osmo-msc
23:12:37.225450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22642): Launched
23:12:37.537965 run   osmo-msc_10.42.42.6(pid=22643): Launched
23:12:40.704008 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
23:12:41.247973 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22644): Launched
23:12:41.561367 run   osmo-mgw_10.42.42.3(pid=22645): Launched
23:12:41.671456 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
23:12:42.202488 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22646): Launched
23:12:42.517472 run   osmo-mgw_10.42.42.4(pid=22647): Launched
23:12:42.627746 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
23:12:43.278224 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22648): Launched
23:12:43.592456 run   osmo-bsc_10.42.42.7(pid=22649): Launched
23:12:49.856999 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
23:12:50.420800 run         rm-remote-dir(pid=22650): Launched
23:12:52.624656 run         rm-remote-dir(pid=22650): Terminated: ok {rc=0}
23:12:52.979004 run         mk-remote-dir(pid=22651): Launched
23:12:55.181692 run         mk-remote-dir(pid=22651): Terminated: ok {rc=0}
23:12:55.480549 run    scp-inst-to-remote(pid=22652): Launched
23:13:08.692876 run    scp-inst-to-remote(pid=22652): Terminated: ok {rc=0}
23:13:09.022328 run         mk-remote-dir(pid=22654): Launched
23:13:10.210255 run         mk-remote-dir(pid=22654): Terminated: ok {rc=0}
23:13:10.491587 run     scp-cfg-to-remote(pid=22655): Launched
23:13:12.681779 run     scp-cfg-to-remote(pid=22655): Terminated: ok {rc=0}
23:13:13.008466 run   reload-dsp-firmware(pid=22660): Launched
23:13:16.198142 run   reload-dsp-firmware(pid=22660): Terminated: ok {rc=0}
23:13:16.514725 run        osmo-bts-sysmo(pid=22661): Launched
23:13:21.752498 tst          emergency_mo_mt_call.py: using MSISDN 5328
23:13:21.924574 bus                        /sierra_1: Setting Powered True
23:13:25.421049 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5328', subscriber_id=1}
23:13:25.605447 bus                        /sierra_2: Setting Powered True
23:13:37.986932 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fa2e00c3400&gt;, timeout=10, timestep=1} [trial-815↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-815↪emergency:sysmo↪emergency_mo_mt_call.py:31]
23:13:37.994239 tst       emergency_mo_mt_call.py:31: Test FAILED (66.0 sec)
23:13:38.031118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22638): Terminating (SIGTERM)
23:13:38.072590 run   osmo-hlr_10.42.42.2(pid=22639): Terminating (SIGTERM)
23:13:38.115971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22640): Terminating (SIGTERM)
23:13:38.160310 run   osmo-stp_10.42.42.5(pid=22641): Terminating (SIGTERM)
23:13:38.228746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22642): Terminating (SIGTERM)
23:13:38.279102 run   osmo-msc_10.42.42.6(pid=22643): Terminating (SIGTERM)
23:13:38.320989 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22644): Terminating (SIGTERM)
23:13:38.362557 run   osmo-mgw_10.42.42.3(pid=22645): Terminating (SIGTERM)
23:13:38.404616 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22646): Terminating (SIGTERM)
23:13:38.446319 run   osmo-mgw_10.42.42.4(pid=22647): Terminating (SIGTERM)
23:13:38.488725 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22648): Terminating (SIGTERM)
23:13:38.530349 run   osmo-bsc_10.42.42.7(pid=22649): Terminating (SIGTERM)
23:13:38.572217 run        osmo-bts-sysmo(pid=22661): Terminating (SIGTERM)
23:13:38.581812 ---      ParallelTerminationStrategy: PID 22638 died...
23:13:38.638302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22638): Terminated: ok {rc=0}
23:13:38.648705 ---      ParallelTerminationStrategy: PID 22639 died...
23:13:38.718302 run   osmo-hlr_10.42.42.2(pid=22639): Terminated: ok {rc=0}
23:13:38.745805 ---      ParallelTerminationStrategy: PID 22640 died...
23:13:38.857220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22640): Terminated: ok {rc=0}
23:13:38.867494 ---      ParallelTerminationStrategy: PID 22641 died...
23:13:38.924165 run   osmo-stp_10.42.42.5(pid=22641): Terminated: ok {rc=0}
23:13:38.937369 ---      ParallelTerminationStrategy: PID 22642 died...
23:13:38.994030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22642): Terminated: ok {rc=0}
23:13:39.004100 ---      ParallelTerminationStrategy: PID 22643 died...
23:13:39.059845 run   osmo-msc_10.42.42.6(pid=22643): Terminated: ok {rc=0}
23:13:39.069931 ---      ParallelTerminationStrategy: PID 22644 died...
23:13:39.125320 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22644): Terminated: ok {rc=0}
23:13:39.135352 ---      ParallelTerminationStrategy: PID 22645 died...
23:13:39.190852 run   osmo-mgw_10.42.42.3(pid=22645): Terminated {rc=15}
23:13:39.200828 ---      ParallelTerminationStrategy: PID 22646 died...
23:13:39.256556 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22646): Terminated: ok {rc=0}
23:13:39.266536 ---      ParallelTerminationStrategy: PID 22647 died...
23:13:39.322289 run   osmo-mgw_10.42.42.4(pid=22647): Terminated {rc=15}
23:13:39.332260 ---      ParallelTerminationStrategy: PID 22648 died...
23:13:39.387893 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22648): Terminated: ok {rc=0}
23:13:39.397978 ---      ParallelTerminationStrategy: PID 22649 died...
23:13:39.453287 run   osmo-bsc_10.42.42.7(pid=22649): Terminated: ok {rc=0}
23:13:39.463217 ---      ParallelTerminationStrategy: PID 22661 died...
23:13:39.518725 run        osmo-bts-sysmo(pid=22661): Terminated: ok {rc=0}
23:13:39.625975 bus                        /sierra_2: Setting Online False
23:13:40.712266 bus                        /sierra_2: Setting Powered False
23:13:46.052438 bus                        /sierra_2: Setting Powered False
23:13:47.157195 bus                        /sierra_2: Setting Powered False
23:13:48.284349 bus                        /sierra_1: Setting Online False
23:13:49.367679 bus                        /sierra_1: Setting Powered False
23:13:54.954579 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fa2e00c3400>, timeout=10, timestep=1} [trial-815↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]