Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 59 builds (Since #751 )
Took 1 min 5 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f64d5acb9d8>, timeout=10, timestep=1} [trial-809↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-809 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
14:38:33.014126 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
14:38:33.025045 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
14:38:33.156467 tst          emergency_mo_mt_call.py: using LAC 7726
14:38:33.275076 tst          emergency_mo_mt_call.py: using RAC 76
14:38:33.392145 tst          emergency_mo_mt_call.py: using CellId 7726
14:38:33.515347 tst          emergency_mo_mt_call.py: using BVCI 7722
14:38:33.539858 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
14:38:33.550981 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
14:38:33.561919 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
14:38:33.572746 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
14:38:33.583864 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
14:38:33.594945 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
14:38:33.694761 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
14:38:33.887661 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
14:38:34.405073 run          create_hlr_db(pid=4183): Launched
14:38:34.592727 bus                        /sierra_1: Setting Powered False
14:38:35.613726 run          create_hlr_db(pid=4183): Terminated: ok {rc=0}
14:38:36.041838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4185): Launched
14:38:36.343090 run    osmo-hlr_10.42.42.2(pid=4186): Launched
14:38:36.451217 run              osmo-stp_10.42.42.5: Starting osmo-stp
14:38:36.974233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4187): Launched
14:38:37.280683 run    osmo-stp_10.42.42.5(pid=4188): Launched
14:38:37.410436 tst          emergency_mo_mt_call.py: using MSISDN 5009
14:38:37.570437 run              osmo-msc_10.42.42.6: Starting osmo-msc
14:38:38.157857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4189): Launched
14:38:38.479584 run    osmo-msc_10.42.42.6(pid=4190): Launched
14:38:41.652115 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
14:38:42.212251 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=4191): Launched
14:38:42.535642 run    osmo-mgw_10.42.42.3(pid=4192): Launched
14:38:42.650059 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
14:38:43.199426 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=4193): Launched
14:38:43.521822 run    osmo-mgw_10.42.42.4(pid=4194): Launched
14:38:43.637604 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
14:38:44.313037 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=4195): Launched
14:38:44.636547 run    osmo-bsc_10.42.42.7(pid=4196): Launched
14:38:50.910575 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
14:38:51.490225 run          rm-remote-dir(pid=4197): Launched
14:38:53.690761 run          rm-remote-dir(pid=4197): Terminated: ok {rc=0}
14:38:54.036830 run          mk-remote-dir(pid=4198): Launched
14:38:55.235068 run          mk-remote-dir(pid=4198): Terminated: ok {rc=0}
14:38:55.527898 run     scp-inst-to-remote(pid=4199): Launched
14:39:08.733074 run     scp-inst-to-remote(pid=4199): Terminated: ok {rc=0}
14:39:09.055343 run          mk-remote-dir(pid=4201): Launched
14:39:11.240483 run          mk-remote-dir(pid=4201): Terminated: ok {rc=0}
14:39:11.516728 run      scp-cfg-to-remote(pid=4202): Launched
14:39:13.703698 run      scp-cfg-to-remote(pid=4202): Terminated: ok {rc=0}
14:39:14.022756 run    reload-dsp-firmware(pid=4204): Launched
14:39:17.208440 run    reload-dsp-firmware(pid=4204): Terminated: ok {rc=0}
14:39:17.517436 run         osmo-bts-sysmo(pid=4205): Launched
14:39:21.765366 tst          emergency_mo_mt_call.py: using MSISDN 5010
14:39:21.936453 bus                        /sierra_1: Setting Powered True
14:39:25.414176 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5010', subscriber_id=1}
14:39:25.604556 bus                        /sierra_2: Setting Powered True
14:39:37.980305 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f64d5acb9d8&gt;, timeout=10, timestep=1} [trial-809↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-809↪emergency:sysmo↪emergency_mo_mt_call.py:31]
14:39:37.987585 tst       emergency_mo_mt_call.py:31: Test FAILED (65.0 sec)
14:39:38.024695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4185): Terminating (SIGTERM)
14:39:38.066720 run    osmo-hlr_10.42.42.2(pid=4186): Terminating (SIGTERM)
14:39:38.110159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4187): Terminating (SIGTERM)
14:39:38.154791 run    osmo-stp_10.42.42.5(pid=4188): Terminating (SIGTERM)
14:39:38.207025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4189): Terminating (SIGTERM)
14:39:38.265104 run    osmo-msc_10.42.42.6(pid=4190): Terminating (SIGTERM)
14:39:38.314035 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=4191): Terminating (SIGTERM)
14:39:38.356989 run    osmo-mgw_10.42.42.3(pid=4192): Terminating (SIGTERM)
14:39:38.411350 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=4193): Terminating (SIGTERM)
14:39:38.457745 run    osmo-mgw_10.42.42.4(pid=4194): Terminating (SIGTERM)
14:39:38.512954 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=4195): Terminating (SIGTERM)
14:39:38.555099 run    osmo-bsc_10.42.42.7(pid=4196): Terminating (SIGTERM)
14:39:38.597428 run         osmo-bts-sysmo(pid=4205): Terminating (SIGTERM)
14:39:38.607097 ---      ParallelTerminationStrategy: PID 4185 died...
14:39:38.663189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4185): Terminated: ok {rc=0}
14:39:38.673251 ---      ParallelTerminationStrategy: PID 4186 died...
14:39:38.729192 run    osmo-hlr_10.42.42.2(pid=4186): Terminated: ok {rc=0}
14:39:38.739142 ---      ParallelTerminationStrategy: PID 4187 died...
14:39:38.796166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4187): Terminated: ok {rc=0}
14:39:38.806656 ---      ParallelTerminationStrategy: PID 4188 died...
14:39:38.863120 run    osmo-stp_10.42.42.5(pid=4188): Terminated: ok {rc=0}
14:39:38.873673 ---      ParallelTerminationStrategy: PID 4189 died...
14:39:38.930455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4189): Terminated: ok {rc=0}
14:39:38.940877 ---      ParallelTerminationStrategy: PID 4190 died...
14:39:38.998015 run    osmo-msc_10.42.42.6(pid=4190): Terminated: ok {rc=0}
14:39:39.008116 ---      ParallelTerminationStrategy: PID 4191 died...
14:39:39.063705 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=4191): Terminated: ok {rc=0}
14:39:39.073832 ---      ParallelTerminationStrategy: PID 4192 died...
14:39:39.129262 run    osmo-mgw_10.42.42.3(pid=4192): Terminated {rc=15}
14:39:39.139291 ---      ParallelTerminationStrategy: PID 4193 died...
14:39:39.195015 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=4193): Terminated: ok {rc=0}
14:39:39.205061 ---      ParallelTerminationStrategy: PID 4194 died...
14:39:39.260919 run    osmo-mgw_10.42.42.4(pid=4194): Terminated {rc=15}
14:39:39.270933 ---      ParallelTerminationStrategy: PID 4195 died...
14:39:39.326760 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=4195): Terminated: ok {rc=0}
14:39:39.336842 ---      ParallelTerminationStrategy: PID 4196 died...
14:39:39.392266 run    osmo-bsc_10.42.42.7(pid=4196): Terminated: ok {rc=0}
14:39:39.402329 ---      ParallelTerminationStrategy: PID 4205 died...
14:39:39.458223 run         osmo-bts-sysmo(pid=4205): Terminated: ok {rc=0}
14:39:39.563852 bus                        /sierra_2: Setting Online False
14:39:40.650008 bus                        /sierra_2: Setting Powered False
14:39:45.982249 bus                        /sierra_2: Setting Powered False
14:39:47.088395 bus                        /sierra_2: Setting Powered False
14:39:48.217877 bus                        /sierra_1: Setting Online False
14:39:49.305528 bus                        /sierra_1: Setting Powered False
14:39:54.969238 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f64d5acb9d8>, timeout=10, timestep=1} [trial-809↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]