Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 56 builds (Since #751 )
Took 1 min 5 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f8301585f28>, timeout=10, timestep=1} [trial-806↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-806 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
11:42:35.011817 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
11:42:35.022882 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
11:42:35.152003 tst          emergency_mo_mt_call.py: using LAC 7486
11:42:35.276782 tst          emergency_mo_mt_call.py: using RAC 91
11:42:35.405964 tst          emergency_mo_mt_call.py: using CellId 7486
11:42:35.527966 tst          emergency_mo_mt_call.py: using BVCI 7482
11:42:35.551213 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
11:42:35.562007 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
11:42:35.572570 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
11:42:35.583645 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
11:42:35.594723 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
11:42:35.605764 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
11:42:35.709302 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
11:42:35.902423 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
11:42:36.412765 run         create_hlr_db(pid=29521): Launched
11:42:36.599028 bus                        /sierra_1: Setting Powered False
11:42:37.619228 run         create_hlr_db(pid=29521): Terminated: ok {rc=0}
11:42:38.047048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29523): Launched
11:42:38.368754 run   osmo-hlr_10.42.42.2(pid=29524): Launched
11:42:38.483902 run              osmo-stp_10.42.42.5: Starting osmo-stp
11:42:39.040122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29525): Launched
11:42:39.362018 run   osmo-stp_10.42.42.5(pid=29526): Launched
11:42:39.484358 tst          emergency_mo_mt_call.py: using MSISDN 4850
11:42:39.635016 run              osmo-msc_10.42.42.6: Starting osmo-msc
11:42:40.188971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29527): Launched
11:42:40.493021 run   osmo-msc_10.42.42.6(pid=29528): Launched
11:42:43.655891 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
11:42:44.186134 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=29529): Launched
11:42:44.490787 run   osmo-mgw_10.42.42.3(pid=29530): Launched
11:42:44.599167 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
11:42:45.118461 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29531): Launched
11:42:45.423534 run   osmo-mgw_10.42.42.4(pid=29532): Launched
11:42:45.531716 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
11:42:46.165046 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=29533): Launched
11:42:46.471737 run   osmo-bsc_10.42.42.7(pid=29534): Launched
11:42:52.731669 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
11:42:53.280759 run         rm-remote-dir(pid=29535): Launched
11:42:55.470314 run         rm-remote-dir(pid=29535): Terminated: ok {rc=0}
11:42:55.797359 run         mk-remote-dir(pid=29536): Launched
11:42:56.983753 run         mk-remote-dir(pid=29536): Terminated: ok {rc=0}
11:42:57.260852 run    scp-inst-to-remote(pid=29537): Launched
11:43:10.469673 run    scp-inst-to-remote(pid=29537): Terminated: ok {rc=0}
11:43:10.811958 run         mk-remote-dir(pid=29539): Launched
11:43:13.010138 run         mk-remote-dir(pid=29539): Terminated: ok {rc=0}
11:43:13.302798 run     scp-cfg-to-remote(pid=29543): Launched
11:43:15.499415 run     scp-cfg-to-remote(pid=29543): Terminated: ok {rc=0}
11:43:15.836310 run   reload-dsp-firmware(pid=29545): Launched
11:43:18.030764 run   reload-dsp-firmware(pid=29545): Terminated: ok {rc=0}
11:43:18.359272 run        osmo-bts-sysmo(pid=29546): Launched
11:43:23.604346 tst          emergency_mo_mt_call.py: using MSISDN 4851
11:43:23.774327 bus                        /sierra_1: Setting Powered True
11:43:27.236110 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4851', subscriber_id=1}
11:43:27.424132 bus                        /sierra_2: Setting Powered True
11:43:39.782919 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f8301585f28&gt;, timeout=10, timestep=1} [trial-806↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-806↪emergency:sysmo↪emergency_mo_mt_call.py:31]
11:43:39.789737 tst       emergency_mo_mt_call.py:31: Test FAILED (64.8 sec)
11:43:39.824381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29523): Terminating (SIGTERM)
11:43:39.864098 run   osmo-hlr_10.42.42.2(pid=29524): Terminating (SIGTERM)
11:43:39.904326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29525): Terminating (SIGTERM)
11:43:39.945539 run   osmo-stp_10.42.42.5(pid=29526): Terminating (SIGTERM)
11:43:39.998554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29527): Terminating (SIGTERM)
11:43:40.044651 run   osmo-msc_10.42.42.6(pid=29528): Terminating (SIGTERM)
11:43:40.095215 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=29529): Terminating (SIGTERM)
11:43:40.136554 run   osmo-mgw_10.42.42.3(pid=29530): Terminating (SIGTERM)
11:43:40.177276 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29531): Terminating (SIGTERM)
11:43:40.218902 run   osmo-mgw_10.42.42.4(pid=29532): Terminating (SIGTERM)
11:43:40.266334 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=29533): Terminating (SIGTERM)
11:43:40.306174 run   osmo-bsc_10.42.42.7(pid=29534): Terminating (SIGTERM)
11:43:40.346197 run        osmo-bts-sysmo(pid=29546): Terminating (SIGTERM)
11:43:40.355476 ---      ParallelTerminationStrategy: PID 29523 died...
11:43:40.408629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29523): Terminated: ok {rc=0}
11:43:40.418039 ---      ParallelTerminationStrategy: PID 29524 died...
11:43:40.470784 run   osmo-hlr_10.42.42.2(pid=29524): Terminated: ok {rc=0}
11:43:40.480358 ---      ParallelTerminationStrategy: PID 29525 died...
11:43:40.533218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29525): Terminated: ok {rc=0}
11:43:40.542726 ---      ParallelTerminationStrategy: PID 29526 died...
11:43:40.597044 run   osmo-stp_10.42.42.5(pid=29526): Terminated: ok {rc=0}
11:43:40.606953 ---      ParallelTerminationStrategy: PID 29527 died...
11:43:40.661059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29527): Terminated: ok {rc=0}
11:43:40.671166 ---      ParallelTerminationStrategy: PID 29528 died...
11:43:40.725111 run   osmo-msc_10.42.42.6(pid=29528): Terminated: ok {rc=0}
11:43:40.734850 ---      ParallelTerminationStrategy: PID 29529 died...
11:43:40.787713 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=29529): Terminated: ok {rc=0}
11:43:40.797468 ---      ParallelTerminationStrategy: PID 29530 died...
11:43:40.850310 run   osmo-mgw_10.42.42.3(pid=29530): Terminated {rc=15}
11:43:40.859980 ---      ParallelTerminationStrategy: PID 29531 died...
11:43:40.912896 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29531): Terminated: ok {rc=0}
11:43:40.922655 ---      ParallelTerminationStrategy: PID 29532 died...
11:43:40.975548 run   osmo-mgw_10.42.42.4(pid=29532): Terminated {rc=15}
11:43:40.985308 ---      ParallelTerminationStrategy: PID 29533 died...
11:43:41.038106 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=29533): Terminated: ok {rc=0}
11:43:41.047804 ---      ParallelTerminationStrategy: PID 29534 died...
11:43:41.101276 run   osmo-bsc_10.42.42.7(pid=29534): Terminated: ok {rc=0}
11:43:41.110750 ---      ParallelTerminationStrategy: PID 29546 died...
11:43:41.163583 run        osmo-bts-sysmo(pid=29546): Terminated: ok {rc=0}
11:43:41.273388 bus                        /sierra_2: Setting Online False
11:43:42.356900 bus                        /sierra_2: Setting Powered False
11:43:47.958902 bus                        /sierra_2: Setting Powered False
11:43:49.064388 bus                        /sierra_2: Setting Powered False
11:43:50.193676 bus                        /sierra_1: Setting Online False
11:43:51.278947 bus                        /sierra_1: Setting Powered False
11:43:56.961747 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f8301585f28>, timeout=10, timestep=1} [trial-806↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]