Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 72 builds (Since #751 )
Took 1 min 7 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fd2c451bf28>, timeout=10, timestep=1} [trial-822↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-822 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
07:51:34.996571 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
07:51:35.007292 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
07:51:35.131774 tst          emergency_mo_mt_call.py: using LAC 8766
07:51:35.253334 tst          emergency_mo_mt_call.py: using RAC 96
07:51:35.375215 tst          emergency_mo_mt_call.py: using CellId 8766
07:51:35.496057 tst          emergency_mo_mt_call.py: using BVCI 8762
07:51:35.519236 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
07:51:35.530003 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
07:51:35.540554 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
07:51:35.551361 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
07:51:35.562260 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
07:51:35.572970 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
07:51:35.670111 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
07:51:35.860527 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
07:51:36.342210 run         create_hlr_db(pid=11963): Launched
07:51:36.523988 bus                        /sierra_1: Setting Powered False
07:51:37.540178 run         create_hlr_db(pid=11963): Terminated: ok {rc=0}
07:51:37.949637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11965): Launched
07:51:38.259246 run   osmo-hlr_10.42.42.2(pid=11966): Launched
07:51:38.368611 run              osmo-stp_10.42.42.5: Starting osmo-stp
07:51:38.900500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11967): Launched
07:51:39.208942 run   osmo-stp_10.42.42.5(pid=11968): Launched
07:51:39.330869 tst          emergency_mo_mt_call.py: using MSISDN 5698
07:51:39.482913 run              osmo-msc_10.42.42.6: Starting osmo-msc
07:51:40.044051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11969): Launched
07:51:40.353548 run   osmo-msc_10.42.42.6(pid=11970): Launched
07:51:43.525112 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
07:51:44.087793 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11971): Launched
07:51:44.413749 run   osmo-mgw_10.42.42.3(pid=11972): Launched
07:51:44.528994 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
07:51:45.083863 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11973): Launched
07:51:45.409744 run   osmo-mgw_10.42.42.4(pid=11974): Launched
07:51:45.526660 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
07:51:46.207074 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11975): Launched
07:51:46.535346 run   osmo-bsc_10.42.42.7(pid=11976): Launched
07:51:52.800549 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
07:51:53.352465 run         rm-remote-dir(pid=11977): Launched
07:51:55.543917 run         rm-remote-dir(pid=11977): Terminated: ok {rc=0}
07:51:55.876799 run         mk-remote-dir(pid=11978): Launched
07:51:58.066763 run         mk-remote-dir(pid=11978): Terminated: ok {rc=0}
07:51:58.346526 run    scp-inst-to-remote(pid=11979): Launched
07:52:11.562148 run    scp-inst-to-remote(pid=11979): Terminated: ok {rc=0}
07:52:11.909326 run         mk-remote-dir(pid=11981): Launched
07:52:14.107024 run         mk-remote-dir(pid=11981): Terminated: ok {rc=0}
07:52:14.402121 run     scp-cfg-to-remote(pid=11982): Launched
07:52:16.601876 run     scp-cfg-to-remote(pid=11982): Terminated: ok {rc=0}
07:52:16.943475 run   reload-dsp-firmware(pid=11984): Launched
07:52:20.139433 run   reload-dsp-firmware(pid=11984): Terminated: ok {rc=0}
07:52:20.472404 run        osmo-bts-sysmo(pid=11985): Launched
07:52:25.721133 tst          emergency_mo_mt_call.py: using MSISDN 5699
07:52:25.898582 bus                        /sierra_1: Setting Powered True
07:52:29.391079 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5699', subscriber_id=1}
07:52:29.579556 bus                        /sierra_2: Setting Powered True
07:52:41.951664 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fd2c451bf28&gt;, timeout=10, timestep=1} [trial-822↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-822↪emergency:sysmo↪emergency_mo_mt_call.py:31]
07:52:41.958289 tst       emergency_mo_mt_call.py:31: Test FAILED (67.0 sec)
07:52:41.992428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11965): Terminating (SIGTERM)
07:52:42.031662 run   osmo-hlr_10.42.42.2(pid=11966): Terminating (SIGTERM)
07:52:42.073032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11967): Terminating (SIGTERM)
07:52:42.115138 run   osmo-stp_10.42.42.5(pid=11968): Terminating (SIGTERM)
07:52:42.166328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11969): Terminating (SIGTERM)
07:52:42.209020 run   osmo-msc_10.42.42.6(pid=11970): Terminating (SIGTERM)
07:52:42.253091 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11971): Terminating (SIGTERM)
07:52:42.296779 run   osmo-mgw_10.42.42.3(pid=11972): Terminating (SIGTERM)
07:52:42.351501 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11973): Terminating (SIGTERM)
07:52:42.394253 run   osmo-mgw_10.42.42.4(pid=11974): Terminating (SIGTERM)
07:52:42.437472 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11975): Terminating (SIGTERM)
07:52:42.480333 run   osmo-bsc_10.42.42.7(pid=11976): Terminating (SIGTERM)
07:52:42.522571 run        osmo-bts-sysmo(pid=11985): Terminating (SIGTERM)
07:52:42.532343 ---      ParallelTerminationStrategy: PID 11965 died...
07:52:42.588572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11965): Terminated: ok {rc=0}
07:52:42.598825 ---      ParallelTerminationStrategy: PID 11966 died...
07:52:42.654588 run   osmo-hlr_10.42.42.2(pid=11966): Terminated: ok {rc=0}
07:52:42.665360 ---      ParallelTerminationStrategy: PID 11967 died...
07:52:42.722414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11967): Terminated: ok {rc=0}
07:52:42.732884 ---      ParallelTerminationStrategy: PID 11968 died...
07:52:42.789839 run   osmo-stp_10.42.42.5(pid=11968): Terminated: ok {rc=0}
07:52:42.800247 ---      ParallelTerminationStrategy: PID 11969 died...
07:52:42.856892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11969): Terminated: ok {rc=0}
07:52:42.867401 ---      ParallelTerminationStrategy: PID 11970 died...
07:52:42.924214 run   osmo-msc_10.42.42.6(pid=11970): Terminated: ok {rc=0}
07:52:42.934661 ---      ParallelTerminationStrategy: PID 11971 died...
07:52:42.990442 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11971): Terminated: ok {rc=0}
07:52:43.000748 ---      ParallelTerminationStrategy: PID 11972 died...
07:52:43.056660 run   osmo-mgw_10.42.42.3(pid=11972): Terminated {rc=15}
07:52:43.066824 ---      ParallelTerminationStrategy: PID 11973 died...
07:52:43.122759 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11973): Terminated: ok {rc=0}
07:52:43.132789 ---      ParallelTerminationStrategy: PID 11974 died...
07:52:43.188860 run   osmo-mgw_10.42.42.4(pid=11974): Terminated {rc=15}
07:52:43.198931 ---      ParallelTerminationStrategy: PID 11975 died...
07:52:43.254367 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11975): Terminated: ok {rc=0}
07:52:43.264349 ---      ParallelTerminationStrategy: PID 11976 died...
07:52:43.319908 run   osmo-bsc_10.42.42.7(pid=11976): Terminated: ok {rc=0}
07:52:43.330048 ---      ParallelTerminationStrategy: PID 11985 died...
07:52:43.385611 run        osmo-bts-sysmo(pid=11985): Terminated: ok {rc=0}
07:52:43.492019 bus                        /sierra_2: Setting Online False
07:52:44.578097 bus                        /sierra_2: Setting Powered False
07:52:49.959065 bus                        /sierra_2: Setting Powered False
07:52:51.064735 bus                        /sierra_2: Setting Powered False
07:52:52.191735 bus                        /sierra_1: Setting Online False
07:52:53.279352 bus                        /sierra_1: Setting Powered False
07:52:58.960094 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fd2c451bf28>, timeout=10, timestep=1} [trial-822↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]