Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 81 builds (Since #751 )
Took 1 min 9 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fd81c73e048>, timeout=10, timestep=1} [trial-831↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-831 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
18:54:59.001605 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
18:54:59.012199 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
18:54:59.136702 tst          emergency_mo_mt_call.py: using LAC 9486
18:54:59.256086 tst          emergency_mo_mt_call.py: using RAC 51
18:54:59.376885 tst          emergency_mo_mt_call.py: using CellId 9486
18:54:59.497357 tst          emergency_mo_mt_call.py: using BVCI 9482
18:54:59.520181 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
18:54:59.530980 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
18:54:59.541617 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
18:54:59.552284 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
18:54:59.563151 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
18:54:59.573927 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
18:54:59.677108 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
18:54:59.875715 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
18:55:00.392763 run          create_hlr_db(pid=5973): Launched
18:55:00.582042 bus                        /sierra_1: Setting Powered False
18:55:01.602081 run          create_hlr_db(pid=5973): Terminated: ok {rc=0}
18:55:02.035759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5978): Launched
18:55:02.358836 run    osmo-hlr_10.42.42.2(pid=5979): Launched
18:55:02.475348 run              osmo-stp_10.42.42.5: Starting osmo-stp
18:55:03.036429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5980): Launched
18:55:03.361358 run    osmo-stp_10.42.42.5(pid=5981): Launched
18:55:03.487470 tst          emergency_mo_mt_call.py: using MSISDN 6175
18:55:03.639377 run              osmo-msc_10.42.42.6: Starting osmo-msc
18:55:04.199743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5982): Launched
18:55:04.512156 run    osmo-msc_10.42.42.6(pid=5983): Launched
18:55:07.675935 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
18:55:08.213007 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5984): Launched
18:55:08.538328 run    osmo-mgw_10.42.42.3(pid=5985): Launched
18:55:08.654412 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
18:55:09.207736 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5986): Launched
18:55:09.534146 run    osmo-mgw_10.42.42.4(pid=5987): Launched
18:55:09.650521 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
18:55:10.327921 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5988): Launched
18:55:10.653020 run    osmo-bsc_10.42.42.7(pid=5989): Launched
18:55:16.931323 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
18:55:17.515015 run          rm-remote-dir(pid=5990): Launched
18:55:19.716519 run          rm-remote-dir(pid=5990): Terminated: ok {rc=0}
18:55:20.067853 run          mk-remote-dir(pid=5991): Launched
18:55:22.268599 run          mk-remote-dir(pid=5991): Terminated: ok {rc=0}
18:55:22.563940 run     scp-inst-to-remote(pid=5992): Launched
18:55:35.781740 run     scp-inst-to-remote(pid=5992): Terminated: ok {rc=0}
18:55:36.127000 run          mk-remote-dir(pid=5994): Launched
18:55:39.327178 run          mk-remote-dir(pid=5994): Terminated: ok {rc=0}
18:55:39.613574 run      scp-cfg-to-remote(pid=5995): Launched
18:55:41.811430 run      scp-cfg-to-remote(pid=5995): Terminated: ok {rc=0}
18:55:42.149953 run    reload-dsp-firmware(pid=5997): Launched
18:55:45.346439 run    reload-dsp-firmware(pid=5997): Terminated: ok {rc=0}
18:55:45.678717 run         osmo-bts-sysmo(pid=5998): Launched
18:55:50.929073 tst          emergency_mo_mt_call.py: using MSISDN 6176
18:55:51.100927 bus                        /sierra_1: Setting Powered True
18:55:54.578625 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6176', subscriber_id=1}
18:55:54.768956 bus                        /sierra_2: Setting Powered True
18:56:07.139318 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fd81c73e048&gt;, timeout=10, timestep=1} [trial-831↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-831↪emergency:sysmo↪emergency_mo_mt_call.py:31]
18:56:07.146186 tst       emergency_mo_mt_call.py:31: Test FAILED (68.1 sec)
18:56:07.180441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5978): Terminating (SIGTERM)
18:56:07.220650 run    osmo-hlr_10.42.42.2(pid=5979): Terminating (SIGTERM)
18:56:07.261969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5980): Terminating (SIGTERM)
18:56:07.304797 run    osmo-stp_10.42.42.5(pid=5981): Terminating (SIGTERM)
18:56:07.356639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5982): Terminating (SIGTERM)
18:56:07.401030 run    osmo-msc_10.42.42.6(pid=5983): Terminating (SIGTERM)
18:56:07.441307 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5984): Terminating (SIGTERM)
18:56:07.481209 run    osmo-mgw_10.42.42.3(pid=5985): Terminating (SIGTERM)
18:56:07.521844 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5986): Terminating (SIGTERM)
18:56:07.561816 run    osmo-mgw_10.42.42.4(pid=5987): Terminating (SIGTERM)
18:56:07.602896 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5988): Terminating (SIGTERM)
18:56:07.646676 run    osmo-bsc_10.42.42.7(pid=5989): Terminating (SIGTERM)
18:56:07.688549 run         osmo-bts-sysmo(pid=5998): Terminating (SIGTERM)
18:56:07.698101 ---      ParallelTerminationStrategy: PID 5978 died...
18:56:07.752778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5978): Terminated: ok {rc=0}
18:56:07.763128 ---      ParallelTerminationStrategy: PID 5979 died...
18:56:07.818320 run    osmo-hlr_10.42.42.2(pid=5979): Terminated: ok {rc=0}
18:56:07.828794 ---      ParallelTerminationStrategy: PID 5980 died...
18:56:07.884103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5980): Terminated: ok {rc=0}
18:56:07.894259 ---      ParallelTerminationStrategy: PID 5981 died...
18:56:07.947859 run    osmo-stp_10.42.42.5(pid=5981): Terminated: ok {rc=0}
18:56:07.958009 ---      ParallelTerminationStrategy: PID 5982 died...
18:56:08.011362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5982): Terminated: ok {rc=0}
18:56:08.021108 ---      ParallelTerminationStrategy: PID 5983 died...
18:56:08.074782 run    osmo-msc_10.42.42.6(pid=5983): Terminated: ok {rc=0}
18:56:08.084299 ---      ParallelTerminationStrategy: PID 5984 died...
18:56:08.138232 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5984): Terminated: ok {rc=0}
18:56:08.147713 ---      ParallelTerminationStrategy: PID 5985 died...
18:56:08.200912 run    osmo-mgw_10.42.42.3(pid=5985): Terminated {rc=15}
18:56:08.210648 ---      ParallelTerminationStrategy: PID 5986 died...
18:56:08.263971 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5986): Terminated: ok {rc=0}
18:56:08.273987 ---      ParallelTerminationStrategy: PID 5987 died...
18:56:08.327470 run    osmo-mgw_10.42.42.4(pid=5987): Terminated {rc=15}
18:56:08.336971 ---      ParallelTerminationStrategy: PID 5988 died...
18:56:08.394124 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5988): Terminated: ok {rc=0}
18:56:08.403858 ---      ParallelTerminationStrategy: PID 5989 died...
18:56:08.457073 run    osmo-bsc_10.42.42.7(pid=5989): Terminated: ok {rc=0}
18:56:08.466921 ---      ParallelTerminationStrategy: PID 5998 died...
18:56:08.520342 run         osmo-bts-sysmo(pid=5998): Terminated: ok {rc=0}
18:56:08.629131 bus                        /sierra_2: Setting Online False
18:56:09.712979 bus                        /sierra_2: Setting Powered False
18:56:15.047991 bus                        /sierra_2: Setting Powered False
18:56:16.150130 bus                        /sierra_2: Setting Powered False
18:56:17.282163 bus                        /sierra_1: Setting Online False
18:56:18.370267 bus                        /sierra_1: Setting Powered False
18:56:23.960763 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fd81c73e048>, timeout=10, timestep=1} [trial-831↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]