Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 83 builds (Since #751 )
Took 1 min 8 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f5de48991e0>, timeout=10, timestep=1} [trial-833↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-833 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
20:55:05.007613 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
20:55:05.019097 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
20:55:05.151376 tst          emergency_mo_mt_call.py: using LAC 9646
20:55:05.282161 tst          emergency_mo_mt_call.py: using RAC 211
20:55:05.408544 tst          emergency_mo_mt_call.py: using CellId 9646
20:55:05.534635 tst          emergency_mo_mt_call.py: using BVCI 9642
20:55:05.559468 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
20:55:05.570669 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
20:55:05.581755 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
20:55:05.592910 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
20:55:05.604178 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
20:55:05.615427 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
20:55:05.715164 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
20:55:05.898508 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
20:55:06.380415 run         create_hlr_db(pid=10066): Launched
20:55:06.557957 bus                        /sierra_1: Setting Powered False
20:55:07.578032 run         create_hlr_db(pid=10066): Terminated: ok {rc=0}
20:55:08.012162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10068): Launched
20:55:08.339843 run   osmo-hlr_10.42.42.2(pid=10069): Launched
20:55:08.458204 run              osmo-stp_10.42.42.5: Starting osmo-stp
20:55:09.025346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10070): Launched
20:55:09.352336 run   osmo-stp_10.42.42.5(pid=10071): Launched
20:55:09.475628 tst          emergency_mo_mt_call.py: using MSISDN 6281
20:55:09.627060 run              osmo-msc_10.42.42.6: Starting osmo-msc
20:55:10.186859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10072): Launched
20:55:10.493800 run   osmo-msc_10.42.42.6(pid=10073): Launched
20:55:13.656629 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
20:55:14.188732 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10074): Launched
20:55:14.499535 run   osmo-mgw_10.42.42.3(pid=10075): Launched
20:55:14.608901 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
20:55:15.131310 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10076): Launched
20:55:15.440047 run   osmo-mgw_10.42.42.4(pid=10077): Launched
20:55:15.548770 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
20:55:16.189648 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=10078): Launched
20:55:16.500407 run   osmo-bsc_10.42.42.7(pid=10079): Launched
20:55:22.761952 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
20:55:23.312000 run         rm-remote-dir(pid=10080): Launched
20:55:25.507067 run         rm-remote-dir(pid=10080): Terminated: ok {rc=0}
20:55:25.837438 run         mk-remote-dir(pid=10081): Launched
20:55:28.026849 run         mk-remote-dir(pid=10081): Terminated: ok {rc=0}
20:55:28.307276 run    scp-inst-to-remote(pid=10082): Launched
20:55:41.513498 run    scp-inst-to-remote(pid=10082): Terminated: ok {rc=0}
20:55:41.838823 run         mk-remote-dir(pid=10084): Launched
20:55:45.037673 run         mk-remote-dir(pid=10084): Terminated: ok {rc=0}
20:55:45.333563 run     scp-cfg-to-remote(pid=10085): Launched
20:55:47.533698 run     scp-cfg-to-remote(pid=10085): Terminated: ok {rc=0}
20:55:47.874589 run   reload-dsp-firmware(pid=10087): Launched
20:55:51.071619 run   reload-dsp-firmware(pid=10087): Terminated: ok {rc=0}
20:55:51.405047 run        osmo-bts-sysmo(pid=10088): Launched
20:55:56.659798 tst          emergency_mo_mt_call.py: using MSISDN 6282
20:55:56.840432 bus                        /sierra_1: Setting Powered True
20:56:00.344365 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6282', subscriber_id=1}
20:56:00.536977 bus                        /sierra_2: Setting Powered True
20:56:12.894112 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f5de48991e0&gt;, timeout=10, timestep=1} [trial-833↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-833↪emergency:sysmo↪emergency_mo_mt_call.py:31]
20:56:12.901035 tst       emergency_mo_mt_call.py:31: Test FAILED (67.9 sec)
20:56:12.935890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10068): Terminating (SIGTERM)
20:56:12.976372 run   osmo-hlr_10.42.42.2(pid=10069): Terminating (SIGTERM)
20:56:13.016903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10070): Terminating (SIGTERM)
20:56:13.061537 run   osmo-stp_10.42.42.5(pid=10071): Terminating (SIGTERM)
20:56:13.113958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10072): Terminating (SIGTERM)
20:56:13.159500 run   osmo-msc_10.42.42.6(pid=10073): Terminating (SIGTERM)
20:56:13.203169 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10074): Terminating (SIGTERM)
20:56:13.250586 run   osmo-mgw_10.42.42.3(pid=10075): Terminating (SIGTERM)
20:56:13.306753 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10076): Terminating (SIGTERM)
20:56:13.353510 run   osmo-mgw_10.42.42.4(pid=10077): Terminating (SIGTERM)
20:56:13.409282 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=10078): Terminating (SIGTERM)
20:56:13.452813 run   osmo-bsc_10.42.42.7(pid=10079): Terminating (SIGTERM)
20:56:13.495892 run        osmo-bts-sysmo(pid=10088): Terminating (SIGTERM)
20:56:13.506342 ---      ParallelTerminationStrategy: PID 10068 died...
20:56:13.564447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10068): Terminated: ok {rc=0}
20:56:13.575149 ---      ParallelTerminationStrategy: PID 10069 died...
20:56:13.633261 run   osmo-hlr_10.42.42.2(pid=10069): Terminated: ok {rc=0}
20:56:13.643850 ---      ParallelTerminationStrategy: PID 10070 died...
20:56:13.702287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10070): Terminated: ok {rc=0}
20:56:13.712895 ---      ParallelTerminationStrategy: PID 10071 died...
20:56:13.771087 run   osmo-stp_10.42.42.5(pid=10071): Terminated: ok {rc=0}
20:56:13.781777 ---      ParallelTerminationStrategy: PID 10072 died...
20:56:13.840266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10072): Terminated: ok {rc=0}
20:56:13.850724 ---      ParallelTerminationStrategy: PID 10073 died...
20:56:13.908062 run   osmo-msc_10.42.42.6(pid=10073): Terminated: ok {rc=0}
20:56:13.918428 ---      ParallelTerminationStrategy: PID 10074 died...
20:56:13.975972 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10074): Terminated: ok {rc=0}
20:56:13.986322 ---      ParallelTerminationStrategy: PID 10075 died...
20:56:14.043564 run   osmo-mgw_10.42.42.3(pid=10075): Terminated {rc=15}
20:56:14.054033 ---      ParallelTerminationStrategy: PID 10076 died...
20:56:14.111237 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10076): Terminated: ok {rc=0}
20:56:14.121681 ---      ParallelTerminationStrategy: PID 10077 died...
20:56:14.178337 run   osmo-mgw_10.42.42.4(pid=10077): Terminated {rc=15}
20:56:14.189267 ---      ParallelTerminationStrategy: PID 10078 died...
20:56:14.246532 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=10078): Terminated: ok {rc=0}
20:56:14.256973 ---      ParallelTerminationStrategy: PID 10079 died...
20:56:14.314506 run   osmo-bsc_10.42.42.7(pid=10079): Terminated: ok {rc=0}
20:56:14.324907 ---      ParallelTerminationStrategy: PID 10088 died...
20:56:14.382084 run        osmo-bts-sysmo(pid=10088): Terminated: ok {rc=0}
20:56:14.488834 bus                        /sierra_2: Setting Online False
20:56:15.574987 bus                        /sierra_2: Setting Powered False
20:56:20.964987 bus                        /sierra_2: Setting Powered False
20:56:22.068276 bus                        /sierra_2: Setting Powered False
20:56:23.201259 bus                        /sierra_1: Setting Online False
20:56:24.285013 bus                        /sierra_1: Setting Powered False
20:56:29.959107 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f5de48991e0>, timeout=10, timestep=1} [trial-833↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]