Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 75 builds (Since #751 )
Took 1 min 8 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f428d978b70>, timeout=10, timestep=1} [trial-825↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-825 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
10:50:08.023708 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
10:50:08.035075 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
10:50:08.183852 tst          emergency_mo_mt_call.py: using LAC 9006
10:50:08.311324 tst          emergency_mo_mt_call.py: using RAC 81
10:50:08.439075 tst          emergency_mo_mt_call.py: using CellId 9006
10:50:08.566342 tst          emergency_mo_mt_call.py: using BVCI 9002
10:50:08.591409 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
10:50:08.602465 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
10:50:08.613380 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
10:50:08.624167 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
10:50:08.635097 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
10:50:08.646325 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
10:50:08.747600 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
10:50:08.936727 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
10:50:09.428323 run         create_hlr_db(pid=18529): Launched
10:50:09.608354 bus                        /sierra_1: Setting Powered False
10:50:10.632295 run         create_hlr_db(pid=18529): Terminated: ok {rc=0}
10:50:11.074723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18532): Launched
10:50:11.409071 run   osmo-hlr_10.42.42.2(pid=18533): Launched
10:50:11.529650 run              osmo-stp_10.42.42.5: Starting osmo-stp
10:50:12.104171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18534): Launched
10:50:12.436423 run   osmo-stp_10.42.42.5(pid=18535): Launched
10:50:12.567316 tst          emergency_mo_mt_call.py: using MSISDN 5857
10:50:12.731359 run              osmo-msc_10.42.42.6: Starting osmo-msc
10:50:13.336445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18536): Launched
10:50:13.670668 run   osmo-msc_10.42.42.6(pid=18537): Launched
10:50:16.847342 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
10:50:17.426180 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=18538): Launched
10:50:17.759926 run   osmo-mgw_10.42.42.3(pid=18539): Launched
10:50:17.878069 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
10:50:18.445704 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18540): Launched
10:50:18.782257 run   osmo-mgw_10.42.42.4(pid=18541): Launched
10:50:18.901621 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
10:50:19.595197 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=18542): Launched
10:50:19.929662 run   osmo-bsc_10.42.42.7(pid=18543): Launched
10:50:26.203813 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
10:50:26.794198 run         rm-remote-dir(pid=18544): Launched
10:50:28.991413 run         rm-remote-dir(pid=18544): Terminated: ok {rc=0}
10:50:29.330013 run         mk-remote-dir(pid=18545): Launched
10:50:31.526501 run         mk-remote-dir(pid=18545): Terminated: ok {rc=0}
10:50:31.812723 run    scp-inst-to-remote(pid=18546): Launched
10:50:45.022974 run    scp-inst-to-remote(pid=18546): Terminated: ok {rc=0}
10:50:45.358890 run         mk-remote-dir(pid=18548): Launched
10:50:47.550186 run         mk-remote-dir(pid=18548): Terminated: ok {rc=0}
10:50:47.833065 run     scp-cfg-to-remote(pid=18549): Launched
10:50:50.023835 run     scp-cfg-to-remote(pid=18549): Terminated: ok {rc=0}
10:50:50.351276 run   reload-dsp-firmware(pid=18551): Launched
10:50:53.541390 run   reload-dsp-firmware(pid=18551): Terminated: ok {rc=0}
10:50:53.862223 run        osmo-bts-sysmo(pid=18552): Launched
10:50:59.110772 tst          emergency_mo_mt_call.py: using MSISDN 5858
10:50:59.294553 bus                        /sierra_1: Setting Powered True
10:51:02.758866 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5858', subscriber_id=1}
10:51:02.956216 bus                        /sierra_2: Setting Powered True
10:51:15.321560 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f428d978b70&gt;, timeout=10, timestep=1} [trial-825↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-825↪emergency:sysmo↪emergency_mo_mt_call.py:31]
10:51:15.328430 tst       emergency_mo_mt_call.py:31: Test FAILED (67.3 sec)
10:51:15.364921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18532): Terminating (SIGTERM)
10:51:15.405082 run   osmo-hlr_10.42.42.2(pid=18533): Terminating (SIGTERM)
10:51:15.446388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18534): Terminating (SIGTERM)
10:51:15.490075 run   osmo-stp_10.42.42.5(pid=18535): Terminating (SIGTERM)
10:51:15.542179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18536): Terminating (SIGTERM)
10:51:15.589621 run   osmo-msc_10.42.42.6(pid=18537): Terminating (SIGTERM)
10:51:15.638845 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=18538): Terminating (SIGTERM)
10:51:15.682965 run   osmo-mgw_10.42.42.3(pid=18539): Terminating (SIGTERM)
10:51:15.727317 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18540): Terminating (SIGTERM)
10:51:15.772753 run   osmo-mgw_10.42.42.4(pid=18541): Terminating (SIGTERM)
10:51:15.817673 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=18542): Terminating (SIGTERM)
10:51:15.861601 run   osmo-bsc_10.42.42.7(pid=18543): Terminating (SIGTERM)
10:51:15.906377 run        osmo-bts-sysmo(pid=18552): Terminating (SIGTERM)
10:51:15.916223 ---      ParallelTerminationStrategy: PID 18532 died...
10:51:15.974774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18532): Terminated: ok {rc=0}
10:51:15.985121 ---      ParallelTerminationStrategy: PID 18533 died...
10:51:16.042367 run   osmo-hlr_10.42.42.2(pid=18533): Terminated: ok {rc=0}
10:51:16.053708 ---      ParallelTerminationStrategy: PID 18534 died...
10:51:16.112637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18534): Terminated: ok {rc=0}
10:51:16.123462 ---      ParallelTerminationStrategy: PID 18535 died...
10:51:16.182414 run   osmo-stp_10.42.42.5(pid=18535): Terminated: ok {rc=0}
10:51:16.193322 ---      ParallelTerminationStrategy: PID 18536 died...
10:51:16.252067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=18536): Terminated: ok {rc=0}
10:51:16.262829 ---      ParallelTerminationStrategy: PID 18537 died...
10:51:16.321575 run   osmo-msc_10.42.42.6(pid=18537): Terminated: ok {rc=0}
10:51:16.331926 ---      ParallelTerminationStrategy: PID 18538 died...
10:51:16.389880 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=18538): Terminated: ok {rc=0}
10:51:16.400298 ---      ParallelTerminationStrategy: PID 18539 died...
10:51:16.458043 run   osmo-mgw_10.42.42.3(pid=18539): Terminated {rc=15}
10:51:16.468299 ---      ParallelTerminationStrategy: PID 18540 died...
10:51:16.525902 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18540): Terminated: ok {rc=0}
10:51:16.536652 ---      ParallelTerminationStrategy: PID 18541 died...
10:51:16.594059 run   osmo-mgw_10.42.42.4(pid=18541): Terminated {rc=15}
10:51:16.604326 ---      ParallelTerminationStrategy: PID 18542 died...
10:51:16.661930 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=18542): Terminated: ok {rc=0}
10:51:16.672220 ---      ParallelTerminationStrategy: PID 18543 died...
10:51:16.729908 run   osmo-bsc_10.42.42.7(pid=18543): Terminated: ok {rc=0}
10:51:16.740143 ---      ParallelTerminationStrategy: PID 18552 died...
10:51:16.798094 run        osmo-bts-sysmo(pid=18552): Terminated: ok {rc=0}
10:51:16.905514 bus                        /sierra_2: Setting Online False
10:51:17.992816 bus                        /sierra_2: Setting Powered False
10:51:23.967290 bus                        /sierra_2: Setting Powered False
10:51:25.074620 bus                        /sierra_2: Setting Powered False
10:51:26.202677 bus                        /sierra_1: Setting Online False
10:51:27.288689 bus                        /sierra_1: Setting Powered False
10:51:32.970656 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f428d978b70>, timeout=10, timestep=1} [trial-825↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]