Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 96 builds (Since #751 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6091c93bf8>, timeout=10, timestep=1} [trial-846↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-846 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
12:27:00.010589 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
12:27:00.021487 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
12:27:00.152945 tst          emergency_mo_mt_call.py: using LAC 10686
12:27:00.280827 tst          emergency_mo_mt_call.py: using RAC 231
12:27:00.408901 tst          emergency_mo_mt_call.py: using CellId 10686
12:27:00.538562 tst          emergency_mo_mt_call.py: using BVCI 10682
12:27:00.563257 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
12:27:00.574188 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
12:27:00.584937 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
12:27:00.595672 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
12:27:00.606512 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
12:27:00.617325 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
12:27:00.719719 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
12:27:00.913942 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
12:27:01.435083 run         create_hlr_db(pid=19947): Launched
12:27:01.624645 bus                        /sierra_1: Setting Powered False
12:27:02.645647 run         create_hlr_db(pid=19947): Terminated: ok {rc=0}
12:27:03.062882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19949): Launched
12:27:03.371918 run   osmo-hlr_10.42.42.2(pid=19950): Launched
12:27:03.485418 run              osmo-stp_10.42.42.5: Starting osmo-stp
12:27:04.014462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19951): Launched
12:27:04.320827 run   osmo-stp_10.42.42.5(pid=19952): Launched
12:27:04.443712 tst          emergency_mo_mt_call.py: using MSISDN 6970
12:27:04.595394 run              osmo-msc_10.42.42.6: Starting osmo-msc
12:27:05.159020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19953): Launched
12:27:05.467047 run   osmo-msc_10.42.42.6(pid=19954): Launched
12:27:08.630267 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
12:27:09.163075 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19955): Launched
12:27:09.475583 run   osmo-mgw_10.42.42.3(pid=19956): Launched
12:27:09.584894 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
12:27:10.107947 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19957): Launched
12:27:10.415342 run   osmo-mgw_10.42.42.4(pid=19958): Launched
12:27:10.524481 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
12:27:11.164039 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19959): Launched
12:27:11.471847 run   osmo-bsc_10.42.42.7(pid=19960): Launched
12:27:17.735590 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
12:27:18.282185 run         rm-remote-dir(pid=19962): Launched
12:27:20.486539 run         rm-remote-dir(pid=19962): Terminated: ok {rc=0}
12:27:20.838251 run         mk-remote-dir(pid=19963): Launched
12:27:23.038539 run         mk-remote-dir(pid=19963): Terminated: ok {rc=0}
12:27:23.336661 run    scp-inst-to-remote(pid=19964): Launched
12:27:37.557399 run    scp-inst-to-remote(pid=19964): Terminated: ok {rc=0}
12:27:37.902156 run         mk-remote-dir(pid=19966): Launched
12:27:41.102184 run         mk-remote-dir(pid=19966): Terminated: ok {rc=0}
12:27:41.396501 run     scp-cfg-to-remote(pid=19967): Launched
12:27:43.595778 run     scp-cfg-to-remote(pid=19967): Terminated: ok {rc=0}
12:27:43.936993 run   reload-dsp-firmware(pid=19969): Launched
12:27:48.135348 run   reload-dsp-firmware(pid=19969): Terminated: ok {rc=0}
12:27:48.468780 run        osmo-bts-sysmo(pid=19970): Launched
12:27:53.709632 tst          emergency_mo_mt_call.py: using MSISDN 6971
12:27:53.879211 bus                        /sierra_1: Setting Powered True
12:27:57.365284 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6971', subscriber_id=1}
12:27:57.555936 bus                        /sierra_2: Setting Powered True
12:28:09.926772 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f6091c93bf8&gt;, timeout=10, timestep=1} [trial-846↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-846↪emergency:sysmo↪emergency_mo_mt_call.py:31]
12:28:09.933452 tst       emergency_mo_mt_call.py:31: Test FAILED (69.9 sec)
12:28:09.968151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19949): Terminating (SIGTERM)
12:28:10.007773 run   osmo-hlr_10.42.42.2(pid=19950): Terminating (SIGTERM)
12:28:10.048417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19951): Terminating (SIGTERM)
12:28:10.091769 run   osmo-stp_10.42.42.5(pid=19952): Terminating (SIGTERM)
12:28:10.145744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19953): Terminating (SIGTERM)
12:28:10.191016 run   osmo-msc_10.42.42.6(pid=19954): Terminating (SIGTERM)
12:28:10.234260 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19955): Terminating (SIGTERM)
12:28:10.282541 run   osmo-mgw_10.42.42.3(pid=19956): Terminating (SIGTERM)
12:28:10.336849 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19957): Terminating (SIGTERM)
12:28:10.382600 run   osmo-mgw_10.42.42.4(pid=19958): Terminating (SIGTERM)
12:28:10.433343 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19959): Terminating (SIGTERM)
12:28:10.475891 run   osmo-bsc_10.42.42.7(pid=19960): Terminating (SIGTERM)
12:28:10.517585 run        osmo-bts-sysmo(pid=19970): Terminating (SIGTERM)
12:28:10.527802 ---      ParallelTerminationStrategy: PID 19949 died...
12:28:10.590010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19949): Terminated: ok {rc=0}
12:28:10.600530 ---      ParallelTerminationStrategy: PID 19950 died...
12:28:10.658360 run   osmo-hlr_10.42.42.2(pid=19950): Terminated: ok {rc=0}
12:28:10.668821 ---      ParallelTerminationStrategy: PID 19951 died...
12:28:10.726600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19951): Terminated: ok {rc=0}
12:28:10.737357 ---      ParallelTerminationStrategy: PID 19952 died...
12:28:10.796858 run   osmo-stp_10.42.42.5(pid=19952): Terminated: ok {rc=0}
12:28:10.808895 ---      ParallelTerminationStrategy: PID 19953 died...
12:28:10.865526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19953): Terminated: ok {rc=0}
12:28:10.875621 ---      ParallelTerminationStrategy: PID 19954 died...
12:28:10.928499 run   osmo-msc_10.42.42.6(pid=19954): Terminated: ok {rc=0}
12:28:10.938350 ---      ParallelTerminationStrategy: PID 19955 died...
12:28:10.991544 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19955): Terminated: ok {rc=0}
12:28:11.001240 ---      ParallelTerminationStrategy: PID 19956 died...
12:28:11.053922 run   osmo-mgw_10.42.42.3(pid=19956): Terminated {rc=15}
12:28:11.063679 ---      ParallelTerminationStrategy: PID 19957 died...
12:28:11.116539 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19957): Terminated: ok {rc=0}
12:28:11.126090 ---      ParallelTerminationStrategy: PID 19958 died...
12:28:11.178931 run   osmo-mgw_10.42.42.4(pid=19958): Terminated {rc=15}
12:28:11.188476 ---      ParallelTerminationStrategy: PID 19959 died...
12:28:11.241460 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19959): Terminated: ok {rc=0}
12:28:11.251090 ---      ParallelTerminationStrategy: PID 19960 died...
12:28:11.304100 run   osmo-bsc_10.42.42.7(pid=19960): Terminated: ok {rc=0}
12:28:11.314121 ---      ParallelTerminationStrategy: PID 19970 died...
12:28:11.367550 run        osmo-bts-sysmo(pid=19970): Terminated: ok {rc=0}
12:28:11.476180 bus                        /sierra_2: Setting Online False
12:28:12.560456 bus                        /sierra_2: Setting Powered False
12:28:17.960587 bus                        /sierra_2: Setting Powered False
12:28:19.062832 bus                        /sierra_2: Setting Powered False
12:28:20.195275 bus                        /sierra_1: Setting Online False
12:28:21.280469 bus                        /sierra_1: Setting Powered False
12:28:26.957807 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6091c93bf8>, timeout=10, timestep=1} [trial-846↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]