Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 70 builds (Since #751 )
Took 1 min 7 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fb34020c158>, timeout=10, timestep=1} [trial-820↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-820 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
05:52:43.015314 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
05:52:43.026032 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
05:52:43.154035 tst          emergency_mo_mt_call.py: using LAC 8606
05:52:43.276653 tst          emergency_mo_mt_call.py: using RAC 191
05:52:43.402958 tst          emergency_mo_mt_call.py: using CellId 8606
05:52:43.531379 tst          emergency_mo_mt_call.py: using BVCI 8602
05:52:43.556281 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
05:52:43.567515 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
05:52:43.578687 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
05:52:43.589667 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
05:52:43.600749 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
05:52:43.611618 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
05:52:43.717907 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
05:52:43.912706 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
05:52:44.440293 run          create_hlr_db(pid=7741): Launched
05:52:44.630531 bus                        /sierra_1: Setting Powered False
05:52:45.650304 run          create_hlr_db(pid=7741): Terminated: ok {rc=0}
05:52:46.065320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7743): Launched
05:52:46.374945 run    osmo-hlr_10.42.42.2(pid=7744): Launched
05:52:46.485055 run              osmo-stp_10.42.42.5: Starting osmo-stp
05:52:47.020308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7745): Launched
05:52:47.330789 run    osmo-stp_10.42.42.5(pid=7746): Launched
05:52:47.456775 tst          emergency_mo_mt_call.py: using MSISDN 5592
05:52:47.609284 run              osmo-msc_10.42.42.6: Starting osmo-msc
05:52:48.175193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7747): Launched
05:52:48.484421 run    osmo-msc_10.42.42.6(pid=7748): Launched
05:52:51.649128 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
05:52:52.182299 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=7749): Launched
05:52:52.491850 run    osmo-mgw_10.42.42.3(pid=7750): Launched
05:52:52.601123 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
05:52:53.123588 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7751): Launched
05:52:53.431619 run    osmo-mgw_10.42.42.4(pid=7752): Launched
05:52:53.540347 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
05:52:54.182600 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=7753): Launched
05:52:54.493129 run    osmo-bsc_10.42.42.7(pid=7754): Launched
05:53:00.755934 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
05:53:01.303903 run          rm-remote-dir(pid=7755): Launched
05:53:03.494349 run          rm-remote-dir(pid=7755): Terminated: ok {rc=0}
05:53:03.826239 run          mk-remote-dir(pid=7756): Launched
05:53:06.015672 run          mk-remote-dir(pid=7756): Terminated: ok {rc=0}
05:53:06.294663 run     scp-inst-to-remote(pid=7757): Launched
05:53:19.510802 run     scp-inst-to-remote(pid=7757): Terminated: ok {rc=0}
05:53:19.857595 run          mk-remote-dir(pid=7759): Launched
05:53:22.055441 run          mk-remote-dir(pid=7759): Terminated: ok {rc=0}
05:53:22.353823 run      scp-cfg-to-remote(pid=7760): Launched
05:53:24.552236 run      scp-cfg-to-remote(pid=7760): Terminated: ok {rc=0}
05:53:24.895459 run    reload-dsp-firmware(pid=7762): Launched
05:53:28.094328 run    reload-dsp-firmware(pid=7762): Terminated: ok {rc=0}
05:53:28.431630 run         osmo-bts-sysmo(pid=7763): Launched
05:53:33.667524 tst          emergency_mo_mt_call.py: using MSISDN 5593
05:53:33.847607 bus                        /sierra_1: Setting Powered True
05:53:37.312224 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5593', subscriber_id=1}
05:53:37.491992 bus                        /sierra_2: Setting Powered True
05:53:49.836715 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fb34020c158&gt;, timeout=10, timestep=1} [trial-820↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-820↪emergency:sysmo↪emergency_mo_mt_call.py:31]
05:53:49.843538 tst       emergency_mo_mt_call.py:31: Test FAILED (66.8 sec)
05:53:49.878905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7743): Terminating (SIGTERM)
05:53:49.918401 run    osmo-hlr_10.42.42.2(pid=7744): Terminating (SIGTERM)
05:53:49.958745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7745): Terminating (SIGTERM)
05:53:50.003517 run    osmo-stp_10.42.42.5(pid=7746): Terminating (SIGTERM)
05:53:50.055162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7747): Terminating (SIGTERM)
05:53:50.096962 run    osmo-msc_10.42.42.6(pid=7748): Terminating (SIGTERM)
05:53:50.137697 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=7749): Terminating (SIGTERM)
05:53:50.177910 run    osmo-mgw_10.42.42.3(pid=7750): Terminating (SIGTERM)
05:53:50.218274 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7751): Terminating (SIGTERM)
05:53:50.258061 run    osmo-mgw_10.42.42.4(pid=7752): Terminating (SIGTERM)
05:53:50.298445 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=7753): Terminating (SIGTERM)
05:53:50.338427 run    osmo-bsc_10.42.42.7(pid=7754): Terminating (SIGTERM)
05:53:50.378430 run         osmo-bts-sysmo(pid=7763): Terminating (SIGTERM)
05:53:50.387783 ---      ParallelTerminationStrategy: PID 7743 died...
05:53:50.441476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7743): Terminated: ok {rc=0}
05:53:50.450930 ---      ParallelTerminationStrategy: PID 7744 died...
05:53:50.504074 run    osmo-hlr_10.42.42.2(pid=7744): Terminated: ok {rc=0}
05:53:50.513925 ---      ParallelTerminationStrategy: PID 7745 died...
05:53:50.568857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7745): Terminated: ok {rc=0}
05:53:50.578965 ---      ParallelTerminationStrategy: PID 7746 died...
05:53:50.652096 run    osmo-stp_10.42.42.5(pid=7746): Terminated: ok {rc=0}
05:53:50.674772 ---      ParallelTerminationStrategy: PID 7747 died...
05:53:50.745954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7747): Terminated: ok {rc=0}
05:53:50.756028 ---      ParallelTerminationStrategy: PID 7749 died...
05:53:50.810898 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=7749): Terminated: ok {rc=0}
05:53:50.820691 ---      ParallelTerminationStrategy: PID 7748 died...
05:53:50.874360 run    osmo-msc_10.42.42.6(pid=7748): Terminated: ok {rc=0}
05:53:50.883920 ---      ParallelTerminationStrategy: PID 7750 died...
05:53:50.937136 run    osmo-mgw_10.42.42.3(pid=7750): Terminated {rc=15}
05:53:50.946951 ---      ParallelTerminationStrategy: PID 7751 died...
05:53:51.000359 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7751): Terminated: ok {rc=0}
05:53:51.009941 ---      ParallelTerminationStrategy: PID 7752 died...
05:53:51.063102 run    osmo-mgw_10.42.42.4(pid=7752): Terminated {rc=15}
05:53:51.072521 ---      ParallelTerminationStrategy: PID 7753 died...
05:53:51.125250 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=7753): Terminated: ok {rc=0}
05:53:51.134946 ---      ParallelTerminationStrategy: PID 7754 died...
05:53:51.188048 run    osmo-bsc_10.42.42.7(pid=7754): Terminated: ok {rc=0}
05:53:51.198113 ---      ParallelTerminationStrategy: PID 7763 died...
05:53:51.251553 run         osmo-bts-sysmo(pid=7763): Terminated: ok {rc=0}
05:53:51.354575 bus                        /sierra_2: Setting Online False
05:53:52.441446 bus                        /sierra_2: Setting Powered False
05:53:57.967519 bus                        /sierra_2: Setting Powered False
05:53:59.073362 bus                        /sierra_2: Setting Powered False
05:54:00.200822 bus                        /sierra_1: Setting Online False
05:54:01.288389 bus                        /sierra_1: Setting Powered False
05:54:06.965400 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fb34020c158>, timeout=10, timestep=1} [trial-820↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]