Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 85 builds (Since #751 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6c942e8268>, timeout=10, timestep=1} [trial-835↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-835 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
22:56:06.005413 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
22:56:06.016571 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
22:56:06.149617 tst          emergency_mo_mt_call.py: using LAC 9806
22:56:06.278010 tst          emergency_mo_mt_call.py: using RAC 116
22:56:06.410513 tst          emergency_mo_mt_call.py: using CellId 9806
22:56:06.537516 tst          emergency_mo_mt_call.py: using BVCI 9802
22:56:06.562450 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
22:56:06.573548 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
22:56:06.584520 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
22:56:06.595529 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
22:56:06.606446 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
22:56:06.617339 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
22:56:06.717343 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
22:56:06.915485 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
22:56:07.443150 run         create_hlr_db(pid=14898): Launched
22:56:07.634436 bus                        /sierra_1: Setting Powered False
22:56:08.645236 run         create_hlr_db(pid=14898): Terminated: ok {rc=0}
22:56:09.091659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14900): Launched
22:56:09.422956 run   osmo-hlr_10.42.42.2(pid=14901): Launched
22:56:09.542211 run              osmo-stp_10.42.42.5: Starting osmo-stp
22:56:10.112093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14902): Launched
22:56:10.442609 run   osmo-stp_10.42.42.5(pid=14903): Launched
22:56:10.565841 tst          emergency_mo_mt_call.py: using MSISDN 6387
22:56:10.718989 run              osmo-msc_10.42.42.6: Starting osmo-msc
22:56:11.285295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14904): Launched
22:56:11.598339 run   osmo-msc_10.42.42.6(pid=14905): Launched
22:56:14.771376 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
22:56:15.344187 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14906): Launched
22:56:15.674936 run   osmo-mgw_10.42.42.3(pid=14907): Launched
22:56:15.792233 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
22:56:16.351098 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14908): Launched
22:56:16.681024 run   osmo-mgw_10.42.42.4(pid=14909): Launched
22:56:16.798215 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
22:56:17.483939 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14910): Launched
22:56:17.815099 run   osmo-bsc_10.42.42.7(pid=14911): Launched
22:56:24.093712 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
22:56:24.681229 run         rm-remote-dir(pid=14912): Launched
22:56:26.884731 run         rm-remote-dir(pid=14912): Terminated: ok {rc=0}
22:56:27.236932 run         mk-remote-dir(pid=14913): Launched
22:56:29.438699 run         mk-remote-dir(pid=14913): Terminated: ok {rc=0}
22:56:29.739734 run    scp-inst-to-remote(pid=14914): Launched
22:56:42.960745 run    scp-inst-to-remote(pid=14914): Terminated: ok {rc=0}
22:56:43.308404 run         mk-remote-dir(pid=14917): Launched
22:56:46.511293 run         mk-remote-dir(pid=14917): Terminated: ok {rc=0}
22:56:46.809076 run     scp-cfg-to-remote(pid=14918): Launched
22:56:49.010128 run     scp-cfg-to-remote(pid=14918): Terminated: ok {rc=0}
22:56:49.352565 run   reload-dsp-firmware(pid=14920): Launched
22:56:52.551945 run   reload-dsp-firmware(pid=14920): Terminated: ok {rc=0}
22:56:52.887190 run        osmo-bts-sysmo(pid=14921): Launched
22:56:59.134721 tst          emergency_mo_mt_call.py: using MSISDN 6388
22:56:59.316008 bus                        /sierra_1: Setting Powered True
22:57:02.785637 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6388', subscriber_id=1}
22:57:02.976591 bus                        /sierra_2: Setting Powered True
22:57:15.337537 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f6c942e8268&gt;, timeout=10, timestep=1} [trial-835↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-835↪emergency:sysmo↪emergency_mo_mt_call.py:31]
22:57:15.344159 tst       emergency_mo_mt_call.py:31: Test FAILED (69.3 sec)
22:57:15.379108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14900): Terminating (SIGTERM)
22:57:15.418476 run   osmo-hlr_10.42.42.2(pid=14901): Terminating (SIGTERM)
22:57:15.459674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14902): Terminating (SIGTERM)
22:57:15.504021 run   osmo-stp_10.42.42.5(pid=14903): Terminating (SIGTERM)
22:57:15.554267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14904): Terminating (SIGTERM)
22:57:15.599587 run   osmo-msc_10.42.42.6(pid=14905): Terminating (SIGTERM)
22:57:15.641584 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14906): Terminating (SIGTERM)
22:57:15.686064 run   osmo-mgw_10.42.42.3(pid=14907): Terminating (SIGTERM)
22:57:15.728843 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14908): Terminating (SIGTERM)
22:57:15.772812 run   osmo-mgw_10.42.42.4(pid=14909): Terminating (SIGTERM)
22:57:15.815304 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14910): Terminating (SIGTERM)
22:57:15.858569 run   osmo-bsc_10.42.42.7(pid=14911): Terminating (SIGTERM)
22:57:15.916827 run        osmo-bts-sysmo(pid=14921): Terminating (SIGTERM)
22:57:15.928211 ---      ParallelTerminationStrategy: PID 14900 died...
22:57:15.986712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14900): Terminated: ok {rc=0}
22:57:15.997214 ---      ParallelTerminationStrategy: PID 14901 died...
22:57:16.054720 run   osmo-hlr_10.42.42.2(pid=14901): Terminated: ok {rc=0}
22:57:16.068401 ---      ParallelTerminationStrategy: PID 14902 died...
22:57:16.126526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14902): Terminated: ok {rc=0}
22:57:16.137889 ---      ParallelTerminationStrategy: PID 14903 died...
22:57:16.194895 run   osmo-stp_10.42.42.5(pid=14903): Terminated: ok {rc=0}
22:57:16.205052 ---      ParallelTerminationStrategy: PID 14904 died...
22:57:16.265657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14904): Terminated: ok {rc=0}
22:57:16.275935 ---      ParallelTerminationStrategy: PID 14905 died...
22:57:16.331980 run   osmo-msc_10.42.42.6(pid=14905): Terminated: ok {rc=0}
22:57:16.342709 ---      ParallelTerminationStrategy: PID 14906 died...
22:57:16.399540 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14906): Terminated: ok {rc=0}
22:57:16.409881 ---      ParallelTerminationStrategy: PID 14907 died...
22:57:16.465955 run   osmo-mgw_10.42.42.3(pid=14907): Terminated {rc=15}
22:57:16.476863 ---      ParallelTerminationStrategy: PID 14908 died...
22:57:16.533578 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14908): Terminated: ok {rc=0}
22:57:16.543823 ---      ParallelTerminationStrategy: PID 14909 died...
22:57:16.600534 run   osmo-mgw_10.42.42.4(pid=14909): Terminated {rc=15}
22:57:16.610554 ---      ParallelTerminationStrategy: PID 14910 died...
22:57:16.667575 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14910): Terminated: ok {rc=0}
22:57:16.678200 ---      ParallelTerminationStrategy: PID 14911 died...
22:57:16.735536 run   osmo-bsc_10.42.42.7(pid=14911): Terminated: ok {rc=0}
22:57:16.746123 ---      ParallelTerminationStrategy: PID 14921 died...
22:57:16.803022 run        osmo-bts-sysmo(pid=14921): Terminated: ok {rc=0}
22:57:16.909680 bus                        /sierra_2: Setting Online False
22:57:17.996253 bus                        /sierra_2: Setting Powered False
22:57:23.966942 bus                        /sierra_2: Setting Powered False
22:57:25.069101 bus                        /sierra_2: Setting Powered False
22:57:26.200414 bus                        /sierra_1: Setting Online False
22:57:27.282951 bus                        /sierra_1: Setting Powered False
22:57:32.968056 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6c942e8268>, timeout=10, timestep=1} [trial-835↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]