Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 74 builds (Since #751 )
Took 1 min 8 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f0055a6b7b8>, timeout=10, timestep=1} [trial-824↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-824 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
09:50:22.992245 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
09:50:23.002912 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
09:50:23.129448 tst          emergency_mo_mt_call.py: using LAC 8926
09:50:23.258677 tst          emergency_mo_mt_call.py: using RAC 1
09:50:23.387480 tst          emergency_mo_mt_call.py: using CellId 8926
09:50:23.516481 tst          emergency_mo_mt_call.py: using BVCI 8922
09:50:23.541614 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
09:50:23.552832 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
09:50:23.563894 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
09:50:23.574835 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
09:50:23.585837 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
09:50:23.596686 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
09:50:23.697205 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
09:50:23.893795 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
09:50:24.425760 run         create_hlr_db(pid=16750): Launched
09:50:24.618904 bus                        /sierra_1: Setting Powered False
09:50:25.638372 run         create_hlr_db(pid=16750): Terminated: ok {rc=0}
09:50:26.060124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16752): Launched
09:50:26.374390 run   osmo-hlr_10.42.42.2(pid=16753): Launched
09:50:26.490725 run              osmo-stp_10.42.42.5: Starting osmo-stp
09:50:27.036588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16754): Launched
09:50:27.350968 run   osmo-stp_10.42.42.5(pid=16755): Launched
09:50:27.474555 tst          emergency_mo_mt_call.py: using MSISDN 5804
09:50:27.629919 run              osmo-msc_10.42.42.6: Starting osmo-msc
09:50:28.202840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16756): Launched
09:50:28.519070 run   osmo-msc_10.42.42.6(pid=16757): Launched
09:50:31.687378 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
09:50:32.234396 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=16758): Launched
09:50:32.563592 run   osmo-mgw_10.42.42.3(pid=16759): Launched
09:50:32.682254 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
09:50:33.247448 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16760): Launched
09:50:33.580350 run   osmo-mgw_10.42.42.4(pid=16761): Launched
09:50:33.699026 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
09:50:34.393555 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=16762): Launched
09:50:34.729969 run   osmo-bsc_10.42.42.7(pid=16763): Launched
09:50:41.013475 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
09:50:41.608486 run         rm-remote-dir(pid=16764): Launched
09:50:43.814527 run         rm-remote-dir(pid=16764): Terminated: ok {rc=0}
09:50:44.174405 run         mk-remote-dir(pid=16765): Launched
09:50:46.379032 run         mk-remote-dir(pid=16765): Terminated: ok {rc=0}
09:50:46.682022 run    scp-inst-to-remote(pid=16766): Launched
09:50:59.905015 run    scp-inst-to-remote(pid=16766): Terminated: ok {rc=0}
09:51:00.257775 run         mk-remote-dir(pid=16768): Launched
09:51:02.460471 run         mk-remote-dir(pid=16768): Terminated: ok {rc=0}
09:51:02.763954 run     scp-cfg-to-remote(pid=16769): Launched
09:51:04.968407 run     scp-cfg-to-remote(pid=16769): Terminated: ok {rc=0}
09:51:05.318989 run   reload-dsp-firmware(pid=16771): Launched
09:51:08.519517 run   reload-dsp-firmware(pid=16771): Terminated: ok {rc=0}
09:51:08.858585 run        osmo-bts-sysmo(pid=16772): Launched
09:51:14.113918 tst          emergency_mo_mt_call.py: using MSISDN 5805
09:51:14.297909 bus                        /sierra_1: Setting Powered True
09:51:17.788336 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5805', subscriber_id=1}
09:51:17.974157 bus                        /sierra_2: Setting Powered True
09:51:30.348965 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f0055a6b7b8&gt;, timeout=10, timestep=1} [trial-824↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-824↪emergency:sysmo↪emergency_mo_mt_call.py:31]
09:51:30.355646 tst       emergency_mo_mt_call.py:31: Test FAILED (67.4 sec)
09:51:30.390462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16752): Terminating (SIGTERM)
09:51:30.430687 run   osmo-hlr_10.42.42.2(pid=16753): Terminating (SIGTERM)
09:51:30.471021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16754): Terminating (SIGTERM)
09:51:30.516636 run   osmo-stp_10.42.42.5(pid=16755): Terminating (SIGTERM)
09:51:30.559354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16756): Terminating (SIGTERM)
09:51:30.602561 run   osmo-msc_10.42.42.6(pid=16757): Terminating (SIGTERM)
09:51:30.644262 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=16758): Terminating (SIGTERM)
09:51:30.685554 run   osmo-mgw_10.42.42.3(pid=16759): Terminating (SIGTERM)
09:51:30.741577 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16760): Terminating (SIGTERM)
09:51:30.783072 run   osmo-mgw_10.42.42.4(pid=16761): Terminating (SIGTERM)
09:51:30.823711 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=16762): Terminating (SIGTERM)
09:51:30.864222 run   osmo-bsc_10.42.42.7(pid=16763): Terminating (SIGTERM)
09:51:30.904281 run        osmo-bts-sysmo(pid=16772): Terminating (SIGTERM)
09:51:30.913518 ---      ParallelTerminationStrategy: PID 16752 died...
09:51:30.967879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16752): Terminated: ok {rc=0}
09:51:30.978190 ---      ParallelTerminationStrategy: PID 16753 died...
09:51:31.033691 run   osmo-hlr_10.42.42.2(pid=16753): Terminated: ok {rc=0}
09:51:31.043822 ---      ParallelTerminationStrategy: PID 16754 died...
09:51:31.098936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16754): Terminated: ok {rc=0}
09:51:31.109307 ---      ParallelTerminationStrategy: PID 16755 died...
09:51:31.163443 run   osmo-stp_10.42.42.5(pid=16755): Terminated: ok {rc=0}
09:51:31.173243 ---      ParallelTerminationStrategy: PID 16756 died...
09:51:31.226621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16756): Terminated: ok {rc=0}
09:51:31.236397 ---      ParallelTerminationStrategy: PID 16757 died...
09:51:31.290483 run   osmo-msc_10.42.42.6(pid=16757): Terminated: ok {rc=0}
09:51:31.300104 ---      ParallelTerminationStrategy: PID 16758 died...
09:51:31.353496 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=16758): Terminated: ok {rc=0}
09:51:31.363367 ---      ParallelTerminationStrategy: PID 16759 died...
09:51:31.417514 run   osmo-mgw_10.42.42.3(pid=16759): Terminated {rc=15}
09:51:31.427442 ---      ParallelTerminationStrategy: PID 16760 died...
09:51:31.481398 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16760): Terminated: ok {rc=0}
09:51:31.491068 ---      ParallelTerminationStrategy: PID 16761 died...
09:51:31.544740 run   osmo-mgw_10.42.42.4(pid=16761): Terminated {rc=15}
09:51:31.554421 ---      ParallelTerminationStrategy: PID 16762 died...
09:51:31.607923 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=16762): Terminated: ok {rc=0}
09:51:31.617859 ---      ParallelTerminationStrategy: PID 16763 died...
09:51:31.671520 run   osmo-bsc_10.42.42.7(pid=16763): Terminated: ok {rc=0}
09:51:31.681324 ---      ParallelTerminationStrategy: PID 16772 died...
09:51:31.735410 run        osmo-bts-sysmo(pid=16772): Terminated: ok {rc=0}
09:51:31.844140 bus                        /sierra_2: Setting Online False
09:51:32.930525 bus                        /sierra_2: Setting Powered False
09:51:38.961039 bus                        /sierra_2: Setting Powered False
09:51:40.064963 bus                        /sierra_2: Setting Powered False
09:51:41.196166 bus                        /sierra_1: Setting Online False
09:51:42.281730 bus                        /sierra_1: Setting Powered False
09:51:47.968522 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f0055a6b7b8>, timeout=10, timestep=1} [trial-824↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]