Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 78 builds (Since #751 )
Took 1 min 8 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f06da8bdae8>, timeout=10, timestep=1} [trial-828↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-828 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
15:55:24.006980 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
15:55:24.017665 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
15:55:24.149578 tst          emergency_mo_mt_call.py: using LAC 9246
15:55:24.277496 tst          emergency_mo_mt_call.py: using RAC 66
15:55:24.407154 tst          emergency_mo_mt_call.py: using CellId 9246
15:55:24.532577 tst          emergency_mo_mt_call.py: using BVCI 9242
15:55:24.557060 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
15:55:24.568235 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
15:55:24.579365 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
15:55:24.590348 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
15:55:24.601331 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
15:55:24.612333 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
15:55:24.712201 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
15:55:24.896618 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
15:55:25.379059 run         create_hlr_db(pid=31330): Launched
15:55:25.554145 bus                        /sierra_1: Setting Powered False
15:55:26.574114 run         create_hlr_db(pid=31330): Terminated: ok {rc=0}
15:55:27.003519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31332): Launched
15:55:27.328680 run   osmo-hlr_10.42.42.2(pid=31333): Launched
15:55:27.445399 run              osmo-stp_10.42.42.5: Starting osmo-stp
15:55:28.005876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31334): Launched
15:55:28.328866 run   osmo-stp_10.42.42.5(pid=31335): Launched
15:55:28.455907 tst          emergency_mo_mt_call.py: using MSISDN 6016
15:55:28.615387 run              osmo-msc_10.42.42.6: Starting osmo-msc
15:55:29.204158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31336): Launched
15:55:29.528729 run   osmo-msc_10.42.42.6(pid=31337): Launched
15:55:32.700084 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
15:55:33.257304 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31338): Launched
15:55:33.563878 run   osmo-mgw_10.42.42.3(pid=31339): Launched
15:55:33.671365 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
15:55:34.193592 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31340): Launched
15:55:34.498551 run   osmo-mgw_10.42.42.4(pid=31341): Launched
15:55:34.606553 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
15:55:35.240061 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31342): Launched
15:55:35.549584 run   osmo-bsc_10.42.42.7(pid=31343): Launched
15:55:41.807476 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
15:55:42.349873 run         rm-remote-dir(pid=31344): Launched
15:55:44.537844 run         rm-remote-dir(pid=31344): Terminated: ok {rc=0}
15:55:44.864745 run         mk-remote-dir(pid=31345): Launched
15:55:47.052133 run         mk-remote-dir(pid=31345): Terminated: ok {rc=0}
15:55:47.327212 run    scp-inst-to-remote(pid=31346): Launched
15:56:00.530233 run    scp-inst-to-remote(pid=31346): Terminated: ok {rc=0}
15:56:00.853256 run         mk-remote-dir(pid=31348): Launched
15:56:03.040812 run         mk-remote-dir(pid=31348): Terminated: ok {rc=0}
15:56:03.317458 run     scp-cfg-to-remote(pid=31353): Launched
15:56:06.503403 run     scp-cfg-to-remote(pid=31353): Terminated: ok {rc=0}
15:56:06.821748 run   reload-dsp-firmware(pid=31355): Launched
15:56:10.005353 run   reload-dsp-firmware(pid=31355): Terminated: ok {rc=0}
15:56:10.319366 run        osmo-bts-sysmo(pid=31356): Launched
15:56:15.565041 tst          emergency_mo_mt_call.py: using MSISDN 6017
15:56:15.733887 bus                        /sierra_1: Setting Powered True
15:56:19.215290 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6017', subscriber_id=1}
15:56:19.392346 bus                        /sierra_2: Setting Powered True
15:56:31.755063 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f06da8bdae8&gt;, timeout=10, timestep=1} [trial-828↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-828↪emergency:sysmo↪emergency_mo_mt_call.py:31]
15:56:31.761950 tst       emergency_mo_mt_call.py:31: Test FAILED (67.7 sec)
15:56:31.796824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31332): Terminating (SIGTERM)
15:56:31.836930 run   osmo-hlr_10.42.42.2(pid=31333): Terminating (SIGTERM)
15:56:31.877597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31334): Terminating (SIGTERM)
15:56:31.920748 run   osmo-stp_10.42.42.5(pid=31335): Terminating (SIGTERM)
15:56:31.973968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31336): Terminating (SIGTERM)
15:56:32.019844 run   osmo-msc_10.42.42.6(pid=31337): Terminating (SIGTERM)
15:56:32.065443 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31338): Terminating (SIGTERM)
15:56:32.107096 run   osmo-mgw_10.42.42.3(pid=31339): Terminating (SIGTERM)
15:56:32.148010 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31340): Terminating (SIGTERM)
15:56:32.189419 run   osmo-mgw_10.42.42.4(pid=31341): Terminating (SIGTERM)
15:56:32.246875 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31342): Terminating (SIGTERM)
15:56:32.290611 run   osmo-bsc_10.42.42.7(pid=31343): Terminating (SIGTERM)
15:56:32.332656 run        osmo-bts-sysmo(pid=31356): Terminating (SIGTERM)
15:56:32.343207 ---      ParallelTerminationStrategy: PID 31332 died...
15:56:32.401051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31332): Terminated: ok {rc=0}
15:56:32.411228 ---      ParallelTerminationStrategy: PID 31333 died...
15:56:32.468142 run   osmo-hlr_10.42.42.2(pid=31333): Terminated: ok {rc=0}
15:56:32.478340 ---      ParallelTerminationStrategy: PID 31334 died...
15:56:32.535368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31334): Terminated: ok {rc=0}
15:56:32.546161 ---      ParallelTerminationStrategy: PID 31335 died...
15:56:32.603057 run   osmo-stp_10.42.42.5(pid=31335): Terminated: ok {rc=0}
15:56:32.613334 ---      ParallelTerminationStrategy: PID 31336 died...
15:56:32.671316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31336): Terminated: ok {rc=0}
15:56:32.681990 ---      ParallelTerminationStrategy: PID 31337 died...
15:56:32.740162 run   osmo-msc_10.42.42.6(pid=31337): Terminated: ok {rc=0}
15:56:32.751038 ---      ParallelTerminationStrategy: PID 31338 died...
15:56:32.809124 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31338): Terminated: ok {rc=0}
15:56:32.819755 ---      ParallelTerminationStrategy: PID 31339 died...
15:56:32.877938 run   osmo-mgw_10.42.42.3(pid=31339): Terminated {rc=15}
15:56:32.889707 ---      ParallelTerminationStrategy: PID 31340 died...
15:56:32.943942 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31340): Terminated: ok {rc=0}
15:56:32.953723 ---      ParallelTerminationStrategy: PID 31341 died...
15:56:33.006866 run   osmo-mgw_10.42.42.4(pid=31341): Terminated {rc=15}
15:56:33.016691 ---      ParallelTerminationStrategy: PID 31342 died...
15:56:33.070408 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31342): Terminated: ok {rc=0}
15:56:33.079918 ---      ParallelTerminationStrategy: PID 31343 died...
15:56:33.133516 run   osmo-bsc_10.42.42.7(pid=31343): Terminated: ok {rc=0}
15:56:33.143113 ---      ParallelTerminationStrategy: PID 31356 died...
15:56:33.196464 run        osmo-bts-sysmo(pid=31356): Terminated: ok {rc=0}
15:56:33.305972 bus                        /sierra_2: Setting Online False
15:56:34.394577 bus                        /sierra_2: Setting Powered False
15:56:39.970206 bus                        /sierra_2: Setting Powered False
15:56:41.073503 bus                        /sierra_2: Setting Powered False
15:56:42.206233 bus                        /sierra_1: Setting Online False
15:56:43.291300 bus                        /sierra_1: Setting Powered False
15:56:48.970820 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f06da8bdae8>, timeout=10, timestep=1} [trial-828↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]