Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 77 builds (Since #751 )
Took 1 min 9 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f0b54c91ae8>, timeout=10, timestep=1} [trial-827↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-827 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
12:49:24.009690 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
12:49:24.020438 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
12:49:24.148854 tst          emergency_mo_mt_call.py: using LAC 9166
12:49:24.268283 tst          emergency_mo_mt_call.py: using RAC 241
12:49:24.389410 tst          emergency_mo_mt_call.py: using CellId 9166
12:49:24.508869 tst          emergency_mo_mt_call.py: using BVCI 9162
12:49:24.532192 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
12:49:24.542877 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
12:49:24.553309 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
12:49:24.563836 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
12:49:24.574392 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
12:49:24.584969 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
12:49:24.687491 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
12:49:24.881905 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
12:49:25.409592 run         create_hlr_db(pid=23237): Launched
12:49:25.600291 bus                        /sierra_1: Setting Powered False
12:49:26.619931 run         create_hlr_db(pid=23237): Terminated: ok {rc=0}
12:49:27.034968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23239): Launched
12:49:27.344247 run   osmo-hlr_10.42.42.2(pid=23240): Launched
12:49:27.454633 run              osmo-stp_10.42.42.5: Starting osmo-stp
12:49:27.992634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23241): Launched
12:49:28.303004 run   osmo-stp_10.42.42.5(pid=23242): Launched
12:49:28.436123 tst          emergency_mo_mt_call.py: using MSISDN 5963
12:49:28.598730 run              osmo-msc_10.42.42.6: Starting osmo-msc
12:49:29.198532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23243): Launched
12:49:29.529329 run   osmo-msc_10.42.42.6(pid=23244): Launched
12:49:32.704376 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
12:49:33.275182 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=23245): Launched
12:49:33.605931 run   osmo-mgw_10.42.42.3(pid=23246): Launched
12:49:33.722520 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
12:49:34.283719 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23247): Launched
12:49:34.613459 run   osmo-mgw_10.42.42.4(pid=23248): Launched
12:49:34.730923 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
12:49:35.415235 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=23249): Launched
12:49:35.746273 run   osmo-bsc_10.42.42.7(pid=23250): Launched
12:49:42.025347 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
12:49:42.613555 run         rm-remote-dir(pid=23251): Launched
12:49:44.817490 run         rm-remote-dir(pid=23251): Terminated: ok {rc=0}
12:49:45.170737 run         mk-remote-dir(pid=23252): Launched
12:49:47.372426 run         mk-remote-dir(pid=23252): Terminated: ok {rc=0}
12:49:47.670375 run    scp-inst-to-remote(pid=23253): Launched
12:50:00.878910 run    scp-inst-to-remote(pid=23253): Terminated: ok {rc=0}
12:50:01.206867 run         mk-remote-dir(pid=23256): Launched
12:50:03.395143 run         mk-remote-dir(pid=23256): Terminated: ok {rc=0}
12:50:03.675909 run     scp-cfg-to-remote(pid=23260): Launched
12:50:06.866408 run     scp-cfg-to-remote(pid=23260): Terminated: ok {rc=0}
12:50:07.188647 run   reload-dsp-firmware(pid=23262): Launched
12:50:10.375430 run   reload-dsp-firmware(pid=23262): Terminated: ok {rc=0}
12:50:10.693553 run        osmo-bts-sysmo(pid=23263): Launched
12:50:15.931015 tst          emergency_mo_mt_call.py: using MSISDN 5964
12:50:16.111388 bus                        /sierra_1: Setting Powered True
12:50:19.604126 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5964', subscriber_id=1}
12:50:19.795134 bus                        /sierra_2: Setting Powered True
12:50:32.171906 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f0b54c91ae8&gt;, timeout=10, timestep=1} [trial-827↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-827↪emergency:sysmo↪emergency_mo_mt_call.py:31]
12:50:32.178591 tst       emergency_mo_mt_call.py:31: Test FAILED (68.2 sec)
12:50:32.213578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23239): Terminating (SIGTERM)
12:50:32.253689 run   osmo-hlr_10.42.42.2(pid=23240): Terminating (SIGTERM)
12:50:32.295046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23241): Terminating (SIGTERM)
12:50:32.336924 run   osmo-stp_10.42.42.5(pid=23242): Terminating (SIGTERM)
12:50:32.388541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23243): Terminating (SIGTERM)
12:50:32.435742 run   osmo-msc_10.42.42.6(pid=23244): Terminating (SIGTERM)
12:50:32.475900 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=23245): Terminating (SIGTERM)
12:50:32.515920 run   osmo-mgw_10.42.42.3(pid=23246): Terminating (SIGTERM)
12:50:32.557584 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23247): Terminating (SIGTERM)
12:50:32.597482 run   osmo-mgw_10.42.42.4(pid=23248): Terminating (SIGTERM)
12:50:32.637884 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=23249): Terminating (SIGTERM)
12:50:32.679649 run   osmo-bsc_10.42.42.7(pid=23250): Terminating (SIGTERM)
12:50:32.721548 run        osmo-bts-sysmo(pid=23263): Terminating (SIGTERM)
12:50:32.733305 ---      ParallelTerminationStrategy: PID 23239 died...
12:50:32.790718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23239): Terminated: ok {rc=0}
12:50:32.800656 ---      ParallelTerminationStrategy: PID 23240 died...
12:50:32.854833 run   osmo-hlr_10.42.42.2(pid=23240): Terminated: ok {rc=0}
12:50:32.865047 ---      ParallelTerminationStrategy: PID 23241 died...
12:50:32.919763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23241): Terminated: ok {rc=0}
12:50:32.929788 ---      ParallelTerminationStrategy: PID 23242 died...
12:50:32.984501 run   osmo-stp_10.42.42.5(pid=23242): Terminated: ok {rc=0}
12:50:32.994547 ---      ParallelTerminationStrategy: PID 23243 died...
12:50:33.047753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23243): Terminated: ok {rc=0}
12:50:33.057565 ---      ParallelTerminationStrategy: PID 23244 died...
12:50:33.110614 run   osmo-msc_10.42.42.6(pid=23244): Terminated: ok {rc=0}
12:50:33.120381 ---      ParallelTerminationStrategy: PID 23245 died...
12:50:33.173552 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=23245): Terminated: ok {rc=0}
12:50:33.183337 ---      ParallelTerminationStrategy: PID 23246 died...
12:50:33.236700 run   osmo-mgw_10.42.42.3(pid=23246): Terminated {rc=15}
12:50:33.246296 ---      ParallelTerminationStrategy: PID 23247 died...
12:50:33.299545 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23247): Terminated: ok {rc=0}
12:50:33.309464 ---      ParallelTerminationStrategy: PID 23248 died...
12:50:33.362670 run   osmo-mgw_10.42.42.4(pid=23248): Terminated {rc=15}
12:50:33.372463 ---      ParallelTerminationStrategy: PID 23249 died...
12:50:33.425901 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=23249): Terminated: ok {rc=0}
12:50:33.435774 ---      ParallelTerminationStrategy: PID 23250 died...
12:50:33.488913 run   osmo-bsc_10.42.42.7(pid=23250): Terminated: ok {rc=0}
12:50:33.498780 ---      ParallelTerminationStrategy: PID 23263 died...
12:50:33.551922 run        osmo-bts-sysmo(pid=23263): Terminated: ok {rc=0}
12:50:33.661938 bus                        /sierra_2: Setting Online False
12:50:34.745747 bus                        /sierra_2: Setting Powered False
12:50:40.084919 bus                        /sierra_2: Setting Powered False
12:50:41.186787 bus                        /sierra_2: Setting Powered False
12:50:42.312889 bus                        /sierra_1: Setting Online False
12:50:43.400348 bus                        /sierra_1: Setting Powered False
12:50:48.959215 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f0b54c91ae8>, timeout=10, timestep=1} [trial-827↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]