Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 96 builds (Since #749 )
Took 1 min 12 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f362140e598>, timeout=10, timestep=1} [trial-844↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-844 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
10:26:06.894666 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:26:06.908066 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
10:26:07.034912 tst                      handover.py: using LAC 10586
10:26:07.164282 tst                      handover.py: using RAC 131
10:26:07.288114 tst                      handover.py: using CellId 10586
10:26:07.413327 tst                      handover.py: using BVCI 10582
10:26:07.437695 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
10:26:07.577120 tst                      handover.py: using LAC 10587
10:26:07.703416 tst                      handover.py: using RAC 132
10:26:07.828385 tst                      handover.py: using CellId 10587
10:26:07.953529 tst                      handover.py: using BVCI 10583
10:26:07.977697 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:26:07.988648 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:26:07.999483 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:26:08.010502 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:26:08.021673 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:26:08.032426 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
10:26:08.140704 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
10:26:08.338266 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
10:26:08.815021 run          create_hlr_db(pid=5291): Launched
10:26:08.945894 bus                        /sierra_1: Setting Powered False
10:26:10.020441 run          create_hlr_db(pid=5291): Terminated: ok {rc=0}
10:26:10.444365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5293): Launched
10:26:10.788871 run    osmo-hlr_10.42.42.2(pid=5294): Launched
10:26:10.913649 run              osmo-stp_10.42.42.5: Starting osmo-stp
10:26:11.475406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5295): Launched
10:26:11.817462 run    osmo-stp_10.42.42.5(pid=5296): Launched
10:26:11.939444 run              osmo-msc_10.42.42.6: Starting osmo-msc
10:26:12.528782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5297): Launched
10:26:12.871929 run    osmo-msc_10.42.42.6(pid=5298): Launched
10:26:16.054287 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
10:26:16.615772 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5299): Launched
10:26:16.958779 run    osmo-mgw_10.42.42.3(pid=5300): Launched
10:26:17.079926 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
10:26:17.629939 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5301): Launched
10:26:17.970216 run    osmo-mgw_10.42.42.4(pid=5302): Launched
10:26:18.091598 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
10:26:18.826004 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5303): Launched
10:26:19.167082 run    osmo-bsc_10.42.42.7(pid=5304): Launched
10:26:25.917767 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
10:26:26.489353 run          rm-remote-dir(pid=5305): Launched
10:26:28.697295 run          rm-remote-dir(pid=5305): Terminated: ok {rc=0}
10:26:29.060302 run          mk-remote-dir(pid=5306): Launched
10:26:31.266430 run          mk-remote-dir(pid=5306): Terminated: ok {rc=0}
10:26:31.576098 run     scp-inst-to-remote(pid=5307): Launched
10:26:45.802412 run     scp-inst-to-remote(pid=5307): Terminated: ok {rc=0}
10:26:46.159476 run          mk-remote-dir(pid=5309): Launched
10:26:48.362831 run          mk-remote-dir(pid=5309): Terminated: ok {rc=0}
10:26:48.668236 run      scp-cfg-to-remote(pid=5310): Launched
10:26:51.864725 run      scp-cfg-to-remote(pid=5310): Terminated: ok {rc=0}
10:26:52.196805 run    reload-dsp-firmware(pid=5312): Launched
10:26:56.390393 run    reload-dsp-firmware(pid=5312): Terminated: ok {rc=0}
10:26:56.712752 run         osmo-bts-sysmo(pid=5313): Launched
10:27:02.030938 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (36.0s)
10:27:02.188999 tst                      handover.py: using MSISDN 6884
10:27:02.367385 bus                        /sierra_1: Setting Powered True
10:27:05.863079 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6884', subscriber_id=1}
10:27:06.001343 tst                      handover.py: using MSISDN 6885
10:27:06.175834 bus                        /sierra_2: Setting Powered True
10:27:18.535843 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f362140e598&gt;, timeout=10, timestep=1} [trial-844↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-844↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
10:27:18.543232 tst                   handover.py:45: Test FAILED (71.6 sec)
10:27:18.579238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5293): Terminating (SIGTERM)
10:27:18.620753 run    osmo-hlr_10.42.42.2(pid=5294): Terminating (SIGTERM)
10:27:18.663954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5295): Terminating (SIGTERM)
10:27:18.707685 run    osmo-stp_10.42.42.5(pid=5296): Terminating (SIGTERM)
10:27:18.790804 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5297): Terminating (SIGTERM)
10:27:18.833413 run    osmo-msc_10.42.42.6(pid=5298): Terminating (SIGTERM)
10:27:18.876011 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5299): Terminating (SIGTERM)
10:27:18.916276 run    osmo-mgw_10.42.42.3(pid=5300): Terminating (SIGTERM)
10:27:18.957731 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5301): Terminating (SIGTERM)
10:27:18.999598 run    osmo-mgw_10.42.42.4(pid=5302): Terminating (SIGTERM)
10:27:19.041588 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5303): Terminating (SIGTERM)
10:27:19.087548 run    osmo-bsc_10.42.42.7(pid=5304): Terminating (SIGTERM)
10:27:19.130436 run         osmo-bts-sysmo(pid=5313): Terminating (SIGTERM)
10:27:19.142221 ---      ParallelTerminationStrategy: PID 5293 died...
10:27:19.199779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5293): Terminated: ok {rc=0}
10:27:19.210790 ---      ParallelTerminationStrategy: PID 5294 died...
10:27:19.268305 run    osmo-hlr_10.42.42.2(pid=5294): Terminated: ok {rc=0}
10:27:19.278726 ---      ParallelTerminationStrategy: PID 5295 died...
10:27:19.333471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5295): Terminated: ok {rc=0}
10:27:19.344156 ---      ParallelTerminationStrategy: PID 5296 died...
10:27:19.399343 run    osmo-stp_10.42.42.5(pid=5296): Terminated: ok {rc=0}
10:27:19.409291 ---      ParallelTerminationStrategy: PID 5297 died...
10:27:19.464404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5297): Terminated: ok {rc=0}
10:27:19.474298 ---      ParallelTerminationStrategy: PID 5298 died...
10:27:19.528501 run    osmo-msc_10.42.42.6(pid=5298): Terminated: ok {rc=0}
10:27:19.539013 ---      ParallelTerminationStrategy: PID 5299 died...
10:27:19.593633 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5299): Terminated: ok {rc=0}
10:27:19.603707 ---      ParallelTerminationStrategy: PID 5300 died...
10:27:19.657920 run    osmo-mgw_10.42.42.3(pid=5300): Terminated {rc=15}
10:27:19.668368 ---      ParallelTerminationStrategy: PID 5301 died...
10:27:19.722678 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5301): Terminated: ok {rc=0}
10:27:19.733283 ---      ParallelTerminationStrategy: PID 5302 died...
10:27:19.788098 run    osmo-mgw_10.42.42.4(pid=5302): Terminated {rc=15}
10:27:19.797976 ---      ParallelTerminationStrategy: PID 5303 died...
10:27:19.852024 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5303): Terminated: ok {rc=0}
10:27:19.862630 ---      ParallelTerminationStrategy: PID 5304 died...
10:27:19.916873 run    osmo-bsc_10.42.42.7(pid=5304): Terminated: ok {rc=0}
10:27:19.927398 ---      ParallelTerminationStrategy: PID 5313 died...
10:27:19.981767 run         osmo-bts-sysmo(pid=5313): Terminated: ok {rc=0}
10:27:20.090417 bus                        /sierra_2: Setting Online False
10:27:21.175005 bus                        /sierra_2: Setting Powered False
10:27:26.961648 bus                        /sierra_2: Setting Powered False
10:27:28.069111 bus                        /sierra_2: Setting Powered False
10:27:29.196488 bus                        /sierra_1: Setting Online False
10:27:30.280070 bus                        /sierra_1: Setting Powered False
10:27:35.964418 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f362140e598>, timeout=10, timestep=1} [trial-844↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]