Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 73 builds (Since #749 )
Took 1 min 9 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f9c5b76a158>, timeout=10, timestep=1} [trial-821↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-821 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
07:23:10.476142 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
07:23:10.487643 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
07:23:10.625964 tst                      handover.py: using LAC 8746
07:23:10.762505 tst                      handover.py: using RAC 76
07:23:10.900454 tst                      handover.py: using CellId 8746
07:23:11.045290 tst                      handover.py: using BVCI 8742
07:23:11.071905 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
07:23:11.240835 tst                      handover.py: using LAC 8747
07:23:11.375654 tst                      handover.py: using RAC 77
07:23:11.513050 tst                      handover.py: using CellId 8747
07:23:11.649241 tst                      handover.py: using BVCI 8743
07:23:11.675854 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
07:23:11.687411 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
07:23:11.698795 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
07:23:11.710167 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
07:23:11.721565 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
07:23:11.732816 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
07:23:11.840106 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
07:23:12.047722 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
07:23:12.575760 run         create_hlr_db(pid=11290): Launched
07:23:12.717210 bus                        /sierra_1: Setting Powered False
07:23:13.798865 run         create_hlr_db(pid=11290): Terminated: ok {rc=0}
07:23:14.211125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11292): Launched
07:23:14.546797 run   osmo-hlr_10.42.42.2(pid=11293): Launched
07:23:14.665488 run              osmo-stp_10.42.42.5: Starting osmo-stp
07:23:15.207770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11294): Launched
07:23:15.540023 run   osmo-stp_10.42.42.5(pid=11295): Launched
07:23:15.657026 run              osmo-msc_10.42.42.6: Starting osmo-msc
07:23:16.229414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11296): Launched
07:23:16.563552 run   osmo-msc_10.42.42.6(pid=11297): Launched
07:23:19.739189 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
07:23:20.283779 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11298): Launched
07:23:20.620561 run   osmo-mgw_10.42.42.3(pid=11299): Launched
07:23:20.737592 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
07:23:21.271905 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11300): Launched
07:23:21.603774 run   osmo-mgw_10.42.42.4(pid=11301): Launched
07:23:21.720563 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
07:23:22.435728 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11302): Launched
07:23:22.768408 run   osmo-bsc_10.42.42.7(pid=11303): Launched
07:23:29.498037 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
07:23:30.056112 run         rm-remote-dir(pid=11304): Launched
07:23:32.259827 run         rm-remote-dir(pid=11304): Terminated: ok {rc=0}
07:23:32.611941 run         mk-remote-dir(pid=11305): Launched
07:23:34.814694 run         mk-remote-dir(pid=11305): Terminated: ok {rc=0}
07:23:35.113454 run    scp-inst-to-remote(pid=11306): Launched
07:23:48.331764 run    scp-inst-to-remote(pid=11306): Terminated: ok {rc=0}
07:23:48.678264 run         mk-remote-dir(pid=11308): Launched
07:23:50.877716 run         mk-remote-dir(pid=11308): Terminated: ok {rc=0}
07:23:51.176078 run     scp-cfg-to-remote(pid=11309): Launched
07:23:53.376844 run     scp-cfg-to-remote(pid=11309): Terminated: ok {rc=0}
07:23:53.720837 run   reload-dsp-firmware(pid=11311): Launched
07:23:56.918555 run   reload-dsp-firmware(pid=11311): Terminated: ok {rc=0}
07:23:57.255754 run        osmo-bts-sysmo(pid=11312): Launched
07:24:02.610110 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (33.0s)
07:24:02.772066 tst                      handover.py: using MSISDN 5665
07:24:02.956149 bus                        /sierra_1: Setting Powered True
07:24:06.459678 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5665', subscriber_id=1}
07:24:06.601899 tst                      handover.py: using MSISDN 5666
07:24:06.781356 bus                        /sierra_2: Setting Powered True
07:24:19.140138 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f9c5b76a158&gt;, timeout=10, timestep=1} [trial-821↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-821↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
07:24:19.146969 tst                   handover.py:45: Test FAILED (68.7 sec)
07:24:19.182462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11292): Terminating (SIGTERM)
07:24:19.222972 run   osmo-hlr_10.42.42.2(pid=11293): Terminating (SIGTERM)
07:24:19.264992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11294): Terminating (SIGTERM)
07:24:19.307994 run   osmo-stp_10.42.42.5(pid=11295): Terminating (SIGTERM)
07:24:19.352196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11296): Terminating (SIGTERM)
07:24:19.395437 run   osmo-msc_10.42.42.6(pid=11297): Terminating (SIGTERM)
07:24:19.441080 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11298): Terminating (SIGTERM)
07:24:19.484225 run   osmo-mgw_10.42.42.3(pid=11299): Terminating (SIGTERM)
07:24:19.526534 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11300): Terminating (SIGTERM)
07:24:19.570733 run   osmo-mgw_10.42.42.4(pid=11301): Terminating (SIGTERM)
07:24:19.612334 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11302): Terminating (SIGTERM)
07:24:19.652863 run   osmo-bsc_10.42.42.7(pid=11303): Terminating (SIGTERM)
07:24:19.693948 run        osmo-bts-sysmo(pid=11312): Terminating (SIGTERM)
07:24:19.703515 ---      ParallelTerminationStrategy: PID 11292 died...
07:24:19.758115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11292): Terminated: ok {rc=0}
07:24:19.767857 ---      ParallelTerminationStrategy: PID 11293 died...
07:24:19.821954 run   osmo-hlr_10.42.42.2(pid=11293): Terminated: ok {rc=0}
07:24:19.831890 ---      ParallelTerminationStrategy: PID 11294 died...
07:24:19.887905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11294): Terminated: ok {rc=0}
07:24:19.898339 ---      ParallelTerminationStrategy: PID 11295 died...
07:24:19.953910 run   osmo-stp_10.42.42.5(pid=11295): Terminated: ok {rc=0}
07:24:19.964178 ---      ParallelTerminationStrategy: PID 11296 died...
07:24:20.019322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11296): Terminated: ok {rc=0}
07:24:20.029378 ---      ParallelTerminationStrategy: PID 11297 died...
07:24:20.083529 run   osmo-msc_10.42.42.6(pid=11297): Terminated: ok {rc=0}
07:24:20.093445 ---      ParallelTerminationStrategy: PID 11298 died...
07:24:20.147441 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11298): Terminated: ok {rc=0}
07:24:20.157313 ---      ParallelTerminationStrategy: PID 11299 died...
07:24:20.211337 run   osmo-mgw_10.42.42.3(pid=11299): Terminated {rc=15}
07:24:20.221296 ---      ParallelTerminationStrategy: PID 11300 died...
07:24:20.275577 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11300): Terminated: ok {rc=0}
07:24:20.285563 ---      ParallelTerminationStrategy: PID 11301 died...
07:24:20.340306 run   osmo-mgw_10.42.42.4(pid=11301): Terminated {rc=15}
07:24:20.350370 ---      ParallelTerminationStrategy: PID 11302 died...
07:24:20.404604 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11302): Terminated: ok {rc=0}
07:24:20.414618 ---      ParallelTerminationStrategy: PID 11303 died...
07:24:20.468958 run   osmo-bsc_10.42.42.7(pid=11303): Terminated: ok {rc=0}
07:24:20.478910 ---      ParallelTerminationStrategy: PID 11312 died...
07:24:20.532885 run        osmo-bts-sysmo(pid=11312): Terminated: ok {rc=0}
07:24:20.643008 bus                        /sierra_2: Setting Online False
07:24:21.731300 bus                        /sierra_2: Setting Powered False
07:24:27.083721 bus                        /sierra_2: Setting Powered False
07:24:28.190672 bus                        /sierra_2: Setting Powered False
07:24:29.326268 bus                        /sierra_1: Setting Online False
07:24:30.412691 bus                        /sierra_1: Setting Powered False
07:24:35.962515 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f9c5b76a158>, timeout=10, timestep=1} [trial-821↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]