Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 83 builds (Since #749 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fd81c4077b8>, timeout=10, timestep=1} [trial-831↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-831 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
19:26:10.111961 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
19:26:10.123632 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
19:26:10.258503 tst                      handover.py: using LAC 9546
19:26:10.390147 tst                      handover.py: using RAC 111
19:26:10.522939 tst                      handover.py: using CellId 9546
19:26:10.660095 tst                      handover.py: using BVCI 9542
19:26:10.686053 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
19:26:10.831878 tst                      handover.py: using LAC 9547
19:26:10.959588 tst                      handover.py: using RAC 112
19:26:11.085071 tst                      handover.py: using CellId 9547
19:26:11.210661 tst                      handover.py: using BVCI 9543
19:26:11.235141 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
19:26:11.246416 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
19:26:11.257128 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
19:26:11.268578 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
19:26:11.279815 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
19:26:11.291001 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
19:26:11.398206 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
19:26:11.601935 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
19:26:12.118639 run          create_hlr_db(pid=7088): Launched
19:26:12.258477 bus                        /sierra_1: Setting Powered False
19:26:13.327396 run          create_hlr_db(pid=7088): Terminated: ok {rc=0}
19:26:13.726525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7090): Launched
19:26:14.051745 run    osmo-hlr_10.42.42.2(pid=7091): Launched
19:26:14.166999 run              osmo-stp_10.42.42.5: Starting osmo-stp
19:26:14.697579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7092): Launched
19:26:15.019786 run    osmo-stp_10.42.42.5(pid=7093): Launched
19:26:15.133702 run              osmo-msc_10.42.42.6: Starting osmo-msc
19:26:15.711281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7094): Launched
19:26:16.054726 run    osmo-msc_10.42.42.6(pid=7095): Launched
19:26:19.236466 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
19:26:19.798978 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=7096): Launched
19:26:20.143659 run    osmo-mgw_10.42.42.3(pid=7097): Launched
19:26:20.266202 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
19:26:20.818390 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7098): Launched
19:26:21.161749 run    osmo-mgw_10.42.42.4(pid=7099): Launched
19:26:21.284236 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
19:26:22.027227 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=7100): Launched
19:26:22.373792 run    osmo-bsc_10.42.42.7(pid=7101): Launched
19:26:29.132435 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
19:26:29.713254 run          rm-remote-dir(pid=7102): Launched
19:26:31.924066 run          rm-remote-dir(pid=7102): Terminated: ok {rc=0}
19:26:32.291006 run          mk-remote-dir(pid=7103): Launched
19:26:34.502801 run          mk-remote-dir(pid=7103): Terminated: ok {rc=0}
19:26:34.811255 run     scp-inst-to-remote(pid=7104): Launched
19:26:48.028530 run     scp-inst-to-remote(pid=7104): Terminated: ok {rc=0}
19:26:48.369505 run          mk-remote-dir(pid=7106): Launched
19:26:51.566846 run          mk-remote-dir(pid=7106): Terminated: ok {rc=0}
19:26:51.857860 run      scp-cfg-to-remote(pid=7107): Launched
19:26:54.055487 run      scp-cfg-to-remote(pid=7107): Terminated: ok {rc=0}
19:26:54.390965 run    reload-dsp-firmware(pid=7109): Launched
19:26:57.584193 run    reload-dsp-firmware(pid=7109): Terminated: ok {rc=0}
19:26:57.910127 run         osmo-bts-sysmo(pid=7110): Launched
19:27:03.231235 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (34.0s)
19:27:03.380408 tst                      handover.py: using MSISDN 6195
19:27:03.557428 bus                        /sierra_1: Setting Powered True
19:27:07.071274 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6195', subscriber_id=1}
19:27:07.216870 tst                      handover.py: using MSISDN 6196
19:27:07.404375 bus                        /sierra_2: Setting Powered True
19:27:19.782870 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fd81c4077b8&gt;, timeout=10, timestep=1} [trial-831↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-831↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
19:27:19.790318 tst                   handover.py:45: Test FAILED (69.7 sec)
19:27:19.826304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7090): Terminating (SIGTERM)
19:27:19.868315 run    osmo-hlr_10.42.42.2(pid=7091): Terminating (SIGTERM)
19:27:19.911454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7092): Terminating (SIGTERM)
19:27:19.954353 run    osmo-stp_10.42.42.5(pid=7093): Terminating (SIGTERM)
19:27:20.025679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7094): Terminating (SIGTERM)
19:27:20.070748 run    osmo-msc_10.42.42.6(pid=7095): Terminating (SIGTERM)
19:27:20.119719 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=7096): Terminating (SIGTERM)
19:27:20.164445 run    osmo-mgw_10.42.42.3(pid=7097): Terminating (SIGTERM)
19:27:20.221069 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7098): Terminating (SIGTERM)
19:27:20.264430 run    osmo-mgw_10.42.42.4(pid=7099): Terminating (SIGTERM)
19:27:20.305060 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=7100): Terminating (SIGTERM)
19:27:20.345321 run    osmo-bsc_10.42.42.7(pid=7101): Terminating (SIGTERM)
19:27:20.385632 run         osmo-bts-sysmo(pid=7110): Terminating (SIGTERM)
19:27:20.395325 ---      ParallelTerminationStrategy: PID 7090 died...
19:27:20.448757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7090): Terminated: ok {rc=0}
19:27:20.458768 ---      ParallelTerminationStrategy: PID 7091 died...
19:27:20.513737 run    osmo-hlr_10.42.42.2(pid=7091): Terminated: ok {rc=0}
19:27:20.524791 ---      ParallelTerminationStrategy: PID 7092 died...
19:27:20.581058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7092): Terminated: ok {rc=0}
19:27:20.591716 ---      ParallelTerminationStrategy: PID 7093 died...
19:27:20.648294 run    osmo-stp_10.42.42.5(pid=7093): Terminated: ok {rc=0}
19:27:20.658210 ---      ParallelTerminationStrategy: PID 7094 died...
19:27:20.711855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7094): Terminated: ok {rc=0}
19:27:20.722023 ---      ParallelTerminationStrategy: PID 7095 died...
19:27:20.775741 run    osmo-msc_10.42.42.6(pid=7095): Terminated: ok {rc=0}
19:27:20.786151 ---      ParallelTerminationStrategy: PID 7096 died...
19:27:20.840087 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=7096): Terminated: ok {rc=0}
19:27:20.850272 ---      ParallelTerminationStrategy: PID 7097 died...
19:27:20.904090 run    osmo-mgw_10.42.42.3(pid=7097): Terminated {rc=15}
19:27:20.914080 ---      ParallelTerminationStrategy: PID 7098 died...
19:27:20.967716 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7098): Terminated: ok {rc=0}
19:27:20.978135 ---      ParallelTerminationStrategy: PID 7099 died...
19:27:21.032188 run    osmo-mgw_10.42.42.4(pid=7099): Terminated {rc=15}
19:27:21.042360 ---      ParallelTerminationStrategy: PID 7100 died...
19:27:21.096409 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=7100): Terminated: ok {rc=0}
19:27:21.106612 ---      ParallelTerminationStrategy: PID 7101 died...
19:27:21.160400 run    osmo-bsc_10.42.42.7(pid=7101): Terminated: ok {rc=0}
19:27:21.170408 ---      ParallelTerminationStrategy: PID 7110 died...
19:27:21.224175 run         osmo-bts-sysmo(pid=7110): Terminated: ok {rc=0}
19:27:21.333910 bus                        /sierra_2: Setting Online False
19:27:22.421109 bus                        /sierra_2: Setting Powered False
19:27:27.962840 bus                        /sierra_2: Setting Powered False
19:27:29.070028 bus                        /sierra_2: Setting Powered False
19:27:30.203353 bus                        /sierra_1: Setting Online False
19:27:31.289312 bus                        /sierra_1: Setting Powered False
19:27:36.966832 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fd81c4077b8>, timeout=10, timestep=1} [trial-831↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]