![[Jenkins]](/jenkins/static/342c126a/images/svgs/logo.svg){kind=logo}
Failed
handover_2G:nanobts+bts1-trx-sysmocell5000.handover.py (from handover_2G_nanobts+bts1-trx-sysmocell5000)
Stacktrace
handover.py: Wait timeout {condition=<bound method OsmoBsc.bts_is_connected of osmo-bsc_10.42.42.7>, timeout=300, timestep=1} [trial-161↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:84]Standard Output
----------------------------------------------
trial-161 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py
----------------------------------------------
07:07:05.041709 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
07:07:05.055827 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2)
07:07:05.201668 tst handover.py: using LAC 16169
07:07:05.330931 tst handover.py: using RAC 104
07:07:05.467373 tst handover.py: using CellId 16168
07:07:05.604064 tst handover.py: using BVCI 2847
07:07:05.631476 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2)
07:07:05.790999 tst handover.py: using LAC 16170
07:07:05.928411 tst handover.py: using RAC 105
07:07:06.064956 tst handover.py: using CellId 16169
07:07:06.198703 tst handover.py: using BVCI 2848
07:07:06.224581 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
07:07:06.238735 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
07:07:06.252777 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
07:07:06.266854 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
07:07:06.281159 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
07:07:06.295554 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2)
07:07:06.422318 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2)
07:07:06.652730 run osmo-hlr_10.42.42.2: Starting osmo-hlr
07:07:07.177499 run create_hlr_db(pid=31811): Launched
07:07:07.318765 bus /sierra_2: Setting Powered False
07:07:08.400008 run create_hlr_db(pid=31811): Terminated: ok {rc=0}
07:07:08.835996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31813): Launched
07:07:09.170679 run osmo-hlr_10.42.42.2(pid=31814): Launched
07:07:09.290680 run osmo-stp_10.42.42.5: Starting osmo-stp
07:07:09.851771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31815): Launched
07:07:10.199101 run osmo-stp_10.42.42.5(pid=31816): Launched
07:07:10.318143 run osmo-msc_10.42.42.6: Starting osmo-msc
07:07:10.926841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31817): Launched
07:07:11.280602 run osmo-msc_10.42.42.6(pid=31818): Launched
07:07:11.403327 run osmo-mgw_10.42.42.3: Starting osmo-mgw
07:07:11.964401 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31819): Launched
07:07:12.312758 run osmo-mgw_10.42.42.3(pid=31820): Launched
07:07:12.440952 run osmo-mgw_10.42.42.4: Starting osmo-mgw
07:07:13.019477 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31821): Launched
07:07:13.404957 run osmo-mgw_10.42.42.4(pid=31822): Launched
07:07:13.531471 run osmo-bsc_10.42.42.7: Starting osmo-bsc
07:07:14.390317 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31823): Launched
07:07:14.733682 run osmo-bsc_10.42.42.7(pid=31824): Launched
07:07:20.319730 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=31825): Launched
07:07:20.456932 run nanobts_NanoBTS-ONW-1900: Finding nanobts 10.42.42.120, binding on 10.42.42.1...
07:07:20.756153 run abisip-find-preconf(pid=31827): Launched
07:09:27.117197 run nanobts_NanoBTS-ONW-1900: Found nanobts 10.42.42.120 with unit_id 9 trx 0
07:09:27.249070 run abisip-find-preconf(pid=31827): Terminating (SIGINT)
07:09:27.607555 run abisip-find-preconf(pid=31827): Terminated {rc=-2}
07:09:27.931921 run ipaccess-config(pid=31835): Launched
07:09:29.139447 run ipaccess-config(pid=31835): Terminated: ok {rc=0}
07:10:20.642719 run nanobts_NanoBTS-ONW-1900: nanoBTS connected to BSC
07:10:22.109110 tst handover.py:43: ----- Report fragment: handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/01_bts0_started: pass (183.6s)
07:10:22.268231 tst handover.py: using MSISDN 13060
07:10:22.461702 bus /sierra_2: Setting Powered True
07:10:26.000469 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015252', msisdn='13060', subscriber_id=1}
07:10:26.156158 tst handover.py: using MSISDN 13061
07:10:26.351161 bus /sierra_3: Setting Powered True
07:10:30.980833 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015253', msisdn='13061', subscriber_id=2}
07:10:31.290938 bus /sierra_2: Setting Online False
07:10:32.496416 bus /sierra_2: Setting Powered False
07:10:38.865539 bus /sierra_2: Setting Powered True
07:10:40.242501 bus /sierra_2: Setting Online True
07:10:42.794414 tst /sierra_2: Connect to ('901', '70')
07:10:43.145113 bus /sierra_3: Setting Online False
07:10:44.358128 bus /sierra_3: Setting Powered False
07:10:50.073279 bus /sierra_3: Setting Powered True
07:10:53.067166 bus /sierra_3: Setting Online True
07:10:55.448385 tst /sierra_3: Connect to ('901', '70')
07:10:55.636467 tst /sierra_2: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054228053'
07:10:55.765693 tst /sierra_3: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054229028'
07:10:55.967531 tst handover.py:54: waiting for modems to attach...
07:10:56.914714 tst /sierra_2: Already registered with network ('901', '70')
07:11:00.279342 tst handover.py:57: ----- Report fragment: handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/02.1_ms0_attach: pass (4.1s)
07:11:10.045810 tst /sierra_3: Already registered with network ('901', '70')
07:11:13.603074 tst handover.py:60: ----- Report fragment: handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/02.2_ms1_attach: pass (13.1s)
07:11:15.126334 tst handover.py:63: ----- Report fragment: handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/02.3_subscribed_in_msc: pass (1.3s)
07:11:19.727452 tst handover.py:68: dial success
07:11:22.431416 tst handover.py:75: answer success, call established and ongoing
07:11:22.743910 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:11:22.971407 tst handover.py:79: ----- Report fragment: handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/03_call_established: pass (3.0s)
07:11:23.124287 run osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
07:11:25.482228 run ssh_sc5_ccli(pid=31841): Launched
07:11:44.732004 run ssh_sc5_ccli(pid=31841): ERR: Terminated: ERROR {rc=255} [trial-161↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:83↪handover.py↪osmo-bts-trx↪sc5-trx↪ssh_sc5_ccli(pid=31841)]
07:11:44.891174 run ssh_sc5_ccli(pid=31841): stdout:
| (launched: 2020-12-07_07:11:25.293736)
07:11:45.050089 run ssh_sc5_ccli(pid=31841): stderr:
| (launched: 2020-12-07_07:11:25.346503)
| ssh: connect to host 10.42.42.112 port 22: No route to host
07:11:45.186198 run sc5-trx: Configuring SC5 TRX failed, retrying 9 more times
07:11:50.563398 run ssh_sc5_ccli(pid=31842): Launched
07:11:52.785397 run ssh_sc5_ccli(pid=31842): Terminated: ok {rc=0}
07:11:52.920532 run osmo-bts-trx: Waiting for sc5-trx to start up...
07:11:54.237713 run osmo-bts-trx(pid=31843): Launched
07:16:54.995310 tst handover.py:84: ----- Report fragment: handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/04.1_bts1_started: FAIL (332.0s)
07:16:55.002538 tst handover.py:84: ERR: Error: handover.py: Wait timeout {condition=<bound method OsmoBsc.bts_is_connected of osmo-bsc_10.42.42.7>, timeout=300, timestep=1} [trial-161↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:84] [trial-161↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:84]
07:16:55.009435 tst handover.py:84: Test FAILED (590.0 sec)
07:16:55.050849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31813): Terminating (SIGTERM)
07:16:55.099628 run osmo-hlr_10.42.42.2(pid=31814): Terminating (SIGTERM)
07:16:55.148744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31815): Terminating (SIGTERM)
07:16:55.202079 run osmo-stp_10.42.42.5(pid=31816): Terminating (SIGTERM)
07:16:55.258575 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31817): Terminating (SIGTERM)
07:16:55.316108 run osmo-msc_10.42.42.6(pid=31818): Terminating (SIGTERM)
07:16:55.373178 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31819): Terminating (SIGTERM)
07:16:55.425509 run osmo-mgw_10.42.42.3(pid=31820): Terminating (SIGTERM)
07:16:55.478377 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31821): Terminating (SIGTERM)
07:16:55.532106 run osmo-mgw_10.42.42.4(pid=31822): Terminating (SIGTERM)
07:16:55.585636 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31823): Terminating (SIGTERM)
07:16:55.640932 run osmo-bsc_10.42.42.7(pid=31824): Terminating (SIGTERM)
07:16:55.693642 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=31825): Terminating (SIGTERM)
07:16:55.745459 run osmo-bts-trx(pid=31843): Terminating (SIGTERM)
07:16:55.758622 --- ParallelTerminationStrategy: PID 31813 died...
07:16:55.828394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31813): Terminated: ok {rc=0}
07:16:55.840909 --- ParallelTerminationStrategy: PID 31814 died...
07:16:55.910081 run osmo-hlr_10.42.42.2(pid=31814): Terminated: ok {rc=0}
07:16:55.922256 --- ParallelTerminationStrategy: PID 31815 died...
07:16:55.991393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31815): Terminated: ok {rc=0}
07:16:56.003619 --- ParallelTerminationStrategy: PID 31816 died...
07:16:56.072794 run osmo-stp_10.42.42.5(pid=31816): Terminated: ok {rc=0}
07:16:56.085447 --- ParallelTerminationStrategy: PID 31817 died...
07:16:56.153842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31817): Terminated: ok {rc=0}
07:16:56.166056 --- ParallelTerminationStrategy: PID 31819 died...
07:16:56.235677 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31819): Terminated: ok {rc=0}
07:16:56.248947 --- ParallelTerminationStrategy: PID 31820 died...
07:16:56.318586 run osmo-mgw_10.42.42.3(pid=31820): Terminated {rc=15}
07:16:56.330946 --- ParallelTerminationStrategy: PID 31821 died...
07:16:56.399249 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31821): Terminated: ok {rc=0}
07:16:56.411644 --- ParallelTerminationStrategy: PID 31822 died...
07:16:56.479950 run osmo-mgw_10.42.42.4(pid=31822): Terminated {rc=15}
07:16:56.492436 --- ParallelTerminationStrategy: PID 31823 died...
07:16:56.560568 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31823): Terminated: ok {rc=0}
07:16:56.573471 --- ParallelTerminationStrategy: PID 31825 died...
07:16:56.641804 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=31825): Terminated: ok {rc=0}
07:16:58.671092 --- ParallelTerminationStrategy: PID 31818 died...
07:16:58.738245 run osmo-msc_10.42.42.6(pid=31818): Terminated: ok {rc=0}
07:16:59.417643 --- ParallelTerminationStrategy: PID 31824 died...
07:16:59.483980 run osmo-bsc_10.42.42.7(pid=31824): Terminated: ok {rc=0}
07:16:59.495762 --- ParallelTerminationStrategy: PID 31843 died...
07:16:59.559845 run osmo-bts-trx(pid=31843): Terminated: ok {rc=0}
07:16:59.715024 bus /sierra_3: Setting Online False
07:17:00.860863 bus /sierra_3: Setting Powered False
07:17:12.644910 bus /sierra_3: Setting Powered False
07:17:13.766406 bus /sierra_3: Setting Powered False
07:17:14.944403 bus /sierra_2: Setting Online False
07:17:16.096441 bus /sierra_2: Setting Powered False
07:17:23.811254 bus /sierra_2: Setting Powered False
Standard Error
Traceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 673, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 84, in <module>
wait(bsc.bts_is_connected, bts1)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: handover.py: Wait timeout {condition=<bound method OsmoBsc.bts_is_connected of osmo-bsc_10.42.42.7>, timeout=300, timestep=1} [trial-161↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:84]