![[Jenkins]](/jenkins/static/342c126a/images/svgs/logo.svg){kind=logo}
Failed
handover_2G:oc2g+bts1-trx-sysmocell5000.handover.py (from handover_2G_oc2g+bts1-trx-sysmocell5000)
Stacktrace
handover.py: Wait timeout {condition=<bound method OsmoBsc.bts_is_connected of osmo-bsc_10.42.42.7>, timeout=300, timestep=1} [trial-162↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:84]Standard Output
----------------------------------------------
trial-162 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py
----------------------------------------------
10:11:20.760828 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
10:11:20.774601 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2)
10:11:20.911598 tst handover.py: using LAC 16255
10:11:21.042235 tst handover.py: using RAC 190
10:11:21.172605 tst handover.py: using CellId 16254
10:11:21.303946 tst handover.py: using BVCI 2933
10:11:21.329995 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2)
10:11:21.484577 tst handover.py: using LAC 16256
10:11:21.615147 tst handover.py: using RAC 191
10:11:21.745611 tst handover.py: using CellId 16255
10:11:21.875507 tst handover.py: using BVCI 2934
10:11:21.901376 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
10:11:21.915144 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
10:11:21.928752 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
10:11:21.942327 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
10:11:21.955829 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
10:11:21.969421 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2)
10:11:22.102988 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2)
10:11:22.335486 run osmo-hlr_10.42.42.2: Starting osmo-hlr
10:11:22.859750 run create_hlr_db(pid=5272): Launched
10:11:22.999592 bus /sierra_2: Setting Powered False
10:11:24.081854 run create_hlr_db(pid=5272): Terminated: ok {rc=0}
10:11:24.522736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5274): Launched
10:11:24.859935 run osmo-hlr_10.42.42.2(pid=5275): Launched
10:11:24.980111 run osmo-stp_10.42.42.5: Starting osmo-stp
10:11:25.537514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5276): Launched
10:11:25.875067 run osmo-stp_10.42.42.5(pid=5277): Launched
10:11:25.994723 run osmo-msc_10.42.42.6: Starting osmo-msc
10:11:26.588302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5278): Launched
10:11:26.925824 run osmo-msc_10.42.42.6(pid=5279): Launched
10:11:27.048170 run osmo-mgw_10.42.42.3: Starting osmo-mgw
10:11:27.618289 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5280): Launched
10:11:27.967834 run osmo-mgw_10.42.42.3(pid=5281): Launched
10:11:28.087850 run osmo-mgw_10.42.42.4: Starting osmo-mgw
10:11:28.639148 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5282): Launched
10:11:28.977996 run osmo-mgw_10.42.42.4(pid=5283): Launched
10:11:29.098628 run osmo-bsc_10.42.42.7: Starting osmo-bsc
10:11:29.854788 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5284): Launched
10:11:30.204053 run osmo-bsc_10.42.42.7(pid=5285): Launched
10:11:33.917573 run osmo-bts-oc2g: Starting OsmoBtsOC2G to connect to osmo-bsc_10.42.42.7
10:11:34.502970 run rm-remote-dir(pid=5286): Launched
10:11:35.724788 run rm-remote-dir(pid=5286): Terminated: ok {rc=0}
10:11:36.109789 run mk-remote-dir(pid=5287): Launched
10:11:37.331790 run mk-remote-dir(pid=5287): Terminated: ok {rc=0}
10:11:37.649782 run scp-inst-to-remote(pid=5288): Launched
10:11:43.867863 run scp-inst-to-remote(pid=5288): Terminated: ok {rc=0}
10:11:44.235316 run mk-remote-dir(pid=5290): Launched
10:11:45.454610 run mk-remote-dir(pid=5290): Terminated: ok {rc=0}
10:11:45.772713 run scp-cfg-to-remote(pid=5291): Launched
10:11:46.981319 run scp-cfg-to-remote(pid=5291): Terminated: ok {rc=0}
10:11:47.327213 run osmo-bts-oc2g(pid=5293): Launched
10:11:53.783957 tst handover.py:43: ----- Report fragment: handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/01_bts0_started: pass (19.8s)
10:11:53.941462 tst handover.py: using MSISDN 13128
10:11:54.138824 bus /sierra_2: Setting Powered True
10:11:57.654877 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015252', msisdn='13128', subscriber_id=1}
10:11:57.810990 tst handover.py: using MSISDN 13129
10:11:58.007676 bus /sierra_3: Setting Powered True
10:12:04.574755 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015253', msisdn='13129', subscriber_id=2}
10:12:04.882156 bus /sierra_2: Setting Online False
10:12:06.087186 bus /sierra_2: Setting Powered False
10:12:11.859545 bus /sierra_2: Setting Powered True
10:12:13.244089 bus /sierra_2: Setting Online True
10:12:15.889915 tst /sierra_2: Connect to ('901', '70')
10:12:16.249312 bus /sierra_3: Setting Online False
10:12:17.463477 bus /sierra_3: Setting Powered False
10:12:23.858554 bus /sierra_3: Setting Powered True
10:12:28.056189 bus /sierra_3: Setting Online True
10:12:30.408286 tst /sierra_2: Already registered with network ('901', '70')
10:12:30.839768 tst /sierra_3: Connect to ('901', '70')
10:12:31.019585 tst /sierra_2: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054228053'
10:12:31.152885 tst /sierra_3: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054229028'
10:12:31.370942 tst handover.py:54: waiting for modems to attach...
10:12:34.705127 tst handover.py:57: ----- Report fragment: handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/02.1_ms0_attach: pass (3.1s)
10:12:46.380939 tst /sierra_3: Already registered with network ('901', '70')
10:12:50.488409 tst handover.py:60: ----- Report fragment: handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/02.2_ms1_attach: pass (15.5s)
10:12:52.019327 tst handover.py:63: ----- Report fragment: handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/02.3_subscribed_in_msc: pass (1.3s)
10:12:56.701712 tst handover.py:68: dial success
10:12:59.408799 tst handover.py:75: answer success, call established and ongoing
10:12:59.724913 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
10:12:59.954486 tst handover.py:79: ----- Report fragment: handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/03_call_established: pass (3.0s)
10:13:00.107377 run osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
10:13:02.474804 run ssh_sc5_ccli(pid=5294): Launched
10:13:21.708253 run ssh_sc5_ccli(pid=5294): ERR: Terminated: ERROR {rc=255} [trial-162↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:83↪handover.py↪osmo-bts-trx↪sc5-trx↪ssh_sc5_ccli(pid=5294)]
10:13:21.857519 run ssh_sc5_ccli(pid=5294): stdout:
| (launched: 2020-12-07_10:13:02.294429)
10:13:22.007089 run ssh_sc5_ccli(pid=5294): stderr:
| (launched: 2020-12-07_10:13:02.352737)
| ssh: connect to host 10.42.42.112 port 22: No route to host
10:13:22.134656 run sc5-trx: Configuring SC5 TRX failed, retrying 9 more times
10:13:27.505070 run ssh_sc5_ccli(pid=5295): Launched
10:13:30.718769 run ssh_sc5_ccli(pid=5295): Terminated: ok {rc=0}
10:13:30.845473 run osmo-bts-trx: Waiting for sc5-trx to start up...
10:13:32.182310 run osmo-bts-trx(pid=5296): Launched
10:18:32.950550 tst handover.py:84: ----- Report fragment: handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/04.1_bts1_started: FAIL (332.9s)
10:18:32.958245 tst handover.py:84: ERR: Error: handover.py: Wait timeout {condition=<bound method OsmoBsc.bts_is_connected of osmo-bsc_10.42.42.7>, timeout=300, timestep=1} [trial-162↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:84] [trial-162↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:84]
10:18:32.965706 tst handover.py:84: Test FAILED (432.2 sec)
10:18:33.007567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5274): Terminating (SIGTERM)
10:18:33.056857 run osmo-hlr_10.42.42.2(pid=5275): Terminating (SIGTERM)
10:18:33.106458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5276): Terminating (SIGTERM)
10:18:33.159028 run osmo-stp_10.42.42.5(pid=5277): Terminating (SIGTERM)
10:18:33.209598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5278): Terminating (SIGTERM)
10:18:33.259566 run osmo-msc_10.42.42.6(pid=5279): Terminating (SIGTERM)
10:18:33.308886 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5280): Terminating (SIGTERM)
10:18:33.356813 run osmo-mgw_10.42.42.3(pid=5281): Terminating (SIGTERM)
10:18:33.405861 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5282): Terminating (SIGTERM)
10:18:33.459195 run osmo-mgw_10.42.42.4(pid=5283): Terminating (SIGTERM)
10:18:33.509512 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5284): Terminating (SIGTERM)
10:18:33.564129 run osmo-bsc_10.42.42.7(pid=5285): Terminating (SIGTERM)
10:18:33.613312 run osmo-bts-oc2g(pid=5293): Terminating (SIGTERM)
10:18:33.661550 run osmo-bts-trx(pid=5296): Terminating (SIGTERM)
10:18:33.673716 --- ParallelTerminationStrategy: PID 5274 died...
10:18:33.737635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5274): Terminated: ok {rc=0}
10:18:33.749407 --- ParallelTerminationStrategy: PID 5275 died...
10:18:33.812485 run osmo-hlr_10.42.42.2(pid=5275): Terminated: ok {rc=0}
10:18:33.824153 --- ParallelTerminationStrategy: PID 5276 died...
10:18:33.887331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5276): Terminated: ok {rc=0}
10:18:33.898727 --- ParallelTerminationStrategy: PID 5277 died...
10:18:33.962334 run osmo-stp_10.42.42.5(pid=5277): Terminated: ok {rc=0}
10:18:33.973964 --- ParallelTerminationStrategy: PID 5278 died...
10:18:34.038013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5278): Terminated: ok {rc=0}
10:18:34.049468 --- ParallelTerminationStrategy: PID 5280 died...
10:18:34.113232 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5280): Terminated: ok {rc=0}
10:18:34.124755 --- ParallelTerminationStrategy: PID 5281 died...
10:18:34.188712 run osmo-mgw_10.42.42.3(pid=5281): Terminated {rc=15}
10:18:34.200427 --- ParallelTerminationStrategy: PID 5282 died...
10:18:34.265924 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5282): Terminated: ok {rc=0}
10:18:34.277511 --- ParallelTerminationStrategy: PID 5283 died...
10:18:34.340818 run osmo-mgw_10.42.42.4(pid=5283): Terminated {rc=15}
10:18:34.352250 --- ParallelTerminationStrategy: PID 5284 died...
10:18:34.415933 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5284): Terminated: ok {rc=0}
10:18:34.427499 --- ParallelTerminationStrategy: PID 5293 died...
10:18:34.491560 run osmo-bts-oc2g(pid=5293): Terminated {rc=36608}
10:18:36.520189 --- ParallelTerminationStrategy: PID 5279 died...
10:18:36.586413 run osmo-msc_10.42.42.6(pid=5279): Terminated: ok {rc=0}
10:18:37.267874 --- ParallelTerminationStrategy: PID 5285 died...
10:18:37.337091 run osmo-bsc_10.42.42.7(pid=5285): Terminated: ok {rc=0}
10:18:37.349422 --- ParallelTerminationStrategy: PID 5296 died...
10:18:37.417024 run osmo-bts-trx(pid=5296): Terminated: ok {rc=0}
10:18:37.570306 bus /sierra_3: Setting Online False
10:18:38.725946 bus /sierra_3: Setting Powered False
10:18:54.643909 bus /sierra_3: Setting Powered False
10:18:55.763958 bus /sierra_3: Setting Powered False
10:18:56.942785 bus /sierra_2: Setting Online False
10:18:58.085069 bus /sierra_2: Setting Powered False
10:19:09.640024 bus /sierra_2: Setting Powered False
Standard Error
Traceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 673, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 84, in <module>
wait(bsc.bts_is_connected, bts1)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: handover.py: Wait timeout {condition=<bound method OsmoBsc.bts_is_connected of osmo-bsc_10.42.42.7>, timeout=300, timestep=1} [trial-162↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:84]