Skip to content

Failed

handover_2G:oc2g+bts1-trx-lms.handover.py (from handover_2G_oc2g+bts1-trx-lms)

Failing for the past 22 builds (Since #140 )
Took 2 min 54 sec.

Stacktrace

handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),

Standard Output

----------------------------------------------
trial-161 handover_2G:oc2g+bts1-trx-lms handover.py
----------------------------------------------
07:39:13.739740 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
07:39:13.753583 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2)
07:39:13.890792 tst                      handover.py: using LAC 16179
07:39:14.027970 tst                      handover.py: using RAC 114
07:39:14.160830 tst                      handover.py: using CellId 16178
07:39:14.290489 tst                      handover.py: using BVCI 2857
07:39:14.316229 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2)
07:39:14.472692 tst                      handover.py: using LAC 16180
07:39:14.602777 tst                      handover.py: using RAC 115
07:39:14.737951 tst                      handover.py: using CellId 16179
07:39:14.867747 tst                      handover.py: using BVCI 2858
07:39:14.893624 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
07:39:14.907439 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
07:39:14.921198 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
07:39:14.934739 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
07:39:14.948455 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
07:39:14.961958 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2)
07:39:15.096169 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2)
07:39:15.637025 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
07:39:16.139462 run         create_hlr_db(pid=32131): Launched
07:39:16.278844 bus                        /sierra_2: Setting Powered False
07:39:17.362803 run         create_hlr_db(pid=32131): Terminated: ok {rc=0}
07:39:17.791605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32133): Launched
07:39:18.140786 run   osmo-hlr_10.42.42.2(pid=32134): Launched
07:39:18.260548 run              osmo-stp_10.42.42.5: Starting osmo-stp
07:39:18.822667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32135): Launched
07:39:19.185615 run   osmo-stp_10.42.42.5(pid=32136): Launched
07:39:19.310951 run              osmo-msc_10.42.42.6: Starting osmo-msc
07:39:19.923207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32137): Launched
07:39:20.259491 run   osmo-msc_10.42.42.6(pid=32138): Launched
07:39:20.380676 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
07:39:20.952190 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=32139): Launched
07:39:21.307059 run   osmo-mgw_10.42.42.3(pid=32140): Launched
07:39:21.433359 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
07:39:22.005983 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=32141): Launched
07:39:22.355876 run   osmo-mgw_10.42.42.4(pid=32142): Launched
07:39:22.474996 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
07:39:23.221632 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=32143): Launched
07:39:23.567390 run   osmo-bsc_10.42.42.7(pid=32144): Launched
07:39:27.289384 run                    osmo-bts-oc2g: Starting OsmoBtsOC2G to connect to osmo-bsc_10.42.42.7
07:39:27.890277 run         rm-remote-dir(pid=32145): Launched
07:39:29.100494 run         rm-remote-dir(pid=32145): Terminated: ok {rc=0}
07:39:29.474793 run         mk-remote-dir(pid=32146): Launched
07:39:30.694968 run         mk-remote-dir(pid=32146): Terminated: ok {rc=0}
07:39:31.013081 run    scp-inst-to-remote(pid=32147): Launched
07:39:37.229565 run    scp-inst-to-remote(pid=32147): Terminated: ok {rc=0}
07:39:37.588062 run         mk-remote-dir(pid=32149): Launched
07:39:38.794788 run         mk-remote-dir(pid=32149): Terminated: ok {rc=0}
07:39:39.110272 run     scp-cfg-to-remote(pid=32150): Launched
07:39:40.330565 run     scp-cfg-to-remote(pid=32150): Terminated: ok {rc=0}
07:39:40.687445 run         osmo-bts-oc2g(pid=32152): Launched
07:39:47.166274 tst                   handover.py:43: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/01_bts0_started: pass (19.8s)
07:39:47.327029 tst                      handover.py: using MSISDN 13070
07:39:47.524410 bus                        /sierra_2: Setting Powered True
07:39:51.038833 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015252', msisdn='13070', subscriber_id=1}
07:39:51.193115 tst                      handover.py: using MSISDN 13071
07:39:53.501124 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015253', msisdn='13071', subscriber_id=2}
07:39:53.815337 bus                        /sierra_2: Setting Online False
07:39:55.021592 bus                        /sierra_2: Setting Powered False
07:40:00.868111 bus                        /sierra_2: Setting Powered True
07:40:02.249042 bus                        /sierra_2: Setting Online True
07:40:04.851950 tst                        /sierra_2: Connect to ('901', '70')
07:40:05.264856 bus                        /sierra_3: Setting Online False
07:40:06.505762 bus                        /sierra_3: Setting Powered False
07:40:12.852053 bus                        /sierra_3: Setting Powered True
07:40:17.355939 bus                        /sierra_3: Setting Online True
07:40:19.138162 tst                        /sierra_2: Already registered with network ('901', '70')
07:40:20.125797 tst                        /sierra_3: Connect to ('901', '70')
07:40:20.310442 tst                        /sierra_2: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054228053'
07:40:20.448483 tst                        /sierra_3: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054229028'
07:40:20.652969 tst                   handover.py:54: waiting for modems to attach...
07:40:22.963448 tst                   handover.py:57: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/02.1_ms0_attach: pass (2.1s)
07:40:36.332209 tst                        /sierra_3: Already registered with network ('901', '70')
07:40:41.440741 tst                   handover.py:60: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/02.2_ms1_attach: pass (18.2s)
07:40:42.999187 tst                   handover.py:63: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/02.3_subscribed_in_msc: pass (1.3s)
07:40:47.718741 tst                   handover.py:68: dial success
07:40:50.395979 tst                   handover.py:75: answer success, call established and ongoing
07:40:50.687119 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:40:50.897724 tst                   handover.py:79: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/03_call_established: pass (2.9s)
07:40:51.040601 run                     osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
07:40:51.501684 run                     osmo-trx-lms: OSMOTRX CONF: {'osmo_trx': {'remote_user': 'jenkins', 'launch_trx': 'True', 'dev_args': 'LimeSDR-USB,serial=00090706024F0A22', 'type': 'lms', 'channels': [{'rx_path': 'LNAW'}], 'trx_ip': '10.42.42.117', 'egprs': 'disable', 'clock_reference': 'external', 'bts_ip': '10.42.42.53'}}
07:40:52.112724 run               uname-m(pid=32538): Launched
07:40:53.347588 run               uname-m(pid=32538): Terminated: ok {rc=0}
07:40:53.746962 run         rm-remote-dir(pid=32539): Launched
07:40:54.965722 run         rm-remote-dir(pid=32539): Terminated: ok {rc=0}
07:40:55.359900 run         mk-remote-dir(pid=32540): Launched
07:40:56.594007 run         mk-remote-dir(pid=32540): Terminated: ok {rc=0}
07:40:56.987731 run         mk-remote-dir(pid=32541): Launched
07:40:58.201585 run         mk-remote-dir(pid=32541): Terminated: ok {rc=0}
07:40:58.536855 run    scp-inst-to-remote(pid=32542): Launched
07:41:00.768907 run    scp-inst-to-remote(pid=32542): Terminated: ok {rc=0}
07:41:01.165034 run         mk-remote-dir(pid=32544): Launched
07:41:02.379189 run         mk-remote-dir(pid=32544): Terminated: ok {rc=0}
07:41:02.710005 run     scp-cfg-to-remote(pid=32545): Launched
07:41:03.943715 run     scp-cfg-to-remote(pid=32545): Terminated: ok {rc=0}
07:41:04.348848 run         mk-remote-dir(pid=32547): Launched
07:41:05.566876 run         mk-remote-dir(pid=32547): Terminated: ok {rc=0}
07:41:05.889011 run scp-wrapper-to-remote(pid=32548): Launched
07:41:07.107128 run scp-wrapper-to-remote(pid=32548): Terminated: ok {rc=0}
07:41:07.466270 run          osmo-trx-lms(pid=32550): Launched
07:41:07.587134 run                     osmo-bts-trx: Waiting for osmo-trx-lms to start up...
07:41:08.896666 run          osmo-bts-trx(pid=32551): Launched
07:41:11.355120 tst                   handover.py:84: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/04.1_bts1_started: pass (20.2s)
07:41:11.583886 tst                   handover.py:86: wait a bit for modems to see bts1
07:41:21.812926 tst                   handover.py:89: starting the second BTS probably took a while, check on the ongoing call
07:41:22.107898 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:41:22.453071 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:41:23.778886 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
07:41:26.122817 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
07:41:26.483217 tst                  handover.py:120: wait for handover counters to change...
07:41:30.099072 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
07:41:30.355541 tst                  handover.py:124: 
�[1;35m20201207074126227 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207074126227 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207074126227 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207074126227 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207074126228 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207074126229 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207074126229 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207074126230 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207074126230 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207074126234 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207074126234 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207074126655 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207074126656 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207074126656 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207074126656 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207074126656 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207074126656 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207074126656 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207074126657 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207074126657 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207074126657 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
07:41:30.673650 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
07:41:30.803527 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-161↪handover_2G:oc2g+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
07:41:31.027732 tst                  handover.py:129: did not work, try again... (attempts left: 4)
07:41:31.347343 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:41:32.670136 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
07:41:35.005182 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
07:41:35.366879 tst                  handover.py:120: wait for handover counters to change...
07:41:38.985264 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
07:41:39.241675 tst                  handover.py:124: 
�[1;35m20201207074135109 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207074135109 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207074135109 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207074135109 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207074135110 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207074135110 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207074135111 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207074135111 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207074135111 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207074135116 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207074135117 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207074135535 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207074135535 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207074135536 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207074135536 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207074135536 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207074135536 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207074135536 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207074135537 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207074135537 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207074135537 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
07:41:39.562131 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
07:41:39.691870 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-161↪handover_2G:oc2g+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
07:41:39.913975 tst                  handover.py:129: did not work, try again... (attempts left: 3)
07:41:40.233057 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:41:41.561611 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
07:41:43.906949 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
07:41:44.270903 tst                  handover.py:120: wait for handover counters to change...
07:41:47.967040 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
07:41:48.223644 tst                  handover.py:124: 
�[1;35m20201207074144011 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207074144011 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207074144011 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207074144011 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207074144011 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207074144012 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207074144012 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207074144012 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207074144012 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207074144016 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207074144016 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207074144434 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207074144434 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207074144434 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207074144434 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207074144434 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207074144434 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207074144434 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207074144435 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207074144435 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207074144435 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
07:41:48.543636 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
07:41:48.673704 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-161↪handover_2G:oc2g+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
07:41:48.896256 tst                  handover.py:129: did not work, try again... (attempts left: 2)
07:41:49.215549 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:41:50.543797 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
07:41:52.900257 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
07:41:53.262510 tst                  handover.py:120: wait for handover counters to change...
07:41:56.877822 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
07:41:57.133286 tst                  handover.py:124: 
�[1;35m20201207074153005 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207074153005 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207074153005 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207074153005 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207074153005 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207074153005 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207074153005 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207074153005 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207074153005 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207074153009 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207074153009 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207074153415 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207074153415 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207074153415 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207074153415 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207074153415 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207074153416 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207074153416 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207074153417 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207074153417 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207074153417 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
07:41:57.452167 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
07:41:57.582440 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-161↪handover_2G:oc2g+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
07:41:57.806249 tst                  handover.py:129: did not work, try again... (attempts left: 1)
07:41:58.123652 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:41:59.451250 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
07:42:01.770851 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
07:42:02.131670 tst                  handover.py:120: wait for handover counters to change...
07:42:05.777232 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
07:42:06.034042 tst                  handover.py:124: 
�[1;35m20201207074201875 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207074201875 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207074201875 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207074201876 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207074201876 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207074201876 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207074201876 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207074201877 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207074201877 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207074201881 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207074201881 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207074202295 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207074202295 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207074202295 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207074202295 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207074202295 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207074202296 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207074202296 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x7a408ba7) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207074202297 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207074202297 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207074202297 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x7a408ba7)[0x6120000132a0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
07:42:06.353380 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
07:42:06.484623 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-161↪handover_2G:oc2g+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
07:42:06.709250 tst                  handover.py:129: did not work, try again... (attempts left: 0)
07:42:06.764270 tst                  handover.py:146: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/05.1_handover_ms0: FAIL (44.6s)
07:42:06.772246 tst                  handover.py:146: ERR: AssertionError: handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),  [trial-161↪handover_2G:oc2g+bts1-trx-lms↪handover.py:146]
07:42:06.778533 tst                  handover.py:146: Test FAILED (173.0 sec)
07:42:06.820379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32133): Terminating (SIGTERM)
07:42:06.869027 run   osmo-hlr_10.42.42.2(pid=32134): Terminating (SIGTERM)
07:42:06.920084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32135): Terminating (SIGTERM)
07:42:06.973365 run   osmo-stp_10.42.42.5(pid=32136): Terminating (SIGTERM)
07:42:07.024734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32137): Terminating (SIGTERM)
07:42:07.084176 run   osmo-msc_10.42.42.6(pid=32138): Terminating (SIGTERM)
07:42:07.137365 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=32139): Terminating (SIGTERM)
07:42:07.185976 run   osmo-mgw_10.42.42.3(pid=32140): Terminating (SIGTERM)
07:42:07.235365 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=32141): Terminating (SIGTERM)
07:42:07.286283 run   osmo-mgw_10.42.42.4(pid=32142): Terminating (SIGTERM)
07:42:07.335700 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=32143): Terminating (SIGTERM)
07:42:07.384213 run   osmo-bsc_10.42.42.7(pid=32144): Terminating (SIGTERM)
07:42:07.433749 run         osmo-bts-oc2g(pid=32152): Terminating (SIGTERM)
07:42:07.482442 run          osmo-trx-lms(pid=32550): Terminating (SIGTERM)
07:42:07.530891 run          osmo-bts-trx(pid=32551): Terminating (SIGTERM)
07:42:07.541613 ---      ParallelTerminationStrategy: PID 32133 died...
07:42:07.606095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32133): Terminated: ok {rc=0}
07:42:07.617708 ---      ParallelTerminationStrategy: PID 32134 died...
07:42:07.681643 run   osmo-hlr_10.42.42.2(pid=32134): Terminated: ok {rc=0}
07:42:07.693233 ---      ParallelTerminationStrategy: PID 32135 died...
07:42:07.757397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32135): Terminated: ok {rc=0}
07:42:07.769073 ---      ParallelTerminationStrategy: PID 32136 died...
07:42:07.833135 run   osmo-stp_10.42.42.5(pid=32136): Terminated: ok {rc=0}
07:42:07.844863 ---      ParallelTerminationStrategy: PID 32137 died...
07:42:07.909075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32137): Terminated: ok {rc=0}
07:42:07.920753 ---      ParallelTerminationStrategy: PID 32139 died...
07:42:07.985480 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=32139): Terminated: ok {rc=0}
07:42:07.997265 ---      ParallelTerminationStrategy: PID 32140 died...
07:42:08.061655 run   osmo-mgw_10.42.42.3(pid=32140): Terminated {rc=15}
07:42:08.073334 ---      ParallelTerminationStrategy: PID 32141 died...
07:42:08.137550 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=32141): Terminated: ok {rc=0}
07:42:08.149215 ---      ParallelTerminationStrategy: PID 32142 died...
07:42:08.213267 run   osmo-mgw_10.42.42.4(pid=32142): Terminated {rc=15}
07:42:08.225262 ---      ParallelTerminationStrategy: PID 32143 died...
07:42:08.289966 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=32143): Terminated: ok {rc=0}
07:42:08.301665 ---      ParallelTerminationStrategy: PID 32152 died...
07:42:08.365838 run         osmo-bts-oc2g(pid=32152): Terminated {rc=36608}
07:42:08.377574 ---      ParallelTerminationStrategy: PID 32550 died...
07:42:08.442239 run          osmo-trx-lms(pid=32550): Terminated {rc=36608}
07:42:10.470337 ---      ParallelTerminationStrategy: PID 32138 died...
07:42:10.539933 run   osmo-msc_10.42.42.6(pid=32138): Terminated: ok {rc=0}
07:42:10.551569 ---      ParallelTerminationStrategy: PID 32144 died...
07:42:10.616285 run   osmo-bsc_10.42.42.7(pid=32144): Terminated: ok {rc=0}
07:42:14.473834 run          osmo-bts-trx(pid=32551): Terminating (SIGINT)
07:42:14.653223 ---      ParallelTerminationStrategy: PID 32551 died...
07:42:14.719419 run          osmo-bts-trx(pid=32551): Terminated: ok {rc=0}
07:42:14.879431 bus                        /sierra_3: Setting Online False
07:42:16.018737 bus                        /sierra_3: Setting Powered False
07:42:31.632043 bus                        /sierra_3: Setting Powered False
07:42:32.757295 bus                        /sierra_3: Setting Powered False
07:42:33.941363 bus                        /sierra_2: Setting Online False
07:42:35.104796 bus                        /sierra_2: Setting Powered False
07:42:46.642957 bus                        /sierra_2: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 673, in exec_module
  File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 146, in <module>
    not_expected=('0-0-2-0 TCH/F ESTABLISHED',),
AssertionError