Skip to content

Failed

handover_2G:oc2g+bts1-trx-lms.handover.py (from handover_2G_oc2g+bts1-trx-lms)

Failing for the past 25 builds (Since #140 )
Took 2 min 57 sec.

Stacktrace

handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),

Standard Output

----------------------------------------------
trial-164 handover_2G:oc2g+bts1-trx-lms handover.py
----------------------------------------------
15:11:38.737140 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
15:11:38.750576 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2)
15:11:38.891158 tst                      handover.py: using LAC 16396
15:11:39.026750 tst                      handover.py: using RAC 76
15:11:39.161981 tst                      handover.py: using CellId 16395
15:11:39.296770 tst                      handover.py: using BVCI 3074
15:11:39.323298 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2)
15:11:39.483506 tst                      handover.py: using LAC 16397
15:11:39.619496 tst                      handover.py: using RAC 77
15:11:39.761991 tst                      handover.py: using CellId 16396
15:11:39.895444 tst                      handover.py: using BVCI 3075
15:11:39.922015 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
15:11:39.935338 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
15:11:39.948720 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
15:11:39.961967 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
15:11:39.975290 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
15:11:39.988531 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2)
15:11:40.126278 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2)
15:11:40.686107 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
15:11:41.202726 run         create_hlr_db(pid=12306): Launched
15:11:41.346274 bus                        /sierra_2: Setting Powered False
15:11:42.431520 run         create_hlr_db(pid=12306): Terminated: ok {rc=0}
15:11:42.875224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12308): Launched
15:11:43.239314 run   osmo-hlr_10.42.42.2(pid=12309): Launched
15:11:43.363866 run              osmo-stp_10.42.42.5: Starting osmo-stp
15:11:43.938474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12310): Launched
15:11:44.286391 run   osmo-stp_10.42.42.5(pid=12311): Launched
15:11:44.410055 run              osmo-msc_10.42.42.6: Starting osmo-msc
15:11:45.015843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12312): Launched
15:11:45.362252 run   osmo-msc_10.42.42.6(pid=12313): Launched
15:11:45.487751 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
15:11:46.062394 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=12314): Launched
15:11:46.420271 run   osmo-mgw_10.42.42.3(pid=12315): Launched
15:11:46.552300 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
15:11:47.152460 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=12316): Launched
15:11:47.515810 run   osmo-mgw_10.42.42.4(pid=12317): Launched
15:11:47.639570 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
15:11:48.408044 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=12318): Launched
15:11:48.755412 run   osmo-bsc_10.42.42.7(pid=12319): Launched
15:11:52.469513 run                    osmo-bts-oc2g: Starting OsmoBtsOC2G to connect to osmo-bsc_10.42.42.7
15:11:53.068224 run         rm-remote-dir(pid=12320): Launched
15:11:54.285200 run         rm-remote-dir(pid=12320): Terminated: ok {rc=0}
15:11:54.669696 run         mk-remote-dir(pid=12321): Launched
15:11:55.899981 run         mk-remote-dir(pid=12321): Terminated: ok {rc=0}
15:11:56.230054 run    scp-inst-to-remote(pid=12322): Launched
15:12:02.466487 run    scp-inst-to-remote(pid=12322): Terminated: ok {rc=0}
15:12:02.859177 run         mk-remote-dir(pid=12325): Launched
15:12:04.085289 run         mk-remote-dir(pid=12325): Terminated: ok {rc=0}
15:12:04.421620 run     scp-cfg-to-remote(pid=12326): Launched
15:12:05.647787 run     scp-cfg-to-remote(pid=12326): Terminated: ok {rc=0}
15:12:06.025377 run         osmo-bts-oc2g(pid=12328): Launched
15:12:12.528957 tst                   handover.py:43: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/01_bts0_started: pass (19.9s)
15:12:12.701726 tst                      handover.py: using MSISDN 13234
15:12:12.907892 bus                        /sierra_2: Setting Powered True
15:12:16.434297 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015252', msisdn='13234', subscriber_id=1}
15:12:16.594945 tst                      handover.py: using MSISDN 13235
15:12:18.910261 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015253', msisdn='13235', subscriber_id=2}
15:12:19.215478 bus                        /sierra_2: Setting Online False
15:12:20.440311 bus                        /sierra_2: Setting Powered False
15:12:26.855481 bus                        /sierra_2: Setting Powered True
15:12:28.250660 bus                        /sierra_2: Setting Online True
15:12:30.908567 tst                        /sierra_2: Connect to ('901', '70')
15:12:31.326485 bus                        /sierra_3: Setting Online False
15:12:32.593154 bus                        /sierra_3: Setting Powered False
15:12:38.854970 bus                        /sierra_3: Setting Powered True
15:12:41.951740 bus                        /sierra_3: Setting Online True
15:12:44.354048 tst                        /sierra_3: Connect to ('901', '70')
15:12:44.537228 tst                        /sierra_2: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054228053'
15:12:44.679690 tst                        /sierra_3: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054229028'
15:12:44.909738 tst                   handover.py:54: waiting for modems to attach...
15:12:45.257831 tst                        /sierra_2: Already registered with network ('901', '70')
15:12:49.391668 tst                   handover.py:57: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/02.1_ms0_attach: pass (4.2s)
15:12:58.761182 tst                        /sierra_3: Already registered with network ('901', '70')
15:13:02.925939 tst                   handover.py:60: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/02.2_ms1_attach: pass (13.3s)
15:13:04.509582 tst                   handover.py:63: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/02.3_subscribed_in_msc: pass (1.3s)
15:13:09.134538 tst                   handover.py:68: dial success
15:13:11.839940 tst                   handover.py:75: answer success, call established and ongoing
15:13:12.143186 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
15:13:12.365551 tst                   handover.py:79: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/03_call_established: pass (3.0s)
15:13:12.514053 run                     osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
15:13:12.993569 run                     osmo-trx-lms: OSMOTRX CONF: {'osmo_trx': {'launch_trx': 'True', 'remote_user': 'jenkins', 'channels': [{'rx_path': 'LNAW'}], 'egprs': 'disable', 'type': 'lms', 'bts_ip': '10.42.42.53', 'trx_ip': '10.42.42.117', 'clock_reference': 'external', 'dev_args': 'LimeSDR-USB,serial=00090706024F0A22'}}
15:13:13.609867 run               uname-m(pid=12329): Launched
15:13:14.830914 run               uname-m(pid=12329): Terminated: ok {rc=0}
15:13:15.236311 run         rm-remote-dir(pid=12330): Launched
15:13:16.481009 run         rm-remote-dir(pid=12330): Terminated: ok {rc=0}
15:13:16.897574 run         mk-remote-dir(pid=12331): Launched
15:13:18.123103 run         mk-remote-dir(pid=12331): Terminated: ok {rc=0}
15:13:18.527345 run         mk-remote-dir(pid=12332): Launched
15:13:19.769412 run         mk-remote-dir(pid=12332): Terminated: ok {rc=0}
15:13:20.120583 run    scp-inst-to-remote(pid=12334): Launched
15:13:22.345551 run    scp-inst-to-remote(pid=12334): Terminated: ok {rc=0}
15:13:22.730240 run         mk-remote-dir(pid=12336): Launched
15:13:23.961998 run         mk-remote-dir(pid=12336): Terminated: ok {rc=0}
15:13:24.298711 run     scp-cfg-to-remote(pid=12337): Launched
15:13:25.521683 run     scp-cfg-to-remote(pid=12337): Terminated: ok {rc=0}
15:13:25.911329 run         mk-remote-dir(pid=12339): Launched
15:13:27.145276 run         mk-remote-dir(pid=12339): Terminated: ok {rc=0}
15:13:27.510149 run scp-wrapper-to-remote(pid=12340): Launched
15:13:28.765114 run scp-wrapper-to-remote(pid=12340): Terminated: ok {rc=0}
15:13:29.171508 run          osmo-trx-lms(pid=12342): Launched
15:13:29.297017 run                     osmo-bts-trx: Waiting for osmo-trx-lms to start up...
15:13:30.618955 run          osmo-bts-trx(pid=12343): Launched
15:13:33.087185 tst                   handover.py:84: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/04.1_bts1_started: pass (20.5s)
15:13:33.326508 tst                   handover.py:86: wait a bit for modems to see bts1
15:13:43.572202 tst                   handover.py:89: starting the second BTS probably took a while, check on the ongoing call
15:13:43.880312 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
15:13:44.240892 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
15:13:45.587564 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
15:13:48.023666 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
15:13:48.406402 tst                  handover.py:120: wait for handover counters to change...
15:13:52.122898 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
15:13:52.392422 tst                  handover.py:124: 
�[1;35m20201207151348133 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207151348133 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207151348133 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207151348133 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207151348133 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207151348134 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207151348134 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207151348134 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207151348134 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207151348138 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207151348138 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207151348552 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207151348553 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207151348553 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207151348553 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207151348553 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207151348553 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207151348553 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207151348554 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207151348554 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207151348554 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014320]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
15:13:52.725288 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
15:13:52.860769 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-164↪handover_2G:oc2g+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
15:13:53.095718 tst                  handover.py:129: did not work, try again... (attempts left: 4)
15:13:53.428194 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
15:13:54.827912 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
15:13:57.748183 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
15:13:58.202083 tst                  handover.py:120: wait for handover counters to change...
15:14:02.423294 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
15:14:02.745542 tst                  handover.py:124: 
�[1;35m20201207151357878 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207151357878 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207151357878 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207151357878 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207151357878 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207151357879 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207151357879 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207151357879 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207151357879 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207151357883 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207151357883 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207151358291 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207151358291 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207151358291 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207151358291 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207151358291 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207151358291 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207151358292 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207151358293 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207151358293 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207151358293 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000014020]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
15:14:03.144202 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
15:14:03.310082 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-164↪handover_2G:oc2g+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
15:14:03.592194 tst                  handover.py:129: did not work, try again... (attempts left: 3)
15:14:03.993053 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
15:14:05.393089 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
15:14:08.261614 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
15:14:08.714944 tst                  handover.py:120: wait for handover counters to change...
15:14:12.944864 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
15:14:13.265855 tst                  handover.py:124: 
�[1;35m20201207151408391 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207151408391 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207151408391 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207151408391 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207151408391 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207151408392 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207151408392 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207151408392 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207151408392 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207151408398 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207151408398 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207151408814 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207151408814 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207151408814 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207151408815 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207151408815 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207151408815 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207151408815 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207151408816 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207151408816 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207151408816 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013d20]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
15:14:13.664666 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
15:14:13.827208 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-164↪handover_2G:oc2g+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
15:14:14.109258 tst                  handover.py:129: did not work, try again... (attempts left: 2)
15:14:14.509721 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
15:14:15.911387 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
15:14:18.804842 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
15:14:19.256497 tst                  handover.py:120: wait for handover counters to change...
15:14:23.666269 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
15:14:23.988093 tst                  handover.py:124: 
�[1;35m20201207151418934 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207151418934 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207151418934 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207151418935 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207151418935 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207151418935 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207151418935 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207151418935 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207151418935 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207151418940 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207151418940 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207151419351 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207151419351 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207151419351 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207151419351 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207151419351 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207151419351 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207151419351 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207151419353 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207151419353 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207151419353 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013a20]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
15:14:24.387260 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
15:14:24.565465 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-164↪handover_2G:oc2g+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
15:14:24.868941 tst                  handover.py:129: did not work, try again... (attempts left: 1)
15:14:25.294061 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
15:14:26.695805 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
15:14:29.581107 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
15:14:30.036590 tst                  handover.py:120: wait for handover counters to change...
15:14:34.243875 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
15:14:34.575088 tst                  handover.py:124: 
�[1;35m20201207151429714 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207151429714 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207151429714 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207151429714 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207151429715 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207151429715 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207151429715 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207151429715 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207151429715 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207151429719 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207151429719 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207151430133 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207151430133 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207151430133 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207151430133 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207151430133 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207151430133 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207151430133 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9cbdad37) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207151430134 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207151430134 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207151430134 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x9cbdad37)[0x612000013720]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
15:14:35.065433 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
15:14:35.202358 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-164↪handover_2G:oc2g+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
15:14:35.437945 tst                  handover.py:129: did not work, try again... (attempts left: 0)
15:14:35.495645 tst                  handover.py:146: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/05.1_handover_ms0: FAIL (51.5s)
15:14:35.504764 tst                  handover.py:146: ERR: AssertionError: handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),  [trial-164↪handover_2G:oc2g+bts1-trx-lms↪handover.py:146]
15:14:35.511700 tst                  handover.py:146: Test FAILED (176.8 sec)
15:14:35.569903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12308): Terminating (SIGTERM)
15:14:35.653373 run   osmo-hlr_10.42.42.2(pid=12309): Terminating (SIGTERM)
15:14:35.717342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12310): Terminating (SIGTERM)
15:14:35.780162 run   osmo-stp_10.42.42.5(pid=12311): Terminating (SIGTERM)
15:14:35.846808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12312): Terminating (SIGTERM)
15:14:35.910212 run   osmo-msc_10.42.42.6(pid=12313): Terminating (SIGTERM)
15:14:35.975974 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=12314): Terminating (SIGTERM)
15:14:36.035410 run   osmo-mgw_10.42.42.3(pid=12315): Terminating (SIGTERM)
15:14:36.101105 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=12316): Terminating (SIGTERM)
15:14:36.160474 run   osmo-mgw_10.42.42.4(pid=12317): Terminating (SIGTERM)
15:14:36.220709 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=12318): Terminating (SIGTERM)
15:14:36.282345 run   osmo-bsc_10.42.42.7(pid=12319): Terminating (SIGTERM)
15:14:36.339467 run         osmo-bts-oc2g(pid=12328): Terminating (SIGTERM)
15:14:36.396511 run          osmo-trx-lms(pid=12342): Terminating (SIGTERM)
15:14:36.451049 run          osmo-bts-trx(pid=12343): Terminating (SIGTERM)
15:14:36.463013 ---      ParallelTerminationStrategy: PID 12308 died...
15:14:36.534529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12308): Terminated: ok {rc=0}
15:14:36.547146 ---      ParallelTerminationStrategy: PID 12309 died...
15:14:36.618033 run   osmo-hlr_10.42.42.2(pid=12309): Terminated: ok {rc=0}
15:14:36.630675 ---      ParallelTerminationStrategy: PID 12310 died...
15:14:36.702030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12310): Terminated: ok {rc=0}
15:14:36.714754 ---      ParallelTerminationStrategy: PID 12311 died...
15:14:36.785030 run   osmo-stp_10.42.42.5(pid=12311): Terminated: ok {rc=0}
15:14:36.797911 ---      ParallelTerminationStrategy: PID 12312 died...
15:14:36.868412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12312): Terminated: ok {rc=0}
15:14:36.881361 ---      ParallelTerminationStrategy: PID 12314 died...
15:14:36.952443 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=12314): Terminated: ok {rc=0}
15:14:36.965714 ---      ParallelTerminationStrategy: PID 12315 died...
15:14:37.036115 run   osmo-mgw_10.42.42.3(pid=12315): Terminated {rc=15}
15:14:37.048617 ---      ParallelTerminationStrategy: PID 12316 died...
15:14:37.119578 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=12316): Terminated: ok {rc=0}
15:14:37.132524 ---      ParallelTerminationStrategy: PID 12317 died...
15:14:37.203291 run   osmo-mgw_10.42.42.4(pid=12317): Terminated {rc=15}
15:14:37.216061 ---      ParallelTerminationStrategy: PID 12318 died...
15:14:37.286580 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=12318): Terminated: ok {rc=0}
15:14:37.299324 ---      ParallelTerminationStrategy: PID 12328 died...
15:14:37.369910 run         osmo-bts-oc2g(pid=12328): Terminated {rc=36608}
15:14:37.382523 ---      ParallelTerminationStrategy: PID 12342 died...
15:14:37.453258 run          osmo-trx-lms(pid=12342): Terminated {rc=36608}
15:14:39.482770 ---      ParallelTerminationStrategy: PID 12313 died...
15:14:39.554948 run   osmo-msc_10.42.42.6(pid=12313): Terminated: ok {rc=0}
15:14:39.567412 ---      ParallelTerminationStrategy: PID 12319 died...
15:14:39.637156 run   osmo-bsc_10.42.42.7(pid=12319): Terminated: ok {rc=0}
15:14:43.497597 run          osmo-bts-trx(pid=12343): Terminating (SIGINT)
15:14:43.677515 ---      ParallelTerminationStrategy: PID 12343 died...
15:14:43.747952 run          osmo-bts-trx(pid=12343): Terminated: ok {rc=0}
15:14:43.901763 bus                        /sierra_3: Setting Online False
15:14:45.050548 bus                        /sierra_3: Setting Powered False
15:15:00.642098 bus                        /sierra_3: Setting Powered False
15:15:01.767795 bus                        /sierra_3: Setting Powered False
15:15:02.951655 bus                        /sierra_2: Setting Online False
15:15:04.089876 bus                        /sierra_2: Setting Powered False
15:15:15.642679 bus                        /sierra_2: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 673, in exec_module
  File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 146, in <module>
    not_expected=('0-0-2-0 TCH/F ESTABLISHED',),
AssertionError