Skip to content

Failed

handover_2G:nanobts+bts1-trx-lms.handover.py (from handover_2G_nanobts+bts1-trx-lms)

Failing for the past 24 builds (Since #140 )
Took 5 min 59 sec.

Stacktrace

handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),

Standard Output

----------------------------------------------
trial-163 handover_2G:nanobts+bts1-trx-lms handover.py
----------------------------------------------
11:45:53.998470 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
11:45:54.012061 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2)
11:45:54.164263 tst                      handover.py: using LAC 16309
11:45:54.307889 tst                      handover.py: using RAC 244
11:45:54.453160 tst                      handover.py: using CellId 16308
11:45:54.596015 tst                      handover.py: using BVCI 2987
11:45:54.624291 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2)
11:45:54.791344 tst                      handover.py: using LAC 16310
11:45:54.934277 tst                      handover.py: using RAC 245
11:45:55.077185 tst                      handover.py: using CellId 16309
11:45:55.219633 tst                      handover.py: using BVCI 2988
11:45:55.248076 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
11:45:55.262610 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
11:45:55.276926 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
11:45:55.291296 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
11:45:55.305920 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
11:45:55.320142 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2)
11:45:55.455092 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2)
11:45:56.025230 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
11:45:56.534425 run          create_hlr_db(pid=7507): Launched
11:45:56.822653 bus                        /sierra_2: Setting Powered False
11:45:57.776193 run          create_hlr_db(pid=7507): Terminated: ok {rc=0}
11:45:58.257593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7509): Launched
11:45:58.602215 run    osmo-hlr_10.42.42.2(pid=7510): Launched
11:45:58.725563 run              osmo-stp_10.42.42.5: Starting osmo-stp
11:45:59.306549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7511): Launched
11:45:59.651125 run    osmo-stp_10.42.42.5(pid=7512): Launched
11:45:59.773702 run              osmo-msc_10.42.42.6: Starting osmo-msc
11:46:00.379173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7513): Launched
11:46:00.735684 run    osmo-msc_10.42.42.6(pid=7514): Launched
11:46:00.874822 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
11:46:01.497657 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=7515): Launched
11:46:01.861290 run    osmo-mgw_10.42.42.3(pid=7516): Launched
11:46:01.995694 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
11:46:02.567018 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7517): Launched
11:46:02.926693 run    osmo-mgw_10.42.42.4(pid=7518): Launched
11:46:03.049391 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
11:46:03.834380 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=7519): Launched
11:46:04.189499 run    osmo-bsc_10.42.42.7(pid=7520): Launched
11:46:09.811906 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=7521): Launched
11:46:09.963123 run         nanobts_NanoBTS-ONW-1900: Finding nanobts 10.42.42.120, binding on 10.42.42.1...
11:46:10.274678 run    abisip-find-preconf(pid=7523): Launched
11:48:12.686100 run         nanobts_NanoBTS-ONW-1900: Found nanobts 10.42.42.120 with unit_id 9 trx 0
11:48:12.817039 run    abisip-find-preconf(pid=7523): Terminating (SIGINT)
11:48:13.174219 run    abisip-find-preconf(pid=7523): Terminated {rc=-2}
11:48:13.500874 run        ipaccess-config(pid=7527): Launched
11:48:14.726103 run        ipaccess-config(pid=7527): Terminated: ok {rc=0}
11:49:28.282890 run         nanobts_NanoBTS-ONW-1900: nanoBTS connected to BSC
11:49:29.765088 tst                   handover.py:43: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/01_bts0_started: pass (201.7s)
11:49:29.929929 tst                      handover.py: using MSISDN 13164
11:49:30.131800 bus                        /sierra_2: Setting Powered True
11:49:33.648094 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015252', msisdn='13164', subscriber_id=1}
11:49:33.812515 tst                      handover.py: using MSISDN 13165
11:49:36.127467 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015253', msisdn='13165', subscriber_id=2}
11:49:36.428636 bus                        /sierra_2: Setting Online False
11:49:37.643875 bus                        /sierra_2: Setting Powered False
11:49:43.854199 bus                        /sierra_2: Setting Powered True
11:49:45.237008 bus                        /sierra_2: Setting Online True
11:49:47.865450 tst                        /sierra_2: Connect to ('901', '70')
11:49:48.292916 bus                        /sierra_3: Setting Online False
11:49:49.563873 bus                        /sierra_3: Setting Powered False
11:49:55.864862 bus                        /sierra_3: Setting Powered True
11:49:58.998058 bus                        /sierra_3: Setting Online True
11:50:01.105828 tst                        /sierra_2: Already registered with network ('901', '70')
11:50:01.363176 tst                        /sierra_3: Connect to ('901', '70')
11:50:01.551372 tst                        /sierra_2: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054228053'
11:50:01.684602 tst                        /sierra_3: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054229028'
11:50:01.893072 tst                   handover.py:54: waiting for modems to attach...
11:50:05.371784 tst                   handover.py:57: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/02.1_ms0_attach: pass (3.2s)
11:50:18.518715 tst                        /sierra_3: Already registered with network ('901', '70')
11:50:22.239339 tst                   handover.py:60: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/02.2_ms1_attach: pass (16.6s)
11:50:23.800601 tst                   handover.py:63: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/02.3_subscribed_in_msc: pass (1.3s)
11:50:29.404031 tst                   handover.py:68: dial success
11:50:32.121121 tst                   handover.py:75: answer success, call established and ongoing
11:50:32.418950 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
11:50:32.634856 tst                   handover.py:79: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/03_call_established: pass (3.0s)
11:50:32.780583 run                     osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
11:50:33.250573 run                     osmo-trx-lms: OSMOTRX CONF: {'osmo_trx': {'channels': [{'rx_path': 'LNAW'}], 'type': 'lms', 'bts_ip': '10.42.42.53', 'clock_reference': 'external', 'remote_user': 'jenkins', 'dev_args': 'LimeSDR-USB,serial=00090706024F0A22', 'trx_ip': '10.42.42.117', 'launch_trx': 'True', 'egprs': 'disable'}}
11:50:33.872961 run                uname-m(pid=7536): Launched
11:50:35.106740 run                uname-m(pid=7536): Terminated: ok {rc=0}
11:50:36.364029 run          rm-remote-dir(pid=7537): Launched
11:50:37.588479 run          rm-remote-dir(pid=7537): Terminated: ok {rc=0}
11:50:37.977236 run          mk-remote-dir(pid=7538): Launched
11:50:39.197398 run          mk-remote-dir(pid=7538): Terminated: ok {rc=0}
11:50:39.591891 run          mk-remote-dir(pid=7539): Launched
11:50:40.822933 run          mk-remote-dir(pid=7539): Terminated: ok {rc=0}
11:50:41.171144 run     scp-inst-to-remote(pid=7540): Launched
11:50:43.393713 run     scp-inst-to-remote(pid=7540): Terminated: ok {rc=0}
11:50:43.775843 run          mk-remote-dir(pid=7542): Launched
11:50:44.993302 run          mk-remote-dir(pid=7542): Terminated: ok {rc=0}
11:50:45.330743 run      scp-cfg-to-remote(pid=7543): Launched
11:50:46.562270 run      scp-cfg-to-remote(pid=7543): Terminated: ok {rc=0}
11:50:46.969481 run          mk-remote-dir(pid=7545): Launched
11:50:48.206391 run          mk-remote-dir(pid=7545): Terminated: ok {rc=0}
11:50:48.551898 run  scp-wrapper-to-remote(pid=7546): Launched
11:50:49.772666 run  scp-wrapper-to-remote(pid=7546): Terminated: ok {rc=0}
11:50:50.151080 run           osmo-trx-lms(pid=7548): Launched
11:50:50.285222 run                     osmo-bts-trx: Waiting for osmo-trx-lms to start up...
11:50:51.613831 run           osmo-bts-trx(pid=7549): Launched
11:50:54.075562 tst                   handover.py:84: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/04.1_bts1_started: pass (21.2s)
11:50:54.307266 tst                   handover.py:86: wait a bit for modems to see bts1
11:51:04.579773 tst                   handover.py:89: starting the second BTS probably took a while, check on the ongoing call
11:51:04.929941 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
11:51:05.355526 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
11:51:06.740795 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
11:51:09.553667 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
11:51:09.992603 tst                  handover.py:120: wait for handover counters to change...
11:51:14.119678 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
11:51:14.430314 tst                  handover.py:124: 
�[1;35m20201207115109683 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207115109683 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207115109683 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207115109684 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207115109684 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207115109685 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207115109685 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207115109685 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207115109685 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207115109689 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207115109689 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207115110059 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207115110059 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207115110059 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207115110059 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207115110059 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207115110060 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207115110060 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207115110061 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207115110061 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207115110061 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
11:51:14.813046 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
11:51:14.969549 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-163↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
11:51:15.239772 tst                  handover.py:129: did not work, try again... (attempts left: 4)
11:51:15.621989 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
11:51:17.008434 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
11:51:19.838449 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
11:51:20.276996 tst                  handover.py:120: wait for handover counters to change...
11:51:24.281873 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
11:51:24.543888 tst                  handover.py:124: 
�[1;35m20201207115119963 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207115119963 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207115119963 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207115119963 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207115119964 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207115119964 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207115119964 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207115119964 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207115119964 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207115119968 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207115119968 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207115120338 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]
�[0;m�[1;35m20201207115120338 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207115120338 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207115120338 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207115120338 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207115120338 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207115120338 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207115120339 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207115120340 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207115120340 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207115120340 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
11:51:24.870158 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
11:51:25.003597 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-163↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
11:51:25.231250 tst                  handover.py:129: did not work, try again... (attempts left: 3)
11:51:25.558061 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
11:51:26.891842 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
11:51:29.256718 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
11:51:29.623509 tst                  handover.py:120: wait for handover counters to change...
11:51:33.278151 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
11:51:33.539900 tst                  handover.py:124: 
�[1;35m20201207115129364 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207115129364 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207115129364 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207115129364 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207115129364 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207115129365 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207115129365 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207115129365 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207115129365 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207115129369 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207115129369 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207115129739 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207115129739 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207115129740 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207115129740 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207115129740 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207115129740 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207115129740 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207115129741 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207115129741 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207115129741 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
11:51:33.864818 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
11:51:33.996464 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-163↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
11:51:34.223547 tst                  handover.py:129: did not work, try again... (attempts left: 2)
11:51:34.548744 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
11:51:35.880478 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
11:51:38.244534 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
11:51:38.609726 tst                  handover.py:120: wait for handover counters to change...
11:51:42.258310 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
11:51:42.519787 tst                  handover.py:124: 
�[1;35m20201207115138350 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207115138350 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207115138350 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207115138350 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207115138350 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207115138351 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207115138351 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207115138351 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207115138351 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207115138356 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207115138356 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207115138739 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207115138739 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207115138739 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207115138739 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207115138740 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207115138740 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207115138740 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207115138741 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207115138741 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207115138741 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
11:51:42.845309 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
11:51:42.977830 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-163↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
11:51:43.205926 tst                  handover.py:129: did not work, try again... (attempts left: 1)
11:51:43.531449 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
11:51:44.861889 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
11:51:47.242298 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
11:51:47.612788 tst                  handover.py:120: wait for handover counters to change...
11:51:51.273946 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
11:51:51.534315 tst                  handover.py:124: 
�[1;35m20201207115147349 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207115147349 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207115147350 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207115147350 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207115147350 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207115147351 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207115147351 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207115147351 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207115147351 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207115147356 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207115147356 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207115147740 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207115147740 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207115147740 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207115147740 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207115147740 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207115147740 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207115147740 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x9b2e207c) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207115147741 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207115147741 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207115147741 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x9b2e207c)[0x6120000132a0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
11:51:51.860939 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
11:51:51.994509 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-163↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
11:51:52.222561 tst                  handover.py:129: did not work, try again... (attempts left: 0)
11:51:52.279135 tst                  handover.py:146: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/05.1_handover_ms0: FAIL (47.3s)
11:51:52.287068 tst                  handover.py:146: ERR: AssertionError: handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),  [trial-163↪handover_2G:nanobts+bts1-trx-lms↪handover.py:146]
11:51:52.292893 tst                  handover.py:146: Test FAILED (358.3 sec)
11:51:52.334737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7509): Terminating (SIGTERM)
11:51:52.383636 run    osmo-hlr_10.42.42.2(pid=7510): Terminating (SIGTERM)
11:51:52.433365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7511): Terminating (SIGTERM)
11:51:52.485651 run    osmo-stp_10.42.42.5(pid=7512): Terminating (SIGTERM)
11:51:52.536547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7513): Terminating (SIGTERM)
11:51:52.588797 run    osmo-msc_10.42.42.6(pid=7514): Terminating (SIGTERM)
11:51:52.638939 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=7515): Terminating (SIGTERM)
11:51:52.689541 run    osmo-mgw_10.42.42.3(pid=7516): Terminating (SIGTERM)
11:51:52.739374 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7517): Terminating (SIGTERM)
11:51:52.788269 run    osmo-mgw_10.42.42.4(pid=7518): Terminating (SIGTERM)
11:51:52.837940 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=7519): Terminating (SIGTERM)
11:51:52.887218 run    osmo-bsc_10.42.42.7(pid=7520): Terminating (SIGTERM)
11:51:52.936067 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=7521): Terminating (SIGTERM)
11:51:52.985039 run           osmo-trx-lms(pid=7548): Terminating (SIGTERM)
11:51:53.036148 run           osmo-bts-trx(pid=7549): Terminating (SIGTERM)
11:51:53.047375 ---      ParallelTerminationStrategy: PID 7509 died...
11:51:53.112396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7509): Terminated: ok {rc=0}
11:51:53.124028 ---      ParallelTerminationStrategy: PID 7510 died...
11:51:53.189068 run    osmo-hlr_10.42.42.2(pid=7510): Terminated: ok {rc=0}
11:51:53.200755 ---      ParallelTerminationStrategy: PID 7511 died...
11:51:53.265679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7511): Terminated: ok {rc=0}
11:51:53.279157 ---      ParallelTerminationStrategy: PID 7512 died...
11:51:53.343796 run    osmo-stp_10.42.42.5(pid=7512): Terminated: ok {rc=0}
11:51:53.355731 ---      ParallelTerminationStrategy: PID 7513 died...
11:51:53.421020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7513): Terminated: ok {rc=0}
11:51:53.432773 ---      ParallelTerminationStrategy: PID 7515 died...
11:51:53.498100 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=7515): Terminated: ok {rc=0}
11:51:53.509870 ---      ParallelTerminationStrategy: PID 7516 died...
11:51:53.574617 run    osmo-mgw_10.42.42.3(pid=7516): Terminated {rc=15}
11:51:53.586642 ---      ParallelTerminationStrategy: PID 7517 died...
11:51:53.652613 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7517): Terminated: ok {rc=0}
11:51:53.664445 ---      ParallelTerminationStrategy: PID 7518 died...
11:51:53.729274 run    osmo-mgw_10.42.42.4(pid=7518): Terminated {rc=15}
11:51:53.741110 ---      ParallelTerminationStrategy: PID 7519 died...
11:51:53.806057 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=7519): Terminated: ok {rc=0}
11:51:53.817774 ---      ParallelTerminationStrategy: PID 7521 died...
11:51:53.882588 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=7521): Terminated: ok {rc=0}
11:51:53.894326 ---      ParallelTerminationStrategy: PID 7548 died...
11:51:53.959270 run           osmo-trx-lms(pid=7548): Terminated {rc=36608}
11:51:55.988670 ---      ParallelTerminationStrategy: PID 7514 died...
11:51:56.063444 run    osmo-msc_10.42.42.6(pid=7514): Terminated: ok {rc=0}
11:51:56.075229 ---      ParallelTerminationStrategy: PID 7520 died...
11:51:56.139909 run    osmo-bsc_10.42.42.7(pid=7520): Terminated: ok {rc=0}
11:51:59.998009 run           osmo-bts-trx(pid=7549): Terminating (SIGINT)
11:52:00.177416 ---      ParallelTerminationStrategy: PID 7549 died...
11:52:00.244211 run           osmo-bts-trx(pid=7549): Terminated: ok {rc=0}
11:52:00.402864 bus                        /sierra_3: Setting Online False
11:52:01.559833 bus                        /sierra_3: Setting Powered False
11:52:12.641454 bus                        /sierra_3: Setting Powered False
11:52:13.760928 bus                        /sierra_3: Setting Powered False
11:52:14.941099 bus                        /sierra_2: Setting Online False
11:52:16.098948 bus                        /sierra_2: Setting Powered False
11:52:22.643617 bus                        /sierra_2: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 673, in exec_module
  File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 146, in <module>
    not_expected=('0-0-2-0 TCH/F ESTABLISHED',),
AssertionError