Skip to content

Failed

handover_2G:nanobts+bts1-trx-lms-limenet-micro.handover.py (from handover_2G_nanobts+bts1-trx-lms-limenet-micro)

Failing for the past 23 builds (Since #140 )
Took 5 min 29 sec.

Stacktrace

handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),

Standard Output

----------------------------------------------
trial-162 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py
----------------------------------------------
09:24:53.044929 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6)
09:24:53.058835 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2)
09:24:53.200682 tst                      handover.py: using LAC 16239
09:24:53.330521 tst                      handover.py: using RAC 174
09:24:53.478420 tst                      handover.py: using CellId 16238
09:24:53.614564 tst                      handover.py: using BVCI 2917
09:24:53.640521 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2)
09:24:53.797019 tst                      handover.py: using LAC 16240
09:24:53.934601 tst                      handover.py: using RAC 175
09:24:54.071318 tst                      handover.py: using CellId 16239
09:24:54.204767 tst                      handover.py: using BVCI 2918
09:24:54.230825 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6)
09:24:54.245101 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6)
09:24:54.259145 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6)
09:24:54.273245 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6)
09:24:54.287385 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6)
09:24:54.301265 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2)
09:24:54.427690 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2)
09:24:54.662978 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
09:24:55.182645 run          create_hlr_db(pid=3633): Launched
09:24:55.323371 bus                        /sierra_2: Setting Powered False
09:24:56.404929 run          create_hlr_db(pid=3633): Terminated: ok {rc=0}
09:24:56.849005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3635): Launched
09:24:57.196228 run    osmo-hlr_10.42.42.2(pid=3636): Launched
09:24:57.316785 run              osmo-stp_10.42.42.5: Starting osmo-stp
09:24:57.878849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3637): Launched
09:24:58.227193 run    osmo-stp_10.42.42.5(pid=3638): Launched
09:24:58.345553 run              osmo-msc_10.42.42.6: Starting osmo-msc
09:24:58.942902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3639): Launched
09:24:59.293341 run    osmo-msc_10.42.42.6(pid=3640): Launched
09:24:59.416876 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
09:24:59.982524 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=3641): Launched
09:25:00.328692 run    osmo-mgw_10.42.42.3(pid=3642): Launched
09:25:00.447137 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
09:25:00.998064 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3643): Launched
09:25:01.363656 run    osmo-mgw_10.42.42.4(pid=3644): Launched
09:25:01.482854 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
09:25:02.230461 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=3648): Launched
09:25:02.575674 run    osmo-bsc_10.42.42.7(pid=3649): Launched
09:25:08.162581 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=3650): Launched
09:25:08.303464 run         nanobts_NanoBTS-ONW-1900: Finding nanobts 10.42.42.120, binding on 10.42.42.1...
09:25:08.604192 run    abisip-find-preconf(pid=3652): Launched
09:27:15.957149 run         nanobts_NanoBTS-ONW-1900: Found nanobts 10.42.42.120 with unit_id 9 trx 0
09:27:16.089214 run    abisip-find-preconf(pid=3652): Terminating (SIGINT)
09:27:16.448705 run    abisip-find-preconf(pid=3652): Terminated {rc=-2}
09:27:16.763670 run        ipaccess-config(pid=3661): Launched
09:27:17.970779 run        ipaccess-config(pid=3661): Terminated: ok {rc=0}
09:27:57.444417 run         nanobts_NanoBTS-ONW-1900: nanoBTS connected to BSC
09:27:58.888147 tst                   handover.py:43: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/01_bts0_started: pass (172.5s)
09:27:59.045249 tst                      handover.py: using MSISDN 13112
09:27:59.238652 bus                        /sierra_2: Setting Powered True
09:28:02.764189 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015252', msisdn='13112', subscriber_id=1}
09:28:02.920290 tst                      handover.py: using MSISDN 13113
09:28:03.115662 bus                        /sierra_3: Setting Powered True
09:28:07.703010 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015253', msisdn='13113', subscriber_id=2}
09:28:08.051257 bus                        /sierra_2: Setting Online False
09:28:09.284899 bus                        /sierra_2: Setting Powered False
09:28:15.024992 bus                        /sierra_2: Setting Powered True
09:28:16.397601 bus                        /sierra_2: Setting Online True
09:28:19.031649 tst                        /sierra_2: Connect to ('901', '70')
09:28:19.382843 bus                        /sierra_3: Setting Online False
09:28:20.593846 bus                        /sierra_3: Setting Powered False
09:28:26.861025 bus                        /sierra_3: Setting Powered True
09:28:30.003954 bus                        /sierra_3: Setting Online True
09:28:32.377105 tst                        /sierra_3: Connect to ('901', '70')
09:28:32.558940 tst                        /sierra_2: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054228053'
09:28:32.686325 tst                        /sierra_3: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054229028'
09:28:32.888792 tst                   handover.py:54: waiting for modems to attach...
09:28:33.553712 tst                        /sierra_2: Already registered with network ('901', '70')
09:28:35.406161 tst                   handover.py:57: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/02.1_ms0_attach: pass (2.3s)
09:28:46.898372 tst                        /sierra_3: Already registered with network ('901', '70')
09:28:50.388040 tst                   handover.py:60: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/02.2_ms1_attach: pass (14.7s)
09:28:51.909776 tst                   handover.py:63: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/02.3_subscribed_in_msc: pass (1.3s)
09:28:56.469456 tst                   handover.py:68: dial success
09:28:59.140529 tst                   handover.py:75: answer success, call established and ongoing
09:28:59.431761 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
09:28:59.658019 tst                   handover.py:79: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/03_call_established: pass (2.9s)
09:28:59.799661 run                     osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
09:29:00.255330 run                     osmo-trx-lms: OSMOTRX CONF: {'osmo_trx': {'launch_trx': 'True', 'dev_args': 'LimeNET-Micro,serial=005839AF25B352', 'clock_reference': 'external', 'trx_ip': '10.42.42.123', 'egprs': 'disable', 'channels': [{}], 'type': 'lms', 'bts_ip': '10.42.42.53', 'remote_user': 'pi'}}
09:29:00.861161 run                uname-m(pid=3668): Launched
09:29:02.087073 run                uname-m(pid=3668): Terminated: ok {rc=0}
09:29:02.485878 run          rm-remote-dir(pid=3669): Launched
09:29:03.704425 run          rm-remote-dir(pid=3669): Terminated: ok {rc=0}
09:29:04.082585 run          mk-remote-dir(pid=3670): Launched
09:29:05.301382 run          mk-remote-dir(pid=3670): Terminated: ok {rc=0}
09:29:05.686883 run          mk-remote-dir(pid=3671): Launched
09:29:06.912067 run          mk-remote-dir(pid=3671): Terminated: ok {rc=0}
09:29:07.242715 run      scp-cfg-to-remote(pid=3672): Launched
09:29:08.465629 run      scp-cfg-to-remote(pid=3672): Terminated: ok {rc=0}
09:29:08.851616 run          mk-remote-dir(pid=3674): Launched
09:29:10.079905 run          mk-remote-dir(pid=3674): Terminated: ok {rc=0}
09:29:10.417108 run  scp-wrapper-to-remote(pid=3675): Launched
09:29:11.633213 run  scp-wrapper-to-remote(pid=3675): Terminated: ok {rc=0}
09:29:11.998832 run           osmo-trx-lms(pid=3677): Launched
09:29:12.119589 run                     osmo-bts-trx: Waiting for osmo-trx-lms to start up...
09:29:14.446381 run           osmo-bts-trx(pid=3678): Launched
09:29:20.063371 tst                   handover.py:84: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/04.1_bts1_started: pass (20.1s)
09:29:20.346053 tst                   handover.py:86: wait a bit for modems to see bts1
09:29:30.620593 tst                   handover.py:89: starting the second BTS probably took a while, check on the ongoing call
09:29:30.965544 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
09:29:31.374480 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
09:29:32.756706 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
09:29:35.533374 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
09:29:35.962709 tst                  handover.py:120: wait for handover counters to change...
09:29:40.042947 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
09:29:40.348824 tst                  handover.py:124: 
�[1;35m20201207092935656 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207092935656 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000017620] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207092935656 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207092935656 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207092935656 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207092935657 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207092935657 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207092935657 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207092935657 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207092935661 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207092935661 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207092936047 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207092936047 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207092936047 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207092936047 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207092936048 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207092936048 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207092936048 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207092936049 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207092936049 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207092936049 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014620]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
09:29:40.745683 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
09:29:40.909164 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-162↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
09:29:41.189476 tst                  handover.py:129: did not work, try again... (attempts left: 4)
09:29:41.569869 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
09:29:42.950025 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
09:29:45.676766 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
09:29:46.105045 tst                  handover.py:120: wait for handover counters to change...
09:29:50.170104 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
09:29:50.476568 tst                  handover.py:124: 
�[1;35m20201207092945801 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207092945801 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000017620] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207092945801 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207092945801 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207092945801 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207092945802 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207092945802 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207092945802 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207092945802 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207092945806 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207092945806 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207092946185 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207092946185 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207092946185 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207092946185 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207092946186 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207092946186 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207092946186 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207092946187 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207092946187 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207092946187 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014320]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
09:29:50.858000 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
09:29:51.011996 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-162↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
09:29:51.278836 tst                  handover.py:129: did not work, try again... (attempts left: 3)
09:29:51.658445 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
09:29:53.039462 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
09:29:55.782888 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
09:29:56.213574 tst                  handover.py:120: wait for handover counters to change...
09:30:00.343061 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
09:30:00.648509 tst                  handover.py:124: 
�[1;35m20201207092955908 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207092955908 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000017620] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207092955908 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207092955908 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207092955909 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207092955909 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207092955909 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207092955909 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207092955910 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207092955914 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207092955914 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207092956265 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207092956265 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207092956265 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207092956265 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207092956265 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207092956266 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207092956266 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207092956267 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207092956267 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207092956267 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000014020]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
09:30:01.033313 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
09:30:01.187730 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-162↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
09:30:01.458950 tst                  handover.py:129: did not work, try again... (attempts left: 2)
09:30:01.837542 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
09:30:03.236481 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
09:30:06.004024 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
09:30:06.434198 tst                  handover.py:120: wait for handover counters to change...
09:30:10.524286 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
09:30:10.874516 tst                  handover.py:124: 
�[1;35m20201207093006128 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207093006128 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000017620] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207093006128 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207093006128 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207093006128 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207093006129 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207093006129 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207093006129 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207093006129 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207093006134 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207093006134 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207093006507 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207093006507 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207093006507 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207093006507 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207093006507 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207093006507 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207093006508 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207093006509 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207093006509 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207093006509 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013d20]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
09:30:11.254587 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
09:30:11.408423 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-162↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
09:30:11.675129 tst                  handover.py:129: did not work, try again... (attempts left: 1)
09:30:12.053924 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
09:30:13.437936 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
09:30:16.186277 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
09:30:16.615385 tst                  handover.py:120: wait for handover counters to change...
09:30:20.686632 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
09:30:20.991545 tst                  handover.py:124: 
�[1;35m20201207093016310 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207093016310 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000017620] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207093016310 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207093016310 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207093016310 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207093016311 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207093016311 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207093016311 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207093016311 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207093016315 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207093016315 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207093016665 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207093016665 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207093016665 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207093016665 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207093016665 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207093016665 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207093016666 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x6198bb2f) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207093016666 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207093016666 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207093016667 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn3_subscr-IMSI-901700000015252-TMSI-0x6198bb2f)[0x612000013a20]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
09:30:21.370015 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
09:30:21.526389 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-162↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
09:30:21.793527 tst                  handover.py:129: did not work, try again... (attempts left: 0)
09:30:21.858938 tst                  handover.py:146: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/05.1_handover_ms0: FAIL (50.8s)
09:30:21.869026 tst                  handover.py:146: ERR: AssertionError: handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),  [trial-162↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:146]
09:30:21.876688 tst                  handover.py:146: Test FAILED (328.8 sec)
09:30:21.925516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3635): Terminating (SIGTERM)
09:30:21.981717 run    osmo-hlr_10.42.42.2(pid=3636): Terminating (SIGTERM)
09:30:22.042853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3637): Terminating (SIGTERM)
09:30:22.104909 run    osmo-stp_10.42.42.5(pid=3638): Terminating (SIGTERM)
09:30:22.173178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3639): Terminating (SIGTERM)
09:30:22.236874 run    osmo-msc_10.42.42.6(pid=3640): Terminating (SIGTERM)
09:30:22.293098 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=3641): Terminating (SIGTERM)
09:30:22.349808 run    osmo-mgw_10.42.42.3(pid=3642): Terminating (SIGTERM)
09:30:22.406097 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3643): Terminating (SIGTERM)
09:30:22.461783 run    osmo-mgw_10.42.42.4(pid=3644): Terminating (SIGTERM)
09:30:22.519274 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=3648): Terminating (SIGTERM)
09:30:22.589924 run    osmo-bsc_10.42.42.7(pid=3649): Terminating (SIGTERM)
09:30:22.661453 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=3650): Terminating (SIGTERM)
09:30:22.730515 run           osmo-trx-lms(pid=3677): Terminating (SIGTERM)
09:30:22.785130 run           osmo-bts-trx(pid=3678): Terminating (SIGTERM)
09:30:22.796836 ---      ParallelTerminationStrategy: PID 3635 died...
09:30:22.865316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3635): Terminated: ok {rc=0}
09:30:22.877599 ---      ParallelTerminationStrategy: PID 3636 died...
09:30:22.946090 run    osmo-hlr_10.42.42.2(pid=3636): Terminated: ok {rc=0}
09:30:22.958270 ---      ParallelTerminationStrategy: PID 3637 died...
09:30:23.026835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3637): Terminated: ok {rc=0}
09:30:23.039091 ---      ParallelTerminationStrategy: PID 3638 died...
09:30:23.107381 run    osmo-stp_10.42.42.5(pid=3638): Terminated: ok {rc=0}
09:30:23.119632 ---      ParallelTerminationStrategy: PID 3639 died...
09:30:23.187906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3639): Terminated: ok {rc=0}
09:30:23.202521 ---      ParallelTerminationStrategy: PID 3641 died...
09:30:23.271183 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=3641): Terminated: ok {rc=0}
09:30:23.283685 ---      ParallelTerminationStrategy: PID 3642 died...
09:30:23.351843 run    osmo-mgw_10.42.42.3(pid=3642): Terminated {rc=15}
09:30:23.364077 ---      ParallelTerminationStrategy: PID 3643 died...
09:30:23.432819 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3643): Terminated: ok {rc=0}
09:30:23.445361 ---      ParallelTerminationStrategy: PID 3644 died...
09:30:23.514095 run    osmo-mgw_10.42.42.4(pid=3644): Terminated {rc=15}
09:30:23.526905 ---      ParallelTerminationStrategy: PID 3648 died...
09:30:23.595106 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=3648): Terminated: ok {rc=0}
09:30:23.607525 ---      ParallelTerminationStrategy: PID 3650 died...
09:30:23.675799 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=3650): Terminated: ok {rc=0}
09:30:23.688402 ---      ParallelTerminationStrategy: PID 3677 died...
09:30:23.757073 run           osmo-trx-lms(pid=3677): Terminated {rc=36608}
09:30:25.786377 ---      ParallelTerminationStrategy: PID 3640 died...
09:30:25.855378 run    osmo-msc_10.42.42.6(pid=3640): Terminated: ok {rc=0}
09:30:25.867713 ---      ParallelTerminationStrategy: PID 3649 died...
09:30:25.934776 run    osmo-bsc_10.42.42.7(pid=3649): Terminated: ok {rc=0}
09:30:29.794615 run           osmo-bts-trx(pid=3678): Terminating (SIGINT)
09:30:29.974429 ---      ParallelTerminationStrategy: PID 3678 died...
09:30:30.043386 run           osmo-bts-trx(pid=3678): Terminated: ok {rc=0}
09:30:30.196182 bus                        /sierra_3: Setting Online False
09:30:31.352554 bus                        /sierra_3: Setting Powered False
09:30:42.633113 bus                        /sierra_3: Setting Powered False
09:30:43.757652 bus                        /sierra_3: Setting Powered False
09:30:44.940049 bus                        /sierra_2: Setting Online False
09:30:46.072101 bus                        /sierra_2: Setting Powered False
09:30:51.641225 bus                        /sierra_2: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 673, in exec_module
  File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 146, in <module>
    not_expected=('0-0-2-0 TCH/F ESTABLISHED',),
AssertionError