Skip to content

Failed

handover_2G:oc2g+bts1-trx-lms-limenet-micro.handover.py (from handover_2G_oc2g+bts1-trx-lms-limenet-micro)

Failing for the past 23 builds (Since #140 )
Took 3 min 3 sec.

Stacktrace

handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),

Standard Output

----------------------------------------------
trial-162 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py
----------------------------------------------
10:07:34.744566 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6)
10:07:34.758432 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2)
10:07:34.895097 tst                      handover.py: using LAC 16253
10:07:35.028118 tst                      handover.py: using RAC 188
10:07:35.159404 tst                      handover.py: using CellId 16252
10:07:35.294778 tst                      handover.py: using BVCI 2931
10:07:35.320781 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2)
10:07:35.469413 tst                      handover.py: using LAC 16254
10:07:35.598825 tst                      handover.py: using RAC 189
10:07:35.728275 tst                      handover.py: using CellId 16253
10:07:35.858029 tst                      handover.py: using BVCI 2932
10:07:35.883929 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6)
10:07:35.898026 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6)
10:07:35.911795 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6)
10:07:35.925695 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6)
10:07:35.939378 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6)
10:07:35.953058 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2)
10:07:36.085645 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2)
10:07:36.309274 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
10:07:36.827198 run          create_hlr_db(pid=4839): Launched
10:07:36.976297 bus                        /sierra_2: Setting Powered False
10:07:38.062842 run          create_hlr_db(pid=4839): Terminated: ok {rc=0}
10:07:38.489292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4841): Launched
10:07:38.825329 run    osmo-hlr_10.42.42.2(pid=4842): Launched
10:07:38.945585 run              osmo-stp_10.42.42.5: Starting osmo-stp
10:07:39.505261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4843): Launched
10:07:39.841344 run    osmo-stp_10.42.42.5(pid=4844): Launched
10:07:39.961237 run              osmo-msc_10.42.42.6: Starting osmo-msc
10:07:40.552218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4845): Launched
10:07:40.888309 run    osmo-msc_10.42.42.6(pid=4846): Launched
10:07:41.010052 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
10:07:41.570969 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=4847): Launched
10:07:41.907065 run    osmo-mgw_10.42.42.3(pid=4848): Launched
10:07:42.026458 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
10:07:42.578850 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=4849): Launched
10:07:42.931073 run    osmo-mgw_10.42.42.4(pid=4850): Launched
10:07:43.057185 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
10:07:43.838420 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=4851): Launched
10:07:44.176873 run    osmo-bsc_10.42.42.7(pid=4852): Launched
10:07:47.869170 run                    osmo-bts-oc2g: Starting OsmoBtsOC2G to connect to osmo-bsc_10.42.42.7
10:07:48.443089 run          rm-remote-dir(pid=4853): Launched
10:07:49.654116 run          rm-remote-dir(pid=4853): Terminated: ok {rc=0}
10:07:50.018314 run          mk-remote-dir(pid=4854): Launched
10:07:51.229183 run          mk-remote-dir(pid=4854): Terminated: ok {rc=0}
10:07:51.536239 run     scp-inst-to-remote(pid=4855): Launched
10:07:57.753424 run     scp-inst-to-remote(pid=4855): Terminated: ok {rc=0}
10:07:58.111193 run          mk-remote-dir(pid=4857): Launched
10:07:59.320605 run          mk-remote-dir(pid=4857): Terminated: ok {rc=0}
10:07:59.633339 run      scp-cfg-to-remote(pid=4858): Launched
10:08:00.849939 run      scp-cfg-to-remote(pid=4858): Terminated: ok {rc=0}
10:08:01.205153 run          osmo-bts-oc2g(pid=4860): Launched
10:08:07.661882 tst                   handover.py:43: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/01_bts0_started: pass (19.7s)
10:08:07.820311 tst                      handover.py: using MSISDN 13126
10:08:08.017533 bus                        /sierra_2: Setting Powered True
10:08:11.524720 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015252', msisdn='13126', subscriber_id=1}
10:08:11.683154 tst                      handover.py: using MSISDN 13127
10:08:11.878937 bus                        /sierra_3: Setting Powered True
10:08:18.385707 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015253', msisdn='13127', subscriber_id=2}
10:08:18.698519 bus                        /sierra_2: Setting Online False
10:08:19.905334 bus                        /sierra_2: Setting Powered False
10:08:25.864927 bus                        /sierra_2: Setting Powered True
10:08:27.234227 bus                        /sierra_2: Setting Online True
10:08:29.815580 tst                        /sierra_2: Connect to ('901', '70')
10:08:30.216132 bus                        /sierra_3: Setting Online False
10:08:31.421158 bus                        /sierra_3: Setting Powered False
10:08:37.842555 bus                        /sierra_3: Setting Powered True
10:08:40.479149 tst                        /sierra_2: Already registered with network ('901', '70')
10:08:42.377181 bus                        /sierra_3: Setting Online True
10:08:45.164886 tst                        /sierra_3: Connect to ('901', '70')
10:08:45.358543 tst                        /sierra_2: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054228053'
10:08:45.499869 tst                        /sierra_3: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054229028'
10:08:45.717532 tst                   handover.py:54: waiting for modems to attach...
10:08:47.084312 tst                   handover.py:57: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/02.1_ms0_attach: pass (1.1s)
10:08:54.830868 tst                        /sierra_3: Already registered with network ('901', '70')
10:09:03.637099 tst                   handover.py:60: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/02.2_ms1_attach: pass (16.3s)
10:09:05.190851 tst                   handover.py:63: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/02.3_subscribed_in_msc: pass (1.3s)
10:09:09.796591 tst                   handover.py:68: dial success
10:09:12.504289 tst                   handover.py:75: answer success, call established and ongoing
10:09:12.817811 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
10:09:13.045190 tst                   handover.py:79: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/03_call_established: pass (3.0s)
10:09:13.197724 run                     osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
10:09:13.689752 run                     osmo-trx-lms: OSMOTRX CONF: {'osmo_trx': {'launch_trx': 'True', 'dev_args': 'LimeNET-Micro,serial=005839AF25B352', 'clock_reference': 'external', 'trx_ip': '10.42.42.123', 'egprs': 'disable', 'channels': [{}], 'type': 'lms', 'bts_ip': '10.42.42.53', 'remote_user': 'pi'}}
10:09:14.327050 run                uname-m(pid=4864): Launched
10:09:15.543585 run                uname-m(pid=4864): Terminated: ok {rc=0}
10:09:15.932204 run          rm-remote-dir(pid=4865): Launched
10:09:17.165520 run          rm-remote-dir(pid=4865): Terminated: ok {rc=0}
10:09:17.561339 run          mk-remote-dir(pid=4866): Launched
10:09:18.780631 run          mk-remote-dir(pid=4866): Terminated: ok {rc=0}
10:09:19.170679 run          mk-remote-dir(pid=4867): Launched
10:09:20.399595 run          mk-remote-dir(pid=4867): Terminated: ok {rc=0}
10:09:20.741576 run      scp-cfg-to-remote(pid=4868): Launched
10:09:21.957767 run      scp-cfg-to-remote(pid=4868): Terminated: ok {rc=0}
10:09:22.334083 run          mk-remote-dir(pid=4870): Launched
10:09:23.550871 run          mk-remote-dir(pid=4870): Terminated: ok {rc=0}
10:09:23.887620 run  scp-wrapper-to-remote(pid=4871): Launched
10:09:25.122055 run  scp-wrapper-to-remote(pid=4871): Terminated: ok {rc=0}
10:09:25.502167 run           osmo-trx-lms(pid=4873): Launched
10:09:25.632108 run                     osmo-bts-trx: Waiting for osmo-trx-lms to start up...
10:09:27.959347 run           osmo-bts-trx(pid=4875): Launched
10:09:33.616058 tst                   handover.py:84: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/04.1_bts1_started: pass (20.2s)
10:09:33.978311 tst                   handover.py:86: wait a bit for modems to see bts1
10:09:44.278136 tst                   handover.py:89: starting the second BTS probably took a while, check on the ongoing call
10:09:44.634838 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
10:09:45.051034 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
10:09:46.440100 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
10:09:49.233077 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
10:09:49.667022 tst                  handover.py:120: wait for handover counters to change...
10:09:53.784620 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
10:09:54.095094 tst                  handover.py:124: 
�[1;35m20201207100949359 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207100949360 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000171a0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207100949360 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207100949360 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207100949360 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207100949361 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207100949361 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207100949361 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207100949361 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207100949365 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207100949365 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207100949793 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207100949793 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207100949793 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207100949793 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207100949793 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207100949794 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207100949794 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207100949795 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207100949795 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207100949795 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000141a0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
10:09:54.479214 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
10:09:54.637027 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-162↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
10:09:54.906390 tst                  handover.py:129: did not work, try again... (attempts left: 4)
10:09:55.290820 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
10:09:56.679748 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
10:09:59.461602 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
10:09:59.895831 tst                  handover.py:120: wait for handover counters to change...
10:10:04.130348 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
10:10:04.442848 tst                  handover.py:124: 
�[1;35m20201207100959586 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207100959586 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000171a0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207100959587 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207100959587 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207100959587 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207100959588 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207100959588 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207100959588 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207100959588 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207100959593 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207100959593 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207101000011 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207101000011 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207101000011 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207101000012 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207101000012 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207101000012 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207101000012 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207101000014 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207101000014 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207101000014 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
10:10:04.826841 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
10:10:04.983869 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-162↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
10:10:05.255379 tst                  handover.py:129: did not work, try again... (attempts left: 3)
10:10:05.641104 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
10:10:07.033820 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
10:10:09.907038 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
10:10:10.343001 tst                  handover.py:120: wait for handover counters to change...
10:10:14.863074 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
10:10:15.227730 tst                  handover.py:124: 
�[1;35m20201207101010033 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207101010033 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000171a0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207101010033 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207101010033 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207101010033 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207101010034 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207101010034 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207101010034 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207101010034 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207101010038 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207101010039 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207101010450 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207101010451 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207101010451 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207101010451 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207101010451 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207101010451 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207101010451 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207101010453 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207101010453 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207101010453 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
10:10:15.671243 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
10:10:15.853877 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-162↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
10:10:16.172019 tst                  handover.py:129: did not work, try again... (attempts left: 2)
10:10:16.620805 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
10:10:18.115862 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
10:10:21.273727 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
10:10:21.708160 tst                  handover.py:120: wait for handover counters to change...
10:10:25.826046 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
10:10:26.135288 tst                  handover.py:124: 
�[1;35m20201207101021399 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207101021399 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000171a0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207101021399 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207101021399 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207101021399 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207101021400 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207101021400 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207101021400 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207101021400 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207101021404 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207101021404 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207101021832 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207101021832 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207101021832 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207101021832 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207101021833 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207101021833 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207101021833 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207101021834 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207101021834 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207101021834 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
10:10:26.519261 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
10:10:26.675840 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-162↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
10:10:26.947139 tst                  handover.py:129: did not work, try again... (attempts left: 1)
10:10:27.331816 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
10:10:28.721702 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
10:10:31.536273 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
10:10:31.970372 tst                  handover.py:120: wait for handover counters to change...
10:10:36.120258 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
10:10:36.432792 tst                  handover.py:124: 
�[1;35m20201207101031661 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207101031661 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000171a0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207101031661 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207101031661 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207101031662 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207101031662 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207101031662 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207101031662 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207101031662 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207101031666 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207101031666 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207101032092 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207101032092 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207101032092 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207101032092 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207101032092 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207101032092 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207101032093 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2224e15b) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207101032094 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207101032094 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207101032094 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2224e15b)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
10:10:36.815505 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
10:10:36.973694 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-162↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
10:10:37.243474 tst                  handover.py:129: did not work, try again... (attempts left: 0)
10:10:37.310321 tst                  handover.py:146: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/05.1_handover_ms0: FAIL (52.6s)
10:10:37.320610 tst                  handover.py:146: ERR: AssertionError: handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),  [trial-162↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:146]
10:10:37.328187 tst                  handover.py:146: Test FAILED (182.6 sec)
10:10:37.378603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4841): Terminating (SIGTERM)
10:10:37.436279 run    osmo-hlr_10.42.42.2(pid=4842): Terminating (SIGTERM)
10:10:37.494871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4843): Terminating (SIGTERM)
10:10:37.555589 run    osmo-stp_10.42.42.5(pid=4844): Terminating (SIGTERM)
10:10:37.614174 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4845): Terminating (SIGTERM)
10:10:37.674630 run    osmo-msc_10.42.42.6(pid=4846): Terminating (SIGTERM)
10:10:37.731862 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=4847): Terminating (SIGTERM)
10:10:37.788901 run    osmo-mgw_10.42.42.3(pid=4848): Terminating (SIGTERM)
10:10:37.845578 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=4849): Terminating (SIGTERM)
10:10:37.902163 run    osmo-mgw_10.42.42.4(pid=4850): Terminating (SIGTERM)
10:10:37.958288 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=4851): Terminating (SIGTERM)
10:10:38.015325 run    osmo-bsc_10.42.42.7(pid=4852): Terminating (SIGTERM)
10:10:38.071503 run          osmo-bts-oc2g(pid=4860): Terminating (SIGTERM)
10:10:38.127935 run           osmo-trx-lms(pid=4873): Terminating (SIGTERM)
10:10:38.182078 run           osmo-bts-trx(pid=4875): Terminating (SIGTERM)
10:10:38.193689 ---      ParallelTerminationStrategy: PID 4841 died...
10:10:38.264278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4841): Terminated: ok {rc=0}
10:10:38.277083 ---      ParallelTerminationStrategy: PID 4842 died...
10:10:38.346196 run    osmo-hlr_10.42.42.2(pid=4842): Terminated: ok {rc=0}
10:10:38.358944 ---      ParallelTerminationStrategy: PID 4843 died...
10:10:38.427483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4843): Terminated: ok {rc=0}
10:10:38.440098 ---      ParallelTerminationStrategy: PID 4844 died...
10:10:38.508590 run    osmo-stp_10.42.42.5(pid=4844): Terminated: ok {rc=0}
10:10:38.521510 ---      ParallelTerminationStrategy: PID 4845 died...
10:10:38.589919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4845): Terminated: ok {rc=0}
10:10:38.602750 ---      ParallelTerminationStrategy: PID 4847 died...
10:10:38.671559 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=4847): Terminated: ok {rc=0}
10:10:38.684030 ---      ParallelTerminationStrategy: PID 4848 died...
10:10:38.752914 run    osmo-mgw_10.42.42.3(pid=4848): Terminated {rc=15}
10:10:38.765414 ---      ParallelTerminationStrategy: PID 4849 died...
10:10:38.834561 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=4849): Terminated: ok {rc=0}
10:10:38.847371 ---      ParallelTerminationStrategy: PID 4850 died...
10:10:38.916517 run    osmo-mgw_10.42.42.4(pid=4850): Terminated {rc=15}
10:10:38.929099 ---      ParallelTerminationStrategy: PID 4851 died...
10:10:38.997976 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=4851): Terminated: ok {rc=0}
10:10:39.010692 ---      ParallelTerminationStrategy: PID 4860 died...
10:10:39.079393 run          osmo-bts-oc2g(pid=4860): Terminated {rc=36608}
10:10:39.092118 ---      ParallelTerminationStrategy: PID 4873 died...
10:10:39.160837 run           osmo-trx-lms(pid=4873): Terminated {rc=36608}
10:10:41.190157 ---      ParallelTerminationStrategy: PID 4846 died...
10:10:41.260630 run    osmo-msc_10.42.42.6(pid=4846): Terminated: ok {rc=0}
10:10:41.273372 ---      ParallelTerminationStrategy: PID 4852 died...
10:10:41.341232 run    osmo-bsc_10.42.42.7(pid=4852): Terminated: ok {rc=0}
10:10:45.201187 run           osmo-bts-trx(pid=4875): Terminating (SIGINT)
10:10:45.381193 ---      ParallelTerminationStrategy: PID 4875 died...
10:10:45.450667 run           osmo-bts-trx(pid=4875): Terminated: ok {rc=0}
10:10:45.608750 bus                        /sierra_3: Setting Online False
10:10:46.768249 bus                        /sierra_3: Setting Powered False
10:11:03.629286 bus                        /sierra_3: Setting Powered False
10:11:04.753297 bus                        /sierra_3: Setting Powered False
10:11:05.936545 bus                        /sierra_2: Setting Online False
10:11:07.102945 bus                        /sierra_2: Setting Powered False
10:11:18.643471 bus                        /sierra_2: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 673, in exec_module
  File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 146, in <module>
    not_expected=('0-0-2-0 TCH/F ESTABLISHED',),
AssertionError