Skip to content

Failed

handover_2G:oc2g+bts1-trx-lms.handover.py (from handover_2G_oc2g+bts1-trx-lms)

Failing for the past 20 builds (Since #140 )
Took 2 min 53 sec.

Stacktrace

handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),

Standard Output

----------------------------------------------
trial-159 handover_2G:oc2g+bts1-trx-lms handover.py
----------------------------------------------
00:15:04.720480 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
00:15:04.733917 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2)
00:15:04.870902 tst                      handover.py: using LAC 16011
00:15:05.008967 tst                      handover.py: using RAC 201
00:15:05.148844 tst                      handover.py: using CellId 16010
00:15:05.285803 tst                      handover.py: using BVCI 2689
00:15:05.312103 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2)
00:15:05.469993 tst                      handover.py: using LAC 16012
00:15:05.605149 tst                      handover.py: using RAC 202
00:15:05.737513 tst                      handover.py: using CellId 16011
00:15:05.870022 tst                      handover.py: using BVCI 2690
00:15:05.896079 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
00:15:05.909701 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
00:15:05.922963 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
00:15:05.936095 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
00:15:05.949481 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
00:15:05.962668 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2)
00:15:06.092739 tst    handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2)
00:15:06.657957 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
00:15:07.194026 run         create_hlr_db(pid=14258): Launched
00:15:07.344221 bus                        /sierra_2: Setting Powered False
00:15:08.431579 run         create_hlr_db(pid=14258): Terminated: ok {rc=0}
00:15:08.867398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14260): Launched
00:15:09.223162 run   osmo-hlr_10.42.42.2(pid=14261): Launched
00:15:09.351849 run              osmo-stp_10.42.42.5: Starting osmo-stp
00:15:09.936985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14262): Launched
00:15:10.289279 run   osmo-stp_10.42.42.5(pid=14263): Launched
00:15:10.409363 run              osmo-msc_10.42.42.6: Starting osmo-msc
00:15:10.998755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14264): Launched
00:15:11.346454 run   osmo-msc_10.42.42.6(pid=14265): Launched
00:15:11.475684 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
00:15:12.047422 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14266): Launched
00:15:12.398858 run   osmo-mgw_10.42.42.3(pid=14267): Launched
00:15:12.520106 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
00:15:13.069122 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14268): Launched
00:15:13.417178 run   osmo-mgw_10.42.42.4(pid=14269): Launched
00:15:13.545245 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
00:15:14.328140 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14270): Launched
00:15:14.667598 run   osmo-bsc_10.42.42.7(pid=14271): Launched
00:15:18.400589 run                    osmo-bts-oc2g: Starting OsmoBtsOC2G to connect to osmo-bsc_10.42.42.7
00:15:19.000517 run         rm-remote-dir(pid=14272): Launched
00:15:20.211880 run         rm-remote-dir(pid=14272): Terminated: ok {rc=0}
00:15:20.577588 run         mk-remote-dir(pid=14273): Launched
00:15:21.789164 run         mk-remote-dir(pid=14273): Terminated: ok {rc=0}
00:15:22.103883 run    scp-inst-to-remote(pid=14274): Launched
00:15:28.321612 run    scp-inst-to-remote(pid=14274): Terminated: ok {rc=0}
00:15:28.689099 run         mk-remote-dir(pid=14276): Launched
00:15:29.907278 run         mk-remote-dir(pid=14276): Terminated: ok {rc=0}
00:15:30.223733 run     scp-cfg-to-remote(pid=14277): Launched
00:15:31.433200 run     scp-cfg-to-remote(pid=14277): Terminated: ok {rc=0}
00:15:31.786393 run         osmo-bts-oc2g(pid=14279): Launched
00:15:38.245806 tst                   handover.py:43: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/01_bts0_started: pass (19.8s)
00:15:38.415802 tst                      handover.py: using MSISDN 12914
00:15:38.607392 bus                        /sierra_2: Setting Powered True
00:15:42.109337 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015252', msisdn='12914', subscriber_id=1}
00:15:42.303958 tst                      handover.py: using MSISDN 12915
00:15:44.626875 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015253', msisdn='12915', subscriber_id=2}
00:15:44.945936 bus                        /sierra_2: Setting Online False
00:15:46.153429 bus                        /sierra_2: Setting Powered False
00:15:51.912207 bus                        /sierra_2: Setting Powered True
00:15:53.297670 bus                        /sierra_2: Setting Online True
00:15:55.896457 tst                        /sierra_2: Connect to ('901', '70')
00:15:56.318470 bus                        /sierra_3: Setting Online False
00:15:57.566957 bus                        /sierra_3: Setting Powered False
00:16:03.841618 bus                        /sierra_3: Setting Powered True
00:16:08.295849 bus                        /sierra_3: Setting Online True
00:16:10.103273 tst                        /sierra_2: Already registered with network ('901', '70')
00:16:11.101168 tst                        /sierra_3: Connect to ('901', '70')
00:16:11.283783 tst                        /sierra_2: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054228053'
00:16:11.412514 tst                        /sierra_3: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054229028'
00:16:11.617502 tst                   handover.py:54: waiting for modems to attach...
00:16:14.932462 tst                   handover.py:57: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/02.1_ms0_attach: pass (3.1s)
00:16:25.877443 tst                        /sierra_3: Already registered with network ('901', '70')
00:16:30.212105 tst                   handover.py:60: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/02.2_ms1_attach: pass (15.0s)
00:16:31.776466 tst                   handover.py:63: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/02.3_subscribed_in_msc: pass (1.3s)
00:16:37.387141 tst                   handover.py:68: dial success
00:16:40.129543 tst                   handover.py:75: answer success, call established and ongoing
00:16:40.449554 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
00:16:40.680853 tst                   handover.py:79: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/03_call_established: pass (3.0s)
00:16:40.837339 run                     osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
00:16:41.336466 run                     osmo-trx-lms: OSMOTRX CONF: {'osmo_trx': {'clock_reference': 'external', 'trx_ip': '10.42.42.117', 'dev_args': 'LimeSDR-USB,serial=00090706024F0A22', 'remote_user': 'jenkins', 'bts_ip': '10.42.42.53', 'channels': [{'rx_path': 'LNAW'}], 'egprs': 'disable', 'type': 'lms', 'launch_trx': 'True'}}
00:16:41.981858 run               uname-m(pid=14280): Launched
00:16:43.201348 run               uname-m(pid=14280): Terminated: ok {rc=0}
00:16:43.597796 run         rm-remote-dir(pid=14281): Launched
00:16:44.815882 run         rm-remote-dir(pid=14281): Terminated: ok {rc=0}
00:16:45.214828 run         mk-remote-dir(pid=14282): Launched
00:16:46.451795 run         mk-remote-dir(pid=14282): Terminated: ok {rc=0}
00:16:46.848992 run         mk-remote-dir(pid=14283): Launched
00:16:48.064253 run         mk-remote-dir(pid=14283): Terminated: ok {rc=0}
00:16:48.402521 run    scp-inst-to-remote(pid=14284): Launched
00:16:50.636469 run    scp-inst-to-remote(pid=14284): Terminated: ok {rc=0}
00:16:51.035283 run         mk-remote-dir(pid=14286): Launched
00:16:52.249963 run         mk-remote-dir(pid=14286): Terminated: ok {rc=0}
00:16:52.574167 run     scp-cfg-to-remote(pid=14287): Launched
00:16:53.790933 run     scp-cfg-to-remote(pid=14287): Terminated: ok {rc=0}
00:16:54.172484 run         mk-remote-dir(pid=14289): Launched
00:16:55.390395 run         mk-remote-dir(pid=14289): Terminated: ok {rc=0}
00:16:55.729934 run scp-wrapper-to-remote(pid=14290): Launched
00:16:56.964035 run scp-wrapper-to-remote(pid=14290): Terminated: ok {rc=0}
00:16:57.350024 run          osmo-trx-lms(pid=14292): Launched
00:16:57.486038 run                     osmo-bts-trx: Waiting for osmo-trx-lms to start up...
00:16:58.807555 run          osmo-bts-trx(pid=14293): Launched
00:17:01.383896 tst                   handover.py:84: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/04.1_bts1_started: pass (20.4s)
00:17:01.676789 tst                   handover.py:86: wait a bit for modems to see bts1
00:17:12.015258 tst                   handover.py:89: starting the second BTS probably took a while, check on the ongoing call
00:17:12.457492 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
00:17:12.841147 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
00:17:14.165404 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
00:17:16.518165 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
00:17:16.881839 tst                  handover.py:120: wait for handover counters to change...
00:17:20.529463 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
00:17:20.788526 tst                  handover.py:124: 
�[1;35m20201207001716624 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207001716624 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207001716624 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207001716624 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207001716624 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207001716625 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207001716625 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207001716625 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207001716625 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207001716631 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207001716631 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207001717053 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207001717053 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207001717053 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207001717053 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207001717053 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207001717053 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207001717054 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207001717055 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207001717055 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207001717055 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
00:17:21.110541 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
00:17:21.241511 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-159↪handover_2G:oc2g+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
00:17:21.468061 tst                  handover.py:129: did not work, try again... (attempts left: 4)
00:17:21.788738 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
00:17:23.112028 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
00:17:25.474686 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
00:17:25.835001 tst                  handover.py:120: wait for handover counters to change...
00:17:29.457018 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
00:17:29.715545 tst                  handover.py:124: 
�[1;35m20201207001725580 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207001725580 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207001725580 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207001725581 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207001725581 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207001725581 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207001725581 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207001725581 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207001725581 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207001725587 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207001725587 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207001725993 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207001725993 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207001725994 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207001725994 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207001725994 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207001725994 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207001725994 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207001725995 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207001725995 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207001725995 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
00:17:30.036796 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
00:17:30.167899 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-159↪handover_2G:oc2g+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
00:17:30.394049 tst                  handover.py:129: did not work, try again... (attempts left: 3)
00:17:30.719089 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
00:17:32.042541 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
00:17:34.430840 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
00:17:34.793537 tst                  handover.py:120: wait for handover counters to change...
00:17:38.415646 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
00:17:38.673923 tst                  handover.py:124: 
�[1;35m20201207001734536 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207001734536 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207001734536 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207001734536 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207001734537 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207001734537 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207001734537 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207001734538 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207001734538 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207001734543 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207001734543 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207001734952 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207001734952 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207001734952 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207001734952 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207001734952 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207001734952 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207001734953 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207001734954 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207001734954 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207001734954 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
00:17:38.993541 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
00:17:39.124983 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-159↪handover_2G:oc2g+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
00:17:39.351306 tst                  handover.py:129: did not work, try again... (attempts left: 2)
00:17:39.673005 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
00:17:41.001628 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
00:17:43.386312 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
00:17:43.748263 tst                  handover.py:120: wait for handover counters to change...
00:17:47.422170 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
00:17:47.680487 tst                  handover.py:124: 
�[1;35m20201207001743491 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207001743491 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207001743491 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207001743492 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207001743492 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207001743492 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207001743493 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207001743493 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207001743493 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207001743498 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207001743498 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207001743915 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207001743915 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207001743915 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207001743915 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207001743915 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207001743915 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207001743916 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207001743917 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207001743917 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207001743917 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
00:17:48.001117 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
00:17:48.131503 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-159↪handover_2G:oc2g+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
00:17:48.357066 tst                  handover.py:129: did not work, try again... (attempts left: 1)
00:17:48.677979 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
00:17:50.001998 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
00:17:52.345004 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
00:17:52.708598 tst                  handover.py:120: wait for handover counters to change...
00:17:56.325623 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
00:17:56.583641 tst                  handover.py:124: 
�[1;35m20201207001752450 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207001752450 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207001752450 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207001752450 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207001752450 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207001752451 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207001752451 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207001752451 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207001752451 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207001752457 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207001752457 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207001752874 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207001752874 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207001752874 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207001752874 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207001752874 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207001752874 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207001752874 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x5bd68129) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207001752875 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207001752875 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207001752875 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x5bd68129)[0x6120000132a0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
00:17:56.903657 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
00:17:57.034481 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-159↪handover_2G:oc2g+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
00:17:57.258493 tst                  handover.py:129: did not work, try again... (attempts left: 0)
00:17:57.315601 tst                  handover.py:146: ----- Report fragment: handover_2G:oc2g+bts1-trx-lms/handover.py/05.1_handover_ms0: FAIL (44.7s)
00:17:57.323404 tst                  handover.py:146: ERR: AssertionError: handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),  [trial-159↪handover_2G:oc2g+bts1-trx-lms↪handover.py:146]
00:17:57.329719 tst                  handover.py:146: Test FAILED (172.6 sec)
00:17:57.371545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14260): Terminating (SIGTERM)
00:17:57.419786 run   osmo-hlr_10.42.42.2(pid=14261): Terminating (SIGTERM)
00:17:57.471934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14262): Terminating (SIGTERM)
00:17:57.524027 run   osmo-stp_10.42.42.5(pid=14263): Terminating (SIGTERM)
00:17:57.574795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14264): Terminating (SIGTERM)
00:17:57.627498 run   osmo-msc_10.42.42.6(pid=14265): Terminating (SIGTERM)
00:17:57.676570 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14266): Terminating (SIGTERM)
00:17:57.724836 run   osmo-mgw_10.42.42.3(pid=14267): Terminating (SIGTERM)
00:17:57.773923 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14268): Terminating (SIGTERM)
00:17:57.822374 run   osmo-mgw_10.42.42.4(pid=14269): Terminating (SIGTERM)
00:17:57.871537 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14270): Terminating (SIGTERM)
00:17:57.919757 run   osmo-bsc_10.42.42.7(pid=14271): Terminating (SIGTERM)
00:17:57.968156 run         osmo-bts-oc2g(pid=14279): Terminating (SIGTERM)
00:17:58.016396 run          osmo-trx-lms(pid=14292): Terminating (SIGTERM)
00:17:58.066629 run          osmo-bts-trx(pid=14293): Terminating (SIGTERM)
00:17:58.077384 ---      ParallelTerminationStrategy: PID 14260 died...
00:17:58.141451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14260): Terminated: ok {rc=0}
00:17:58.153078 ---      ParallelTerminationStrategy: PID 14261 died...
00:17:58.217050 run   osmo-hlr_10.42.42.2(pid=14261): Terminated: ok {rc=0}
00:17:58.228605 ---      ParallelTerminationStrategy: PID 14262 died...
00:17:58.292627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14262): Terminated: ok {rc=0}
00:17:58.304168 ---      ParallelTerminationStrategy: PID 14263 died...
00:17:58.368366 run   osmo-stp_10.42.42.5(pid=14263): Terminated: ok {rc=0}
00:17:58.379853 ---      ParallelTerminationStrategy: PID 14264 died...
00:17:58.443793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14264): Terminated: ok {rc=0}
00:17:58.455812 ---      ParallelTerminationStrategy: PID 14266 died...
00:17:58.519692 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14266): Terminated: ok {rc=0}
00:17:58.531277 ---      ParallelTerminationStrategy: PID 14267 died...
00:17:58.595652 run   osmo-mgw_10.42.42.3(pid=14267): Terminated {rc=15}
00:17:58.607341 ---      ParallelTerminationStrategy: PID 14268 died...
00:17:58.671496 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14268): Terminated: ok {rc=0}
00:17:58.683120 ---      ParallelTerminationStrategy: PID 14269 died...
00:17:58.747097 run   osmo-mgw_10.42.42.4(pid=14269): Terminated {rc=15}
00:17:58.758755 ---      ParallelTerminationStrategy: PID 14270 died...
00:17:58.822887 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14270): Terminated: ok {rc=0}
00:17:58.834652 ---      ParallelTerminationStrategy: PID 14279 died...
00:17:58.898636 run         osmo-bts-oc2g(pid=14279): Terminated {rc=36608}
00:17:58.910296 ---      ParallelTerminationStrategy: PID 14292 died...
00:17:58.974988 run          osmo-trx-lms(pid=14292): Terminated {rc=36608}
00:18:01.003231 ---      ParallelTerminationStrategy: PID 14265 died...
00:18:01.078382 run   osmo-msc_10.42.42.6(pid=14265): Terminated: ok {rc=0}
00:18:01.759430 ---      ParallelTerminationStrategy: PID 14271 died...
00:18:01.833533 run   osmo-bsc_10.42.42.7(pid=14271): Terminated: ok {rc=0}
00:18:05.027964 run          osmo-bts-trx(pid=14293): Terminating (SIGINT)
00:18:05.210438 ---      ParallelTerminationStrategy: PID 14293 died...
00:18:05.277557 run          osmo-bts-trx(pid=14293): Terminated: ok {rc=0}
00:18:05.427455 bus                        /sierra_3: Setting Online False
00:18:06.589497 bus                        /sierra_3: Setting Powered False
00:18:22.847840 bus                        /sierra_3: Setting Powered False
00:18:23.972222 bus                        /sierra_3: Setting Powered False
00:18:25.156470 bus                        /sierra_2: Setting Online False
00:18:26.299671 bus                        /sierra_2: Setting Powered False
00:18:37.640375 bus                        /sierra_2: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 673, in exec_module
  File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 146, in <module>
    not_expected=('0-0-2-0 TCH/F ESTABLISHED',),
AssertionError