Skip to content

Failed

handover_2G:nanobts+bts1-trx-lms.handover.py (from handover_2G_nanobts+bts1-trx-lms)

Failing for the past 25 builds (Since #140 )
Took 5 min 45 sec.

Stacktrace

handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),

Standard Output

----------------------------------------------
trial-164 handover_2G:nanobts+bts1-trx-lms handover.py
----------------------------------------------
14:25:49.017560 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
14:25:49.031034 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2)
14:25:49.175776 tst                      handover.py: using LAC 16382
14:25:49.309833 tst                      handover.py: using RAC 62
14:25:49.443701 tst                      handover.py: using CellId 16381
14:25:49.578436 tst                      handover.py: using BVCI 3060
14:25:49.604930 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2)
14:25:49.761093 tst                      handover.py: using LAC 16383
14:25:49.895413 tst                      handover.py: using RAC 63
14:25:50.032215 tst                      handover.py: using CellId 16382
14:25:50.166650 tst                      handover.py: using BVCI 3061
14:25:50.193332 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
14:25:50.206829 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
14:25:50.220081 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
14:25:50.233451 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
14:25:50.246778 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
14:25:50.259941 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2)
14:25:50.395436 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2)
14:25:50.631170 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
14:25:51.167453 run         create_hlr_db(pid=11488): Launched
14:25:51.322668 bus                        /sierra_2: Setting Powered False
14:25:52.414302 run         create_hlr_db(pid=11488): Terminated: ok {rc=0}
14:25:52.853567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11490): Launched
14:25:53.213736 run   osmo-hlr_10.42.42.2(pid=11491): Launched
14:25:53.347959 run              osmo-stp_10.42.42.5: Starting osmo-stp
14:25:53.952240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11492): Launched
14:25:54.309953 run   osmo-stp_10.42.42.5(pid=11493): Launched
14:25:54.442857 run              osmo-msc_10.42.42.6: Starting osmo-msc
14:25:55.083748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11494): Launched
14:25:55.433144 run   osmo-msc_10.42.42.6(pid=11495): Launched
14:25:55.559774 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
14:25:56.151643 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11496): Launched
14:25:56.517378 run   osmo-mgw_10.42.42.3(pid=11497): Launched
14:25:56.641713 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
14:25:57.214679 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11498): Launched
14:25:57.580133 run   osmo-mgw_10.42.42.4(pid=11499): Launched
14:25:57.704708 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
14:25:58.491990 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11500): Launched
14:25:58.841104 run   osmo-bsc_10.42.42.7(pid=11501): Launched
14:26:04.440910 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=11502): Launched
14:26:04.584381 run         nanobts_NanoBTS-ONW-1900: Finding nanobts 10.42.42.120, binding on 10.42.42.1...
14:26:04.897440 run   abisip-find-preconf(pid=11504): Launched
14:28:13.266692 run         nanobts_NanoBTS-ONW-1900: Found nanobts 10.42.42.120 with unit_id 9 trx 0
14:28:13.407403 run   abisip-find-preconf(pid=11504): Terminating (SIGINT)
14:28:13.778041 run   abisip-find-preconf(pid=11504): Terminated {rc=-2}
14:28:14.106242 run       ipaccess-config(pid=11510): Launched
14:28:15.330956 run       ipaccess-config(pid=11510): Terminated: ok {rc=0}
14:29:05.861860 run         nanobts_NanoBTS-ONW-1900: nanoBTS connected to BSC
14:29:07.354610 tst                   handover.py:43: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/01_bts0_started: pass (184.7s)
14:29:07.529219 tst                      handover.py: using MSISDN 13220
14:29:07.724938 bus                        /sierra_2: Setting Powered True
14:29:11.241135 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015252', msisdn='13220', subscriber_id=1}
14:29:11.409867 tst                      handover.py: using MSISDN 13221
14:29:11.613596 bus                        /sierra_3: Setting Powered True
14:29:15.152516 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015253', msisdn='13221', subscriber_id=2}
14:29:15.474750 bus                        /sierra_2: Setting Online False
14:29:16.687906 bus                        /sierra_2: Setting Powered False
14:29:22.876787 bus                        /sierra_2: Setting Powered True
14:29:24.281989 bus                        /sierra_2: Setting Online True
14:29:26.909105 tst                        /sierra_2: Connect to ('901', '70')
14:29:27.271063 bus                        /sierra_3: Setting Online False
14:29:28.491023 bus                        /sierra_3: Setting Powered False
14:29:34.872805 bus                        /sierra_3: Setting Powered True
14:29:36.261632 bus                        /sierra_3: Setting Online True
14:29:38.835695 tst                        /sierra_3: Connect to ('901', '70')
14:29:39.018436 tst                        /sierra_2: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054228053'
14:29:39.149157 tst                        /sierra_3: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054229028'
14:29:39.359219 tst                   handover.py:54: waiting for modems to attach...
14:29:42.102803 tst                        /sierra_2: Already registered with network ('901', '70')
14:29:45.669437 tst                   handover.py:57: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/02.1_ms0_attach: pass (6.1s)
14:29:53.749606 tst                        /sierra_3: Already registered with network ('901', '70')
14:29:57.344123 tst                   handover.py:60: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/02.2_ms1_attach: pass (11.4s)
14:29:58.884723 tst                   handover.py:63: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/02.3_subscribed_in_msc: pass (1.3s)
14:30:03.510717 tst                   handover.py:68: dial success
14:30:06.223876 tst                   handover.py:75: answer success, call established and ongoing
14:30:06.527257 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
14:30:06.744534 tst                   handover.py:79: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/03_call_established: pass (3.0s)
14:30:06.890941 run                     osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
14:30:07.363988 run                     osmo-trx-lms: OSMOTRX CONF: {'osmo_trx': {'launch_trx': 'True', 'remote_user': 'jenkins', 'channels': [{'rx_path': 'LNAW'}], 'egprs': 'disable', 'type': 'lms', 'bts_ip': '10.42.42.53', 'trx_ip': '10.42.42.117', 'clock_reference': 'external', 'dev_args': 'LimeSDR-USB,serial=00090706024F0A22'}}
14:30:07.994152 run               uname-m(pid=11522): Launched
14:30:09.234223 run               uname-m(pid=11522): Terminated: ok {rc=0}
14:30:10.494601 run         rm-remote-dir(pid=11523): Launched
14:30:11.732850 run         rm-remote-dir(pid=11523): Terminated: ok {rc=0}
14:30:12.147914 run         mk-remote-dir(pid=11524): Launched
14:30:13.387374 run         mk-remote-dir(pid=11524): Terminated: ok {rc=0}
14:30:13.792537 run         mk-remote-dir(pid=11525): Launched
14:30:15.011704 run         mk-remote-dir(pid=11525): Terminated: ok {rc=0}
14:30:15.334697 run    scp-inst-to-remote(pid=11526): Launched
14:30:17.571021 run    scp-inst-to-remote(pid=11526): Terminated: ok {rc=0}
14:30:17.972814 run         mk-remote-dir(pid=11528): Launched
14:30:19.192721 run         mk-remote-dir(pid=11528): Terminated: ok {rc=0}
14:30:19.536071 run     scp-cfg-to-remote(pid=11529): Launched
14:30:20.774978 run     scp-cfg-to-remote(pid=11529): Terminated: ok {rc=0}
14:30:21.191524 run         mk-remote-dir(pid=11531): Launched
14:30:22.432144 run         mk-remote-dir(pid=11531): Terminated: ok {rc=0}
14:30:22.787670 run scp-wrapper-to-remote(pid=11532): Launched
14:30:24.026548 run scp-wrapper-to-remote(pid=11532): Terminated: ok {rc=0}
14:30:24.426840 run          osmo-trx-lms(pid=11534): Launched
14:30:24.563325 run                     osmo-bts-trx: Waiting for osmo-trx-lms to start up...
14:30:27.824969 run          osmo-bts-trx(pid=11535): Launched
14:30:30.382406 tst                   handover.py:84: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/04.1_bts1_started: pass (23.4s)
14:30:30.663837 tst                   handover.py:86: wait a bit for modems to see bts1
14:30:40.947314 tst                   handover.py:89: starting the second BTS probably took a while, check on the ongoing call
14:30:41.306797 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
14:30:41.728482 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
14:30:43.134386 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
14:30:45.970105 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
14:30:46.418452 tst                  handover.py:120: wait for handover counters to change...
14:30:50.580297 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
14:30:50.901011 tst                  handover.py:124: 
�[1;35m20201207143046099 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207143046099 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207143046100 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207143046100 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207143046100 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207143046100 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207143046100 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207143046101 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207143046101 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207143046106 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207143046106 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207143046482 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207143046482 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207143046482 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207143046482 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207143046482 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207143046482 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207143046482 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207143046483 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207143046483 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207143046483 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ea0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
14:30:51.294522 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
14:30:51.455855 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-164↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
14:30:51.731705 tst                  handover.py:129: did not work, try again... (attempts left: 4)
14:30:52.127610 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
14:30:53.521512 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
14:30:56.366819 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
14:30:56.811063 tst                  handover.py:120: wait for handover counters to change...
14:31:01.012146 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
14:31:01.327756 tst                  handover.py:124: 
�[1;35m20201207143056495 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207143056495 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207143056495 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207143056495 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207143056495 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207143056496 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207143056496 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207143056496 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207143056496 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207143056501 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207143056501 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207143056861 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207143056861 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207143056861 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207143056861 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207143056862 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207143056862 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207143056862 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207143056862 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207143056863 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207143056863 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000013ba0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
14:31:01.718795 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
14:31:01.881365 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-164↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
14:31:02.160281 tst                  handover.py:129: did not work, try again... (attempts left: 3)
14:31:02.554504 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
14:31:03.949923 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
14:31:06.819314 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
14:31:07.263303 tst                  handover.py:120: wait for handover counters to change...
14:31:11.443099 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
14:31:11.760858 tst                  handover.py:124: 
�[1;35m20201207143106947 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207143106947 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207143106947 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207143106947 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207143106947 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207143106947 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207143106947 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207143106947 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207143106947 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207143106952 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207143106952 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207143107302 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207143107302 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207143107302 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207143107302 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207143107302 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207143107303 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207143107303 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207143107304 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207143107304 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207143107304 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000138a0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
14:31:12.155193 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
14:31:12.316447 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-164↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
14:31:12.593803 tst                  handover.py:129: did not work, try again... (attempts left: 2)
14:31:12.985868 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
14:31:14.384184 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
14:31:17.211963 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
14:31:17.658643 tst                  handover.py:120: wait for handover counters to change...
14:31:21.817213 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
14:31:22.134229 tst                  handover.py:124: 
�[1;35m20201207143117340 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207143117340 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207143117340 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207143117340 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207143117340 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207143117341 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207143117341 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207143117341 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207143117341 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207143117345 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207143117345 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207143117723 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207143117723 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207143117723 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207143117723 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207143117723 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207143117723 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207143117723 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207143117725 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207143117725 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207143117725 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000135a0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
14:31:22.527320 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
14:31:22.687490 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-164↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
14:31:22.964584 tst                  handover.py:129: did not work, try again... (attempts left: 1)
14:31:23.357086 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
14:31:24.750076 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
14:31:27.594093 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
14:31:28.042152 tst                  handover.py:120: wait for handover counters to change...
14:31:32.201144 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
14:31:32.466696 tst                  handover.py:124: 
�[1;35m20201207143127722 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207143127722 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x612000016ea0] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207143127722 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207143127722 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207143127722 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207143127723 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207143127723 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207143127723 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207143127723 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207143127727 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207143127727 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207143128103 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207143128103 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207143128103 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207143128103 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207143128103 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207143128103 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207143128103 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2e31812d) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207143128104 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207143128104 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207143128104 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn5_subscr-IMSI-901700000015252-TMSI-0x2e31812d)[0x6120000132a0]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
14:31:32.794818 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
14:31:32.928806 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-164↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
14:31:33.161265 tst                  handover.py:129: did not work, try again... (attempts left: 0)
14:31:33.218013 tst                  handover.py:146: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/05.1_handover_ms0: FAIL (51.8s)
14:31:33.225674 tst                  handover.py:146: ERR: AssertionError: handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),  [trial-164↪handover_2G:nanobts+bts1-trx-lms↪handover.py:146]
14:31:33.231623 tst                  handover.py:146: Test FAILED (344.2 sec)
14:31:33.273227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11490): Terminating (SIGTERM)
14:31:33.322419 run   osmo-hlr_10.42.42.2(pid=11491): Terminating (SIGTERM)
14:31:33.372276 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11492): Terminating (SIGTERM)
14:31:33.424854 run   osmo-stp_10.42.42.5(pid=11493): Terminating (SIGTERM)
14:31:33.481429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11494): Terminating (SIGTERM)
14:31:33.534121 run   osmo-msc_10.42.42.6(pid=11495): Terminating (SIGTERM)
14:31:33.583036 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11496): Terminating (SIGTERM)
14:31:33.631543 run   osmo-mgw_10.42.42.3(pid=11497): Terminating (SIGTERM)
14:31:33.680878 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11498): Terminating (SIGTERM)
14:31:33.729401 run   osmo-mgw_10.42.42.4(pid=11499): Terminating (SIGTERM)
14:31:33.778991 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11500): Terminating (SIGTERM)
14:31:33.828132 run   osmo-bsc_10.42.42.7(pid=11501): Terminating (SIGTERM)
14:31:33.876922 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=11502): Terminating (SIGTERM)
14:31:33.926018 run          osmo-trx-lms(pid=11534): Terminating (SIGTERM)
14:31:33.974620 run          osmo-bts-trx(pid=11535): Terminating (SIGTERM)
14:31:33.985710 ---      ParallelTerminationStrategy: PID 11490 died...
14:31:34.050723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11490): Terminated: ok {rc=0}
14:31:34.062402 ---      ParallelTerminationStrategy: PID 11491 died...
14:31:34.127311 run   osmo-hlr_10.42.42.2(pid=11491): Terminated: ok {rc=0}
14:31:34.138938 ---      ParallelTerminationStrategy: PID 11492 died...
14:31:34.203183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11492): Terminated: ok {rc=0}
14:31:34.214766 ---      ParallelTerminationStrategy: PID 11493 died...
14:31:34.280807 run   osmo-stp_10.42.42.5(pid=11493): Terminated: ok {rc=0}
14:31:34.292528 ---      ParallelTerminationStrategy: PID 11494 died...
14:31:34.357155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11494): Terminated: ok {rc=0}
14:31:34.368862 ---      ParallelTerminationStrategy: PID 11496 died...
14:31:34.433052 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11496): Terminated: ok {rc=0}
14:31:34.444728 ---      ParallelTerminationStrategy: PID 11497 died...
14:31:34.509259 run   osmo-mgw_10.42.42.3(pid=11497): Terminated {rc=15}
14:31:34.520945 ---      ParallelTerminationStrategy: PID 11498 died...
14:31:34.585282 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11498): Terminated: ok {rc=0}
14:31:34.597290 ---      ParallelTerminationStrategy: PID 11499 died...
14:31:34.661686 run   osmo-mgw_10.42.42.4(pid=11499): Terminated {rc=15}
14:31:34.673388 ---      ParallelTerminationStrategy: PID 11500 died...
14:31:34.738029 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11500): Terminated: ok {rc=0}
14:31:34.749728 ---      ParallelTerminationStrategy: PID 11502 died...
14:31:34.814106 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=11502): Terminated: ok {rc=0}
14:31:34.825741 ---      ParallelTerminationStrategy: PID 11534 died...
14:31:34.890592 run          osmo-trx-lms(pid=11534): Terminated {rc=36608}
14:31:36.918686 ---      ParallelTerminationStrategy: PID 11495 died...
14:31:36.994999 run   osmo-msc_10.42.42.6(pid=11495): Terminated: ok {rc=0}
14:31:37.009326 ---      ParallelTerminationStrategy: PID 11501 died...
14:31:37.077720 run   osmo-bsc_10.42.42.7(pid=11501): Terminated: ok {rc=0}
14:31:40.937591 run          osmo-bts-trx(pid=11535): Terminating (SIGINT)
14:31:41.118549 ---      ParallelTerminationStrategy: PID 11535 died...
14:31:41.185067 run          osmo-bts-trx(pid=11535): Terminated: ok {rc=0}
14:31:41.343475 bus                        /sierra_3: Setting Online False
14:31:42.479857 bus                        /sierra_3: Setting Powered False
14:32:06.638268 bus                        /sierra_3: Setting Powered False
14:32:07.765578 bus                        /sierra_3: Setting Powered False
14:32:08.950548 bus                        /sierra_2: Setting Online False
14:32:10.101531 bus                        /sierra_2: Setting Powered False
14:32:15.635863 bus                        /sierra_2: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 673, in exec_module
  File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 146, in <module>
    not_expected=('0-0-2-0 TCH/F ESTABLISHED',),
AssertionError