Skip to content

Failed

handover_2G:nanobts+bts1-trx-lms.handover.py (from handover_2G_nanobts+bts1-trx-lms)

Failing for the past 22 builds (Since #140 )
Took 5 min 39 sec.

Stacktrace

handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),

Standard Output

----------------------------------------------
trial-161 handover_2G:nanobts+bts1-trx-lms handover.py
----------------------------------------------
06:54:51.024833 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
06:54:51.038592 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2)
06:54:51.191623 tst                      handover.py: using LAC 16165
06:54:51.333190 tst                      handover.py: using RAC 100
06:54:51.471804 tst                      handover.py: using CellId 16164
06:54:51.601857 tst                      handover.py: using BVCI 2843
06:54:51.627688 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2)
06:54:51.782039 tst                      handover.py: using LAC 16166
06:54:51.911264 tst                      handover.py: using RAC 101
06:54:52.041298 tst                      handover.py: using CellId 16165
06:54:52.170284 tst                      handover.py: using BVCI 2844
06:54:52.196186 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
06:54:52.210153 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
06:54:52.224183 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
06:54:52.238009 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
06:54:52.251728 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
06:54:52.265517 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2)
06:54:52.401362 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2)
06:54:52.947229 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
06:54:53.448043 run         create_hlr_db(pid=31705): Launched
06:54:53.710978 bus                        /sierra_2: Setting Powered False
06:54:54.669195 run         create_hlr_db(pid=31705): Terminated: ok {rc=0}
06:54:55.132786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31707): Launched
06:54:55.469358 run   osmo-hlr_10.42.42.2(pid=31708): Launched
06:54:55.588688 run              osmo-stp_10.42.42.5: Starting osmo-stp
06:54:56.142547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31709): Launched
06:54:56.484229 run   osmo-stp_10.42.42.5(pid=31710): Launched
06:54:56.609589 run              osmo-msc_10.42.42.6: Starting osmo-msc
06:54:57.225024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31711): Launched
06:54:57.572505 run   osmo-msc_10.42.42.6(pid=31712): Launched
06:54:57.693421 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
06:54:58.260437 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31713): Launched
06:54:58.612882 run   osmo-mgw_10.42.42.3(pid=31714): Launched
06:54:58.737804 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
06:54:59.305732 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31715): Launched
06:54:59.649230 run   osmo-mgw_10.42.42.4(pid=31716): Launched
06:54:59.774431 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
06:55:00.576814 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31717): Launched
06:55:00.911911 run   osmo-bsc_10.42.42.7(pid=31718): Launched
06:55:06.502598 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=31722): Launched
06:55:06.641875 run         nanobts_NanoBTS-ONW-1900: Finding nanobts 10.42.42.120, binding on 10.42.42.1...
06:55:06.934792 run   abisip-find-preconf(pid=31724): Launched
06:57:18.386863 run         nanobts_NanoBTS-ONW-1900: Found nanobts 10.42.42.120 with unit_id 9 trx 0
06:57:18.513213 run   abisip-find-preconf(pid=31724): Terminating (SIGINT)
06:57:18.863890 run   abisip-find-preconf(pid=31724): Terminated {rc=-2}
06:57:19.168296 run       ipaccess-config(pid=31729): Launched
06:57:20.375466 run       ipaccess-config(pid=31729): Terminated: ok {rc=0}
06:58:07.854521 run         nanobts_NanoBTS-ONW-1900: nanoBTS connected to BSC
06:58:09.300792 tst                   handover.py:43: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/01_bts0_started: pass (184.6s)
06:58:09.458621 tst                      handover.py: using MSISDN 13056
06:58:09.654119 bus                        /sierra_2: Setting Powered True
06:58:13.177584 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015252', msisdn='13056', subscriber_id=1}
06:58:13.335506 tst                      handover.py: using MSISDN 13057
06:58:15.639027 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015253', msisdn='13057', subscriber_id=2}
06:58:15.947486 bus                        /sierra_2: Setting Online False
06:58:17.152511 bus                        /sierra_2: Setting Powered False
06:58:22.894639 bus                        /sierra_2: Setting Powered True
06:58:24.287524 bus                        /sierra_2: Setting Online True
06:58:26.881864 tst                        /sierra_2: Connect to ('901', '70')
06:58:27.346544 bus                        /sierra_3: Setting Online False
06:58:28.617918 bus                        /sierra_3: Setting Powered False
06:58:34.841035 bus                        /sierra_3: Setting Powered True
06:58:35.213177 tst                        /sierra_2: Already registered with network ('901', '70')
06:58:38.060311 bus                        /sierra_3: Setting Online True
06:58:40.427797 tst                        /sierra_3: Connect to ('901', '70')
06:58:40.609528 tst                        /sierra_2: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054228053'
06:58:40.742708 tst                        /sierra_3: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054229028'
06:58:40.958389 tst                   handover.py:54: waiting for modems to attach...
06:58:44.258416 tst                   handover.py:57: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/02.1_ms0_attach: pass (3.1s)
06:58:50.663649 tst                        /sierra_3: Already registered with network ('901', '70')
06:58:58.591779 tst                   handover.py:60: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/02.2_ms1_attach: pass (14.1s)
06:59:00.149314 tst                   handover.py:63: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/02.3_subscribed_in_msc: pass (1.3s)
06:59:04.747110 tst                   handover.py:68: dial success
06:59:07.437445 tst                   handover.py:75: answer success, call established and ongoing
06:59:07.749418 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
06:59:07.976691 tst                   handover.py:79: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/03_call_established: pass (3.0s)
06:59:08.130073 run                     osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
06:59:08.626686 run                     osmo-trx-lms: OSMOTRX CONF: {'osmo_trx': {'remote_user': 'jenkins', 'launch_trx': 'True', 'dev_args': 'LimeSDR-USB,serial=00090706024F0A22', 'type': 'lms', 'channels': [{'rx_path': 'LNAW'}], 'trx_ip': '10.42.42.117', 'egprs': 'disable', 'clock_reference': 'external', 'bts_ip': '10.42.42.53'}}
06:59:09.258500 run               uname-m(pid=31735): Launched
06:59:10.474370 run               uname-m(pid=31735): Terminated: ok {rc=0}
06:59:11.661361 run         rm-remote-dir(pid=31736): Launched
06:59:12.876749 run         rm-remote-dir(pid=31736): Terminated: ok {rc=0}
06:59:13.271507 run         mk-remote-dir(pid=31737): Launched
06:59:14.503586 run         mk-remote-dir(pid=31737): Terminated: ok {rc=0}
06:59:14.893236 run         mk-remote-dir(pid=31738): Launched
06:59:16.106603 run         mk-remote-dir(pid=31738): Terminated: ok {rc=0}
06:59:16.436677 run    scp-inst-to-remote(pid=31739): Launched
06:59:18.651756 run    scp-inst-to-remote(pid=31739): Terminated: ok {rc=0}
06:59:19.038065 run         mk-remote-dir(pid=31741): Launched
06:59:20.274848 run         mk-remote-dir(pid=31741): Terminated: ok {rc=0}
06:59:20.608678 run     scp-cfg-to-remote(pid=31742): Launched
06:59:21.824316 run     scp-cfg-to-remote(pid=31742): Terminated: ok {rc=0}
06:59:22.215508 run         mk-remote-dir(pid=31744): Launched
06:59:23.448422 run         mk-remote-dir(pid=31744): Terminated: ok {rc=0}
06:59:23.791847 run scp-wrapper-to-remote(pid=31745): Launched
06:59:25.006978 run scp-wrapper-to-remote(pid=31745): Terminated: ok {rc=0}
06:59:25.377056 run          osmo-trx-lms(pid=31747): Launched
06:59:25.509675 run                     osmo-bts-trx: Waiting for osmo-trx-lms to start up...
06:59:26.844991 run          osmo-bts-trx(pid=31748): Launched
06:59:29.303190 tst                   handover.py:84: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/04.1_bts1_started: pass (21.1s)
06:59:29.533738 tst                   handover.py:86: wait a bit for modems to see bts1
06:59:39.765731 tst                   handover.py:89: starting the second BTS probably took a while, check on the ongoing call
06:59:40.061959 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
06:59:40.407088 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
06:59:41.730714 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
06:59:44.055284 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
06:59:44.419372 tst                  handover.py:120: wait for handover counters to change...
06:59:48.403523 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
06:59:48.732895 tst                  handover.py:124: 
�[1;35m20201207065944160 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207065944160 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207065944160 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207065944160 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207065944161 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207065944161 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207065944161 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207065944162 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207065944162 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207065944166 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207065944166 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207065944546 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207065944546 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207065944546 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207065944546 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207065944546 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207065944547 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207065944547 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207065944548 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207065944548 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207065944548 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014320]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
06:59:49.142734 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
06:59:49.311199 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-161↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
06:59:49.598602 tst                  handover.py:129: did not work, try again... (attempts left: 4)
06:59:50.006379 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
06:59:51.473125 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
06:59:53.880317 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
06:59:54.242067 tst                  handover.py:120: wait for handover counters to change...
06:59:57.826384 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
06:59:58.080849 tst                  handover.py:124: 
�[1;35m20201207065953984 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207065953984 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207065953984 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207065953985 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207065953985 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207065953985 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207065953985 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207065953985 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207065953985 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207065953989 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207065953989 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207065954368 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207065954368 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207065954368 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207065954368 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207065954368 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207065954368 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207065954368 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207065954369 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207065954369 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207065954369 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000014020]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
06:59:58.400640 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
06:59:58.535467 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-161↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
06:59:58.821983 tst                  handover.py:129: did not work, try again... (attempts left: 3)
06:59:59.231264 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:00:00.614871 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
07:00:03.427145 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
07:00:03.786372 tst                  handover.py:120: wait for handover counters to change...
07:00:07.841390 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
07:00:08.144893 tst                  handover.py:124: 
�[1;35m20201207070003532 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207070003532 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207070003532 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207070003532 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207070003532 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207070003533 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207070003533 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207070003533 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207070003533 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207070003537 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207070003537 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207070003907 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207070003907 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207070003907 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207070003907 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207070003907 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207070003908 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207070003908 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207070003909 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207070003910 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207070003910 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013d20]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
07:00:08.523495 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
07:00:08.678902 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-161↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
07:00:08.946465 tst                  handover.py:129: did not work, try again... (attempts left: 2)
07:00:09.324314 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:00:10.703729 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
07:00:13.435183 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
07:00:13.864718 tst                  handover.py:120: wait for handover counters to change...
07:00:18.188737 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
07:00:18.493274 tst                  handover.py:124: 
�[1;35m20201207070013560 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207070013560 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207070013560 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207070013560 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207070013561 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207070013561 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207070013561 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207070013561 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207070013561 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207070013565 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207070013565 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207070013946 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207070013946 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207070013946 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207070013946 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207070013946 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207070013947 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207070013947 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207070013948 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207070013948 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207070013948 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013a20]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
07:00:18.870219 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
07:00:19.024203 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-161↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
07:00:19.290691 tst                  handover.py:129: did not work, try again... (attempts left: 1)
07:00:19.669171 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:00:21.052456 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
07:00:23.778512 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
07:00:24.208832 tst                  handover.py:120: wait for handover counters to change...
07:00:28.117425 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
07:00:28.374943 tst                  handover.py:124: 
�[1;35m20201207070023901 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207070023901 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207070023901 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207070023901 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207070023902 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207070023903 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207070023903 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207070023903 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207070023903 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207070023909 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207070023909 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207070024266 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207070024266 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207070024266 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207070024266 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207070024267 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207070024267 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207070024267 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x1fefa4a1) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207070024268 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207070024268 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207070024268 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x1fefa4a1)[0x612000013720]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
07:00:28.694050 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
07:00:28.824137 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-161↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
07:00:29.048594 tst                  handover.py:129: did not work, try again... (attempts left: 0)
07:00:29.103822 tst                  handover.py:146: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/05.1_handover_ms0: FAIL (49.0s)
07:00:29.111951 tst                  handover.py:146: ERR: AssertionError: handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),  [trial-161↪handover_2G:nanobts+bts1-trx-lms↪handover.py:146]
07:00:29.119039 tst                  handover.py:146: Test FAILED (338.1 sec)
07:00:29.160858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31707): Terminating (SIGTERM)
07:00:29.209181 run   osmo-hlr_10.42.42.2(pid=31708): Terminating (SIGTERM)
07:00:29.258343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31709): Terminating (SIGTERM)
07:00:29.308768 run   osmo-stp_10.42.42.5(pid=31710): Terminating (SIGTERM)
07:00:29.369071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31711): Terminating (SIGTERM)
07:00:29.428840 run   osmo-msc_10.42.42.6(pid=31712): Terminating (SIGTERM)
07:00:29.478019 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31713): Terminating (SIGTERM)
07:00:29.527970 run   osmo-mgw_10.42.42.3(pid=31714): Terminating (SIGTERM)
07:00:29.578305 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31715): Terminating (SIGTERM)
07:00:29.627894 run   osmo-mgw_10.42.42.4(pid=31716): Terminating (SIGTERM)
07:00:29.678239 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31717): Terminating (SIGTERM)
07:00:29.727667 run   osmo-bsc_10.42.42.7(pid=31718): Terminating (SIGTERM)
07:00:29.777306 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=31722): Terminating (SIGTERM)
07:00:29.826755 run          osmo-trx-lms(pid=31747): Terminating (SIGTERM)
07:00:29.876294 run          osmo-bts-trx(pid=31748): Terminating (SIGTERM)
07:00:29.887540 ---      ParallelTerminationStrategy: PID 31707 died...
07:00:29.953139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31707): Terminated: ok {rc=0}
07:00:29.964950 ---      ParallelTerminationStrategy: PID 31708 died...
07:00:30.030337 run   osmo-hlr_10.42.42.2(pid=31708): Terminated: ok {rc=0}
07:00:30.042380 ---      ParallelTerminationStrategy: PID 31709 died...
07:00:30.107697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31709): Terminated: ok {rc=0}
07:00:30.119425 ---      ParallelTerminationStrategy: PID 31710 died...
07:00:30.184968 run   osmo-stp_10.42.42.5(pid=31710): Terminated: ok {rc=0}
07:00:30.196712 ---      ParallelTerminationStrategy: PID 31711 died...
07:00:30.261875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31711): Terminated: ok {rc=0}
07:00:30.273646 ---      ParallelTerminationStrategy: PID 31713 died...
07:00:30.338827 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31713): Terminated: ok {rc=0}
07:00:30.350604 ---      ParallelTerminationStrategy: PID 31714 died...
07:00:30.416587 run   osmo-mgw_10.42.42.3(pid=31714): Terminated {rc=15}
07:00:30.428418 ---      ParallelTerminationStrategy: PID 31715 died...
07:00:30.494352 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31715): Terminated: ok {rc=0}
07:00:30.506232 ---      ParallelTerminationStrategy: PID 31716 died...
07:00:30.571435 run   osmo-mgw_10.42.42.4(pid=31716): Terminated {rc=15}
07:00:30.583339 ---      ParallelTerminationStrategy: PID 31717 died...
07:00:30.649130 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31717): Terminated: ok {rc=0}
07:00:30.661115 ---      ParallelTerminationStrategy: PID 31722 died...
07:00:30.726563 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=31722): Terminated: ok {rc=0}
07:00:30.738414 ---      ParallelTerminationStrategy: PID 31747 died...
07:00:30.803814 run          osmo-trx-lms(pid=31747): Terminated {rc=36608}
07:00:32.833581 ---      ParallelTerminationStrategy: PID 31712 died...
07:00:32.910855 run   osmo-msc_10.42.42.6(pid=31712): Terminated: ok {rc=0}
07:00:32.922664 ---      ParallelTerminationStrategy: PID 31718 died...
07:00:32.986453 run   osmo-bsc_10.42.42.7(pid=31718): Terminated: ok {rc=0}
07:00:36.843431 run          osmo-bts-trx(pid=31748): Terminating (SIGINT)
07:00:37.022655 ---      ParallelTerminationStrategy: PID 31748 died...
07:00:37.088611 run          osmo-bts-trx(pid=31748): Terminated: ok {rc=0}
07:00:37.249029 bus                        /sierra_3: Setting Online False
07:00:38.409559 bus                        /sierra_3: Setting Powered False
07:00:49.639908 bus                        /sierra_3: Setting Powered False
07:00:50.761086 bus                        /sierra_3: Setting Powered False
07:00:51.943054 bus                        /sierra_2: Setting Online False
07:00:53.092164 bus                        /sierra_2: Setting Powered False
07:00:58.643765 bus                        /sierra_2: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 673, in exec_module
  File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 146, in <module>
    not_expected=('0-0-2-0 TCH/F ESTABLISHED',),
AssertionError