Skip to content

Failed

handover_2G:nanobts+bts1-trx-lms.handover.py (from handover_2G_nanobts+bts1-trx-lms)

Failing for the past 20 builds (Since #140 )
Took 5 min 46 sec.

Stacktrace

handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),

Standard Output

----------------------------------------------
trial-159 handover_2G:nanobts+bts1-trx-lms handover.py
----------------------------------------------
23:28:55.011319 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
23:28:55.025314 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2)
23:28:55.163706 tst                      handover.py: using LAC 15997
23:28:55.297767 tst                      handover.py: using RAC 187
23:28:55.427207 tst                      handover.py: using CellId 15996
23:28:55.556882 tst                      handover.py: using BVCI 2675
23:28:55.583376 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2)
23:28:55.736522 tst                      handover.py: using LAC 15998
23:28:55.866357 tst                      handover.py: using RAC 188
23:28:55.996064 tst                      handover.py: using CellId 15997
23:28:56.125517 tst                      handover.py: using BVCI 2676
23:28:56.151161 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
23:28:56.164716 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
23:28:56.178092 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
23:28:56.191354 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
23:28:56.204711 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6)
23:28:56.218055 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2)
23:28:56.354081 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2)
23:28:56.909091 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
23:28:57.429965 run         create_hlr_db(pid=13770): Launched
23:28:57.709636 bus                        /sierra_2: Setting Powered False
23:28:58.664801 run         create_hlr_db(pid=13770): Terminated: ok {rc=0}
23:28:59.137453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13772): Launched
23:28:59.473545 run   osmo-hlr_10.42.42.2(pid=13773): Launched
23:28:59.593749 run              osmo-stp_10.42.42.5: Starting osmo-stp
23:29:00.150790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13774): Launched
23:29:00.487360 run   osmo-stp_10.42.42.5(pid=13775): Launched
23:29:00.607259 run              osmo-msc_10.42.42.6: Starting osmo-msc
23:29:01.196053 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13776): Launched
23:29:01.542074 run   osmo-msc_10.42.42.6(pid=13777): Launched
23:29:01.681426 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
23:29:02.283847 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13778): Launched
23:29:02.620143 run   osmo-mgw_10.42.42.3(pid=13779): Launched
23:29:02.740703 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
23:29:03.287335 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13780): Launched
23:29:03.635261 run   osmo-mgw_10.42.42.4(pid=13781): Launched
23:29:03.763513 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
23:29:04.549025 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13782): Launched
23:29:04.895713 run   osmo-bsc_10.42.42.7(pid=13783): Launched
23:29:10.508527 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=13784): Launched
23:29:10.649322 run         nanobts_NanoBTS-ONW-1900: Finding nanobts 10.42.42.120, binding on 10.42.42.1...
23:29:10.952280 run   abisip-find-preconf(pid=13786): Launched
23:31:17.301709 run         nanobts_NanoBTS-ONW-1900: Found nanobts 10.42.42.120 with unit_id 9 trx 0
23:31:17.428955 run   abisip-find-preconf(pid=13786): Terminating (SIGINT)
23:31:17.780722 run   abisip-find-preconf(pid=13786): Terminated {rc=-2}
23:31:18.096581 run       ipaccess-config(pid=13793): Launched
23:31:19.315473 run       ipaccess-config(pid=13793): Terminated: ok {rc=0}
23:32:14.812179 run         nanobts_NanoBTS-ONW-1900: nanoBTS connected to BSC
23:32:16.258318 tst                   handover.py:43: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/01_bts0_started: pass (187.5s)
23:32:16.418532 tst                      handover.py: using MSISDN 12900
23:32:16.615372 bus                        /sierra_2: Setting Powered True
23:32:20.105250 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015252', msisdn='12900', subscriber_id=1}
23:32:20.263767 tst                      handover.py: using MSISDN 12901
23:32:22.571623 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015253', msisdn='12901', subscriber_id=2}
23:32:22.867807 bus                        /sierra_2: Setting Online False
23:32:24.081434 bus                        /sierra_2: Setting Powered False
23:32:29.842399 bus                        /sierra_2: Setting Powered True
23:32:31.220627 bus                        /sierra_2: Setting Online True
23:32:33.830627 tst                        /sierra_2: Connect to ('901', '70')
23:32:34.223914 bus                        /sierra_3: Setting Online False
23:32:35.479030 bus                        /sierra_3: Setting Powered False
23:32:41.839523 bus                        /sierra_3: Setting Powered True
23:32:43.368271 tst                        /sierra_2: Already registered with network ('901', '70')
23:32:45.228265 bus                        /sierra_3: Setting Online True
23:32:47.602763 tst                        /sierra_3: Connect to ('901', '70')
23:32:47.788046 tst                        /sierra_2: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054228053'
23:32:47.925321 tst                        /sierra_3: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054229028'
23:32:48.145083 tst                   handover.py:54: waiting for modems to attach...
23:32:51.479845 tst                   handover.py:57: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/02.1_ms0_attach: pass (3.1s)
23:32:58.161326 tst                        /sierra_3: Already registered with network ('901', '70')
23:33:06.170933 tst                   handover.py:60: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/02.2_ms1_attach: pass (14.4s)
23:33:07.734333 tst                   handover.py:63: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/02.3_subscribed_in_msc: pass (1.3s)
23:33:13.362026 tst                   handover.py:68: dial success
23:33:16.086137 tst                   handover.py:75: answer success, call established and ongoing
23:33:16.407337 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
23:33:16.639579 tst                   handover.py:79: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/03_call_established: pass (3.0s)
23:33:16.796402 run                     osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
23:33:17.299452 run                     osmo-trx-lms: OSMOTRX CONF: {'osmo_trx': {'clock_reference': 'external', 'trx_ip': '10.42.42.117', 'dev_args': 'LimeSDR-USB,serial=00090706024F0A22', 'remote_user': 'jenkins', 'bts_ip': '10.42.42.53', 'channels': [{'rx_path': 'LNAW'}], 'egprs': 'disable', 'type': 'lms', 'launch_trx': 'True'}}
23:33:17.938908 run               uname-m(pid=13796): Launched
23:33:19.155034 run               uname-m(pid=13796): Terminated: ok {rc=0}
23:33:20.374566 run         rm-remote-dir(pid=13797): Launched
23:33:21.613068 run         rm-remote-dir(pid=13797): Terminated: ok {rc=0}
23:33:22.016790 run         mk-remote-dir(pid=13798): Launched
23:33:23.234092 run         mk-remote-dir(pid=13798): Terminated: ok {rc=0}
23:33:23.613233 run         mk-remote-dir(pid=13799): Launched
23:33:24.828164 run         mk-remote-dir(pid=13799): Terminated: ok {rc=0}
23:33:25.158650 run    scp-inst-to-remote(pid=13800): Launched
23:33:27.378686 run    scp-inst-to-remote(pid=13800): Terminated: ok {rc=0}
23:33:27.765931 run         mk-remote-dir(pid=13802): Launched
23:33:28.997001 run         mk-remote-dir(pid=13802): Terminated: ok {rc=0}
23:33:29.341217 run     scp-cfg-to-remote(pid=13803): Launched
23:33:30.559224 run     scp-cfg-to-remote(pid=13803): Terminated: ok {rc=0}
23:33:30.952077 run         mk-remote-dir(pid=13806): Launched
23:33:32.187674 run         mk-remote-dir(pid=13806): Terminated: ok {rc=0}
23:33:32.540378 run scp-wrapper-to-remote(pid=13807): Launched
23:33:33.773937 run scp-wrapper-to-remote(pid=13807): Terminated: ok {rc=0}
23:33:34.157030 run          osmo-trx-lms(pid=13809): Launched
23:33:34.280519 run                     osmo-bts-trx: Waiting for osmo-trx-lms to start up...
23:33:35.612893 run          osmo-bts-trx(pid=13810): Launched
23:33:38.187645 tst                   handover.py:84: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/04.1_bts1_started: pass (21.3s)
23:33:38.466348 tst                   handover.py:86: wait a bit for modems to see bts1
23:33:48.743271 tst                   handover.py:89: starting the second BTS probably took a while, check on the ongoing call
23:33:49.095918 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
23:33:49.511414 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
23:33:50.988203 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
23:33:53.728118 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
23:33:54.169637 tst                  handover.py:120: wait for handover counters to change...
23:33:58.287132 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
23:33:58.598708 tst                  handover.py:124: 
�[1;35m20201206233353853 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201206233353853 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201206233353853 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201206233353854 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201206233353854 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201206233353855 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201206233353855 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201206233353855 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201206233353855 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201206233353861 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201206233353861 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201206233354218 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201206233354218 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201206233354218 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201206233354218 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201206233354218 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201206233354218 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201206233354218 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201206233354220 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201206233354220 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201206233354220 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014320]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
23:33:58.986332 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
23:33:59.144946 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-159↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
23:33:59.418132 tst                  handover.py:129: did not work, try again... (attempts left: 4)
23:33:59.802087 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
23:34:01.191077 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
23:34:04.135175 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
23:34:04.624527 tst                  handover.py:120: wait for handover counters to change...
23:34:08.741221 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
23:34:09.053767 tst                  handover.py:124: 
�[1;35m20201206233404272 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201206233404272 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201206233404272 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201206233404272 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201206233404272 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201206233404273 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201206233404273 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201206233404273 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201206233404273 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201206233404277 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201206233404278 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201206233404657 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201206233404658 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201206233404658 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201206233404658 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201206233404658 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201206233404658 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201206233404658 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201206233404659 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201206233404659 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201206233404659 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000014020]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
23:34:09.445157 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
23:34:09.602476 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-159↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
23:34:09.874870 tst                  handover.py:129: did not work, try again... (attempts left: 3)
23:34:10.261728 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
23:34:11.649092 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
23:34:14.437941 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
23:34:14.872949 tst                  handover.py:120: wait for handover counters to change...
23:34:18.996030 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
23:34:19.307379 tst                  handover.py:124: 
�[1;35m20201206233414565 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201206233414565 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201206233414565 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201206233414565 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201206233414565 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201206233414566 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201206233414566 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201206233414566 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201206233414566 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201206233414570 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201206233414570 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201206233414920 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201206233414920 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201206233414920 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201206233414920 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201206233414920 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201206233414921 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201206233414921 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201206233414922 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201206233414922 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201206233414922 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013d20]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
23:34:19.691975 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
23:34:19.849049 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-159↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
23:34:20.121708 tst                  handover.py:129: did not work, try again... (attempts left: 2)
23:34:20.507045 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
23:34:21.896185 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
23:34:24.678735 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
23:34:25.114981 tst                  handover.py:120: wait for handover counters to change...
23:34:29.238316 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
23:34:29.547444 tst                  handover.py:124: 
�[1;35m20201206233424806 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201206233424806 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201206233424806 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201206233424806 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201206233424806 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201206233424807 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201206233424807 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201206233424807 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201206233424807 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201206233424811 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201206233424811 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201206233425177 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201206233425177 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201206233425178 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201206233425178 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201206233425178 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201206233425178 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201206233425178 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201206233425179 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201206233425179 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201206233425179 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013a20]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
23:34:29.932964 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
23:34:30.090431 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-159↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
23:34:30.364681 tst                  handover.py:129: did not work, try again... (attempts left: 1)
23:34:30.807951 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
23:34:32.205728 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
23:34:35.005205 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
23:34:35.441708 tst                  handover.py:120: wait for handover counters to change...
23:34:39.559754 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
23:34:39.869699 tst                  handover.py:124: 
�[1;35m20201206233435130 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201206233435130 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201206233435130 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201206233435130 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201206233435130 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201206233435130 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201206233435131 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201206233435131 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201206233435131 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201206233435135 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201206233435135 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201206233435497 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201206233435498 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201206233435498 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201206233435498 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201206233435498 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201206233435498 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201206233435498 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x2d7f2d27) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201206233435500 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201206233435500 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201206233435500 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x2d7f2d27)[0x612000013720]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
23:34:40.257743 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
23:34:40.414382 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-159↪handover_2G:nanobts+bts1-trx-lms↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
23:34:40.687509 tst                  handover.py:129: did not work, try again... (attempts left: 0)
23:34:40.753397 tst                  handover.py:146: ----- Report fragment: handover_2G:nanobts+bts1-trx-lms/handover.py/05.1_handover_ms0: FAIL (51.6s)
23:34:40.762766 tst                  handover.py:146: ERR: AssertionError: handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),  [trial-159↪handover_2G:nanobts+bts1-trx-lms↪handover.py:146]
23:34:40.770206 tst                  handover.py:146: Test FAILED (345.8 sec)
23:34:40.817980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13772): Terminating (SIGTERM)
23:34:40.873556 run   osmo-hlr_10.42.42.2(pid=13773): Terminating (SIGTERM)
23:34:40.929279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13774): Terminating (SIGTERM)
23:34:40.988628 run   osmo-stp_10.42.42.5(pid=13775): Terminating (SIGTERM)
23:34:41.054271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13776): Terminating (SIGTERM)
23:34:41.120669 run   osmo-msc_10.42.42.6(pid=13777): Terminating (SIGTERM)
23:34:41.176788 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13778): Terminating (SIGTERM)
23:34:41.231235 run   osmo-mgw_10.42.42.3(pid=13779): Terminating (SIGTERM)
23:34:41.287167 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13780): Terminating (SIGTERM)
23:34:41.341763 run   osmo-mgw_10.42.42.4(pid=13781): Terminating (SIGTERM)
23:34:41.396900 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13782): Terminating (SIGTERM)
23:34:41.451335 run   osmo-bsc_10.42.42.7(pid=13783): Terminating (SIGTERM)
23:34:41.506778 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=13784): Terminating (SIGTERM)
23:34:41.561497 run          osmo-trx-lms(pid=13809): Terminating (SIGTERM)
23:34:41.614018 run          osmo-bts-trx(pid=13810): Terminating (SIGTERM)
23:34:41.625766 ---      ParallelTerminationStrategy: PID 13772 died...
23:34:41.693945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13772): Terminated: ok {rc=0}
23:34:41.706181 ---      ParallelTerminationStrategy: PID 13773 died...
23:34:41.773947 run   osmo-hlr_10.42.42.2(pid=13773): Terminated: ok {rc=0}
23:34:41.786658 ---      ParallelTerminationStrategy: PID 13774 died...
23:34:41.854561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13774): Terminated: ok {rc=0}
23:34:41.866925 ---      ParallelTerminationStrategy: PID 13775 died...
23:34:41.935322 run   osmo-stp_10.42.42.5(pid=13775): Terminated: ok {rc=0}
23:34:41.948227 ---      ParallelTerminationStrategy: PID 13776 died...
23:34:42.016617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13776): Terminated: ok {rc=0}
23:34:42.029458 ---      ParallelTerminationStrategy: PID 13778 died...
23:34:42.097938 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13778): Terminated: ok {rc=0}
23:34:42.110223 ---      ParallelTerminationStrategy: PID 13779 died...
23:34:42.178712 run   osmo-mgw_10.42.42.3(pid=13779): Terminated {rc=15}
23:34:42.190863 ---      ParallelTerminationStrategy: PID 13780 died...
23:34:42.260862 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13780): Terminated: ok {rc=0}
23:34:42.273544 ---      ParallelTerminationStrategy: PID 13781 died...
23:34:42.342091 run   osmo-mgw_10.42.42.4(pid=13781): Terminated {rc=15}
23:34:42.354482 ---      ParallelTerminationStrategy: PID 13782 died...
23:34:42.422515 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13782): Terminated: ok {rc=0}
23:34:42.434792 ---      ParallelTerminationStrategy: PID 13784 died...
23:34:42.503270 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=13784): Terminated: ok {rc=0}
23:34:42.515947 ---      ParallelTerminationStrategy: PID 13809 died...
23:34:42.590956 run          osmo-trx-lms(pid=13809): Terminated {rc=36608}
23:34:44.622016 ---      ParallelTerminationStrategy: PID 13777 died...
23:34:44.687414 run   osmo-msc_10.42.42.6(pid=13777): Terminated: ok {rc=0}
23:34:44.698957 ---      ParallelTerminationStrategy: PID 13783 died...
23:34:44.762357 run   osmo-bsc_10.42.42.7(pid=13783): Terminated: ok {rc=0}
23:34:48.618760 run          osmo-bts-trx(pid=13810): Terminating (SIGINT)
23:34:48.798037 ---      ParallelTerminationStrategy: PID 13810 died...
23:34:48.863292 run          osmo-bts-trx(pid=13810): Terminated: ok {rc=0}
23:34:49.019273 bus                        /sierra_3: Setting Online False
23:34:50.157933 bus                        /sierra_3: Setting Powered False
23:35:01.634137 bus                        /sierra_3: Setting Powered False
23:35:02.756986 bus                        /sierra_3: Setting Powered False
23:35:03.941589 bus                        /sierra_2: Setting Online False
23:35:05.130281 bus                        /sierra_2: Setting Powered False
23:35:10.644517 bus                        /sierra_2: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 673, in exec_module
  File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 146, in <module>
    not_expected=('0-0-2-0 TCH/F ESTABLISHED',),
AssertionError