Skip to content

Failed

handover_2G:nanobts+bts1-trx-b200.handover.py (from handover_2G_nanobts+bts1-trx-b200)

Failing for the past 22 builds (Since #140 )
Took 6 min 0 sec.

Stacktrace

handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),

Standard Output

----------------------------------------------
trial-161 handover_2G:nanobts+bts1-trx-b200 handover.py
----------------------------------------------
07:24:30.020731 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
07:24:30.034564 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2)
07:24:30.173517 tst                      handover.py: using LAC 16173
07:24:30.304730 tst                      handover.py: using RAC 108
07:24:30.438623 tst                      handover.py: using CellId 16172
07:24:30.575138 tst                      handover.py: using BVCI 2851
07:24:30.602441 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2)
07:24:30.758696 tst                      handover.py: using LAC 16174
07:24:30.899623 tst                      handover.py: using RAC 109
07:24:31.039523 tst                      handover.py: using CellId 16173
07:24:31.171759 tst                      handover.py: using BVCI 2852
07:24:31.197632 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
07:24:31.211686 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
07:24:31.225688 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
07:24:31.239355 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
07:24:31.254668 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
07:24:31.268262 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2)
07:24:31.404806 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2)
07:24:31.632644 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
07:24:32.135698 run         create_hlr_db(pid=31981): Launched
07:24:32.274679 bus                        /sierra_2: Setting Powered False
07:24:33.367467 run         create_hlr_db(pid=31981): Terminated: ok {rc=0}
07:24:33.792814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31983): Launched
07:24:34.128809 run   osmo-hlr_10.42.42.2(pid=31984): Launched
07:24:34.248372 run              osmo-stp_10.42.42.5: Starting osmo-stp
07:24:34.805100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31985): Launched
07:24:35.140955 run   osmo-stp_10.42.42.5(pid=31986): Launched
07:24:35.260945 run              osmo-msc_10.42.42.6: Starting osmo-msc
07:24:35.859043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31987): Launched
07:24:36.210550 run   osmo-msc_10.42.42.6(pid=31988): Launched
07:24:36.332641 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
07:24:36.901348 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31989): Launched
07:24:37.253239 run   osmo-mgw_10.42.42.3(pid=31990): Launched
07:24:37.374355 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
07:24:37.921958 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31991): Launched
07:24:38.257697 run   osmo-mgw_10.42.42.4(pid=31992): Launched
07:24:38.376611 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
07:24:39.125763 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31993): Launched
07:24:39.463496 run   osmo-bsc_10.42.42.7(pid=31994): Launched
07:24:45.013550 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=31995): Launched
07:24:45.155281 run         nanobts_NanoBTS-ONW-1900: Finding nanobts 10.42.42.120, binding on 10.42.42.1...
07:24:45.461152 run   abisip-find-preconf(pid=31997): Launched
07:26:54.821401 run         nanobts_NanoBTS-ONW-1900: Found nanobts 10.42.42.120 with unit_id 9 trx 0
07:26:54.947912 run   abisip-find-preconf(pid=31997): Terminating (SIGINT)
07:26:55.300487 run   abisip-find-preconf(pid=31997): Terminated {rc=-2}
07:26:55.616270 run       ipaccess-config(pid=32004): Launched
07:26:56.835229 run       ipaccess-config(pid=32004): Terminated: ok {rc=0}
07:28:02.370002 run         nanobts_NanoBTS-ONW-1900: nanoBTS connected to BSC
07:28:03.842787 tst                   handover.py:43: ----- Report fragment: handover_2G:nanobts+bts1-trx-b200/handover.py/01_bts0_started: pass (200.6s)
07:28:04.007350 tst                      handover.py: using MSISDN 13064
07:28:04.196449 bus                        /sierra_2: Setting Powered True
07:28:07.725121 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015252', msisdn='13064', subscriber_id=1}
07:28:07.887021 tst                      handover.py: using MSISDN 13065
07:28:08.075368 bus                        /sierra_3: Setting Powered True
07:28:12.671966 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015253', msisdn='13065', subscriber_id=2}
07:28:12.980293 bus                        /sierra_2: Setting Online False
07:28:14.186118 bus                        /sierra_2: Setting Powered False
07:28:19.938940 bus                        /sierra_2: Setting Powered True
07:28:21.319741 bus                        /sierra_2: Setting Online True
07:28:23.949707 tst                        /sierra_2: Connect to ('901', '70')
07:28:24.303163 bus                        /sierra_3: Setting Online False
07:28:25.507551 bus                        /sierra_3: Setting Powered False
07:28:31.862249 bus                        /sierra_3: Setting Powered True
07:28:34.961159 bus                        /sierra_3: Setting Online True
07:28:37.334495 tst                        /sierra_3: Connect to ('901', '70')
07:28:37.518458 tst                        /sierra_2: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054228053'
07:28:37.651734 tst                        /sierra_3: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054229028'
07:28:37.865678 tst                   handover.py:54: waiting for modems to attach...
07:28:38.084975 tst                        /sierra_2: Already registered with network ('901', '70')
07:28:42.167493 tst                   handover.py:57: ----- Report fragment: handover_2G:nanobts+bts1-trx-b200/handover.py/02.1_ms0_attach: pass (4.1s)
07:28:53.876237 tst                        /sierra_3: Already registered with network ('901', '70')
07:28:57.492136 tst                   handover.py:60: ----- Report fragment: handover_2G:nanobts+bts1-trx-b200/handover.py/02.2_ms1_attach: pass (15.1s)
07:28:59.046873 tst                   handover.py:63: ----- Report fragment: handover_2G:nanobts+bts1-trx-b200/handover.py/02.3_subscribed_in_msc: pass (1.3s)
07:29:04.659052 tst                   handover.py:68: dial success
07:29:07.368445 tst                   handover.py:75: answer success, call established and ongoing
07:29:07.658354 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:29:07.868683 tst                   handover.py:79: ----- Report fragment: handover_2G:nanobts+bts1-trx-b200/handover.py/03_call_established: pass (3.0s)
07:29:08.010752 run                     osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
07:29:08.472666 run                     osmo-trx-uhd: OSMOTRX CONF: {'osmo_trx': {'remote_user': 'jenkins', 'launch_trx': 'True', 'dev_args': 'type=b200,serial=306BD11', 'multi_arfcn': 'True', 'type': 'uhd', 'channels': [{}], 'trx_ip': '10.42.42.116', 'egprs': 'disable', 'clock_reference': 'external', 'bts_ip': '10.42.42.50'}}
07:29:09.083896 run               uname-m(pid=32013): Launched
07:29:10.314585 run               uname-m(pid=32013): Terminated: ok {rc=0}
07:29:10.719967 run         rm-remote-dir(pid=32014): Launched
07:29:11.949694 run         rm-remote-dir(pid=32014): Terminated: ok {rc=0}
07:29:12.353070 run         mk-remote-dir(pid=32015): Launched
07:29:13.585136 run         mk-remote-dir(pid=32015): Terminated: ok {rc=0}
07:29:13.981851 run         mk-remote-dir(pid=32016): Launched
07:29:15.210296 run         mk-remote-dir(pid=32016): Terminated: ok {rc=0}
07:29:15.550346 run    scp-inst-to-remote(pid=32017): Launched
07:29:17.768193 run    scp-inst-to-remote(pid=32017): Terminated: ok {rc=0}
07:29:18.154162 run         mk-remote-dir(pid=32019): Launched
07:29:19.381177 run         mk-remote-dir(pid=32019): Terminated: ok {rc=0}
07:29:19.714739 run     scp-cfg-to-remote(pid=32020): Launched
07:29:20.934799 run     scp-cfg-to-remote(pid=32020): Terminated: ok {rc=0}
07:29:21.313960 run         mk-remote-dir(pid=32022): Launched
07:29:22.532781 run         mk-remote-dir(pid=32022): Terminated: ok {rc=0}
07:29:22.874072 run scp-wrapper-to-remote(pid=32023): Launched
07:29:24.108524 run scp-wrapper-to-remote(pid=32023): Terminated: ok {rc=0}
07:29:24.491785 run          osmo-trx-uhd(pid=32025): Launched
07:29:24.613432 run                     osmo-bts-trx: Waiting for osmo-trx-uhd to start up...
07:29:26.914210 run          osmo-bts-trx(pid=32026): Launched
07:29:28.374411 tst                   handover.py:84: ----- Report fragment: handover_2G:nanobts+bts1-trx-b200/handover.py/04.1_bts1_started: pass (20.3s)
07:29:28.601955 tst                   handover.py:86: wait a bit for modems to see bts1
07:29:38.867775 tst                   handover.py:89: starting the second BTS probably took a while, check on the ongoing call
07:29:39.213154 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:29:39.623608 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:29:41.004936 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
07:29:43.749372 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
07:29:44.180977 tst                  handover.py:120: wait for handover counters to change...
07:29:48.238198 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
07:29:48.543815 tst                  handover.py:124: 
�[1;35m20201207072943872 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207072943872 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207072943872 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207072943872 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207072943872 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207072943873 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207072943873 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207072943873 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207072943873 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207072943878 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207072943878 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207072944295 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207072944295 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207072944296 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207072944296 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207072944296 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207072944296 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207072944296 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207072944297 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207072944297 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207072944297 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014320]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
07:29:48.920187 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
07:29:49.073421 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-161↪handover_2G:nanobts+bts1-trx-b200↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
07:29:49.339008 tst                  handover.py:129: did not work, try again... (attempts left: 4)
07:29:49.713662 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:29:51.092553 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
07:29:53.841971 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
07:29:54.266706 tst                  handover.py:120: wait for handover counters to change...
07:29:58.330882 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
07:29:58.635390 tst                  handover.py:124: 
�[1;35m20201207072953965 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207072953965 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207072953965 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207072953965 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207072953965 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207072953965 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207072953965 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207072953966 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207072953966 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207072953969 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207072953970 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207072954355 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207072954355 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207072954355 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207072954355 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207072954355 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207072954355 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207072954355 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207072954356 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207072954356 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207072954356 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000014020]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
07:29:59.013819 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
07:29:59.167466 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-161↪handover_2G:nanobts+bts1-trx-b200↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
07:29:59.434747 tst                  handover.py:129: did not work, try again... (attempts left: 3)
07:29:59.813984 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:30:01.196815 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
07:30:03.937580 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
07:30:04.364532 tst                  handover.py:120: wait for handover counters to change...
07:30:08.413488 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
07:30:08.717898 tst                  handover.py:124: 
�[1;35m20201207073004060 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207073004060 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207073004060 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207073004060 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207073004060 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207073004060 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207073004061 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207073004061 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207073004061 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207073004065 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207073004065 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207073004435 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207073004436 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207073004436 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207073004436 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207073004436 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207073004436 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207073004436 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207073004437 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207073004437 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207073004437 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013d20]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
07:30:09.093674 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
07:30:09.247247 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-161↪handover_2G:nanobts+bts1-trx-b200↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
07:30:09.512597 tst                  handover.py:129: did not work, try again... (attempts left: 2)
07:30:09.887392 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:30:11.269009 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
07:30:14.007531 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
07:30:14.435622 tst                  handover.py:120: wait for handover counters to change...
07:30:18.514547 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
07:30:18.818984 tst                  handover.py:124: 
�[1;35m20201207073014130 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207073014130 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207073014130 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207073014130 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207073014130 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207073014131 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207073014131 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207073014131 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207073014131 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207073014135 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207073014135 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207073014533 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207073014533 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207073014534 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207073014534 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207073014534 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207073014534 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207073014534 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207073014535 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207073014535 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207073014535 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013a20]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
07:30:19.196370 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
07:30:19.350880 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-161↪handover_2G:nanobts+bts1-trx-b200↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
07:30:19.616711 tst                  handover.py:129: did not work, try again... (attempts left: 1)
07:30:19.994627 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (2 of 2 requirements): ['0-0-2-0 TCH/F ESTABLISHED', '0-0-3-0 TCH/F ESTABLISHED']
07:30:21.377639 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 1 requirements): ['not: 1-0-2-0']
07:30:24.120122 tst                  handover.py:117: trigger handover: bts 0 trx 0 timeslot 2 sub-slot 0 handover 1
07:30:24.546303 tst                  handover.py:120: wait for handover counters to change...
07:30:28.605976 tst                  handover.py:122: 
| rate_ctr.abs.bsc.0.handover:failed = 1
| rate_ctr.abs.bts.0.handover:failed = 1
07:30:28.911543 tst                  handover.py:124: 
�[1;35m20201207073024243 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{NOT_STARTED}: Allocated (fsm.c:461)�[0;m
�[0;m�[1;35m20201207073024243 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{NOT_STARTED}: is child of SUBSCR_CONN(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000017320] (fsm.c:491)�[0;m
�[0;m�[1;35m20201207073024243 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-none: (BSC) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207073024243 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-none: (BTS) incrementing rate counter: handover:attempted Intra-BSC handover attempts (handover_fsm.c:333)�[0;m
�[0;m�[1;35m20201207073024243 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{NOT_STARTED}: (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-none: No explicit neighbors, regarding all local cells as neighbors (handover_logic.c:188)�[0;m
�[0;m�[1;35m20201207073024244 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207073024244 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:attempted Intra-BSC handover attempts (handover_fsm.c:385)�[0;m
�[0;m�[1;35m20201207073024244 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{NOT_STARTED}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: Selected lchan (bts=1,trx=0,ts=2,ss=0) (handover_fsm.c:395)�[0;m
�[0;m�[1;35m20201207073024244 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{NOT_STARTED}: state_chg to WAIT_LCHAN_ACTIVE (handover_fsm.c:397)�[0;m
�[0;m�[1;35m20201207073024249 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{WAIT_LCHAN_ACTIVE}: Received Event HO_EV_LCHAN_ACTIVE (lchan_fsm.c:818)�[0;m
�[0;m�[1;35m20201207073024249 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{WAIT_LCHAN_ACTIVE}: state_chg to WAIT_RR_HO_DETECT (handover_fsm.c:993)�[0;m
�[0;m�[1;35m20201207073024654 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{WAIT_RR_HO_DETECT}: Received Event HO_EV_RR_HO_FAIL (gsm_04_08_rr.c:946)�[0;m
�[0;m�[1;35m20201207073024655 �[1;31mDRSL�[0;m�[1;35m �[1;31mERROR�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: Handover failed in state HANDOVER, Failure (MS sent RR Handover Failure): Received RR Handover Fail message (handover_fsm.c:1155)�[0;m
�[0;m�[1;35m20201207073024655 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BSC) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:932)�[0;m
�[0;m�[1;35m20201207073024655 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BSC) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:933)�[0;m
�[0;m�[1;35m20201207073024655 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BTS) incrementing rate counter: handover:failed Received Handover Fail messages (handover_fsm.c:934)�[0;m
�[0;m�[1;35m20201207073024655 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: (BTS) incrementing rate counter: intra_bsc_ho:failed Received Handover Fail messages (handover_fsm.c:935)�[0;m
�[0;m�[1;35m20201207073024655 �[1;32mDRSL�[0;m�[1;35m �[1;32mINFO�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{WAIT_RR_HO_DETECT}: (0-0-2-TCH_F-0-SPEECH_V1) --HO-> (1-0-2-TCH/F-0) (subscr subscr-IMSI-901700000015252-TMSI-0x837dd5e1) HO-intraBSC: Result: Failure (MS sent RR Handover Failure) (handover_fsm.c:937)�[0;m
�[1;35m20201207073024656 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{WAIT_RR_HO_DETECT}: Terminating (cause = OSMO_FSM_TERM_REGULAR) (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207073024656 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{WAIT_RR_HO_DETECT}: Freeing instance (handover_fsm.c:970)�[0;m
�[0;m�[1;35m20201207073024657 �[1;34mDRSL�[0;m�[1;35m �[1;34mDEBUG�[0;m�[1;35m handover(intraBSC_msc0-conn4_subscr-IMSI-901700000015252-TMSI-0x837dd5e1)[0x612000013720]{WAIT_RR_HO_DETECT}: Deallocated (fsm.c:573)�[0;m
07:30:29.290294 bus Vty(host='10.42.42.7', port=4242): Found matching lchan activity (1 of 3 requirements): ['0-0-3-0 TCH/F ESTABLISHED']
07:30:29.445527 bus Vty(host='10.42.42.7', port=4242): ERR: Found unexpected lchan activity (2 of 3 requirements): ['missing: 1-0-2-0 TCH/F ESTABLISHED', 'unexpected: 0-0-2-0 TCH/F ESTABLISHED']  [trial-161↪handover_2G:nanobts+bts1-trx-b200↪handover.py:126↪handover.py↪osmo-bsc_10.42.42.7↪Vty(host='10.42.42.7', port=4242)]
07:30:29.710714 tst                  handover.py:129: did not work, try again... (attempts left: 0)
07:30:29.775278 tst                  handover.py:146: ----- Report fragment: handover_2G:nanobts+bts1-trx-b200/handover.py/05.1_handover_ms0: FAIL (50.5s)
07:30:29.784903 tst                  handover.py:146: ERR: AssertionError: handover.py:146: not_expected=('0-0-2-0 TCH/F ESTABLISHED',),  [trial-161↪handover_2G:nanobts+bts1-trx-b200↪handover.py:146]
07:30:29.792557 tst                  handover.py:146: Test FAILED (359.8 sec)
07:30:29.842182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31983): Terminating (SIGTERM)
07:30:29.899279 run   osmo-hlr_10.42.42.2(pid=31984): Terminating (SIGTERM)
07:30:29.956631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31985): Terminating (SIGTERM)
07:30:30.015280 run   osmo-stp_10.42.42.5(pid=31986): Terminating (SIGTERM)
07:30:30.090296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31987): Terminating (SIGTERM)
07:30:30.150554 run   osmo-msc_10.42.42.6(pid=31988): Terminating (SIGTERM)
07:30:30.207270 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31989): Terminating (SIGTERM)
07:30:30.265172 run   osmo-mgw_10.42.42.3(pid=31990): Terminating (SIGTERM)
07:30:30.321533 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31991): Terminating (SIGTERM)
07:30:30.378474 run   osmo-mgw_10.42.42.4(pid=31992): Terminating (SIGTERM)
07:30:30.435091 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31993): Terminating (SIGTERM)
07:30:30.491144 run   osmo-bsc_10.42.42.7(pid=31994): Terminating (SIGTERM)
07:30:30.547870 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=31995): Terminating (SIGTERM)
07:30:30.603901 run          osmo-trx-uhd(pid=32025): Terminating (SIGTERM)
07:30:30.659354 run          osmo-bts-trx(pid=32026): Terminating (SIGTERM)
07:30:30.670851 ---      ParallelTerminationStrategy: PID 31983 died...
07:30:30.740440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31983): Terminated: ok {rc=0}
07:30:30.752997 ---      ParallelTerminationStrategy: PID 31984 died...
07:30:30.822039 run   osmo-hlr_10.42.42.2(pid=31984): Terminated: ok {rc=0}
07:30:30.834678 ---      ParallelTerminationStrategy: PID 31985 died...
07:30:30.904382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31985): Terminated: ok {rc=0}
07:30:30.917397 ---      ParallelTerminationStrategy: PID 31986 died...
07:30:30.987511 run   osmo-stp_10.42.42.5(pid=31986): Terminated: ok {rc=0}
07:30:31.000296 ---      ParallelTerminationStrategy: PID 31987 died...
07:30:31.070716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31987): Terminated: ok {rc=0}
07:30:31.083270 ---      ParallelTerminationStrategy: PID 31989 died...
07:30:31.152743 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31989): Terminated: ok {rc=0}
07:30:31.165592 ---      ParallelTerminationStrategy: PID 31990 died...
07:30:31.234969 run   osmo-mgw_10.42.42.3(pid=31990): Terminated {rc=15}
07:30:31.247399 ---      ParallelTerminationStrategy: PID 31991 died...
07:30:31.317224 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31991): Terminated: ok {rc=0}
07:30:31.329715 ---      ParallelTerminationStrategy: PID 31992 died...
07:30:31.399331 run   osmo-mgw_10.42.42.4(pid=31992): Terminated {rc=15}
07:30:31.411994 ---      ParallelTerminationStrategy: PID 31993 died...
07:30:31.481686 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31993): Terminated: ok {rc=0}
07:30:31.494330 ---      ParallelTerminationStrategy: PID 31995 died...
07:30:31.564500 run pcap-recorder_any(filters='(host 10.42.42.120) and port not 22')(pid=31995): Terminated: ok {rc=0}
07:30:31.577374 ---      ParallelTerminationStrategy: PID 32025 died...
07:30:31.647082 run          osmo-trx-uhd(pid=32025): Terminated {rc=36608}
07:30:33.676723 ---      ParallelTerminationStrategy: PID 31988 died...
07:30:33.747670 run   osmo-msc_10.42.42.6(pid=31988): Terminated: ok {rc=0}
07:30:33.759928 ---      ParallelTerminationStrategy: PID 31994 died...
07:30:33.827915 run   osmo-bsc_10.42.42.7(pid=31994): Terminated: ok {rc=0}
07:30:37.688404 run          osmo-bts-trx(pid=32026): Terminating (SIGINT)
07:30:37.868173 ---      ParallelTerminationStrategy: PID 32026 died...
07:30:37.938577 run          osmo-bts-trx(pid=32026): Terminated: ok {rc=0}
07:30:38.096456 bus                        /sierra_3: Setting Online False
07:30:39.221574 bus                        /sierra_3: Setting Powered False
07:30:50.643013 bus                        /sierra_3: Setting Powered False
07:30:51.764728 bus                        /sierra_3: Setting Powered False
07:30:52.946640 bus                        /sierra_2: Setting Online False
07:30:54.102685 bus                        /sierra_2: Setting Powered False
07:30:59.640210 bus                        /sierra_2: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 673, in exec_module
  File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 146, in <module>
    not_expected=('0-0-2-0 TCH/F ESTABLISHED',),
AssertionError