![[Jenkins]](/jenkins/static/342c126a/images/svgs/logo.svg){kind=logo}
Failed
handover_2G:octphy+bts1-sysmo.handover.py (from handover_2G_octphy+bts1-sysmo)
Stacktrace
osmo-bts-octphy(pid=14723): Process ended prematurely: osmo-bts-octphy(pid=14723) [trial-159↪handover_2G:octphy+bts1-sysmo↪handover.py:43↪handover.py↪osmo-bts-octphy↪osmo-bts-octphy(pid=14723)]
Standard Output
----------------------------------------------
trial-159 handover_2G:octphy+bts1-sysmo handover.py
----------------------------------------------
00:44:57.662346 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6)
00:44:57.676434 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2)
00:44:57.819993 tst handover.py: using LAC 16029
00:44:57.952300 tst handover.py: using RAC 219
00:44:58.085150 tst handover.py: using CellId 16028
00:44:58.218219 tst handover.py: using BVCI 2707
00:44:58.244495 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2)
00:44:58.383498 tst handover.py: using LAC 16030
00:44:58.515960 tst handover.py: using RAC 220
00:44:58.648106 tst handover.py: using CellId 16029
00:44:58.779837 tst handover.py: using BVCI 2708
00:44:58.805832 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6)
00:44:58.819281 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6)
00:44:58.832677 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6)
00:44:58.846099 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6)
00:44:58.859399 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6)
00:44:58.872802 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2)
00:44:59.006005 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2)
00:44:59.235860 run osmo-hlr_10.42.42.2: Starting osmo-hlr
00:44:59.763079 run create_hlr_db(pid=14702): Launched
00:44:59.914001 bus /sierra_2: Setting Powered False
00:45:00.999402 run create_hlr_db(pid=14702): Terminated: ok {rc=0}
00:45:01.431921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14704): Launched
00:45:01.772655 run osmo-hlr_10.42.42.2(pid=14708): Launched
00:45:01.894406 run osmo-stp_10.42.42.5: Starting osmo-stp
00:45:02.463873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14709): Launched
00:45:02.820433 run osmo-stp_10.42.42.5(pid=14710): Launched
00:45:02.941393 run osmo-msc_10.42.42.6: Starting osmo-msc
00:45:03.539515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14711): Launched
00:45:03.882919 run osmo-msc_10.42.42.6(pid=14712): Launched
00:45:04.006759 run osmo-mgw_10.42.42.3: Starting osmo-mgw
00:45:04.572707 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14713): Launched
00:45:04.911990 run osmo-mgw_10.42.42.3(pid=14714): Launched
00:45:05.033280 run osmo-mgw_10.42.42.4: Starting osmo-mgw
00:45:05.588483 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14715): Launched
00:45:05.929069 run osmo-mgw_10.42.42.4(pid=14716): Launched
00:45:06.050137 run osmo-bsc_10.42.42.7: Starting osmo-bsc
00:45:06.808282 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14717): Launched
00:45:07.170957 run osmo-bsc_10.42.42.7(pid=14718): Launched
00:45:10.908900 run osmo-bts-octphy: Starting to connect to osmo-bsc_10.42.42.7
00:45:11.283851 run osmo-bts-octphy: Setting RPATH for osmo-bts-octphy
00:45:11.591919 run patchelf(pid=14719): Launched
00:45:12.797715 run patchelf(pid=14719): Terminated: ok {rc=0}
00:45:12.923652 run osmo-bts-octphy: Applying CAP_NET_RAW capability to osmo-bts-octphy
00:45:13.236461 run osmo-gsm-tester_setcap_net_raw.sh(pid=14720): Launched
00:45:14.454491 run osmo-gsm-tester_setcap_net_raw.sh(pid=14720): Terminated: ok {rc=0}
00:45:14.768309 run osmo-bts-octphy(pid=14723): Launched
00:45:20.977203 run osmo-bts-octphy(pid=14723): ERR: Terminated: ERROR {rc=23} [trial-159↪handover_2G:octphy+bts1-sysmo↪handover.py:43↪handover.py↪osmo-bts-octphy↪osmo-bts-octphy(pid=14723)]
00:45:21.115021 run osmo-bts-octphy(pid=14723): stdout:
| (launched: 2020-12-07_00:45:14.593298)
00:45:21.254801 run osmo-bts-octphy(pid=14723): stderr:
| �[0;m�[1;36m20201207004514850 �[1;34mDOML�[0;m�[1;36m �[1;34mDEBUG�[0;m�[1;36m OC=GPRS-NSE(f0) INST=(00,ff,ff): Rx CHG ADM STATE (oml.c:1017)
| �[0;m�[1;36m20201207004514850 �[1;33mDOML�[0;m�[1;36m �[1;33mNOTICE�[0;m�[1;36m OC=GPRS-NSE(f0) INST=(00,ff,ff): ADM STATE Locked -> Unlocked (oml.c:1046)
| �[0;m�[1;36m20201207004514851 �[1;34mDOML�[0;m�[1;36m �[1;34mDEBUG�[0;m�[1;36m OC=GPRS-NSE(f0) INST=(00,ff,ff): Tx Change Administrative State Ack (oml.c:144)
| �[0;m�[1;36m20201207004514851 �[1;34mDOML�[0;m�[1;36m �[1;34mDEBUG�[0;m�[1;36m OC=GPRS-NSE(f0) INST=(00,ff,ff): Tx State Changed Event Report (oml.c:144)
| �[0;m�[1;36m20201207004514852 �[1;34mDOML�[0;m�[1;36m �[1;34mDEBUG�[0;m�[1;36m OC=RADIO-CARRIER(02) INST=(00,00,ff): Rx OPSTART (oml.c:990)
| �[0;m20201207004515849 �[1;31mDLINP�[0;m �[1;31mERROR�[0;m abis_sendmsg: msg->dst == NULL: 0c 12 01 90 0f ff ff (e1_input.c:269)
| 20201207004516849 �[1;31mDLINP�[0;m �[1;31mERROR�[0;m abis_sendmsg: msg->dst == NULL: 0c 12 01 90 0f ff ff (e1_input.c:269)
| 20201207004517849 �[1;31mDLINP�[0;m �[1;31mERROR�[0;m abis_sendmsg: msg->dst == NULL: 0c 12 01 90 0f ff ff (e1_input.c:269)
| 20201207004518850 �[1;31mDLINP�[0;m �[1;31mERROR�[0;m abis_sendmsg: msg->dst == NULL: 0c 12 01 90 0f ff ff (e1_input.c:269)
| 20201207004519788 �[1;31mDL1C�[0;m �[1;31mFATAL�[0;m Timeout waiting for L1 primitive TRX-CLOSE-ALL (l1_if.c:205)
00:45:21.389190 run osmo-bts-octphy(pid=14723): stdout:
| (launched: 2020-12-07_00:45:14.593298)
00:45:21.521894 run osmo-bts-octphy(pid=14723): stderr:
| �[0;m�[1;36m20201207004514850 �[1;34mDOML�[0;m�[1;36m �[1;34mDEBUG�[0;m�[1;36m OC=GPRS-NSE(f0) INST=(00,ff,ff): Rx CHG ADM STATE (oml.c:1017)
| �[0;m�[1;36m20201207004514850 �[1;33mDOML�[0;m�[1;36m �[1;33mNOTICE�[0;m�[1;36m OC=GPRS-NSE(f0) INST=(00,ff,ff): ADM STATE Locked -> Unlocked (oml.c:1046)
| �[0;m�[1;36m20201207004514851 �[1;34mDOML�[0;m�[1;36m �[1;34mDEBUG�[0;m�[1;36m OC=GPRS-NSE(f0) INST=(00,ff,ff): Tx Change Administrative State Ack (oml.c:144)
| �[0;m�[1;36m20201207004514851 �[1;34mDOML�[0;m�[1;36m �[1;34mDEBUG�[0;m�[1;36m OC=GPRS-NSE(f0) INST=(00,ff,ff): Tx State Changed Event Report (oml.c:144)
| �[0;m�[1;36m20201207004514852 �[1;34mDOML�[0;m�[1;36m �[1;34mDEBUG�[0;m�[1;36m OC=RADIO-CARRIER(02) INST=(00,00,ff): Rx OPSTART (oml.c:990)
| �[0;m20201207004515849 �[1;31mDLINP�[0;m �[1;31mERROR�[0;m abis_sendmsg: msg->dst == NULL: 0c 12 01 90 0f ff ff (e1_input.c:269)
| 20201207004516849 �[1;31mDLINP�[0;m �[1;31mERROR�[0;m abis_sendmsg: msg->dst == NULL: 0c 12 01 90 0f ff ff (e1_input.c:269)
| 20201207004517849 �[1;31mDLINP�[0;m �[1;31mERROR�[0;m abis_sendmsg: msg->dst == NULL: 0c 12 01 90 0f ff ff (e1_input.c:269)
| 20201207004518850 �[1;31mDLINP�[0;m �[1;31mERROR�[0;m abis_sendmsg: msg->dst == NULL: 0c 12 01 90 0f ff ff (e1_input.c:269)
| 20201207004519788 �[1;31mDL1C�[0;m �[1;31mFATAL�[0;m Timeout waiting for L1 primitive TRX-CLOSE-ALL (l1_if.c:205)
00:45:21.577492 tst handover.py:43: ----- Report fragment: handover_2G:octphy+bts1-sysmo/handover.py/01_bts0_started: FAIL (10.8s)
00:45:21.585991 tst handover.py:43: ERR: Error: osmo-bts-octphy(pid=14723): Process ended prematurely: osmo-bts-octphy(pid=14723) [trial-159↪handover_2G:octphy+bts1-sysmo↪handover.py:43↪handover.py↪osmo-bts-octphy↪osmo-bts-octphy(pid=14723)] [trial-159↪handover_2G:octphy+bts1-sysmo↪handover.py:43]
00:45:21.594360 tst handover.py:43: Test FAILED (23.9 sec)
00:45:21.635544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14704): Terminating (SIGTERM)
00:45:21.683140 run osmo-hlr_10.42.42.2(pid=14708): Terminating (SIGTERM)
00:45:21.731797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14709): Terminating (SIGTERM)
00:45:21.782956 run osmo-stp_10.42.42.5(pid=14710): Terminating (SIGTERM)
00:45:21.832417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14711): Terminating (SIGTERM)
00:45:21.883343 run osmo-msc_10.42.42.6(pid=14712): Terminating (SIGTERM)
00:45:21.931026 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14713): Terminating (SIGTERM)
00:45:21.979165 run osmo-mgw_10.42.42.3(pid=14714): Terminating (SIGTERM)
00:45:22.026720 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14715): Terminating (SIGTERM)
00:45:22.074154 run osmo-mgw_10.42.42.4(pid=14716): Terminating (SIGTERM)
00:45:22.121716 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14717): Terminating (SIGTERM)
00:45:22.169042 run osmo-bsc_10.42.42.7(pid=14718): Terminating (SIGTERM)
00:45:22.179964 --- ParallelTerminationStrategy: PID 14704 died...
00:45:22.243055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14704): Terminated: ok {rc=0}
00:45:22.254399 --- ParallelTerminationStrategy: PID 14708 died...
00:45:22.317586 run osmo-hlr_10.42.42.2(pid=14708): Terminated: ok {rc=0}
00:45:22.329323 --- ParallelTerminationStrategy: PID 14709 died...
00:45:22.392637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14709): Terminated: ok {rc=0}
00:45:22.404030 --- ParallelTerminationStrategy: PID 14710 died...
00:45:22.467138 run osmo-stp_10.42.42.5(pid=14710): Terminated: ok {rc=0}
00:45:22.478482 --- ParallelTerminationStrategy: PID 14711 died...
00:45:22.541732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14711): Terminated: ok {rc=0}
00:45:22.553187 --- ParallelTerminationStrategy: PID 14713 died...
00:45:22.616612 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14713): Terminated: ok {rc=0}
00:45:22.628004 --- ParallelTerminationStrategy: PID 14714 died...
00:45:22.691256 run osmo-mgw_10.42.42.3(pid=14714): Terminated {rc=15}
00:45:22.702725 --- ParallelTerminationStrategy: PID 14715 died...
00:45:22.766084 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14715): Terminated: ok {rc=0}
00:45:22.777551 --- ParallelTerminationStrategy: PID 14716 died...
00:45:22.840870 run osmo-mgw_10.42.42.4(pid=14716): Terminated {rc=15}
00:45:22.852305 --- ParallelTerminationStrategy: PID 14717 died...
00:45:22.915775 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14717): Terminated: ok {rc=0}
00:45:25.610486 --- ParallelTerminationStrategy: PID 14712 died...
00:45:25.678611 run osmo-msc_10.42.42.6(pid=14712): Terminated: ok {rc=0}
00:45:25.690687 --- ParallelTerminationStrategy: PID 14718 died...
00:45:25.757858 run osmo-bsc_10.42.42.7(pid=14718): Terminated: ok {rc=0}
00:45:25.877742 bus Ctrl(host='10.42.42.7', port=4249): ERR: ConnectionRefusedError: [Errno 111] Connection refused [trial-159↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-bsc_10.42.42.7↪Ctrl(host='10.42.42.7', port=4249)]
00:45:25.977935 bus /sierra_2: Setting Powered False
Standard Error
Traceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 673, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 43, in <module>
wait(bsc.bts_is_connected, bts0)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-bts-octphy(pid=14723): Process ended prematurely: osmo-bts-octphy(pid=14723) [trial-159↪handover_2G:octphy+bts1-sysmo↪handover.py:43↪handover.py↪osmo-bts-octphy↪osmo-bts-octphy(pid=14723)]