![[Jenkins]](/jenkins/static/342c126a/images/svgs/logo.svg){kind=logo}
Failed
handover_2G:octphy+bts1-trx-b200.handover.py (from handover_2G_octphy+bts1-trx-b200)
Stacktrace
osmo-bts-octphy(pid=29340): Process ended prematurely: osmo-bts-octphy(pid=29340) [trial-160↪handover_2G:octphy+bts1-trx-b200↪handover.py:43↪handover.py↪osmo-bts-octphy↪osmo-bts-octphy(pid=29340)]
Standard Output
----------------------------------------------
trial-160 handover_2G:octphy+bts1-trx-b200 handover.py
----------------------------------------------
05:43:26.026227 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
05:43:26.040694 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2)
05:43:26.190156 tst handover.py: using LAC 16127
05:43:26.329502 tst handover.py: using RAC 62
05:43:26.466717 tst handover.py: using CellId 16126
05:43:26.604560 tst handover.py: using BVCI 2805
05:43:26.631918 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2)
05:43:26.791388 tst handover.py: using LAC 16128
05:43:26.929050 tst handover.py: using RAC 63
05:43:27.066708 tst handover.py: using CellId 16127
05:43:27.202351 tst handover.py: using BVCI 2806
05:43:27.228620 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
05:43:27.242596 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
05:43:27.257606 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
05:43:27.271668 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
05:43:27.285616 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
05:43:27.299945 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2)
05:43:27.433750 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2)
05:43:27.667030 run osmo-hlr_10.42.42.2: Starting osmo-hlr
05:43:28.190963 run create_hlr_db(pid=29322): Launched
05:43:28.337077 bus /sierra_2: Setting Powered False
05:43:29.423466 run create_hlr_db(pid=29322): Terminated: ok {rc=0}
05:43:29.863882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29324): Launched
05:43:30.201477 run osmo-hlr_10.42.42.2(pid=29325): Launched
05:43:30.321901 run osmo-stp_10.42.42.5: Starting osmo-stp
05:43:30.891736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29326): Launched
05:43:31.244931 run osmo-stp_10.42.42.5(pid=29327): Launched
05:43:31.367821 run osmo-msc_10.42.42.6: Starting osmo-msc
05:43:31.962298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29328): Launched
05:43:32.302096 run osmo-msc_10.42.42.6(pid=29329): Launched
05:43:32.425272 run osmo-mgw_10.42.42.3: Starting osmo-mgw
05:43:32.998463 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=29330): Launched
05:43:33.352307 run osmo-mgw_10.42.42.3(pid=29331): Launched
05:43:33.473314 run osmo-mgw_10.42.42.4: Starting osmo-mgw
05:43:34.032880 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29332): Launched
05:43:34.388784 run osmo-mgw_10.42.42.4(pid=29333): Launched
05:43:34.509836 run osmo-bsc_10.42.42.7: Starting osmo-bsc
05:43:35.269473 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=29334): Launched
05:43:35.622738 run osmo-bsc_10.42.42.7(pid=29335): Launched
05:43:39.318249 run osmo-bts-octphy: Starting to connect to osmo-bsc_10.42.42.7
05:43:39.675188 run osmo-bts-octphy: Setting RPATH for osmo-bts-octphy
05:43:39.984909 run patchelf(pid=29336): Launched
05:43:41.200590 run patchelf(pid=29336): Terminated: ok {rc=0}
05:43:41.333436 run osmo-bts-octphy: Applying CAP_NET_RAW capability to osmo-bts-octphy
05:43:41.649103 run osmo-gsm-tester_setcap_net_raw.sh(pid=29337): Launched
05:43:42.855530 run osmo-gsm-tester_setcap_net_raw.sh(pid=29337): Terminated: ok {rc=0}
05:43:43.157101 run osmo-bts-octphy(pid=29340): Launched
05:43:49.366006 run osmo-bts-octphy(pid=29340): ERR: Terminated: ERROR {rc=23} [trial-160↪handover_2G:octphy+bts1-trx-b200↪handover.py:43↪handover.py↪osmo-bts-octphy↪osmo-bts-octphy(pid=29340)]
05:43:49.511394 run osmo-bts-octphy(pid=29340): stdout:
| (launched: 2020-12-07_05:43:42.987396)
05:43:49.659189 run osmo-bts-octphy(pid=29340): stderr:
| �[0;m�[1;36m20201207054343241 �[1;34mDOML�[0;m�[1;36m �[1;34mDEBUG�[0;m�[1;36m OC=GPRS-NSE(f0) INST=(00,ff,ff): Rx CHG ADM STATE (oml.c:1017)
| �[0;m�[1;36m20201207054343241 �[1;33mDOML�[0;m�[1;36m �[1;33mNOTICE�[0;m�[1;36m OC=GPRS-NSE(f0) INST=(00,ff,ff): ADM STATE Locked -> Unlocked (oml.c:1046)
| �[0;m�[1;36m20201207054343241 �[1;34mDOML�[0;m�[1;36m �[1;34mDEBUG�[0;m�[1;36m OC=GPRS-NSE(f0) INST=(00,ff,ff): Tx Change Administrative State Ack (oml.c:144)
| �[0;m�[1;36m20201207054343241 �[1;34mDOML�[0;m�[1;36m �[1;34mDEBUG�[0;m�[1;36m OC=GPRS-NSE(f0) INST=(00,ff,ff): Tx State Changed Event Report (oml.c:144)
| �[0;m�[1;36m20201207054343243 �[1;34mDOML�[0;m�[1;36m �[1;34mDEBUG�[0;m�[1;36m OC=RADIO-CARRIER(02) INST=(00,00,ff): Rx OPSTART (oml.c:990)
| �[0;m20201207054344239 �[1;31mDLINP�[0;m �[1;31mERROR�[0;m abis_sendmsg: msg->dst == NULL: 0c 12 01 90 0f ff ff (e1_input.c:269)
| 20201207054345239 �[1;31mDLINP�[0;m �[1;31mERROR�[0;m abis_sendmsg: msg->dst == NULL: 0c 12 01 90 0f ff ff (e1_input.c:269)
| 20201207054346240 �[1;31mDLINP�[0;m �[1;31mERROR�[0;m abis_sendmsg: msg->dst == NULL: 0c 12 01 90 0f ff ff (e1_input.c:269)
| 20201207054347240 �[1;31mDLINP�[0;m �[1;31mERROR�[0;m abis_sendmsg: msg->dst == NULL: 0c 12 01 90 0f ff ff (e1_input.c:269)
| 20201207054348176 �[1;31mDL1C�[0;m �[1;31mFATAL�[0;m Timeout waiting for L1 primitive TRX-CLOSE-ALL (l1_if.c:205)
05:43:49.799086 run osmo-bts-octphy(pid=29340): stdout:
| (launched: 2020-12-07_05:43:42.987396)
05:43:49.938414 run osmo-bts-octphy(pid=29340): stderr:
| �[0;m�[1;36m20201207054343241 �[1;34mDOML�[0;m�[1;36m �[1;34mDEBUG�[0;m�[1;36m OC=GPRS-NSE(f0) INST=(00,ff,ff): Rx CHG ADM STATE (oml.c:1017)
| �[0;m�[1;36m20201207054343241 �[1;33mDOML�[0;m�[1;36m �[1;33mNOTICE�[0;m�[1;36m OC=GPRS-NSE(f0) INST=(00,ff,ff): ADM STATE Locked -> Unlocked (oml.c:1046)
| �[0;m�[1;36m20201207054343241 �[1;34mDOML�[0;m�[1;36m �[1;34mDEBUG�[0;m�[1;36m OC=GPRS-NSE(f0) INST=(00,ff,ff): Tx Change Administrative State Ack (oml.c:144)
| �[0;m�[1;36m20201207054343241 �[1;34mDOML�[0;m�[1;36m �[1;34mDEBUG�[0;m�[1;36m OC=GPRS-NSE(f0) INST=(00,ff,ff): Tx State Changed Event Report (oml.c:144)
| �[0;m�[1;36m20201207054343243 �[1;34mDOML�[0;m�[1;36m �[1;34mDEBUG�[0;m�[1;36m OC=RADIO-CARRIER(02) INST=(00,00,ff): Rx OPSTART (oml.c:990)
| �[0;m20201207054344239 �[1;31mDLINP�[0;m �[1;31mERROR�[0;m abis_sendmsg: msg->dst == NULL: 0c 12 01 90 0f ff ff (e1_input.c:269)
| 20201207054345239 �[1;31mDLINP�[0;m �[1;31mERROR�[0;m abis_sendmsg: msg->dst == NULL: 0c 12 01 90 0f ff ff (e1_input.c:269)
| 20201207054346240 �[1;31mDLINP�[0;m �[1;31mERROR�[0;m abis_sendmsg: msg->dst == NULL: 0c 12 01 90 0f ff ff (e1_input.c:269)
| 20201207054347240 �[1;31mDLINP�[0;m �[1;31mERROR�[0;m abis_sendmsg: msg->dst == NULL: 0c 12 01 90 0f ff ff (e1_input.c:269)
| 20201207054348176 �[1;31mDL1C�[0;m �[1;31mFATAL�[0;m Timeout waiting for L1 primitive TRX-CLOSE-ALL (l1_if.c:205)
05:43:49.997596 tst handover.py:43: ----- Report fragment: handover_2G:octphy+bts1-trx-b200/handover.py/01_bts0_started: FAIL (10.8s)
05:43:50.007093 tst handover.py:43: ERR: Error: osmo-bts-octphy(pid=29340): Process ended prematurely: osmo-bts-octphy(pid=29340) [trial-160↪handover_2G:octphy+bts1-trx-b200↪handover.py:43↪handover.py↪osmo-bts-octphy↪osmo-bts-octphy(pid=29340)] [trial-160↪handover_2G:octphy+bts1-trx-b200↪handover.py:43]
05:43:50.016816 tst handover.py:43: Test FAILED (24.0 sec)
05:43:50.061742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29324): Terminating (SIGTERM)
05:43:50.112870 run osmo-hlr_10.42.42.2(pid=29325): Terminating (SIGTERM)
05:43:50.165167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29326): Terminating (SIGTERM)
05:43:50.217060 run osmo-stp_10.42.42.5(pid=29327): Terminating (SIGTERM)
05:43:50.270895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29328): Terminating (SIGTERM)
05:43:50.324570 run osmo-msc_10.42.42.6(pid=29329): Terminating (SIGTERM)
05:43:50.375844 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=29330): Terminating (SIGTERM)
05:43:50.426547 run osmo-mgw_10.42.42.3(pid=29331): Terminating (SIGTERM)
05:43:50.477541 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29332): Terminating (SIGTERM)
05:43:50.528241 run osmo-mgw_10.42.42.4(pid=29333): Terminating (SIGTERM)
05:43:50.579161 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=29334): Terminating (SIGTERM)
05:43:50.630088 run osmo-bsc_10.42.42.7(pid=29335): Terminating (SIGTERM)
05:43:50.641869 --- ParallelTerminationStrategy: PID 29324 died...
05:43:50.709288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29324): Terminated: ok {rc=0}
05:43:50.721562 --- ParallelTerminationStrategy: PID 29325 died...
05:43:50.788560 run osmo-hlr_10.42.42.2(pid=29325): Terminated: ok {rc=0}
05:43:50.800859 --- ParallelTerminationStrategy: PID 29326 died...
05:43:50.868759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29326): Terminated: ok {rc=0}
05:43:50.881086 --- ParallelTerminationStrategy: PID 29327 died...
05:43:50.947815 run osmo-stp_10.42.42.5(pid=29327): Terminated: ok {rc=0}
05:43:50.960222 --- ParallelTerminationStrategy: PID 29328 died...
05:43:51.027233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29328): Terminated: ok {rc=0}
05:43:51.039562 --- ParallelTerminationStrategy: PID 29330 died...
05:43:51.106876 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=29330): Terminated: ok {rc=0}
05:43:51.119235 --- ParallelTerminationStrategy: PID 29331 died...
05:43:51.186391 run osmo-mgw_10.42.42.3(pid=29331): Terminated {rc=15}
05:43:51.198648 --- ParallelTerminationStrategy: PID 29332 died...
05:43:51.266318 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29332): Terminated: ok {rc=0}
05:43:51.278642 --- ParallelTerminationStrategy: PID 29333 died...
05:43:51.345668 run osmo-mgw_10.42.42.4(pid=29333): Terminated {rc=15}
05:43:51.357985 --- ParallelTerminationStrategy: PID 29334 died...
05:43:51.425198 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=29334): Terminated: ok {rc=0}
05:43:54.120030 --- ParallelTerminationStrategy: PID 29329 died...
05:43:54.185450 run osmo-msc_10.42.42.6(pid=29329): Terminated: ok {rc=0}
05:43:54.197367 --- ParallelTerminationStrategy: PID 29335 died...
05:43:54.260799 run osmo-bsc_10.42.42.7(pid=29335): Terminated: ok {rc=0}
05:43:54.375819 bus Ctrl(host='10.42.42.7', port=4249): ERR: ConnectionRefusedError: [Errno 111] Connection refused [trial-160↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-bsc_10.42.42.7↪Ctrl(host='10.42.42.7', port=4249)]
05:43:54.479176 bus /sierra_2: Setting Powered False
Standard Error
Traceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 673, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 43, in <module>
wait(bsc.bts_is_connected, bts0)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-bts-octphy(pid=29340): Process ended prematurely: osmo-bts-octphy(pid=29340) [trial-160↪handover_2G:octphy+bts1-trx-b200↪handover.py:43↪handover.py↪osmo-bts-octphy↪osmo-bts-octphy(pid=29340)]