Stack Trace
rm-remote-dir(pid=31730): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2071↪gprs:sysmo↪ping_idle_ping.py:34↪ping_idle_ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=31730)]Standard Output
----------------------------------------------
trial-2071 gprs:sysmo ping_idle_ping.py
----------------------------------------------
22:01:10.981176 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
22:01:10.993283 tst gprs:sysmo: Using 1 x bts (candidates: 1)
22:01:11.125236 tst ping_idle_ping.py: using LAC 41720
22:01:11.253710 tst ping_idle_ping.py: using RAC 155
22:01:11.378946 tst ping_idle_ping.py: using CellId 41720
22:01:11.500066 tst ping_idle_ping.py: using BVCI 41721
22:01:11.523248 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
22:01:11.533852 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
22:01:11.544645 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
22:01:11.555520 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
22:01:11.566446 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
22:01:11.577443 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
22:01:11.588123 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
22:01:11.598916 tst gprs:sysmo: Using 1 x modem (candidates: 4)
22:01:11.891792 tst ping_idle_ping.py:24: start network...
22:01:12.026003 run osmo-hlr_10.42.42.2: Starting osmo-hlr
22:01:12.546302 run create_hlr_db(pid=31692): Launched
22:01:12.735017 bus /gobi_6: Setting Powered False
22:01:13.754765 run create_hlr_db(pid=31692): Terminated: ok {rc=0}
22:01:14.162631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31694): Launched
22:01:14.468028 run osmo-hlr_10.42.42.2(pid=31695): Launched
22:01:14.577115 run osmo-stp_10.42.42.5: Starting osmo-stp
22:01:15.101428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31696): Launched
22:01:15.403369 run osmo-stp_10.42.42.5(pid=31697): Launched
22:01:15.510450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn
22:01:16.038512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31698): Launched
22:01:16.146901 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
22:01:16.412391 run patchelf(pid=31699): Launched
22:01:17.594183 run patchelf(pid=31699): Terminated: ok {rc=0}
22:01:17.705547 run osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn
22:01:17.979991 run osmo-gsm-tester_setcap_net_admin.sh(pid=31700): Launched
22:01:19.172960 run osmo-gsm-tester_setcap_net_admin.sh(pid=31700): Terminated: ok {rc=0}
22:01:19.500142 run osmo-ggsn_10.42.42.6(pid=31703): Launched
22:01:19.748747 run osmo-sgsn_10.42.42.7: Starting osmo-sgsn
22:01:20.327311 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31720): Launched
22:01:20.652140 run osmo-sgsn_10.42.42.7(pid=31721): Launched
22:01:20.797587 run osmo-msc_10.42.42.8: Starting osmo-msc
22:01:21.541828 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31722): Launched
22:01:21.884553 run osmo-msc_10.42.42.8(pid=31723): Launched
22:01:25.077495 run osmo-mgw_10.42.42.3: Starting osmo-mgw
22:01:25.638830 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31724): Launched
22:01:25.961992 run osmo-mgw_10.42.42.3(pid=31725): Launched
22:01:26.078725 run osmo-mgw_10.42.42.4: Starting osmo-mgw
22:01:26.631744 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31726): Launched
22:01:26.956592 run osmo-mgw_10.42.42.4(pid=31727): Launched
22:01:27.072824 run osmo-bsc_10.42.42.9: Starting osmo-bsc
22:01:27.752384 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31728): Launched
22:01:28.077355 run osmo-bsc_10.42.42.9(pid=31729): Launched
22:01:34.337397 run osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.9
22:01:34.878715 run rm-remote-dir(pid=31730): Launched
22:01:38.068798 run rm-remote-dir(pid=31730): ERR: Terminated: ERROR {rc=255} [trial-2071↪gprs:sysmo↪ping_idle_ping.py:34↪ping_idle_ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=31730)]
22:01:38.202717 run rm-remote-dir(pid=31730): stdout:
| (launched: 2023-01-03_22:01:34.723237)
22:01:38.336709 run rm-remote-dir(pid=31730): stderr:
| (launched: 2023-01-03_22:01:34.771369)
| ssh: connect to host 10.42.42.114 port 22: No route to host
22:01:38.391661 tst ping_idle_ping.py:34: ERR: Error: rm-remote-dir(pid=31730): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2071↪gprs:sysmo↪ping_idle_ping.py:34↪ping_idle_ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=31730)] [trial-2071↪gprs:sysmo↪ping_idle_ping.py:34]
22:01:38.398864 tst ping_idle_ping.py:34: Test FAILED (27.4 sec)
22:01:38.434673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31694): Terminating (SIGTERM)
22:01:38.475189 run osmo-hlr_10.42.42.2(pid=31695): Terminating (SIGTERM)
22:01:38.517669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31696): Terminating (SIGTERM)
22:01:38.560864 run osmo-stp_10.42.42.5(pid=31697): Terminating (SIGTERM)
22:01:38.604479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31698): Terminating (SIGTERM)
22:01:38.646319 run osmo-ggsn_10.42.42.6(pid=31703): Terminating (SIGTERM)
22:01:38.697470 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31720): Terminating (SIGTERM)
22:01:38.761729 run osmo-sgsn_10.42.42.7(pid=31721): Terminating (SIGTERM)
22:01:38.805268 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31722): Terminating (SIGTERM)
22:01:38.848748 run osmo-msc_10.42.42.8(pid=31723): Terminating (SIGTERM)
22:01:38.892459 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31724): Terminating (SIGTERM)
22:01:38.933870 run osmo-mgw_10.42.42.3(pid=31725): Terminating (SIGTERM)
22:01:38.975689 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31726): Terminating (SIGTERM)
22:01:39.017484 run osmo-mgw_10.42.42.4(pid=31727): Terminating (SIGTERM)
22:01:39.059263 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31728): Terminating (SIGTERM)
22:01:39.102112 run osmo-bsc_10.42.42.9(pid=31729): Terminating (SIGTERM)
22:01:39.111906 --- ParallelTerminationStrategy: PID 31694 died...
22:01:39.169396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31694): Terminated: ok {rc=0}
22:01:39.179854 --- ParallelTerminationStrategy: PID 31695 died...
22:01:39.247286 run osmo-hlr_10.42.42.2(pid=31695): Terminated: ok {rc=0}
22:01:39.258168 --- ParallelTerminationStrategy: PID 31696 died...
22:01:39.317306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31696): Terminated: ok {rc=0}
22:01:39.328283 --- ParallelTerminationStrategy: PID 31697 died...
22:01:39.387242 run osmo-stp_10.42.42.5(pid=31697): Terminated: ok {rc=0}
22:01:39.399869 --- ParallelTerminationStrategy: PID 31698 died...
22:01:39.453995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31698): Terminated: ok {rc=0}
22:01:39.464024 --- ParallelTerminationStrategy: PID 31703 died...
22:01:39.518016 run osmo-ggsn_10.42.42.6(pid=31703): Terminated: ok {rc=0}
22:01:39.527646 --- ParallelTerminationStrategy: PID 31720 died...
22:01:39.581604 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31720): Terminated: ok {rc=0}
22:01:39.591362 --- ParallelTerminationStrategy: PID 31722 died...
22:01:39.645536 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31722): Terminated: ok {rc=0}
22:01:39.655336 --- ParallelTerminationStrategy: PID 31723 died...
22:01:39.709503 run osmo-msc_10.42.42.8(pid=31723): Terminated: ok {rc=0}
22:01:39.719185 --- ParallelTerminationStrategy: PID 31724 died...
22:01:39.773059 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31724): Terminated: ok {rc=0}
22:01:39.783755 --- ParallelTerminationStrategy: PID 31725 died...
22:01:39.839687 run osmo-mgw_10.42.42.3(pid=31725): Terminated {rc=15}
22:01:39.850069 --- ParallelTerminationStrategy: PID 31726 died...
22:01:39.907067 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31726): Terminated: ok {rc=0}
22:01:39.917826 --- ParallelTerminationStrategy: PID 31727 died...
22:01:39.974797 run osmo-mgw_10.42.42.4(pid=31727): Terminated {rc=15}
22:01:39.985528 --- ParallelTerminationStrategy: PID 31728 died...
22:01:40.042422 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31728): Terminated: ok {rc=0}
22:01:40.052893 --- ParallelTerminationStrategy: PID 31729 died...
22:01:40.108133 run osmo-bsc_10.42.42.9(pid=31729): Terminated: ok {rc=0}
22:01:40.117959 --- ParallelTerminationStrategy: PID 31721 died...
22:01:40.171717 run osmo-sgsn_10.42.42.7(pid=31721): Terminated: ok {rc=0}
22:01:40.262347 bus /gobi_6: Setting Powered False
Standard Error
Traceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/ping_idle_ping.py", line 34, in <module>
bts.start()
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_sysmo.py", line 113, in start
rem_host.recreate_remote_dir(self.remote_inst)
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 146, in recreate_remote_dir
self.rm_remote_dir(remote_dir)
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 139, in rm_remote_dir
self.run_remote_sync('rm-remote-dir', ('test', '!', '-d', remote_dir_str, '||', 'rm', '-rf', remote_dir_str))
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 134, in run_remote_sync
proc.launch_sync()
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 216, in launch_sync
raise self.RunError('launch_sync()')
osmo_gsm_tester.core.log.Error: rm-remote-dir(pid=31730): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2071↪gprs:sysmo↪ping_idle_ping.py:34↪ping_idle_ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=31730)]