![[Jenkins]](/jenkins/static/b68c8964/images/svgs/logo.svg){kind=logo}
Failed
gprs:sysmo.ping.py (from gprs_sysmo)
Failing for the past 4 builds
(Since Failed )
Stacktrace
rm-remote-dir(pid=13923): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2072↪gprs:sysmo↪ping.py:29↪ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=13923)]
Standard Output
----------------------------------------------
trial-2072 gprs:sysmo ping.py
----------------------------------------------
16:56:33.180373 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
16:56:33.192018 tst gprs:sysmo: Using 1 x bts (candidates: 1)
16:56:33.319820 tst ping.py: using LAC 41726
16:56:33.437563 tst ping.py: using RAC 161
16:56:33.553388 tst ping.py: using CellId 41726
16:56:33.668955 tst ping.py: using BVCI 41727
16:56:33.691799 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
16:56:33.702328 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
16:56:33.712912 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
16:56:33.723156 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
16:56:33.733379 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
16:56:33.743577 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
16:56:33.753998 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
16:56:33.764303 tst gprs:sysmo: Using 1 x modem (candidates: 4)
16:56:34.054364 tst ping.py:19: start network...
16:56:34.187488 run osmo-hlr_10.42.42.2: Starting osmo-hlr
16:56:34.688663 run create_hlr_db(pid=13883): Launched
16:56:34.874221 bus /gobi_6: Setting Powered False
16:56:35.931729 run create_hlr_db(pid=13883): Terminated: ok {rc=0}
16:56:36.380893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13885): Launched
16:56:36.737880 run osmo-hlr_10.42.42.2(pid=13886): Launched
16:56:36.929209 run osmo-stp_10.42.42.5: Starting osmo-stp
16:56:37.559737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13887): Launched
16:56:37.879600 run osmo-stp_10.42.42.5(pid=13888): Launched
16:56:37.993705 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn
16:56:38.549987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13889): Launched
16:56:38.663459 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
16:56:38.941894 run patchelf(pid=13890): Launched
16:56:40.132121 run patchelf(pid=13890): Terminated: ok {rc=0}
16:56:40.249682 run osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn
16:56:40.533444 run osmo-gsm-tester_setcap_net_admin.sh(pid=13891): Launched
16:56:41.722571 run osmo-gsm-tester_setcap_net_admin.sh(pid=13891): Terminated: ok {rc=0}
16:56:42.048279 run osmo-ggsn_10.42.42.6(pid=13894): Launched
16:56:42.269109 run osmo-sgsn_10.42.42.7: Starting osmo-sgsn
16:56:42.820532 run pcap-recorder_any(filters='host 10.42.42.7')(pid=13913): Launched
16:56:43.117748 run osmo-sgsn_10.42.42.7(pid=13914): Launched
16:56:43.226064 run osmo-msc_10.42.42.8: Starting osmo-msc
16:56:43.773962 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=13915): Launched
16:56:44.072119 run osmo-msc_10.42.42.8(pid=13916): Launched
16:56:47.230013 run osmo-mgw_10.42.42.3: Starting osmo-mgw
16:56:47.748139 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13917): Launched
16:56:48.045036 run osmo-mgw_10.42.42.3(pid=13918): Launched
16:56:48.151436 run osmo-mgw_10.42.42.4: Starting osmo-mgw
16:56:48.657245 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13919): Launched
16:56:48.952920 run osmo-mgw_10.42.42.4(pid=13920): Launched
16:56:49.057820 run osmo-bsc_10.42.42.9: Starting osmo-bsc
16:56:49.693974 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=13921): Launched
16:56:49.991635 run osmo-bsc_10.42.42.9(pid=13922): Launched
16:56:56.246408 run osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.9
16:56:56.779280 run rm-remote-dir(pid=13923): Launched
16:56:59.968569 run rm-remote-dir(pid=13923): ERR: Terminated: ERROR {rc=255} [trial-2072↪gprs:sysmo↪ping.py:29↪ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=13923)]
16:57:00.100460 run rm-remote-dir(pid=13923): stdout:
| (launched: 2023-03-07_16:56:56.626049)
16:57:00.233095 run rm-remote-dir(pid=13923): stderr:
| (launched: 2023-03-07_16:56:56.673850)
| ssh: connect to host 10.42.42.114 port 22: No route to host
16:57:00.287291 tst ping.py:29: ERR: Error: rm-remote-dir(pid=13923): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2072↪gprs:sysmo↪ping.py:29↪ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=13923)] [trial-2072↪gprs:sysmo↪ping.py:29]
16:57:00.294442 tst ping.py:29: Test FAILED (27.1 sec)
16:57:00.329352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13885): Terminating (SIGTERM)
16:57:00.369232 run osmo-hlr_10.42.42.2(pid=13886): Terminating (SIGTERM)
16:57:00.410294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13887): Terminating (SIGTERM)
16:57:00.453380 run osmo-stp_10.42.42.5(pid=13888): Terminating (SIGTERM)
16:57:00.496045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13889): Terminating (SIGTERM)
16:57:00.539220 run osmo-ggsn_10.42.42.6(pid=13894): Terminating (SIGTERM)
16:57:00.589355 run pcap-recorder_any(filters='host 10.42.42.7')(pid=13913): Terminating (SIGTERM)
16:57:00.642226 run osmo-sgsn_10.42.42.7(pid=13914): Terminating (SIGTERM)
16:57:00.686913 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=13915): Terminating (SIGTERM)
16:57:00.730600 run osmo-msc_10.42.42.8(pid=13916): Terminating (SIGTERM)
16:57:00.778745 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13917): Terminating (SIGTERM)
16:57:00.824976 run osmo-mgw_10.42.42.3(pid=13918): Terminating (SIGTERM)
16:57:00.873605 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13919): Terminating (SIGTERM)
16:57:00.913561 run osmo-mgw_10.42.42.4(pid=13920): Terminating (SIGTERM)
16:57:00.953948 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=13921): Terminating (SIGTERM)
16:57:00.993819 run osmo-bsc_10.42.42.9(pid=13922): Terminating (SIGTERM)
16:57:01.002853 --- ParallelTerminationStrategy: PID 13885 died...
16:57:01.056505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13885): Terminated: ok {rc=0}
16:57:01.067052 --- ParallelTerminationStrategy: PID 13886 died...
16:57:01.122879 run osmo-hlr_10.42.42.2(pid=13886): Terminated: ok {rc=0}
16:57:01.133498 --- ParallelTerminationStrategy: PID 13887 died...
16:57:01.191598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13887): Terminated: ok {rc=0}
16:57:01.202637 --- ParallelTerminationStrategy: PID 13888 died...
16:57:01.277864 run osmo-stp_10.42.42.5(pid=13888): Terminated: ok {rc=0}
16:57:01.288763 --- ParallelTerminationStrategy: PID 13889 died...
16:57:01.346366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13889): Terminated: ok {rc=0}
16:57:01.362003 --- ParallelTerminationStrategy: PID 13894 died...
16:57:01.415495 run osmo-ggsn_10.42.42.6(pid=13894): Terminated: ok {rc=0}
16:57:01.425729 --- ParallelTerminationStrategy: PID 13913 died...
16:57:01.478836 run pcap-recorder_any(filters='host 10.42.42.7')(pid=13913): Terminated: ok {rc=0}
16:57:01.488599 --- ParallelTerminationStrategy: PID 13915 died...
16:57:01.541407 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=13915): Terminated: ok {rc=0}
16:57:01.551143 --- ParallelTerminationStrategy: PID 13916 died...
16:57:01.604371 run osmo-msc_10.42.42.8(pid=13916): Terminated: ok {rc=0}
16:57:01.614363 --- ParallelTerminationStrategy: PID 13917 died...
16:57:01.667835 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13917): Terminated: ok {rc=0}
16:57:01.678097 --- ParallelTerminationStrategy: PID 13918 died...
16:57:01.732479 run osmo-mgw_10.42.42.3(pid=13918): Terminated {rc=15}
16:57:01.742757 --- ParallelTerminationStrategy: PID 13919 died...
16:57:01.798498 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13919): Terminated: ok {rc=0}
16:57:01.809125 --- ParallelTerminationStrategy: PID 13920 died...
16:57:01.864694 run osmo-mgw_10.42.42.4(pid=13920): Terminated {rc=15}
16:57:01.875076 --- ParallelTerminationStrategy: PID 13921 died...
16:57:01.930372 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=13921): Terminated: ok {rc=0}
16:57:01.940664 --- ParallelTerminationStrategy: PID 13922 died...
16:57:01.994632 run osmo-bsc_10.42.42.9(pid=13922): Terminated: ok {rc=0}
16:57:02.004438 --- ParallelTerminationStrategy: PID 13914 died...
16:57:02.057363 run osmo-sgsn_10.42.42.7(pid=13914): Terminated: ok {rc=0}
16:57:02.141002 bus /gobi_6: Setting Powered False
Standard Error
Traceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/ping.py", line 29, in <module>
bts.start()
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_sysmo.py", line 113, in start
rem_host.recreate_remote_dir(self.remote_inst)
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 146, in recreate_remote_dir
self.rm_remote_dir(remote_dir)
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 139, in rm_remote_dir
self.run_remote_sync('rm-remote-dir', ('test', '!', '-d', remote_dir_str, '||', 'rm', '-rf', remote_dir_str))
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 134, in run_remote_sync
proc.launch_sync()
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 216, in launch_sync
raise self.RunError('launch_sync()')
osmo_gsm_tester.core.log.Error: rm-remote-dir(pid=13923): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2072↪gprs:sysmo↪ping.py:29↪ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=13923)]