![[Jenkins]](/jenkins/static/b68c8964/images/svgs/logo.svg){kind=logo}
Regression
gprs:sysmo.ping.py (from gprs_sysmo)
Failing for the past 1 build
(Since Failed )
Stacktrace
rm-remote-dir(pid=10158): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2069↪gprs:sysmo↪ping.py:29↪ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=10158)]
Standard Output
----------------------------------------------
trial-2069 gprs:sysmo ping.py
----------------------------------------------
18:30:15.508204 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:30:15.520289 tst gprs:sysmo: Using 1 x bts (candidates: 1)
18:30:15.661716 tst ping.py: using LAC 41705
18:30:15.784045 tst ping.py: using RAC 140
18:30:15.902440 tst ping.py: using CellId 41705
18:30:16.021962 tst ping.py: using BVCI 41706
18:30:16.044840 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:30:16.055384 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:30:16.065887 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:30:16.076862 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:30:16.087739 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:30:16.098623 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:30:16.109842 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:30:16.120250 tst gprs:sysmo: Using 1 x modem (candidates: 4)
18:30:16.413350 tst ping.py:19: start network...
18:30:16.547230 run osmo-hlr_10.42.42.2: Starting osmo-hlr
18:30:17.051594 run create_hlr_db(pid=9943): Launched
18:30:17.237985 bus /gobi_6: Setting Powered False
18:30:18.258658 run create_hlr_db(pid=9943): Terminated: ok {rc=0}
18:30:18.659005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9945): Launched
18:30:18.956770 run osmo-hlr_10.42.42.2(pid=9946): Launched
18:30:19.065087 run osmo-stp_10.42.42.5: Starting osmo-stp
18:30:19.585049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9947): Launched
18:30:19.883474 run osmo-stp_10.42.42.5(pid=9948): Launched
18:30:19.989018 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn
18:30:20.506306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9949): Launched
18:30:20.611863 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
18:30:20.896647 run patchelf(pid=9950): Launched
18:30:22.137531 run patchelf(pid=9950): Terminated: ok {rc=0}
18:30:22.258617 run osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn
18:30:22.538325 run osmo-gsm-tester_setcap_net_admin.sh(pid=9951): Launched
18:30:23.738565 run osmo-gsm-tester_setcap_net_admin.sh(pid=9951): Terminated: ok {rc=0}
18:30:24.163281 run osmo-ggsn_10.42.42.6(pid=10129): Launched
18:30:24.417986 run osmo-sgsn_10.42.42.7: Starting osmo-sgsn
18:30:25.075688 run pcap-recorder_any(filters='host 10.42.42.7')(pid=10146): Launched
18:30:25.464135 run osmo-sgsn_10.42.42.7(pid=10147): Launched
18:30:25.687105 run osmo-msc_10.42.42.8: Starting osmo-msc
18:30:26.368514 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=10148): Launched
18:30:26.760620 run osmo-msc_10.42.42.8(pid=10149): Launched
18:30:29.936714 run osmo-mgw_10.42.42.3: Starting osmo-mgw
18:30:30.451238 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10151): Launched
18:30:30.747842 run osmo-mgw_10.42.42.3(pid=10152): Launched
18:30:30.853589 run osmo-mgw_10.42.42.4: Starting osmo-mgw
18:30:31.357177 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10153): Launched
18:30:31.685781 run osmo-mgw_10.42.42.4(pid=10155): Launched
18:30:31.791943 run osmo-bsc_10.42.42.9: Starting osmo-bsc
18:30:32.421016 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=10156): Launched
18:30:32.719321 run osmo-bsc_10.42.42.9(pid=10157): Launched
18:30:38.988983 run osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.9
18:30:39.518038 run rm-remote-dir(pid=10158): Launched
18:30:42.704369 run rm-remote-dir(pid=10158): ERR: Terminated: ERROR {rc=255} [trial-2069↪gprs:sysmo↪ping.py:29↪ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=10158)]
18:30:42.835629 run rm-remote-dir(pid=10158): stdout:
| (launched: 2022-12-20_18:30:39.365399)
18:30:42.967578 run rm-remote-dir(pid=10158): stderr:
| (launched: 2022-12-20_18:30:39.412595)
| ssh: connect to host 10.42.42.114 port 22: No route to host
18:30:43.021774 tst ping.py:29: ERR: Error: rm-remote-dir(pid=10158): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2069↪gprs:sysmo↪ping.py:29↪ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=10158)] [trial-2069↪gprs:sysmo↪ping.py:29]
18:30:43.029086 tst ping.py:29: Test FAILED (27.5 sec)
18:30:43.064008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9945): Terminating (SIGTERM)
18:30:43.103677 run osmo-hlr_10.42.42.2(pid=9946): Terminating (SIGTERM)
18:30:43.144757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9947): Terminating (SIGTERM)
18:30:43.188412 run osmo-stp_10.42.42.5(pid=9948): Terminating (SIGTERM)
18:30:43.230185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9949): Terminating (SIGTERM)
18:30:43.270993 run osmo-ggsn_10.42.42.6(pid=10129): Terminating (SIGTERM)
18:30:43.335034 run pcap-recorder_any(filters='host 10.42.42.7')(pid=10146): Terminating (SIGTERM)
18:30:43.391070 run osmo-sgsn_10.42.42.7(pid=10147): Terminating (SIGTERM)
18:30:43.436319 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=10148): Terminating (SIGTERM)
18:30:43.477369 run osmo-msc_10.42.42.8(pid=10149): Terminating (SIGTERM)
18:30:43.518555 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10151): Terminating (SIGTERM)
18:30:43.558378 run osmo-mgw_10.42.42.3(pid=10152): Terminating (SIGTERM)
18:30:43.598925 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10153): Terminating (SIGTERM)
18:30:43.638387 run osmo-mgw_10.42.42.4(pid=10155): Terminating (SIGTERM)
18:30:43.678336 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=10156): Terminating (SIGTERM)
18:30:43.717717 run osmo-bsc_10.42.42.9(pid=10157): Terminating (SIGTERM)
18:30:43.726959 --- ParallelTerminationStrategy: PID 9945 died...
18:30:43.780513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9945): Terminated: ok {rc=0}
18:30:43.790874 --- ParallelTerminationStrategy: PID 9946 died...
18:30:43.845546 run osmo-hlr_10.42.42.2(pid=9946): Terminated: ok {rc=0}
18:30:43.855762 --- ParallelTerminationStrategy: PID 9947 died...
18:30:43.911505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9947): Terminated: ok {rc=0}
18:30:43.922098 --- ParallelTerminationStrategy: PID 9948 died...
18:30:43.976850 run osmo-stp_10.42.42.5(pid=9948): Terminated: ok {rc=0}
18:30:43.987275 --- ParallelTerminationStrategy: PID 9949 died...
18:30:44.042236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9949): Terminated: ok {rc=0}
18:30:44.053168 --- ParallelTerminationStrategy: PID 10129 died...
18:30:44.107592 run osmo-ggsn_10.42.42.6(pid=10129): Terminated: ok {rc=0}
18:30:44.117522 --- ParallelTerminationStrategy: PID 10146 died...
18:30:44.170911 run pcap-recorder_any(filters='host 10.42.42.7')(pid=10146): Terminated: ok {rc=0}
18:30:44.181234 --- ParallelTerminationStrategy: PID 10148 died...
18:30:44.234557 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=10148): Terminated: ok {rc=0}
18:30:44.244581 --- ParallelTerminationStrategy: PID 10149 died...
18:30:44.297607 run osmo-msc_10.42.42.8(pid=10149): Terminated: ok {rc=0}
18:30:44.307550 --- ParallelTerminationStrategy: PID 10151 died...
18:30:44.360686 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10151): Terminated: ok {rc=0}
18:30:44.370505 --- ParallelTerminationStrategy: PID 10152 died...
18:30:44.424038 run osmo-mgw_10.42.42.3(pid=10152): Terminated {rc=15}
18:30:44.434705 --- ParallelTerminationStrategy: PID 10153 died...
18:30:44.489841 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10153): Terminated: ok {rc=0}
18:30:44.500478 --- ParallelTerminationStrategy: PID 10155 died...
18:30:44.556105 run osmo-mgw_10.42.42.4(pid=10155): Terminated {rc=15}
18:30:44.566836 --- ParallelTerminationStrategy: PID 10156 died...
18:30:44.622891 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=10156): Terminated: ok {rc=0}
18:30:44.633689 --- ParallelTerminationStrategy: PID 10157 died...
18:30:44.689290 run osmo-bsc_10.42.42.9(pid=10157): Terminated: ok {rc=0}
18:30:44.867902 --- ParallelTerminationStrategy: PID 10147 died...
18:30:44.922876 run osmo-sgsn_10.42.42.7(pid=10147): Terminated: ok {rc=0}
18:30:45.006598 bus /gobi_6: Setting Powered False
Standard Error
Traceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/ping.py", line 29, in <module>
bts.start()
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_sysmo.py", line 113, in start
rem_host.recreate_remote_dir(self.remote_inst)
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 146, in recreate_remote_dir
self.rm_remote_dir(remote_dir)
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 139, in rm_remote_dir
self.run_remote_sync('rm-remote-dir', ('test', '!', '-d', remote_dir_str, '||', 'rm', '-rf', remote_dir_str))
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 134, in run_remote_sync
proc.launch_sync()
File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 216, in launch_sync
raise self.RunError('launch_sync()')
osmo_gsm_tester.core.log.Error: rm-remote-dir(pid=10158): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2069↪gprs:sysmo↪ping.py:29↪ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=10158)]