Skip to content
[Jenkins]Jenkins
log in | sign up

Failed

gprs:sysmo.ping.py (from gprs_sysmo)

Failing for the past 4 builds (Since #2069 )
Took 28 sec.

Stacktrace

rm-remote-dir(pid=13923): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2072↪gprs:sysmo↪ping.py:29↪ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=13923)]

Standard Output

----------------------------------------------
trial-2072 gprs:sysmo ping.py
----------------------------------------------
16:56:33.180373 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
16:56:33.192018 tst                       gprs:sysmo: Using 1 x bts (candidates: 1)
16:56:33.319820 tst                          ping.py: using LAC 41726
16:56:33.437563 tst                          ping.py: using RAC 161
16:56:33.553388 tst                          ping.py: using CellId 41726
16:56:33.668955 tst                          ping.py: using BVCI 41727
16:56:33.691799 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
16:56:33.702328 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
16:56:33.712912 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
16:56:33.723156 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
16:56:33.733379 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
16:56:33.743577 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
16:56:33.753998 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
16:56:33.764303 tst                       gprs:sysmo: Using 1 x modem (candidates: 4)
16:56:34.054364 tst                       ping.py:19: start network...
16:56:34.187488 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
16:56:34.688663 run         create_hlr_db(pid=13883): Launched
16:56:34.874221 bus                          /gobi_6: Setting Powered False
16:56:35.931729 run         create_hlr_db(pid=13883): Terminated: ok {rc=0}
16:56:36.380893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13885): Launched
16:56:36.737880 run   osmo-hlr_10.42.42.2(pid=13886): Launched
16:56:36.929209 run              osmo-stp_10.42.42.5: Starting osmo-stp
16:56:37.559737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13887): Launched
16:56:37.879600 run   osmo-stp_10.42.42.5(pid=13888): Launched
16:56:37.993705 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
16:56:38.549987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13889): Launched
16:56:38.663459 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
16:56:38.941894 run              patchelf(pid=13890): Launched
16:56:40.132121 run              patchelf(pid=13890): Terminated: ok {rc=0}
16:56:40.249682 run             osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn
16:56:40.533444 run osmo-gsm-tester_setcap_net_admin.sh(pid=13891): Launched
16:56:41.722571 run osmo-gsm-tester_setcap_net_admin.sh(pid=13891): Terminated: ok {rc=0}
16:56:42.048279 run  osmo-ggsn_10.42.42.6(pid=13894): Launched
16:56:42.269109 run             osmo-sgsn_10.42.42.7: Starting osmo-sgsn
16:56:42.820532 run pcap-recorder_any(filters='host 10.42.42.7')(pid=13913): Launched
16:56:43.117748 run  osmo-sgsn_10.42.42.7(pid=13914): Launched
16:56:43.226064 run              osmo-msc_10.42.42.8: Starting osmo-msc
16:56:43.773962 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=13915): Launched
16:56:44.072119 run   osmo-msc_10.42.42.8(pid=13916): Launched
16:56:47.230013 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
16:56:47.748139 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13917): Launched
16:56:48.045036 run   osmo-mgw_10.42.42.3(pid=13918): Launched
16:56:48.151436 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
16:56:48.657245 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13919): Launched
16:56:48.952920 run   osmo-mgw_10.42.42.4(pid=13920): Launched
16:56:49.057820 run              osmo-bsc_10.42.42.9: Starting osmo-bsc
16:56:49.693974 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=13921): Launched
16:56:49.991635 run   osmo-bsc_10.42.42.9(pid=13922): Launched
16:56:56.246408 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.9
16:56:56.779280 run         rm-remote-dir(pid=13923): Launched
16:56:59.968569 run         rm-remote-dir(pid=13923): ERR: Terminated: ERROR {rc=255}  [trial-2072↪gprs:sysmo↪ping.py:29↪ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=13923)]
16:57:00.100460 run         rm-remote-dir(pid=13923): stdout: 
| (launched: 2023-03-07_16:56:56.626049) 
16:57:00.233095 run         rm-remote-dir(pid=13923): stderr: 
| (launched: 2023-03-07_16:56:56.673850)
| ssh: connect to host 10.42.42.114 port 22: No route to host 
16:57:00.287291 tst                       ping.py:29: ERR: Error: rm-remote-dir(pid=13923): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2072↪gprs:sysmo↪ping.py:29↪ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=13923)]  [trial-2072↪gprs:sysmo↪ping.py:29]
16:57:00.294442 tst                       ping.py:29: Test FAILED (27.1 sec)
16:57:00.329352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13885): Terminating (SIGTERM)
16:57:00.369232 run   osmo-hlr_10.42.42.2(pid=13886): Terminating (SIGTERM)
16:57:00.410294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13887): Terminating (SIGTERM)
16:57:00.453380 run   osmo-stp_10.42.42.5(pid=13888): Terminating (SIGTERM)
16:57:00.496045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13889): Terminating (SIGTERM)
16:57:00.539220 run  osmo-ggsn_10.42.42.6(pid=13894): Terminating (SIGTERM)
16:57:00.589355 run pcap-recorder_any(filters='host 10.42.42.7')(pid=13913): Terminating (SIGTERM)
16:57:00.642226 run  osmo-sgsn_10.42.42.7(pid=13914): Terminating (SIGTERM)
16:57:00.686913 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=13915): Terminating (SIGTERM)
16:57:00.730600 run   osmo-msc_10.42.42.8(pid=13916): Terminating (SIGTERM)
16:57:00.778745 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13917): Terminating (SIGTERM)
16:57:00.824976 run   osmo-mgw_10.42.42.3(pid=13918): Terminating (SIGTERM)
16:57:00.873605 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13919): Terminating (SIGTERM)
16:57:00.913561 run   osmo-mgw_10.42.42.4(pid=13920): Terminating (SIGTERM)
16:57:00.953948 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=13921): Terminating (SIGTERM)
16:57:00.993819 run   osmo-bsc_10.42.42.9(pid=13922): Terminating (SIGTERM)
16:57:01.002853 ---      ParallelTerminationStrategy: PID 13885 died...
16:57:01.056505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13885): Terminated: ok {rc=0}
16:57:01.067052 ---      ParallelTerminationStrategy: PID 13886 died...
16:57:01.122879 run   osmo-hlr_10.42.42.2(pid=13886): Terminated: ok {rc=0}
16:57:01.133498 ---      ParallelTerminationStrategy: PID 13887 died...
16:57:01.191598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13887): Terminated: ok {rc=0}
16:57:01.202637 ---      ParallelTerminationStrategy: PID 13888 died...
16:57:01.277864 run   osmo-stp_10.42.42.5(pid=13888): Terminated: ok {rc=0}
16:57:01.288763 ---      ParallelTerminationStrategy: PID 13889 died...
16:57:01.346366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13889): Terminated: ok {rc=0}
16:57:01.362003 ---      ParallelTerminationStrategy: PID 13894 died...
16:57:01.415495 run  osmo-ggsn_10.42.42.6(pid=13894): Terminated: ok {rc=0}
16:57:01.425729 ---      ParallelTerminationStrategy: PID 13913 died...
16:57:01.478836 run pcap-recorder_any(filters='host 10.42.42.7')(pid=13913): Terminated: ok {rc=0}
16:57:01.488599 ---      ParallelTerminationStrategy: PID 13915 died...
16:57:01.541407 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=13915): Terminated: ok {rc=0}
16:57:01.551143 ---      ParallelTerminationStrategy: PID 13916 died...
16:57:01.604371 run   osmo-msc_10.42.42.8(pid=13916): Terminated: ok {rc=0}
16:57:01.614363 ---      ParallelTerminationStrategy: PID 13917 died...
16:57:01.667835 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13917): Terminated: ok {rc=0}
16:57:01.678097 ---      ParallelTerminationStrategy: PID 13918 died...
16:57:01.732479 run   osmo-mgw_10.42.42.3(pid=13918): Terminated {rc=15}
16:57:01.742757 ---      ParallelTerminationStrategy: PID 13919 died...
16:57:01.798498 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13919): Terminated: ok {rc=0}
16:57:01.809125 ---      ParallelTerminationStrategy: PID 13920 died...
16:57:01.864694 run   osmo-mgw_10.42.42.4(pid=13920): Terminated {rc=15}
16:57:01.875076 ---      ParallelTerminationStrategy: PID 13921 died...
16:57:01.930372 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=13921): Terminated: ok {rc=0}
16:57:01.940664 ---      ParallelTerminationStrategy: PID 13922 died...
16:57:01.994632 run   osmo-bsc_10.42.42.9(pid=13922): Terminated: ok {rc=0}
16:57:02.004438 ---      ParallelTerminationStrategy: PID 13914 died...
16:57:02.057363 run  osmo-sgsn_10.42.42.7(pid=13914): Terminated: ok {rc=0}
16:57:02.141002 bus                          /gobi_6: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/ping.py", line 29, in <module>
    bts.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_sysmo.py", line 113, in start
    rem_host.recreate_remote_dir(self.remote_inst)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 146, in recreate_remote_dir
    self.rm_remote_dir(remote_dir)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 139, in rm_remote_dir
    self.run_remote_sync('rm-remote-dir', ('test', '!', '-d', remote_dir_str, '||', 'rm', '-rf', remote_dir_str))
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 134, in run_remote_sync
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 216, in launch_sync
    raise self.RunError('launch_sync()')
osmo_gsm_tester.core.log.Error: rm-remote-dir(pid=13923): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2072↪gprs:sysmo↪ping.py:29↪ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=13923)]