Skip to content
[Jenkins]Jenkins
log in | sign up

Regression

gprs:sysmo.ping.py (from gprs_sysmo)

Failing for the past 1 build (Since #2069 )
Took 28 sec.

Stacktrace

rm-remote-dir(pid=10158): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2069↪gprs:sysmo↪ping.py:29↪ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=10158)]

Standard Output

----------------------------------------------
trial-2069 gprs:sysmo ping.py
----------------------------------------------
18:30:15.508204 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:30:15.520289 tst                       gprs:sysmo: Using 1 x bts (candidates: 1)
18:30:15.661716 tst                          ping.py: using LAC 41705
18:30:15.784045 tst                          ping.py: using RAC 140
18:30:15.902440 tst                          ping.py: using CellId 41705
18:30:16.021962 tst                          ping.py: using BVCI 41706
18:30:16.044840 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:30:16.055384 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:30:16.065887 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:30:16.076862 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:30:16.087739 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:30:16.098623 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:30:16.109842 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:30:16.120250 tst                       gprs:sysmo: Using 1 x modem (candidates: 4)
18:30:16.413350 tst                       ping.py:19: start network...
18:30:16.547230 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
18:30:17.051594 run          create_hlr_db(pid=9943): Launched
18:30:17.237985 bus                          /gobi_6: Setting Powered False
18:30:18.258658 run          create_hlr_db(pid=9943): Terminated: ok {rc=0}
18:30:18.659005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9945): Launched
18:30:18.956770 run    osmo-hlr_10.42.42.2(pid=9946): Launched
18:30:19.065087 run              osmo-stp_10.42.42.5: Starting osmo-stp
18:30:19.585049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9947): Launched
18:30:19.883474 run    osmo-stp_10.42.42.5(pid=9948): Launched
18:30:19.989018 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
18:30:20.506306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9949): Launched
18:30:20.611863 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
18:30:20.896647 run               patchelf(pid=9950): Launched
18:30:22.137531 run               patchelf(pid=9950): Terminated: ok {rc=0}
18:30:22.258617 run             osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn
18:30:22.538325 run osmo-gsm-tester_setcap_net_admin.sh(pid=9951): Launched
18:30:23.738565 run osmo-gsm-tester_setcap_net_admin.sh(pid=9951): Terminated: ok {rc=0}
18:30:24.163281 run  osmo-ggsn_10.42.42.6(pid=10129): Launched
18:30:24.417986 run             osmo-sgsn_10.42.42.7: Starting osmo-sgsn
18:30:25.075688 run pcap-recorder_any(filters='host 10.42.42.7')(pid=10146): Launched
18:30:25.464135 run  osmo-sgsn_10.42.42.7(pid=10147): Launched
18:30:25.687105 run              osmo-msc_10.42.42.8: Starting osmo-msc
18:30:26.368514 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=10148): Launched
18:30:26.760620 run   osmo-msc_10.42.42.8(pid=10149): Launched
18:30:29.936714 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
18:30:30.451238 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10151): Launched
18:30:30.747842 run   osmo-mgw_10.42.42.3(pid=10152): Launched
18:30:30.853589 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
18:30:31.357177 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10153): Launched
18:30:31.685781 run   osmo-mgw_10.42.42.4(pid=10155): Launched
18:30:31.791943 run              osmo-bsc_10.42.42.9: Starting osmo-bsc
18:30:32.421016 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=10156): Launched
18:30:32.719321 run   osmo-bsc_10.42.42.9(pid=10157): Launched
18:30:38.988983 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.9
18:30:39.518038 run         rm-remote-dir(pid=10158): Launched
18:30:42.704369 run         rm-remote-dir(pid=10158): ERR: Terminated: ERROR {rc=255}  [trial-2069↪gprs:sysmo↪ping.py:29↪ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=10158)]
18:30:42.835629 run         rm-remote-dir(pid=10158): stdout: 
| (launched: 2022-12-20_18:30:39.365399) 
18:30:42.967578 run         rm-remote-dir(pid=10158): stderr: 
| (launched: 2022-12-20_18:30:39.412595)
| ssh: connect to host 10.42.42.114 port 22: No route to host 
18:30:43.021774 tst                       ping.py:29: ERR: Error: rm-remote-dir(pid=10158): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2069↪gprs:sysmo↪ping.py:29↪ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=10158)]  [trial-2069↪gprs:sysmo↪ping.py:29]
18:30:43.029086 tst                       ping.py:29: Test FAILED (27.5 sec)
18:30:43.064008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9945): Terminating (SIGTERM)
18:30:43.103677 run    osmo-hlr_10.42.42.2(pid=9946): Terminating (SIGTERM)
18:30:43.144757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9947): Terminating (SIGTERM)
18:30:43.188412 run    osmo-stp_10.42.42.5(pid=9948): Terminating (SIGTERM)
18:30:43.230185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9949): Terminating (SIGTERM)
18:30:43.270993 run  osmo-ggsn_10.42.42.6(pid=10129): Terminating (SIGTERM)
18:30:43.335034 run pcap-recorder_any(filters='host 10.42.42.7')(pid=10146): Terminating (SIGTERM)
18:30:43.391070 run  osmo-sgsn_10.42.42.7(pid=10147): Terminating (SIGTERM)
18:30:43.436319 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=10148): Terminating (SIGTERM)
18:30:43.477369 run   osmo-msc_10.42.42.8(pid=10149): Terminating (SIGTERM)
18:30:43.518555 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10151): Terminating (SIGTERM)
18:30:43.558378 run   osmo-mgw_10.42.42.3(pid=10152): Terminating (SIGTERM)
18:30:43.598925 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10153): Terminating (SIGTERM)
18:30:43.638387 run   osmo-mgw_10.42.42.4(pid=10155): Terminating (SIGTERM)
18:30:43.678336 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=10156): Terminating (SIGTERM)
18:30:43.717717 run   osmo-bsc_10.42.42.9(pid=10157): Terminating (SIGTERM)
18:30:43.726959 ---      ParallelTerminationStrategy: PID 9945 died...
18:30:43.780513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9945): Terminated: ok {rc=0}
18:30:43.790874 ---      ParallelTerminationStrategy: PID 9946 died...
18:30:43.845546 run    osmo-hlr_10.42.42.2(pid=9946): Terminated: ok {rc=0}
18:30:43.855762 ---      ParallelTerminationStrategy: PID 9947 died...
18:30:43.911505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9947): Terminated: ok {rc=0}
18:30:43.922098 ---      ParallelTerminationStrategy: PID 9948 died...
18:30:43.976850 run    osmo-stp_10.42.42.5(pid=9948): Terminated: ok {rc=0}
18:30:43.987275 ---      ParallelTerminationStrategy: PID 9949 died...
18:30:44.042236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9949): Terminated: ok {rc=0}
18:30:44.053168 ---      ParallelTerminationStrategy: PID 10129 died...
18:30:44.107592 run  osmo-ggsn_10.42.42.6(pid=10129): Terminated: ok {rc=0}
18:30:44.117522 ---      ParallelTerminationStrategy: PID 10146 died...
18:30:44.170911 run pcap-recorder_any(filters='host 10.42.42.7')(pid=10146): Terminated: ok {rc=0}
18:30:44.181234 ---      ParallelTerminationStrategy: PID 10148 died...
18:30:44.234557 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=10148): Terminated: ok {rc=0}
18:30:44.244581 ---      ParallelTerminationStrategy: PID 10149 died...
18:30:44.297607 run   osmo-msc_10.42.42.8(pid=10149): Terminated: ok {rc=0}
18:30:44.307550 ---      ParallelTerminationStrategy: PID 10151 died...
18:30:44.360686 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10151): Terminated: ok {rc=0}
18:30:44.370505 ---      ParallelTerminationStrategy: PID 10152 died...
18:30:44.424038 run   osmo-mgw_10.42.42.3(pid=10152): Terminated {rc=15}
18:30:44.434705 ---      ParallelTerminationStrategy: PID 10153 died...
18:30:44.489841 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10153): Terminated: ok {rc=0}
18:30:44.500478 ---      ParallelTerminationStrategy: PID 10155 died...
18:30:44.556105 run   osmo-mgw_10.42.42.4(pid=10155): Terminated {rc=15}
18:30:44.566836 ---      ParallelTerminationStrategy: PID 10156 died...
18:30:44.622891 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=10156): Terminated: ok {rc=0}
18:30:44.633689 ---      ParallelTerminationStrategy: PID 10157 died...
18:30:44.689290 run   osmo-bsc_10.42.42.9(pid=10157): Terminated: ok {rc=0}
18:30:44.867902 ---      ParallelTerminationStrategy: PID 10147 died...
18:30:44.922876 run  osmo-sgsn_10.42.42.7(pid=10147): Terminated: ok {rc=0}
18:30:45.006598 bus                          /gobi_6: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/ping.py", line 29, in <module>
    bts.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_sysmo.py", line 113, in start
    rem_host.recreate_remote_dir(self.remote_inst)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 146, in recreate_remote_dir
    self.rm_remote_dir(remote_dir)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 139, in rm_remote_dir
    self.run_remote_sync('rm-remote-dir', ('test', '!', '-d', remote_dir_str, '||', 'rm', '-rf', remote_dir_str))
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 134, in run_remote_sync
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 216, in launch_sync
    raise self.RunError('launch_sync()')
osmo_gsm_tester.core.log.Error: rm-remote-dir(pid=10158): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2069↪gprs:sysmo↪ping.py:29↪ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=10158)]