Skip to content
[Jenkins]Jenkins
log insign up

Failed

gprs:sysmo.ping_idle_ping.py (from gprs_sysmo)

Failing for the past 3 builds (Since Failed#2069 )
Took 28 sec.

Stacktrace

rm-remote-dir(pid=31730): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2071↪gprs:sysmo↪ping_idle_ping.py:34↪ping_idle_ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=31730)]

Standard Output

----------------------------------------------
trial-2071 gprs:sysmo ping_idle_ping.py
----------------------------------------------
22:01:10.981176 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
22:01:10.993283 tst                       gprs:sysmo: Using 1 x bts (candidates: 1)
22:01:11.125236 tst                ping_idle_ping.py: using LAC 41720
22:01:11.253710 tst                ping_idle_ping.py: using RAC 155
22:01:11.378946 tst                ping_idle_ping.py: using CellId 41720
22:01:11.500066 tst                ping_idle_ping.py: using BVCI 41721
22:01:11.523248 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
22:01:11.533852 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
22:01:11.544645 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
22:01:11.555520 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
22:01:11.566446 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
22:01:11.577443 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
22:01:11.588123 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
22:01:11.598916 tst                       gprs:sysmo: Using 1 x modem (candidates: 4)
22:01:11.891792 tst             ping_idle_ping.py:24: start network...
22:01:12.026003 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
22:01:12.546302 run         create_hlr_db(pid=31692): Launched
22:01:12.735017 bus                          /gobi_6: Setting Powered False
22:01:13.754765 run         create_hlr_db(pid=31692): Terminated: ok {rc=0}
22:01:14.162631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31694): Launched
22:01:14.468028 run   osmo-hlr_10.42.42.2(pid=31695): Launched
22:01:14.577115 run              osmo-stp_10.42.42.5: Starting osmo-stp
22:01:15.101428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31696): Launched
22:01:15.403369 run   osmo-stp_10.42.42.5(pid=31697): Launched
22:01:15.510450 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
22:01:16.038512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31698): Launched
22:01:16.146901 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
22:01:16.412391 run              patchelf(pid=31699): Launched
22:01:17.594183 run              patchelf(pid=31699): Terminated: ok {rc=0}
22:01:17.705547 run             osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn
22:01:17.979991 run osmo-gsm-tester_setcap_net_admin.sh(pid=31700): Launched
22:01:19.172960 run osmo-gsm-tester_setcap_net_admin.sh(pid=31700): Terminated: ok {rc=0}
22:01:19.500142 run  osmo-ggsn_10.42.42.6(pid=31703): Launched
22:01:19.748747 run             osmo-sgsn_10.42.42.7: Starting osmo-sgsn
22:01:20.327311 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31720): Launched
22:01:20.652140 run  osmo-sgsn_10.42.42.7(pid=31721): Launched
22:01:20.797587 run              osmo-msc_10.42.42.8: Starting osmo-msc
22:01:21.541828 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31722): Launched
22:01:21.884553 run   osmo-msc_10.42.42.8(pid=31723): Launched
22:01:25.077495 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
22:01:25.638830 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31724): Launched
22:01:25.961992 run   osmo-mgw_10.42.42.3(pid=31725): Launched
22:01:26.078725 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
22:01:26.631744 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31726): Launched
22:01:26.956592 run   osmo-mgw_10.42.42.4(pid=31727): Launched
22:01:27.072824 run              osmo-bsc_10.42.42.9: Starting osmo-bsc
22:01:27.752384 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31728): Launched
22:01:28.077355 run   osmo-bsc_10.42.42.9(pid=31729): Launched
22:01:34.337397 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.9
22:01:34.878715 run         rm-remote-dir(pid=31730): Launched
22:01:38.068798 run         rm-remote-dir(pid=31730): ERR: Terminated: ERROR {rc=255}  [trial-2071↪gprs:sysmo↪ping_idle_ping.py:34↪ping_idle_ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=31730)]
22:01:38.202717 run         rm-remote-dir(pid=31730): stdout: 
| (launched: 2023-01-03_22:01:34.723237) 
22:01:38.336709 run         rm-remote-dir(pid=31730): stderr: 
| (launched: 2023-01-03_22:01:34.771369)
| ssh: connect to host 10.42.42.114 port 22: No route to host 
22:01:38.391661 tst             ping_idle_ping.py:34: ERR: Error: rm-remote-dir(pid=31730): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2071↪gprs:sysmo↪ping_idle_ping.py:34↪ping_idle_ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=31730)]  [trial-2071↪gprs:sysmo↪ping_idle_ping.py:34]
22:01:38.398864 tst             ping_idle_ping.py:34: Test FAILED (27.4 sec)
22:01:38.434673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31694): Terminating (SIGTERM)
22:01:38.475189 run   osmo-hlr_10.42.42.2(pid=31695): Terminating (SIGTERM)
22:01:38.517669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31696): Terminating (SIGTERM)
22:01:38.560864 run   osmo-stp_10.42.42.5(pid=31697): Terminating (SIGTERM)
22:01:38.604479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31698): Terminating (SIGTERM)
22:01:38.646319 run  osmo-ggsn_10.42.42.6(pid=31703): Terminating (SIGTERM)
22:01:38.697470 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31720): Terminating (SIGTERM)
22:01:38.761729 run  osmo-sgsn_10.42.42.7(pid=31721): Terminating (SIGTERM)
22:01:38.805268 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31722): Terminating (SIGTERM)
22:01:38.848748 run   osmo-msc_10.42.42.8(pid=31723): Terminating (SIGTERM)
22:01:38.892459 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31724): Terminating (SIGTERM)
22:01:38.933870 run   osmo-mgw_10.42.42.3(pid=31725): Terminating (SIGTERM)
22:01:38.975689 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31726): Terminating (SIGTERM)
22:01:39.017484 run   osmo-mgw_10.42.42.4(pid=31727): Terminating (SIGTERM)
22:01:39.059263 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31728): Terminating (SIGTERM)
22:01:39.102112 run   osmo-bsc_10.42.42.9(pid=31729): Terminating (SIGTERM)
22:01:39.111906 ---      ParallelTerminationStrategy: PID 31694 died...
22:01:39.169396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31694): Terminated: ok {rc=0}
22:01:39.179854 ---      ParallelTerminationStrategy: PID 31695 died...
22:01:39.247286 run   osmo-hlr_10.42.42.2(pid=31695): Terminated: ok {rc=0}
22:01:39.258168 ---      ParallelTerminationStrategy: PID 31696 died...
22:01:39.317306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31696): Terminated: ok {rc=0}
22:01:39.328283 ---      ParallelTerminationStrategy: PID 31697 died...
22:01:39.387242 run   osmo-stp_10.42.42.5(pid=31697): Terminated: ok {rc=0}
22:01:39.399869 ---      ParallelTerminationStrategy: PID 31698 died...
22:01:39.453995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31698): Terminated: ok {rc=0}
22:01:39.464024 ---      ParallelTerminationStrategy: PID 31703 died...
22:01:39.518016 run  osmo-ggsn_10.42.42.6(pid=31703): Terminated: ok {rc=0}
22:01:39.527646 ---      ParallelTerminationStrategy: PID 31720 died...
22:01:39.581604 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31720): Terminated: ok {rc=0}
22:01:39.591362 ---      ParallelTerminationStrategy: PID 31722 died...
22:01:39.645536 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31722): Terminated: ok {rc=0}
22:01:39.655336 ---      ParallelTerminationStrategy: PID 31723 died...
22:01:39.709503 run   osmo-msc_10.42.42.8(pid=31723): Terminated: ok {rc=0}
22:01:39.719185 ---      ParallelTerminationStrategy: PID 31724 died...
22:01:39.773059 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31724): Terminated: ok {rc=0}
22:01:39.783755 ---      ParallelTerminationStrategy: PID 31725 died...
22:01:39.839687 run   osmo-mgw_10.42.42.3(pid=31725): Terminated {rc=15}
22:01:39.850069 ---      ParallelTerminationStrategy: PID 31726 died...
22:01:39.907067 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31726): Terminated: ok {rc=0}
22:01:39.917826 ---      ParallelTerminationStrategy: PID 31727 died...
22:01:39.974797 run   osmo-mgw_10.42.42.4(pid=31727): Terminated {rc=15}
22:01:39.985528 ---      ParallelTerminationStrategy: PID 31728 died...
22:01:40.042422 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31728): Terminated: ok {rc=0}
22:01:40.052893 ---      ParallelTerminationStrategy: PID 31729 died...
22:01:40.108133 run   osmo-bsc_10.42.42.9(pid=31729): Terminated: ok {rc=0}
22:01:40.117959 ---      ParallelTerminationStrategy: PID 31721 died...
22:01:40.171717 run  osmo-sgsn_10.42.42.7(pid=31721): Terminated: ok {rc=0}
22:01:40.262347 bus                          /gobi_6: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/ping_idle_ping.py", line 34, in <module>
    bts.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_sysmo.py", line 113, in start
    rem_host.recreate_remote_dir(self.remote_inst)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 146, in recreate_remote_dir
    self.rm_remote_dir(remote_dir)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 139, in rm_remote_dir
    self.run_remote_sync('rm-remote-dir', ('test', '!', '-d', remote_dir_str, '||', 'rm', '-rf', remote_dir_str))
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 134, in run_remote_sync
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 216, in launch_sync
    raise self.RunError('launch_sync()')
osmo_gsm_tester.core.log.Error: rm-remote-dir(pid=31730): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2071↪gprs:sysmo↪ping_idle_ping.py:34↪ping_idle_ping.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=31730)]