Failed
sms:sysmo.mo_mt_sms.py (from sms_sysmo)
Failing for the past 2 builds
(Since Failed )
Stacktrace
rm-remote-dir(pid=9734): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2070↪sms:sysmo↪mo_mt_sms.py:23↪mo_mt_sms.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=9734)]
Standard Output
---------------------------------------------- trial-2070 sms:sysmo mo_mt_sms.py ---------------------------------------------- 15:41:46.759554 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:41:46.770096 tst sms:sysmo: Using 1 x bts (candidates: 1) 15:41:46.888802 tst mo_mt_sms.py: using LAC 41708 15:41:47.006038 tst mo_mt_sms.py: using RAC 143 15:41:47.124333 tst mo_mt_sms.py: using CellId 41708 15:41:47.239700 tst mo_mt_sms.py: using BVCI 41709 15:41:47.262072 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:41:47.272598 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:41:47.282939 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:41:47.293293 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:41:47.303619 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:41:47.313978 tst sms:sysmo: Using 1 x modem (candidates: 2) 15:41:47.429839 tst sms:sysmo: Using 1 x modem (candidates: 2) 15:41:47.625025 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:49.226800 run create_hlr_db(pid=9717): Launched 15:41:49.396500 bus /sierra_2: Setting Powered False 15:41:50.417261 run create_hlr_db(pid=9717): Terminated: ok {rc=0} 15:41:50.808769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9719): Launched 15:41:51.248296 run osmo-hlr_10.42.42.2(pid=9720): Launched 15:41:51.380026 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:53.967941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9721): Launched 15:41:54.282131 run osmo-stp_10.42.42.5(pid=9722): Launched 15:41:54.396352 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:59.757234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9723): Launched 15:42:00.071890 run osmo-msc_10.42.42.6(pid=9724): Launched 15:42:03.242266 run osmo-mgw_10.42.42.3: Starting osmo-mgw 15:42:04.980683 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=9728): Launched 15:42:05.296039 run osmo-mgw_10.42.42.3(pid=9729): Launched 15:42:05.410120 run osmo-mgw_10.42.42.4: Starting osmo-mgw 15:42:05.945924 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9730): Launched 15:42:06.274962 run osmo-mgw_10.42.42.4(pid=9731): Launched 15:42:06.483937 run osmo-bsc_10.42.42.7: Starting osmo-bsc 15:42:11.093576 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=9732): Launched 15:42:11.386657 run osmo-bsc_10.42.42.7(pid=9733): Launched 15:42:17.641050 run osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7 15:42:18.536641 run rm-remote-dir(pid=9734): Launched 15:42:21.771955 run rm-remote-dir(pid=9734): ERR: Terminated: ERROR {rc=255} [trial-2070↪sms:sysmo↪mo_mt_sms.py:23↪mo_mt_sms.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=9734)] 15:42:21.939688 run rm-remote-dir(pid=9734): stdout: | (launched: 2022-12-23_15:42:18.385235) 15:42:22.083741 run rm-remote-dir(pid=9734): stderr: | (launched: 2022-12-23_15:42:18.431803) | ssh: connect to host 10.42.42.114 port 22: No route to host 15:42:22.143328 tst mo_mt_sms.py:23: ERR: Error: rm-remote-dir(pid=9734): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2070↪sms:sysmo↪mo_mt_sms.py:23↪mo_mt_sms.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=9734)] [trial-2070↪sms:sysmo↪mo_mt_sms.py:23] 15:42:22.152213 tst mo_mt_sms.py:23: Test FAILED (35.4 sec) 15:42:22.193488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9719): Terminating (SIGTERM) 15:42:22.240032 run osmo-hlr_10.42.42.2(pid=9720): Terminating (SIGTERM) 15:42:22.285530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9721): Terminating (SIGTERM) 15:42:22.333008 run osmo-stp_10.42.42.5(pid=9722): Terminating (SIGTERM) 15:42:22.409204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9723): Terminating (SIGTERM) 15:42:22.453622 run osmo-msc_10.42.42.6(pid=9724): Terminating (SIGTERM) 15:42:22.496039 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=9728): Terminating (SIGTERM) 15:42:22.538957 run osmo-mgw_10.42.42.3(pid=9729): Terminating (SIGTERM) 15:42:22.581347 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9730): Terminating (SIGTERM) 15:42:22.622286 run osmo-mgw_10.42.42.4(pid=9731): Terminating (SIGTERM) 15:42:22.670427 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=9732): Terminating (SIGTERM) 15:42:22.713331 run osmo-bsc_10.42.42.7(pid=9733): Terminating (SIGTERM) 15:42:22.723138 --- ParallelTerminationStrategy: PID 9719 died... 15:42:22.781357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9719): Terminated: ok {rc=0} 15:42:22.791414 --- ParallelTerminationStrategy: PID 9720 died... 15:42:22.849013 run osmo-hlr_10.42.42.2(pid=9720): Terminated: ok {rc=0} 15:42:22.858939 --- ParallelTerminationStrategy: PID 9721 died... 15:42:22.916363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9721): Terminated: ok {rc=0} 15:42:22.926468 --- ParallelTerminationStrategy: PID 9722 died... 15:42:22.983683 run osmo-stp_10.42.42.5(pid=9722): Terminated: ok {rc=0} 15:42:22.993714 --- ParallelTerminationStrategy: PID 9723 died... 15:42:23.051153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9723): Terminated: ok {rc=0} 15:42:23.061333 --- ParallelTerminationStrategy: PID 9724 died... 15:42:23.118633 run osmo-msc_10.42.42.6(pid=9724): Terminated: ok {rc=0} 15:42:23.128795 --- ParallelTerminationStrategy: PID 9728 died... 15:42:23.186405 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=9728): Terminated: ok {rc=0} 15:42:23.196557 --- ParallelTerminationStrategy: PID 9729 died... 15:42:23.253854 run osmo-mgw_10.42.42.3(pid=9729): Terminated {rc=15} 15:42:23.263905 --- ParallelTerminationStrategy: PID 9730 died... 15:42:23.321528 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9730): Terminated: ok {rc=0} 15:42:23.331588 --- ParallelTerminationStrategy: PID 9731 died... 15:42:23.389300 run osmo-mgw_10.42.42.4(pid=9731): Terminated {rc=15} 15:42:23.399382 --- ParallelTerminationStrategy: PID 9732 died... 15:42:23.457427 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=9732): Terminated: ok {rc=0} 15:42:23.635965 --- ParallelTerminationStrategy: PID 9733 died... 15:42:23.694707 run osmo-bsc_10.42.42.7(pid=9733): Terminated: ok {rc=0} 15:42:23.781457 bus /sierra_3: Setting Powered False 15:42:24.887802 bus /sierra_3: Setting Powered False 15:42:25.996629 bus /sierra_2: Setting Powered False
Standard Error
Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run self.path) File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file spec.loader.exec_module( importlib.util.module_from_spec(spec) ) File "<frozen importlib._bootstrap_external>", line 728, in exec_module File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/sms/mo_mt_sms.py", line 23, in <module> bts.start() File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_sysmo.py", line 113, in start rem_host.recreate_remote_dir(self.remote_inst) File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 146, in recreate_remote_dir self.rm_remote_dir(remote_dir) File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 139, in rm_remote_dir self.run_remote_sync('rm-remote-dir', ('test', '!', '-d', remote_dir_str, '||', 'rm', '-rf', remote_dir_str)) File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 134, in run_remote_sync proc.launch_sync() File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 216, in launch_sync raise self.RunError('launch_sync()') osmo_gsm_tester.core.log.Error: rm-remote-dir(pid=9734): launch_sync(): local ssh process exited with status 255 (ssh: connect to host 10.42.42.114 port 22: No route to host) [trial-2070↪sms:sysmo↪mo_mt_sms.py:23↪mo_mt_sms.py↪osmo-bts-sysmo↪host-root@10.42.42.114↪rm-remote-dir(pid=9734)]