Failed

ussd:trx-b200.assert_extension.py (from ussd_trx-b200)

Failing for the past 57 builds (Since #749 )

Took 21 sec.

Stacktrace

uname-m(pid=27290): launch_sync(): local ssh process exited with status 255 [trial-805↪ussd:trx-b200↪assert_extension.py:24↪assert_extension.py↪osmo-bts-trx↪osmo-trx-uhd↪host-jenkins@127.0.0.1↪uname-m(pid=27290)]

Standard Output

----------------------------------------------
trial-805 ussd:trx-b200 assert_extension.py
----------------------------------------------
10:46:07.417723 tst                    ussd:trx-b200: Using 1 x ip_address (candidates: 6)
10:46:07.428849 tst                    ussd:trx-b200: Using 1 x bts (candidates: 1)
10:46:07.570960 tst              assert_extension.py: using LAC 7413
10:46:07.698257 tst              assert_extension.py: using RAC 18
10:46:07.824312 tst              assert_extension.py: using CellId 7413
10:46:07.947097 tst              assert_extension.py: using BVCI 7409
10:46:07.970640 tst                    ussd:trx-b200: Using 1 x ip_address (candidates: 6)
10:46:07.981352 tst                    ussd:trx-b200: Using 1 x ip_address (candidates: 6)
10:46:07.992015 tst                    ussd:trx-b200: Using 1 x ip_address (candidates: 6)
10:46:08.002749 tst                    ussd:trx-b200: Using 1 x ip_address (candidates: 6)
10:46:08.013523 tst                    ussd:trx-b200: Using 1 x ip_address (candidates: 6)
10:46:08.024386 tst                    ussd:trx-b200: Using 1 x modem (candidates: 1)
10:46:08.208813 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
10:46:08.692336 run         create_hlr_db(pid=27276): Launched
10:46:08.871609 bus                        /sierra_1: Setting Powered False
10:46:09.892302 run         create_hlr_db(pid=27276): Terminated: ok {rc=0}
10:46:10.327010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27278): Launched
10:46:10.655219 run   osmo-hlr_10.42.42.2(pid=27279): Launched
10:46:10.774141 run              osmo-stp_10.42.42.5: Starting osmo-stp
10:46:11.341602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27280): Launched
10:46:11.668083 run   osmo-stp_10.42.42.5(pid=27281): Launched
10:46:11.784811 run              osmo-msc_10.42.42.6: Starting osmo-msc
10:46:12.373571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27282): Launched
10:46:12.681845 run   osmo-msc_10.42.42.6(pid=27283): Launched
10:46:15.846789 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
10:46:16.381910 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27284): Launched
10:46:16.690633 run   osmo-mgw_10.42.42.3(pid=27285): Launched
10:46:16.801049 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
10:46:17.331619 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27286): Launched
10:46:17.641298 run   osmo-mgw_10.42.42.4(pid=27287): Launched
10:46:17.751791 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
10:46:18.400857 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27288): Launched
10:46:18.711452 run   osmo-bsc_10.42.42.7(pid=27289): Launched
10:46:24.985754 run                     osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
10:46:25.458303 run                     osmo-trx-uhd: OSMOTRX CONF: {'osmo_trx': {'clock_reference': 'external', 'launch_trx': 'True', 'type': 'uhd', 'bts_ip': '10.42.42.50', 'trx_ip': '127.0.0.1', 'egprs': 'disable', 'channels': [{}], 'dev_args': 'type=b200,serial=30A9FFB', 'multi_arfcn': 'True', 'remote_user': 'jenkins'}}
10:46:26.059176 run               uname-m(pid=27290): Launched
10:46:27.262750 run               uname-m(pid=27290): ERR: Terminated: ERROR {rc=255}  [trial-805↪ussd:trx-b200↪assert_extension.py:24↪assert_extension.py↪osmo-bts-trx↪osmo-trx-uhd↪host-jenkins@127.0.0.1↪uname-m(pid=27290)]
10:46:27.408351 run               uname-m(pid=27290): stdout: 
| (launched: 2022-12-04_10:46:25.886439) 
10:46:27.554292 run               uname-m(pid=27290): stderr: 
| (launched: 2022-12-04_10:46:25.938906)
| Host key verification failed. 
10:46:27.614551 tst           assert_extension.py:24: ERR: Error: uname-m(pid=27290): launch_sync(): local ssh process exited with status 255 [trial-805↪ussd:trx-b200↪assert_extension.py:24↪assert_extension.py↪osmo-bts-trx↪osmo-trx-uhd↪host-jenkins@127.0.0.1↪uname-m(pid=27290)]  [trial-805↪ussd:trx-b200↪assert_extension.py:24]
10:46:27.622761 tst           assert_extension.py:24: Test FAILED (20.2 sec)
10:46:27.659213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27278): Terminating (SIGTERM)
10:46:27.700667 run   osmo-hlr_10.42.42.2(pid=27279): Terminating (SIGTERM)
10:46:27.743105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27280): Terminating (SIGTERM)
10:46:27.787907 run   osmo-stp_10.42.42.5(pid=27281): Terminating (SIGTERM)
10:46:27.852170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27282): Terminating (SIGTERM)
10:46:27.899923 run   osmo-msc_10.42.42.6(pid=27283): Terminating (SIGTERM)
10:46:27.941816 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27284): Terminating (SIGTERM)
10:46:27.983379 run   osmo-mgw_10.42.42.3(pid=27285): Terminating (SIGTERM)
10:46:28.025576 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27286): Terminating (SIGTERM)
10:46:28.066913 run   osmo-mgw_10.42.42.4(pid=27287): Terminating (SIGTERM)
10:46:28.109237 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27288): Terminating (SIGTERM)
10:46:28.150663 run   osmo-bsc_10.42.42.7(pid=27289): Terminating (SIGTERM)
10:46:28.160308 ---      ParallelTerminationStrategy: PID 27278 died...
10:46:28.216096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27278): Terminated: ok {rc=0}
10:46:28.226138 ---      ParallelTerminationStrategy: PID 27279 died...
10:46:28.281451 run   osmo-hlr_10.42.42.2(pid=27279): Terminated: ok {rc=0}
10:46:28.291517 ---      ParallelTerminationStrategy: PID 27280 died...
10:46:28.346955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27280): Terminated: ok {rc=0}
10:46:28.356994 ---      ParallelTerminationStrategy: PID 27281 died...
10:46:28.412178 run   osmo-stp_10.42.42.5(pid=27281): Terminated: ok {rc=0}
10:46:28.422220 ---      ParallelTerminationStrategy: PID 27282 died...
10:46:28.477670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27282): Terminated: ok {rc=0}
10:46:28.487660 ---      ParallelTerminationStrategy: PID 27284 died...
10:46:28.543055 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27284): Terminated: ok {rc=0}
10:46:28.553109 ---      ParallelTerminationStrategy: PID 27285 died...
10:46:28.608873 run   osmo-mgw_10.42.42.3(pid=27285): Terminated {rc=15}
10:46:28.619082 ---      ParallelTerminationStrategy: PID 27286 died...
10:46:28.674920 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27286): Terminated: ok {rc=0}
10:46:28.685124 ---      ParallelTerminationStrategy: PID 27287 died...
10:46:28.741127 run   osmo-mgw_10.42.42.4(pid=27287): Terminated {rc=15}
10:46:28.751373 ---      ParallelTerminationStrategy: PID 27288 died...
10:46:28.810378 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27288): Terminated: ok {rc=0}
10:46:28.988742 ---      ParallelTerminationStrategy: PID 27283 died...
10:46:29.045089 run   osmo-msc_10.42.42.6(pid=27283): Terminated: ok {rc=0}
10:46:29.055175 ---      ParallelTerminationStrategy: PID 27289 died...
10:46:29.110279 run   osmo-bsc_10.42.42.7(pid=27289): Terminated: ok {rc=0}
10:46:29.197058 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/ussd/assert_extension.py", line 24, in <module>
    bts.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_osmotrx.py", line 174, in start
    self.trx.start(keepalive)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_osmotrx.py", line 327, in start
    self.start_remotely(keepalive)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_osmotrx.py", line 293, in start_remotely
    have_inst = rem_host.inst_compatible_for_remote()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 150, in inst_compatible_for_remote
    proc = self.run_remote_sync('uname-m', ('uname', '-m'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 134, in run_remote_sync
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 216, in launch_sync
    raise self.RunError('launch_sync()')
osmo_gsm_tester.core.log.Error: uname-m(pid=27290): launch_sync(): local ssh process exited with status 255 [trial-805↪ussd:trx-b200↪assert_extension.py:24↪assert_extension.py↪osmo-bts-trx↪osmo-trx-uhd↪host-jenkins@127.0.0.1↪uname-m(pid=27290)]