Skip to content

Failed

emergency:trx-b200.emergency_mo_mt_call.py (from emergency_trx-b200)

Failing for the past 81 builds (Since #749 )
Took 21 sec.

Stacktrace

uname-m(pid=1219): launch_sync(): local ssh process exited with status 255 [trial-829↪emergency:trx-b200↪emergency_mo_mt_call.py:27↪emergency_mo_mt_call.py↪osmo-bts-trx↪osmo-trx-uhd↪host-jenkins@127.0.0.1↪uname-m(pid=1219)]

Standard Output

----------------------------------------------
trial-829 emergency:trx-b200 emergency_mo_mt_call.py
----------------------------------------------
17:05:21.868409 tst               emergency:trx-b200: Using 1 x ip_address (candidates: 6)
17:05:21.879057 tst               emergency:trx-b200: Using 1 x bts (candidates: 1)
17:05:22.019594 tst          emergency_mo_mt_call.py: using LAC 9352
17:05:22.146235 tst          emergency_mo_mt_call.py: using RAC 172
17:05:22.270693 tst          emergency_mo_mt_call.py: using CellId 9352
17:05:22.395358 tst          emergency_mo_mt_call.py: using BVCI 9348
17:05:22.420023 tst               emergency:trx-b200: Using 1 x ip_address (candidates: 6)
17:05:22.431366 tst               emergency:trx-b200: Using 1 x ip_address (candidates: 6)
17:05:22.442738 tst               emergency:trx-b200: Using 1 x ip_address (candidates: 6)
17:05:22.453919 tst               emergency:trx-b200: Using 1 x ip_address (candidates: 6)
17:05:22.464904 tst               emergency:trx-b200: Using 1 x ip_address (candidates: 6)
17:05:22.475970 tst               emergency:trx-b200: Using 1 x modem (candidates: 4)
17:05:22.577486 tst               emergency:trx-b200: Using 1 x modem (candidates: 4)
17:05:22.769640 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
17:05:23.288523 run          create_hlr_db(pid=1204): Launched
17:05:23.476496 bus                        /sierra_1: Setting Powered False
17:05:24.496846 run          create_hlr_db(pid=1204): Terminated: ok {rc=0}
17:05:24.907241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1206): Launched
17:05:25.211988 run    osmo-hlr_10.42.42.2(pid=1207): Launched
17:05:25.321129 run              osmo-stp_10.42.42.5: Starting osmo-stp
17:05:25.851463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1208): Launched
17:05:26.158000 run    osmo-stp_10.42.42.5(pid=1209): Launched
17:05:26.280013 tst          emergency_mo_mt_call.py: using MSISDN 6071
17:05:26.430999 run              osmo-msc_10.42.42.6: Starting osmo-msc
17:05:26.989884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1210): Launched
17:05:27.297829 run    osmo-msc_10.42.42.6(pid=1211): Launched
17:05:30.460838 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
17:05:30.992973 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=1212): Launched
17:05:31.302089 run    osmo-mgw_10.42.42.3(pid=1213): Launched
17:05:31.410809 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
17:05:31.933618 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=1214): Launched
17:05:32.241719 run    osmo-mgw_10.42.42.4(pid=1215): Launched
17:05:32.350646 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
17:05:32.993066 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=1216): Launched
17:05:33.300505 run    osmo-bsc_10.42.42.7(pid=1217): Launched
17:05:39.564317 run                     osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
17:05:40.007970 run                     osmo-trx-uhd: OSMOTRX CONF: {'osmo_trx': {'clock_reference': 'external', 'launch_trx': 'True', 'type': 'uhd', 'bts_ip': '10.42.42.50', 'trx_ip': '127.0.0.1', 'egprs': 'disable', 'channels': [{}], 'dev_args': 'type=b200,serial=30A9FFB', 'multi_arfcn': 'True', 'remote_user': 'jenkins'}}
17:05:40.572904 run                uname-m(pid=1219): Launched
17:05:41.762719 run                uname-m(pid=1219): ERR: Terminated: ERROR {rc=255}  [trial-829↪emergency:trx-b200↪emergency_mo_mt_call.py:27↪emergency_mo_mt_call.py↪osmo-bts-trx↪osmo-trx-uhd↪host-jenkins@127.0.0.1↪uname-m(pid=1219)]
17:05:41.898562 run                uname-m(pid=1219): stdout: 
| (launched: 2022-12-05_17:05:40.407563) 
17:05:42.034109 run                uname-m(pid=1219): stderr: 
| (launched: 2022-12-05_17:05:40.456482)
| Host key verification failed. 
17:05:42.090456 tst       emergency_mo_mt_call.py:27: ERR: Error: uname-m(pid=1219): launch_sync(): local ssh process exited with status 255 [trial-829↪emergency:trx-b200↪emergency_mo_mt_call.py:27↪emergency_mo_mt_call.py↪osmo-bts-trx↪osmo-trx-uhd↪host-jenkins@127.0.0.1↪uname-m(pid=1219)]  [trial-829↪emergency:trx-b200↪emergency_mo_mt_call.py:27]
17:05:42.097850 tst       emergency_mo_mt_call.py:27: Test FAILED (20.2 sec)
17:05:42.133695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1206): Terminating (SIGTERM)
17:05:42.173470 run    osmo-hlr_10.42.42.2(pid=1207): Terminating (SIGTERM)
17:05:42.214305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1208): Terminating (SIGTERM)
17:05:42.255863 run    osmo-stp_10.42.42.5(pid=1209): Terminating (SIGTERM)
17:05:42.299525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1210): Terminating (SIGTERM)
17:05:42.340163 run    osmo-msc_10.42.42.6(pid=1211): Terminating (SIGTERM)
17:05:42.382008 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=1212): Terminating (SIGTERM)
17:05:42.422901 run    osmo-mgw_10.42.42.3(pid=1213): Terminating (SIGTERM)
17:05:42.464027 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=1214): Terminating (SIGTERM)
17:05:42.506232 run    osmo-mgw_10.42.42.4(pid=1215): Terminating (SIGTERM)
17:05:42.547607 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=1216): Terminating (SIGTERM)
17:05:42.587142 run    osmo-bsc_10.42.42.7(pid=1217): Terminating (SIGTERM)
17:05:42.596559 ---      ParallelTerminationStrategy: PID 1206 died...
17:05:42.649644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1206): Terminated: ok {rc=0}
17:05:42.659558 ---      ParallelTerminationStrategy: PID 1207 died...
17:05:42.712458 run    osmo-hlr_10.42.42.2(pid=1207): Terminated: ok {rc=0}
17:05:42.722312 ---      ParallelTerminationStrategy: PID 1208 died...
17:05:42.775641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1208): Terminated: ok {rc=0}
17:05:42.785244 ---      ParallelTerminationStrategy: PID 1209 died...
17:05:42.838126 run    osmo-stp_10.42.42.5(pid=1209): Terminated: ok {rc=0}
17:05:42.847520 ---      ParallelTerminationStrategy: PID 1210 died...
17:05:42.900813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1210): Terminated: ok {rc=0}
17:05:42.910425 ---      ParallelTerminationStrategy: PID 1211 died...
17:05:42.963329 run    osmo-msc_10.42.42.6(pid=1211): Terminated: ok {rc=0}
17:05:42.972627 ---      ParallelTerminationStrategy: PID 1212 died...
17:05:43.025518 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=1212): Terminated: ok {rc=0}
17:05:43.035293 ---      ParallelTerminationStrategy: PID 1213 died...
17:05:43.088311 run    osmo-mgw_10.42.42.3(pid=1213): Terminated {rc=15}
17:05:43.098085 ---      ParallelTerminationStrategy: PID 1214 died...
17:05:43.151721 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=1214): Terminated: ok {rc=0}
17:05:43.161424 ---      ParallelTerminationStrategy: PID 1215 died...
17:05:43.214659 run    osmo-mgw_10.42.42.4(pid=1215): Terminated {rc=15}
17:05:43.224264 ---      ParallelTerminationStrategy: PID 1216 died...
17:05:43.277355 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=1216): Terminated: ok {rc=0}
17:05:43.762440 ---      ParallelTerminationStrategy: PID 1217 died...
17:05:43.820180 run    osmo-bsc_10.42.42.7(pid=1217): Terminated: ok {rc=0}
17:05:43.906227 bus                        /sierra_2: Setting Powered False
17:05:45.013017 bus                        /sierra_2: Setting Powered False
17:05:46.121376 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 27, in <module>
    bts.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_osmotrx.py", line 174, in start
    self.trx.start(keepalive)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_osmotrx.py", line 327, in start
    self.start_remotely(keepalive)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_osmotrx.py", line 293, in start_remotely
    have_inst = rem_host.inst_compatible_for_remote()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 150, in inst_compatible_for_remote
    proc = self.run_remote_sync('uname-m', ('uname', '-m'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 134, in run_remote_sync
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 216, in launch_sync
    raise self.RunError('launch_sync()')
osmo_gsm_tester.core.log.Error: uname-m(pid=1219): launch_sync(): local ssh process exited with status 255 [trial-829↪emergency:trx-b200↪emergency_mo_mt_call.py:27↪emergency_mo_mt_call.py↪osmo-bts-trx↪osmo-trx-uhd↪host-jenkins@127.0.0.1↪uname-m(pid=1219)]