Skip to content

Failed

emergency:trx-b200.emergency_mo_mt_call.py (from emergency_trx-b200)

Failing for the past 67 builds (Since #749 )
Took 21 sec.

Stacktrace

uname-m(pid=23177): launch_sync(): local ssh process exited with status 255 [trial-815↪emergency:trx-b200↪emergency_mo_mt_call.py:27↪emergency_mo_mt_call.py↪osmo-bts-trx↪osmo-trx-uhd↪host-jenkins@127.0.0.1↪uname-m(pid=23177)]

Standard Output

----------------------------------------------
trial-815 emergency:trx-b200 emergency_mo_mt_call.py
----------------------------------------------
23:22:40.469133 tst               emergency:trx-b200: Using 1 x ip_address (candidates: 6)
23:22:40.480455 tst               emergency:trx-b200: Using 1 x bts (candidates: 1)
23:22:40.627441 tst          emergency_mo_mt_call.py: using LAC 8232
23:22:40.756940 tst          emergency_mo_mt_call.py: using RAC 72
23:22:40.886787 tst          emergency_mo_mt_call.py: using CellId 8232
23:22:41.016736 tst          emergency_mo_mt_call.py: using BVCI 8228
23:22:41.042448 tst               emergency:trx-b200: Using 1 x ip_address (candidates: 6)
23:22:41.053988 tst               emergency:trx-b200: Using 1 x ip_address (candidates: 6)
23:22:41.065129 tst               emergency:trx-b200: Using 1 x ip_address (candidates: 6)
23:22:41.077306 tst               emergency:trx-b200: Using 1 x ip_address (candidates: 6)
23:22:41.088612 tst               emergency:trx-b200: Using 1 x ip_address (candidates: 6)
23:22:41.099942 tst               emergency:trx-b200: Using 1 x modem (candidates: 4)
23:22:41.202702 tst               emergency:trx-b200: Using 1 x modem (candidates: 4)
23:22:41.400927 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
23:22:41.939092 run         create_hlr_db(pid=23163): Launched
23:22:42.134330 bus                        /sierra_1: Setting Powered False
23:22:43.154780 run         create_hlr_db(pid=23163): Terminated: ok {rc=0}
23:22:43.580693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23165): Launched
23:22:43.899667 run   osmo-hlr_10.42.42.2(pid=23166): Launched
23:22:44.012607 run              osmo-stp_10.42.42.5: Starting osmo-stp
23:22:44.562055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23167): Launched
23:22:44.878224 run   osmo-stp_10.42.42.5(pid=23168): Launched
23:22:45.002082 tst          emergency_mo_mt_call.py: using MSISDN 5329
23:22:45.158347 run              osmo-msc_10.42.42.6: Starting osmo-msc
23:22:45.735052 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23169): Launched
23:22:46.053080 run   osmo-msc_10.42.42.6(pid=23170): Launched
23:22:49.221312 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
23:22:49.769797 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=23171): Launched
23:22:50.086636 run   osmo-mgw_10.42.42.3(pid=23172): Launched
23:22:50.198968 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
23:22:50.739637 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23173): Launched
23:22:51.058798 run   osmo-mgw_10.42.42.4(pid=23174): Launched
23:22:51.171649 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
23:22:51.835305 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=23175): Launched
23:22:52.155453 run   osmo-bsc_10.42.42.7(pid=23176): Launched
23:22:58.441767 run                     osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
23:22:58.925439 run                     osmo-trx-uhd: OSMOTRX CONF: {'osmo_trx': {'clock_reference': 'external', 'launch_trx': 'True', 'type': 'uhd', 'bts_ip': '10.42.42.50', 'trx_ip': '127.0.0.1', 'egprs': 'disable', 'channels': [{}], 'dev_args': 'type=b200,serial=30A9FFB', 'multi_arfcn': 'True', 'remote_user': 'jenkins'}}
23:22:59.551753 run               uname-m(pid=23177): Launched
23:23:00.760075 run               uname-m(pid=23177): ERR: Terminated: ERROR {rc=255}  [trial-815↪emergency:trx-b200↪emergency_mo_mt_call.py:27↪emergency_mo_mt_call.py↪osmo-bts-trx↪osmo-trx-uhd↪host-jenkins@127.0.0.1↪uname-m(pid=23177)]
23:23:00.909034 run               uname-m(pid=23177): stdout: 
| (launched: 2022-12-04_23:22:59.368322) 
23:23:01.058191 run               uname-m(pid=23177): stderr: 
| (launched: 2022-12-04_23:22:59.422333)
| Host key verification failed. 
23:23:01.120191 tst       emergency_mo_mt_call.py:27: ERR: Error: uname-m(pid=23177): launch_sync(): local ssh process exited with status 255 [trial-815↪emergency:trx-b200↪emergency_mo_mt_call.py:27↪emergency_mo_mt_call.py↪osmo-bts-trx↪osmo-trx-uhd↪host-jenkins@127.0.0.1↪uname-m(pid=23177)]  [trial-815↪emergency:trx-b200↪emergency_mo_mt_call.py:27]
23:23:01.128638 tst       emergency_mo_mt_call.py:27: Test FAILED (20.6 sec)
23:23:01.165042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23165): Terminating (SIGTERM)
23:23:01.206840 run   osmo-hlr_10.42.42.2(pid=23166): Terminating (SIGTERM)
23:23:01.250221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23167): Terminating (SIGTERM)
23:23:01.295332 run   osmo-stp_10.42.42.5(pid=23168): Terminating (SIGTERM)
23:23:01.363994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23169): Terminating (SIGTERM)
23:23:01.422467 run   osmo-msc_10.42.42.6(pid=23170): Terminating (SIGTERM)
23:23:01.464113 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=23171): Terminating (SIGTERM)
23:23:01.505520 run   osmo-mgw_10.42.42.3(pid=23172): Terminating (SIGTERM)
23:23:01.547665 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23173): Terminating (SIGTERM)
23:23:01.589776 run   osmo-mgw_10.42.42.4(pid=23174): Terminating (SIGTERM)
23:23:01.631896 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=23175): Terminating (SIGTERM)
23:23:01.673964 run   osmo-bsc_10.42.42.7(pid=23176): Terminating (SIGTERM)
23:23:01.683872 ---      ParallelTerminationStrategy: PID 23165 died...
23:23:01.739450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23165): Terminated: ok {rc=0}
23:23:01.749753 ---      ParallelTerminationStrategy: PID 23166 died...
23:23:01.805095 run   osmo-hlr_10.42.42.2(pid=23166): Terminated: ok {rc=0}
23:23:01.815437 ---      ParallelTerminationStrategy: PID 23167 died...
23:23:01.871144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23167): Terminated: ok {rc=0}
23:23:01.881447 ---      ParallelTerminationStrategy: PID 23168 died...
23:23:01.936726 run   osmo-stp_10.42.42.5(pid=23168): Terminated: ok {rc=0}
23:23:01.946856 ---      ParallelTerminationStrategy: PID 23169 died...
23:23:02.002298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23169): Terminated: ok {rc=0}
23:23:02.012497 ---      ParallelTerminationStrategy: PID 23171 died...
23:23:02.068503 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=23171): Terminated: ok {rc=0}
23:23:02.078725 ---      ParallelTerminationStrategy: PID 23172 died...
23:23:02.136657 run   osmo-mgw_10.42.42.3(pid=23172): Terminated {rc=15}
23:23:02.147533 ---      ParallelTerminationStrategy: PID 23173 died...
23:23:02.205140 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23173): Terminated: ok {rc=0}
23:23:02.215964 ---      ParallelTerminationStrategy: PID 23174 died...
23:23:02.282967 run   osmo-mgw_10.42.42.4(pid=23174): Terminated {rc=15}
23:23:02.313946 ---      ParallelTerminationStrategy: PID 23175 died...
23:23:02.421248 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=23175): Terminated: ok {rc=0}
23:23:02.431694 ---      ParallelTerminationStrategy: PID 23170 died...
23:23:02.486073 run   osmo-msc_10.42.42.6(pid=23170): Terminated: ok {rc=0}
23:23:02.496960 ---      ParallelTerminationStrategy: PID 23176 died...
23:23:02.551981 run   osmo-bsc_10.42.42.7(pid=23176): Terminated: ok {rc=0}
23:23:02.640697 bus                        /sierra_2: Setting Powered False
23:23:03.744268 bus                        /sierra_2: Setting Powered False
23:23:04.856514 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 27, in <module>
    bts.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_osmotrx.py", line 174, in start
    self.trx.start(keepalive)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_osmotrx.py", line 327, in start
    self.start_remotely(keepalive)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_osmotrx.py", line 293, in start_remotely
    have_inst = rem_host.inst_compatible_for_remote()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 150, in inst_compatible_for_remote
    proc = self.run_remote_sync('uname-m', ('uname', '-m'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 134, in run_remote_sync
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 216, in launch_sync
    raise self.RunError('launch_sync()')
osmo_gsm_tester.core.log.Error: uname-m(pid=23177): launch_sync(): local ssh process exited with status 255 [trial-815↪emergency:trx-b200↪emergency_mo_mt_call.py:27↪emergency_mo_mt_call.py↪osmo-bts-trx↪osmo-trx-uhd↪host-jenkins@127.0.0.1↪uname-m(pid=23177)]