Failed

sms:sysmo.mo_mt_sms.py (from sms_sysmo)

Failing for the past 1 build (Since #284 )

Took 5 min 51 sec.

Stacktrace

mo_mt_sms.py:24: Wait timeout {condition=<bound method OsmoBsc.bts_is_connected of osmo-bsc_10.42.42.7>, timeout=300, timestep=1} [trial-284↪sms:sysmo↪mo_mt_sms.py:24]

Standard Output

----------------------------------------------
trial-284 sms:sysmo mo_mt_sms.py
----------------------------------------------
15:12:48.034206 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
15:12:48.049550 tst                        sms:sysmo: Using 1 x bts (candidates: 1)
15:12:48.592349 tst                     mo_mt_sms.py: using LAC 2357
15:12:48.720323 tst                     mo_mt_sms.py: using RAC 62
15:12:48.845482 tst                     mo_mt_sms.py: using CellId 2357
15:12:48.973210 tst                     mo_mt_sms.py: using BVCI 2044
15:12:48.998428 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
15:12:49.013313 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
15:12:49.028172 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
15:12:49.043247 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
15:12:49.058514 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
15:12:49.073601 tst                        sms:sysmo: Using 1 x modem (candidates: 2)
15:12:49.319172 tst                        sms:sysmo: Using 1 x modem (candidates: 2)
15:12:49.564279 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
15:12:51.544516 run         create_hlr_db(pid=17973): Launched
15:12:52.773965 run         create_hlr_db(pid=17973): Terminated: ok {rc=0}
15:12:53.217309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17975): Launched
15:12:53.639810 run   osmo-hlr_10.42.42.2(pid=17976): Launched
15:12:53.759776 run              osmo-stp_10.42.42.5: Starting osmo-stp
15:12:56.768129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17977): Launched
15:12:57.180909 run   osmo-stp_10.42.42.5(pid=17978): Launched
15:12:57.298762 run              osmo-msc_10.42.42.6: Starting osmo-msc
15:13:02.626632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17979): Launched
15:13:03.036264 run   osmo-msc_10.42.42.6(pid=17980): Launched
15:13:03.162908 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
15:13:05.239837 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=17981): Launched
15:13:05.651466 run   osmo-mgw_10.42.42.3(pid=17982): Launched
15:13:05.768633 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
15:13:06.494379 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=17983): Launched
15:13:06.903514 run   osmo-mgw_10.42.42.4(pid=17984): Launched
15:13:07.021813 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
15:13:11.114852 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=17985): Launched
15:13:11.524267 run   osmo-bsc_10.42.42.7(pid=17986): Launched
15:13:11.643076 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
15:13:12.804583 run         rm-remote-dir(pid=17987): Launched
15:13:15.037528 run         rm-remote-dir(pid=17987): Terminated: ok {rc=0}
15:13:15.480187 run         mk-remote-dir(pid=17988): Launched
15:13:17.718852 run         mk-remote-dir(pid=17988): Terminated: ok {rc=0}
15:13:18.091685 run    scp-inst-to-remote(pid=17989): Launched
15:13:29.333245 run    scp-inst-to-remote(pid=17989): Terminated: ok {rc=0}
15:13:29.768935 run         mk-remote-dir(pid=17991): Launched
15:13:32.004042 run         mk-remote-dir(pid=17991): Terminated: ok {rc=0}
15:13:32.375970 run     scp-cfg-to-remote(pid=17992): Launched
15:13:34.600882 run     scp-cfg-to-remote(pid=17992): Terminated: ok {rc=0}
15:13:35.028926 run   reload-dsp-firmware(pid=17994): Launched
15:13:37.260556 run   reload-dsp-firmware(pid=17994): Terminated: ok {rc=0}
15:13:37.687040 run        osmo-bts-sysmo(pid=17995): Launched
15:18:38.544028 tst                  mo_mt_sms.py:24: ERR: Error: mo_mt_sms.py:24: Wait timeout {condition=&lt;bound method OsmoBsc.bts_is_connected of osmo-bsc_10.42.42.7&gt;, timeout=300, timestep=1} [trial-284↪sms:sysmo↪mo_mt_sms.py:24]  [trial-284↪sms:sysmo↪mo_mt_sms.py:24]
15:18:38.553236 tst                  mo_mt_sms.py:24: Test FAILED (350.5 sec)
15:18:38.598624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17975): Terminating (SIGTERM)
15:18:38.648951 run   osmo-hlr_10.42.42.2(pid=17976): Terminating (SIGTERM)
15:18:38.700343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17977): Terminating (SIGTERM)
15:18:38.753602 run   osmo-stp_10.42.42.5(pid=17978): Terminating (SIGTERM)
15:18:38.805074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17979): Terminating (SIGTERM)
15:18:38.856084 run   osmo-msc_10.42.42.6(pid=17980): Terminating (SIGTERM)
15:18:38.906620 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=17981): Terminating (SIGTERM)
15:18:38.959286 run   osmo-mgw_10.42.42.3(pid=17982): Terminating (SIGTERM)
15:18:39.010112 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=17983): Terminating (SIGTERM)
15:18:39.060340 run   osmo-mgw_10.42.42.4(pid=17984): Terminating (SIGTERM)
15:18:39.111206 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=17985): Terminating (SIGTERM)
15:18:39.162181 run   osmo-bsc_10.42.42.7(pid=17986): Terminating (SIGTERM)
15:18:39.212685 run        osmo-bts-sysmo(pid=17995): Terminating (SIGTERM)
15:18:39.224119 ---      ParallelTerminationStrategy: PID 17975 died...
15:18:39.302784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17975): Terminated: ok {rc=0}
15:18:39.314867 ---      ParallelTerminationStrategy: PID 17976 died...
15:18:39.393156 run   osmo-hlr_10.42.42.2(pid=17976): Terminated: ok {rc=0}
15:18:39.405253 ---      ParallelTerminationStrategy: PID 17977 died...
15:18:39.483346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17977): Terminated: ok {rc=0}
15:18:39.495407 ---      ParallelTerminationStrategy: PID 17978 died...
15:18:39.573616 run   osmo-stp_10.42.42.5(pid=17978): Terminated: ok {rc=0}
15:18:39.585773 ---      ParallelTerminationStrategy: PID 17979 died...
15:18:39.664023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17979): Terminated: ok {rc=0}
15:18:39.676117 ---      ParallelTerminationStrategy: PID 17981 died...
15:18:39.754415 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=17981): Terminated: ok {rc=0}
15:18:39.766591 ---      ParallelTerminationStrategy: PID 17982 died...
15:18:39.844834 run   osmo-mgw_10.42.42.3(pid=17982): Terminated {rc=15}
15:18:39.856953 ---      ParallelTerminationStrategy: PID 17983 died...
15:18:39.936159 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=17983): Terminated: ok {rc=0}
15:18:39.948461 ---      ParallelTerminationStrategy: PID 17984 died...
15:18:40.026944 run   osmo-mgw_10.42.42.4(pid=17984): Terminated {rc=15}
15:18:40.039083 ---      ParallelTerminationStrategy: PID 17985 died...
15:18:40.117660 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=17985): Terminated: ok {rc=0}
15:18:40.130234 ---      ParallelTerminationStrategy: PID 17995 died...
15:18:40.208639 run        osmo-bts-sysmo(pid=17995): Terminated {rc=36608}
15:18:42.238557 ---      ParallelTerminationStrategy: PID 17980 died...
15:18:42.320141 run   osmo-msc_10.42.42.6(pid=17980): Terminated: ok {rc=0}
15:18:42.331898 ---      ParallelTerminationStrategy: PID 17986 died...
15:18:42.408184 run   osmo-bsc_10.42.42.7(pid=17986): Terminated: ok {rc=0}
15:18:42.531753 bus                        /sierra_7: Setting Powered False
15:18:43.685210 bus                        /sierra_7: Setting Powered False
15:18:44.841168 bus                        /sierra_6: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 367, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 673, in exec_module
  File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/sysmocom/suites/sms/mo_mt_sms.py", line 24, in <module>
    wait(bsc.bts_is_connected, bts)
  File "/home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: mo_mt_sms.py:24: Wait timeout {condition=<bound method OsmoBsc.bts_is_connected of osmo-bsc_10.42.42.7>, timeout=300, timestep=1} [trial-284↪sms:sysmo↪mo_mt_sms.py:24]