Skip to content

Failed

sms:sysmo.mo_mt_sms.py (from sms_sysmo)

Failing for the past 87 builds (Since #751 )
Took 1 min 23 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f112ecee378>, timeout=10, timestep=1} [trial-837↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-837 sms:sysmo mo_mt_sms.py
----------------------------------------------
01:11:45.330742 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
01:11:45.341822 tst                        sms:sysmo: Using 1 x bts (candidates: 1)
01:11:45.468374 tst                     mo_mt_sms.py: using LAC 9949
01:11:45.589864 tst                     mo_mt_sms.py: using RAC 4
01:11:45.708377 tst                     mo_mt_sms.py: using CellId 9949
01:11:45.826868 tst                     mo_mt_sms.py: using BVCI 9945
01:11:45.850032 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
01:11:45.860531 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
01:11:45.871056 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
01:11:45.881718 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
01:11:45.892289 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
01:11:45.902930 tst                        sms:sysmo: Using 1 x modem (candidates: 2)
01:11:46.006595 tst                        sms:sysmo: Using 1 x modem (candidates: 2)
01:11:46.204132 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
01:11:47.862081 run         create_hlr_db(pid=19209): Launched
01:11:48.038916 bus                        /sierra_1: Setting Powered False
01:11:49.059686 run         create_hlr_db(pid=19209): Terminated: ok {rc=0}
01:11:49.488620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19211): Launched
01:11:49.813723 run   osmo-hlr_10.42.42.2(pid=19212): Launched
01:11:49.932424 run              osmo-stp_10.42.42.5: Starting osmo-stp
01:11:52.455505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19213): Launched
01:11:52.779293 run   osmo-stp_10.42.42.5(pid=19214): Launched
01:11:52.895740 run              osmo-msc_10.42.42.6: Starting osmo-msc
01:11:58.300001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19215): Launched
01:11:58.623497 run   osmo-msc_10.42.42.6(pid=19216): Launched
01:12:01.796854 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
01:12:03.575209 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19217): Launched
01:12:03.904183 run   osmo-mgw_10.42.42.3(pid=19218): Launched
01:12:04.019856 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
01:12:04.568656 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19219): Launched
01:12:04.891180 run   osmo-mgw_10.42.42.4(pid=19220): Launched
01:12:05.007617 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
01:12:09.503866 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19221): Launched
01:12:09.829091 run   osmo-bsc_10.42.42.7(pid=19222): Launched
01:12:16.122962 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
01:12:17.035498 run         rm-remote-dir(pid=19225): Launched
01:12:19.224642 run         rm-remote-dir(pid=19225): Terminated: ok {rc=0}
01:12:19.552583 run         mk-remote-dir(pid=19226): Launched
01:12:21.740335 run         mk-remote-dir(pid=19226): Terminated: ok {rc=0}
01:12:22.016227 run    scp-inst-to-remote(pid=19227): Launched
01:12:36.220013 run    scp-inst-to-remote(pid=19227): Terminated: ok {rc=0}
01:12:36.541137 run         mk-remote-dir(pid=19229): Launched
01:12:38.729493 run         mk-remote-dir(pid=19229): Terminated: ok {rc=0}
01:12:39.003174 run     scp-cfg-to-remote(pid=19231): Launched
01:12:42.189638 run     scp-cfg-to-remote(pid=19231): Terminated: ok {rc=0}
01:12:42.505832 run   reload-dsp-firmware(pid=19233): Launched
01:12:45.688919 run   reload-dsp-firmware(pid=19233): Terminated: ok {rc=0}
01:12:45.997797 run        osmo-bts-sysmo(pid=19234): Launched
01:12:51.287541 tst                     mo_mt_sms.py: using MSISDN 6462
01:12:51.458736 bus                        /sierra_1: Setting Powered True
01:12:54.928922 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6462', subscriber_id=1}
01:12:55.070506 tst                     mo_mt_sms.py: using MSISDN 6463
01:12:55.247070 bus                        /sierra_2: Setting Powered True
01:13:07.584608 tst                  mo_mt_sms.py:27: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f112ecee378&gt;, timeout=10, timestep=1} [trial-837↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]  [trial-837↪sms:sysmo↪mo_mt_sms.py:27]
01:13:07.591282 tst                  mo_mt_sms.py:27: Test FAILED (82.3 sec)
01:13:07.626153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19211): Terminating (SIGTERM)
01:13:07.666317 run   osmo-hlr_10.42.42.2(pid=19212): Terminating (SIGTERM)
01:13:07.707015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19213): Terminating (SIGTERM)
01:13:07.749021 run   osmo-stp_10.42.42.5(pid=19214): Terminating (SIGTERM)
01:13:07.801833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19215): Terminating (SIGTERM)
01:13:07.846648 run   osmo-msc_10.42.42.6(pid=19216): Terminating (SIGTERM)
01:13:07.890641 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19217): Terminating (SIGTERM)
01:13:07.938165 run   osmo-mgw_10.42.42.3(pid=19218): Terminating (SIGTERM)
01:13:07.993133 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19219): Terminating (SIGTERM)
01:13:08.037218 run   osmo-mgw_10.42.42.4(pid=19220): Terminating (SIGTERM)
01:13:08.093332 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19221): Terminating (SIGTERM)
01:13:08.138458 run   osmo-bsc_10.42.42.7(pid=19222): Terminating (SIGTERM)
01:13:08.181553 run        osmo-bts-sysmo(pid=19234): Terminating (SIGTERM)
01:13:08.191224 ---      ParallelTerminationStrategy: PID 19211 died...
01:13:08.248348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19211): Terminated: ok {rc=0}
01:13:08.258578 ---      ParallelTerminationStrategy: PID 19212 died...
01:13:08.315514 run   osmo-hlr_10.42.42.2(pid=19212): Terminated: ok {rc=0}
01:13:08.325719 ---      ParallelTerminationStrategy: PID 19213 died...
01:13:08.382489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19213): Terminated: ok {rc=0}
01:13:08.392563 ---      ParallelTerminationStrategy: PID 19214 died...
01:13:08.448547 run   osmo-stp_10.42.42.5(pid=19214): Terminated: ok {rc=0}
01:13:08.458484 ---      ParallelTerminationStrategy: PID 19215 died...
01:13:08.515532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19215): Terminated: ok {rc=0}
01:13:08.525598 ---      ParallelTerminationStrategy: PID 19216 died...
01:13:08.581841 run   osmo-msc_10.42.42.6(pid=19216): Terminated: ok {rc=0}
01:13:08.592887 ---      ParallelTerminationStrategy: PID 19217 died...
01:13:08.650495 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19217): Terminated: ok {rc=0}
01:13:08.661903 ---      ParallelTerminationStrategy: PID 19218 died...
01:13:08.720634 run   osmo-mgw_10.42.42.3(pid=19218): Terminated {rc=15}
01:13:08.731736 ---      ParallelTerminationStrategy: PID 19219 died...
01:13:08.790757 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19219): Terminated: ok {rc=0}
01:13:08.801792 ---      ParallelTerminationStrategy: PID 19220 died...
01:13:08.859794 run   osmo-mgw_10.42.42.4(pid=19220): Terminated {rc=15}
01:13:08.869954 ---      ParallelTerminationStrategy: PID 19221 died...
01:13:08.927148 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19221): Terminated: ok {rc=0}
01:13:08.937599 ---      ParallelTerminationStrategy: PID 19222 died...
01:13:08.995378 run   osmo-bsc_10.42.42.7(pid=19222): Terminated: ok {rc=0}
01:13:09.005216 ---      ParallelTerminationStrategy: PID 19234 died...
01:13:09.058716 run        osmo-bts-sysmo(pid=19234): Terminated: ok {rc=0}
01:13:09.167659 bus                        /sierra_2: Setting Online False
01:13:10.250498 bus                        /sierra_2: Setting Powered False
01:13:15.965045 bus                        /sierra_2: Setting Powered False
01:13:17.071107 bus                        /sierra_2: Setting Powered False
01:13:18.199691 bus                        /sierra_1: Setting Online False
01:13:19.285338 bus                        /sierra_1: Setting Powered False
01:13:24.961639 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/sms/mo_mt_sms.py", line 27, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f112ecee378>, timeout=10, timestep=1} [trial-837↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]