Skip to content

Failed

sms:sysmo.mo_mt_sms.py (from sms_sysmo)

Failing for the past 93 builds (Since #751 )
Took 1 min 23 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f57466768c8>, timeout=10, timestep=1} [trial-843↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-843 sms:sysmo mo_mt_sms.py
----------------------------------------------
08:29:45.000138 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
08:29:45.011156 tst                        sms:sysmo: Using 1 x bts (candidates: 1)
08:29:45.134986 tst                     mo_mt_sms.py: using LAC 10429
08:29:45.257017 tst                     mo_mt_sms.py: using RAC 229
08:29:45.376457 tst                     mo_mt_sms.py: using CellId 10429
08:29:45.495236 tst                     mo_mt_sms.py: using BVCI 10425
08:29:45.518310 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
08:29:45.528785 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
08:29:45.539259 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
08:29:45.549811 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
08:29:45.560317 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
08:29:45.570893 tst                        sms:sysmo: Using 1 x modem (candidates: 2)
08:29:45.672827 tst                        sms:sysmo: Using 1 x modem (candidates: 2)
08:29:45.859571 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
08:29:47.455467 run           create_hlr_db(pid=631): Launched
08:29:47.631246 bus                        /sierra_1: Setting Powered False
08:29:48.652382 run           create_hlr_db(pid=631): Terminated: ok {rc=0}
08:29:49.059752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=633): Launched
08:29:49.371559 run     osmo-hlr_10.42.42.2(pid=634): Launched
08:29:49.482891 run              osmo-stp_10.42.42.5: Starting osmo-stp
08:29:51.867327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=635): Launched
08:29:52.172012 run     osmo-stp_10.42.42.5(pid=636): Launched
08:29:52.280655 run              osmo-msc_10.42.42.6: Starting osmo-msc
08:29:57.391095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=638): Launched
08:29:57.697963 run     osmo-msc_10.42.42.6(pid=639): Launched
08:30:00.862722 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
08:30:02.555023 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=643): Launched
08:30:02.862267 run     osmo-mgw_10.42.42.3(pid=644): Launched
08:30:02.971801 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
08:30:03.492104 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=645): Launched
08:30:03.799765 run     osmo-mgw_10.42.42.4(pid=646): Launched
08:30:03.910695 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
08:30:08.243347 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=647): Launched
08:30:08.550485 run     osmo-bsc_10.42.42.7(pid=648): Launched
08:30:14.814509 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
08:30:15.732297 run           rm-remote-dir(pid=649): Launched
08:30:17.931594 run           rm-remote-dir(pid=649): Terminated: ok {rc=0}
08:30:18.277340 run           mk-remote-dir(pid=650): Launched
08:30:20.476134 run           mk-remote-dir(pid=650): Terminated: ok {rc=0}
08:30:20.768652 run      scp-inst-to-remote(pid=651): Launched
08:30:34.988637 run      scp-inst-to-remote(pid=651): Terminated: ok {rc=0}
08:30:35.330575 run           mk-remote-dir(pid=653): Launched
08:30:37.534783 run           mk-remote-dir(pid=653): Terminated: ok {rc=0}
08:30:37.848632 run       scp-cfg-to-remote(pid=654): Launched
08:30:41.049332 run       scp-cfg-to-remote(pid=654): Terminated: ok {rc=0}
08:30:41.386007 run     reload-dsp-firmware(pid=656): Launched
08:30:44.580586 run     reload-dsp-firmware(pid=656): Terminated: ok {rc=0}
08:30:44.909918 run          osmo-bts-sysmo(pid=657): Launched
08:30:51.173801 tst                     mo_mt_sms.py: using MSISDN 6780
08:30:51.344331 bus                        /sierra_1: Setting Powered True
08:30:54.803957 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6780', subscriber_id=1}
08:30:54.943042 tst                     mo_mt_sms.py: using MSISDN 6781
08:30:55.111975 bus                        /sierra_2: Setting Powered True
08:31:07.468217 tst                  mo_mt_sms.py:27: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f57466768c8&gt;, timeout=10, timestep=1} [trial-843↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]  [trial-843↪sms:sysmo↪mo_mt_sms.py:27]
08:31:07.475689 tst                  mo_mt_sms.py:27: Test FAILED (82.5 sec)
08:31:07.512156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=633): Terminating (SIGTERM)
08:31:07.554524 run     osmo-hlr_10.42.42.2(pid=634): Terminating (SIGTERM)
08:31:07.597496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=635): Terminating (SIGTERM)
08:31:07.641856 run     osmo-stp_10.42.42.5(pid=636): Terminating (SIGTERM)
08:31:07.700761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=638): Terminating (SIGTERM)
08:31:07.760068 run     osmo-msc_10.42.42.6(pid=639): Terminating (SIGTERM)
08:31:07.804825 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=643): Terminating (SIGTERM)
08:31:07.849828 run     osmo-mgw_10.42.42.3(pid=644): Terminating (SIGTERM)
08:31:07.893115 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=645): Terminating (SIGTERM)
08:31:07.937815 run     osmo-mgw_10.42.42.4(pid=646): Terminating (SIGTERM)
08:31:07.982511 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=647): Terminating (SIGTERM)
08:31:08.025236 run     osmo-bsc_10.42.42.7(pid=648): Terminating (SIGTERM)
08:31:08.066791 run          osmo-bts-sysmo(pid=657): Terminating (SIGTERM)
08:31:08.076310 ---      ParallelTerminationStrategy: PID 633 died...
08:31:08.132011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=633): Terminated: ok {rc=0}
08:31:08.141931 ---      ParallelTerminationStrategy: PID 634 died...
08:31:08.197204 run     osmo-hlr_10.42.42.2(pid=634): Terminated: ok {rc=0}
08:31:08.211192 ---      ParallelTerminationStrategy: PID 635 died...
08:31:08.267533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=635): Terminated: ok {rc=0}
08:31:08.278141 ---      ParallelTerminationStrategy: PID 636 died...
08:31:08.334358 run     osmo-stp_10.42.42.5(pid=636): Terminated: ok {rc=0}
08:31:08.344634 ---      ParallelTerminationStrategy: PID 638 died...
08:31:08.400788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=638): Terminated: ok {rc=0}
08:31:08.411231 ---      ParallelTerminationStrategy: PID 639 died...
08:31:08.467580 run     osmo-msc_10.42.42.6(pid=639): Terminated: ok {rc=0}
08:31:08.477605 ---      ParallelTerminationStrategy: PID 643 died...
08:31:08.532455 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=643): Terminated: ok {rc=0}
08:31:08.542400 ---      ParallelTerminationStrategy: PID 644 died...
08:31:08.597358 run     osmo-mgw_10.42.42.3(pid=644): Terminated {rc=15}
08:31:08.607235 ---      ParallelTerminationStrategy: PID 645 died...
08:31:08.662109 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=645): Terminated: ok {rc=0}
08:31:08.672002 ---      ParallelTerminationStrategy: PID 646 died...
08:31:08.726854 run     osmo-mgw_10.42.42.4(pid=646): Terminated {rc=15}
08:31:08.736662 ---      ParallelTerminationStrategy: PID 647 died...
08:31:08.791687 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=647): Terminated: ok {rc=0}
08:31:08.802010 ---      ParallelTerminationStrategy: PID 648 died...
08:31:08.857248 run     osmo-bsc_10.42.42.7(pid=648): Terminated: ok {rc=0}
08:31:08.867177 ---      ParallelTerminationStrategy: PID 657 died...
08:31:08.922245 run          osmo-bts-sysmo(pid=657): Terminated: ok {rc=0}
08:31:09.028708 bus                        /sierra_2: Setting Online False
08:31:10.114256 bus                        /sierra_2: Setting Powered False
08:31:15.968853 bus                        /sierra_2: Setting Powered False
08:31:17.070975 bus                        /sierra_2: Setting Powered False
08:31:18.202199 bus                        /sierra_1: Setting Online False
08:31:19.286202 bus                        /sierra_1: Setting Powered False
08:31:24.969959 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/sms/mo_mt_sms.py", line 27, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f57466768c8>, timeout=10, timestep=1} [trial-843↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]