Skip to content

Failed

sms:sysmo.mo_mt_sms.py (from sms_sysmo)

Failing for the past 50 builds (Since #751 )
Took 1 min 18 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f602cda5378>, timeout=10, timestep=1} [trial-800↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-800 sms:sysmo mo_mt_sms.py
----------------------------------------------
05:29:07.078015 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
05:29:07.089651 tst                        sms:sysmo: Using 1 x bts (candidates: 1)
05:29:07.218773 tst                     mo_mt_sms.py: using LAC 6989
05:29:07.346414 tst                     mo_mt_sms.py: using RAC 104
05:29:07.474566 tst                     mo_mt_sms.py: using CellId 6989
05:29:07.601925 tst                     mo_mt_sms.py: using BVCI 6985
05:29:07.626513 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
05:29:07.637529 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
05:29:07.648285 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
05:29:07.659132 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
05:29:07.669941 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
05:29:07.680725 tst                        sms:sysmo: Using 1 x modem (candidates: 2)
05:29:07.781842 tst                        sms:sysmo: Using 1 x modem (candidates: 2)
05:29:07.975457 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
05:29:09.643323 run         create_hlr_db(pid=13169): Launched
05:29:09.833925 bus                        /sierra_1: Setting Powered False
05:29:10.852931 run         create_hlr_db(pid=13169): Terminated: ok {rc=0}
05:29:11.287188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13171): Launched
05:29:11.613448 run   osmo-hlr_10.42.42.2(pid=13172): Launched
05:29:11.731274 run              osmo-stp_10.42.42.5: Starting osmo-stp
05:29:14.284611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13173): Launched
05:29:14.608051 run   osmo-stp_10.42.42.5(pid=13174): Launched
05:29:14.723906 run              osmo-msc_10.42.42.6: Starting osmo-msc
05:29:20.106886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13175): Launched
05:29:20.432123 run   osmo-msc_10.42.42.6(pid=13176): Launched
05:29:23.606302 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
05:29:25.405789 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13177): Launched
05:29:25.736395 run   osmo-mgw_10.42.42.3(pid=13178): Launched
05:29:25.851212 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
05:29:26.404682 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13179): Launched
05:29:26.727888 run   osmo-mgw_10.42.42.4(pid=13180): Launched
05:29:26.844358 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
05:29:31.363335 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13181): Launched
05:29:31.689914 run   osmo-bsc_10.42.42.7(pid=13182): Launched
05:29:37.959299 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
05:29:38.898393 run         rm-remote-dir(pid=13183): Launched
05:29:41.099038 run         rm-remote-dir(pid=13183): Terminated: ok {rc=0}
05:29:41.445756 run         mk-remote-dir(pid=13184): Launched
05:29:42.643433 run         mk-remote-dir(pid=13184): Terminated: ok {rc=0}
05:29:42.936050 run    scp-inst-to-remote(pid=13185): Launched
05:29:56.153086 run    scp-inst-to-remote(pid=13185): Terminated: ok {rc=0}
05:29:56.495807 run         mk-remote-dir(pid=13187): Launched
05:29:58.683184 run         mk-remote-dir(pid=13187): Terminated: ok {rc=0}
05:29:58.960787 run     scp-cfg-to-remote(pid=13188): Launched
05:30:00.154711 run     scp-cfg-to-remote(pid=13188): Terminated: ok {rc=0}
05:30:00.493985 run   reload-dsp-firmware(pid=13190): Launched
05:30:03.691765 run   reload-dsp-firmware(pid=13190): Terminated: ok {rc=0}
05:30:04.021595 run        osmo-bts-sysmo(pid=13194): Launched
05:30:08.267829 tst                     mo_mt_sms.py: using MSISDN 4501
05:30:08.445870 bus                        /sierra_1: Setting Powered True
05:30:11.925630 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4501', subscriber_id=1}
05:30:12.062560 tst                     mo_mt_sms.py: using MSISDN 4502
05:30:12.240161 bus                        /sierra_2: Setting Powered True
05:30:24.615851 tst                  mo_mt_sms.py:27: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f602cda5378&gt;, timeout=10, timestep=1} [trial-800↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]  [trial-800↪sms:sysmo↪mo_mt_sms.py:27]
05:30:24.623113 tst                  mo_mt_sms.py:27: Test FAILED (77.5 sec)
05:30:24.659566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13171): Terminating (SIGTERM)
05:30:24.701574 run   osmo-hlr_10.42.42.2(pid=13172): Terminating (SIGTERM)
05:30:24.745091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13173): Terminating (SIGTERM)
05:30:24.788859 run   osmo-stp_10.42.42.5(pid=13174): Terminating (SIGTERM)
05:30:24.852837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13175): Terminating (SIGTERM)
05:30:24.899956 run   osmo-msc_10.42.42.6(pid=13176): Terminating (SIGTERM)
05:30:24.943748 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13177): Terminating (SIGTERM)
05:30:24.986849 run   osmo-mgw_10.42.42.3(pid=13178): Terminating (SIGTERM)
05:30:25.041279 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13179): Terminating (SIGTERM)
05:30:25.087515 run   osmo-mgw_10.42.42.4(pid=13180): Terminating (SIGTERM)
05:30:25.130166 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13181): Terminating (SIGTERM)
05:30:25.174692 run   osmo-bsc_10.42.42.7(pid=13182): Terminating (SIGTERM)
05:30:25.217020 run        osmo-bts-sysmo(pid=13194): Terminating (SIGTERM)
05:30:25.226606 ---      ParallelTerminationStrategy: PID 13171 died...
05:30:25.282806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13171): Terminated: ok {rc=0}
05:30:25.292666 ---      ParallelTerminationStrategy: PID 13172 died...
05:30:25.348495 run   osmo-hlr_10.42.42.2(pid=13172): Terminated: ok {rc=0}
05:30:25.358445 ---      ParallelTerminationStrategy: PID 13173 died...
05:30:25.414201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13173): Terminated: ok {rc=0}
05:30:25.424132 ---      ParallelTerminationStrategy: PID 13174 died...
05:30:25.479775 run   osmo-stp_10.42.42.5(pid=13174): Terminated: ok {rc=0}
05:30:25.489925 ---      ParallelTerminationStrategy: PID 13175 died...
05:30:25.545375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13175): Terminated: ok {rc=0}
05:30:25.555318 ---      ParallelTerminationStrategy: PID 13176 died...
05:30:25.610804 run   osmo-msc_10.42.42.6(pid=13176): Terminated: ok {rc=0}
05:30:25.620594 ---      ParallelTerminationStrategy: PID 13177 died...
05:30:25.677406 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13177): Terminated: ok {rc=0}
05:30:25.688082 ---      ParallelTerminationStrategy: PID 13178 died...
05:30:25.744806 run   osmo-mgw_10.42.42.3(pid=13178): Terminated {rc=15}
05:30:25.755266 ---      ParallelTerminationStrategy: PID 13179 died...
05:30:25.812314 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13179): Terminated: ok {rc=0}
05:30:25.823071 ---      ParallelTerminationStrategy: PID 13180 died...
05:30:25.879977 run   osmo-mgw_10.42.42.4(pid=13180): Terminated {rc=15}
05:30:25.890589 ---      ParallelTerminationStrategy: PID 13181 died...
05:30:25.946620 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13181): Terminated: ok {rc=0}
05:30:25.956526 ---      ParallelTerminationStrategy: PID 13182 died...
05:30:26.012035 run   osmo-bsc_10.42.42.7(pid=13182): Terminated: ok {rc=0}
05:30:26.022102 ---      ParallelTerminationStrategy: PID 13194 died...
05:30:26.077523 run        osmo-bts-sysmo(pid=13194): Terminated: ok {rc=0}
05:30:26.184277 bus                        /sierra_2: Setting Online False
05:30:27.270285 bus                        /sierra_2: Setting Powered False
05:30:32.968870 bus                        /sierra_2: Setting Powered False
05:30:34.072892 bus                        /sierra_2: Setting Powered False
05:30:35.206285 bus                        /sierra_1: Setting Online False
05:30:36.290287 bus                        /sierra_1: Setting Powered False
05:30:41.964747 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/sms/mo_mt_sms.py", line 27, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f602cda5378>, timeout=10, timestep=1} [trial-800↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]