Skip to content

Failed

sms:sysmo.mo_mt_sms.py (from sms_sysmo)

Failing for the past 92 builds (Since #751 )
Took 1 min 24 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f1918a06378>, timeout=10, timestep=1} [trial-842↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-842 sms:sysmo mo_mt_sms.py
----------------------------------------------
07:29:12.566665 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
07:29:12.577833 tst                        sms:sysmo: Using 1 x bts (candidates: 1)
07:29:12.705797 tst                     mo_mt_sms.py: using LAC 10349
07:29:12.831178 tst                     mo_mt_sms.py: using RAC 149
07:29:12.956498 tst                     mo_mt_sms.py: using CellId 10349
07:29:13.083908 tst                     mo_mt_sms.py: using BVCI 10345
07:29:13.108394 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
07:29:13.119506 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
07:29:13.130470 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
07:29:13.141384 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
07:29:13.152256 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
07:29:13.163162 tst                        sms:sysmo: Using 1 x modem (candidates: 2)
07:29:13.266350 tst                        sms:sysmo: Using 1 x modem (candidates: 2)
07:29:13.452540 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
07:29:15.062410 run         create_hlr_db(pid=31299): Launched
07:29:15.237722 bus                        /sierra_1: Setting Powered False
07:29:16.259540 run         create_hlr_db(pid=31299): Terminated: ok {rc=0}
07:29:16.689987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31301): Launched
07:29:17.015577 run   osmo-hlr_10.42.42.2(pid=31302): Launched
07:29:17.134300 run              osmo-stp_10.42.42.5: Starting osmo-stp
07:29:19.648886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31303): Launched
07:29:19.971813 run   osmo-stp_10.42.42.5(pid=31304): Launched
07:29:20.087693 run              osmo-msc_10.42.42.6: Starting osmo-msc
07:29:25.509357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31306): Launched
07:29:25.832098 run   osmo-msc_10.42.42.6(pid=31307): Launched
07:29:29.005931 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
07:29:30.791379 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31310): Launched
07:29:31.121105 run   osmo-mgw_10.42.42.3(pid=31311): Launched
07:29:31.236554 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
07:29:31.795107 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31312): Launched
07:29:32.118051 run   osmo-mgw_10.42.42.4(pid=31313): Launched
07:29:32.234003 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
07:29:36.792969 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31314): Launched
07:29:37.118354 run   osmo-bsc_10.42.42.7(pid=31315): Launched
07:29:43.388023 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
07:29:44.301087 run         rm-remote-dir(pid=31316): Launched
07:29:46.491308 run         rm-remote-dir(pid=31316): Terminated: ok {rc=0}
07:29:46.816463 run         mk-remote-dir(pid=31317): Launched
07:29:49.005005 run         mk-remote-dir(pid=31317): Terminated: ok {rc=0}
07:29:49.284148 run    scp-inst-to-remote(pid=31318): Launched
07:30:03.495927 run    scp-inst-to-remote(pid=31318): Terminated: ok {rc=0}
07:30:03.837561 run         mk-remote-dir(pid=31323): Launched
07:30:06.035337 run         mk-remote-dir(pid=31323): Terminated: ok {rc=0}
07:30:06.356435 run     scp-cfg-to-remote(pid=31324): Launched
07:30:09.555089 run     scp-cfg-to-remote(pid=31324): Terminated: ok {rc=0}
07:30:09.892343 run   reload-dsp-firmware(pid=31326): Launched
07:30:13.090052 run   reload-dsp-firmware(pid=31326): Terminated: ok {rc=0}
07:30:13.418731 run        osmo-bts-sysmo(pid=31327): Launched
07:30:19.656638 tst                     mo_mt_sms.py: using MSISDN 6727
07:30:19.834480 bus                        /sierra_1: Setting Powered True
07:30:23.309444 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6727', subscriber_id=1}
07:30:23.449126 tst                     mo_mt_sms.py: using MSISDN 6728
07:30:23.619604 bus                        /sierra_2: Setting Powered True
07:30:36.001084 tst                  mo_mt_sms.py:27: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f1918a06378&gt;, timeout=10, timestep=1} [trial-842↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]  [trial-842↪sms:sysmo↪mo_mt_sms.py:27]
07:30:36.008562 tst                  mo_mt_sms.py:27: Test FAILED (83.4 sec)
07:30:36.044138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31301): Terminating (SIGTERM)
07:30:36.085496 run   osmo-hlr_10.42.42.2(pid=31302): Terminating (SIGTERM)
07:30:36.128895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31303): Terminating (SIGTERM)
07:30:36.171421 run   osmo-stp_10.42.42.5(pid=31304): Terminating (SIGTERM)
07:30:36.240403 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31306): Terminating (SIGTERM)
07:30:36.298434 run   osmo-msc_10.42.42.6(pid=31307): Terminating (SIGTERM)
07:30:36.344326 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31310): Terminating (SIGTERM)
07:30:36.385717 run   osmo-mgw_10.42.42.3(pid=31311): Terminating (SIGTERM)
07:30:36.427698 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31312): Terminating (SIGTERM)
07:30:36.469490 run   osmo-mgw_10.42.42.4(pid=31313): Terminating (SIGTERM)
07:30:36.511246 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31314): Terminating (SIGTERM)
07:30:36.552876 run   osmo-bsc_10.42.42.7(pid=31315): Terminating (SIGTERM)
07:30:36.594596 run        osmo-bts-sysmo(pid=31327): Terminating (SIGTERM)
07:30:36.604045 ---      ParallelTerminationStrategy: PID 31301 died...
07:30:36.659703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31301): Terminated: ok {rc=0}
07:30:36.669615 ---      ParallelTerminationStrategy: PID 31302 died...
07:30:36.724731 run   osmo-hlr_10.42.42.2(pid=31302): Terminated: ok {rc=0}
07:30:36.734588 ---      ParallelTerminationStrategy: PID 31303 died...
07:30:36.789592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31303): Terminated: ok {rc=0}
07:30:36.799460 ---      ParallelTerminationStrategy: PID 31304 died...
07:30:36.854645 run   osmo-stp_10.42.42.5(pid=31304): Terminated: ok {rc=0}
07:30:36.864450 ---      ParallelTerminationStrategy: PID 31306 died...
07:30:36.919646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31306): Terminated: ok {rc=0}
07:30:36.929593 ---      ParallelTerminationStrategy: PID 31310 died...
07:30:36.986448 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31310): Terminated: ok {rc=0}
07:30:36.996846 ---      ParallelTerminationStrategy: PID 31311 died...
07:30:37.053185 run   osmo-mgw_10.42.42.3(pid=31311): Terminated {rc=15}
07:30:37.063920 ---      ParallelTerminationStrategy: PID 31312 died...
07:30:37.120926 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31312): Terminated: ok {rc=0}
07:30:37.131361 ---      ParallelTerminationStrategy: PID 31313 died...
07:30:37.187366 run   osmo-mgw_10.42.42.4(pid=31313): Terminated {rc=15}
07:30:37.197663 ---      ParallelTerminationStrategy: PID 31307 died...
07:30:37.253744 run   osmo-msc_10.42.42.6(pid=31307): Terminated: ok {rc=0}
07:30:37.264266 ---      ParallelTerminationStrategy: PID 31314 died...
07:30:37.320963 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31314): Terminated: ok {rc=0}
07:30:37.331387 ---      ParallelTerminationStrategy: PID 31327 died...
07:30:37.387706 run        osmo-bts-sysmo(pid=31327): Terminated: ok {rc=0}
07:30:37.566219 ---      ParallelTerminationStrategy: PID 31315 died...
07:30:37.622667 run   osmo-bsc_10.42.42.7(pid=31315): Terminated: ok {rc=0}
07:30:37.728780 bus                        /sierra_2: Setting Online False
07:30:38.815383 bus                        /sierra_2: Setting Powered False
07:30:44.160361 bus                        /sierra_2: Setting Powered False
07:30:45.268124 bus                        /sierra_2: Setting Powered False
07:30:46.395245 bus                        /sierra_1: Setting Online False
07:30:47.482683 bus                        /sierra_1: Setting Powered False
07:30:52.965533 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/sms/mo_mt_sms.py", line 27, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f1918a06378>, timeout=10, timestep=1} [trial-842↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]