Skip to content

Failed

sms:sysmo.mo_mt_sms.py (from sms_sysmo)

Failing for the past 90 builds (Since #751 )
Took 1 min 23 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f447851c158>, timeout=10, timestep=1} [trial-840↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-840 sms:sysmo mo_mt_sms.py
----------------------------------------------
05:28:40.899583 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
05:28:40.910085 tst                        sms:sysmo: Using 1 x bts (candidates: 1)
05:28:41.042971 tst                     mo_mt_sms.py: using LAC 10189
05:28:41.161416 tst                     mo_mt_sms.py: using RAC 244
05:28:41.279145 tst                     mo_mt_sms.py: using CellId 10189
05:28:41.395521 tst                     mo_mt_sms.py: using BVCI 10185
05:28:41.418391 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
05:28:41.428760 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
05:28:41.439136 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
05:28:41.449722 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
05:28:41.460257 tst                        sms:sysmo: Using 1 x ip_address (candidates: 6)
05:28:41.470887 tst                        sms:sysmo: Using 1 x modem (candidates: 2)
05:28:41.569793 tst                        sms:sysmo: Using 1 x modem (candidates: 2)
05:28:41.753853 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
05:28:43.339993 run         create_hlr_db(pid=27068): Launched
05:28:43.513726 bus                        /sierra_1: Setting Powered False
05:28:44.545050 run         create_hlr_db(pid=27068): Terminated: ok {rc=0}
05:28:44.972048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27070): Launched
05:28:45.294373 run   osmo-hlr_10.42.42.2(pid=27071): Launched
05:28:45.412753 run              osmo-stp_10.42.42.5: Starting osmo-stp
05:28:47.906874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27072): Launched
05:28:48.226962 run   osmo-stp_10.42.42.5(pid=27073): Launched
05:28:48.342437 run              osmo-msc_10.42.42.6: Starting osmo-msc
05:28:53.697412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27074): Launched
05:28:54.019369 run   osmo-msc_10.42.42.6(pid=27075): Launched
05:28:57.192818 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
05:28:58.973602 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27076): Launched
05:28:59.301507 run   osmo-mgw_10.42.42.3(pid=27077): Launched
05:28:59.416418 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
05:28:59.963517 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27078): Launched
05:29:00.285907 run   osmo-mgw_10.42.42.4(pid=27079): Launched
05:29:00.402937 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
05:29:04.911617 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27080): Launched
05:29:05.234980 run   osmo-bsc_10.42.42.7(pid=27081): Launched
05:29:11.502810 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
05:29:12.420474 run         rm-remote-dir(pid=27082): Launched
05:29:14.620150 run         rm-remote-dir(pid=27082): Terminated: ok {rc=0}
05:29:14.964056 run         mk-remote-dir(pid=27083): Launched
05:29:17.162254 run         mk-remote-dir(pid=27083): Terminated: ok {rc=0}
05:29:17.454827 run    scp-inst-to-remote(pid=27084): Launched
05:29:31.671961 run    scp-inst-to-remote(pid=27084): Terminated: ok {rc=0}
05:29:32.011329 run         mk-remote-dir(pid=27087): Launched
05:29:34.206909 run         mk-remote-dir(pid=27087): Terminated: ok {rc=0}
05:29:34.516489 run     scp-cfg-to-remote(pid=27088): Launched
05:29:37.716679 run     scp-cfg-to-remote(pid=27088): Terminated: ok {rc=0}
05:29:38.051986 run   reload-dsp-firmware(pid=27094): Launched
05:29:41.236160 run   reload-dsp-firmware(pid=27094): Terminated: ok {rc=0}
05:29:41.541730 run        osmo-bts-sysmo(pid=27095): Launched
05:29:46.775182 tst                     mo_mt_sms.py: using MSISDN 6621
05:29:46.952240 bus                        /sierra_1: Setting Powered True
05:29:50.431678 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6621', subscriber_id=1}
05:29:50.569131 tst                     mo_mt_sms.py: using MSISDN 6622
05:29:50.734118 bus                        /sierra_2: Setting Powered True
05:30:03.081724 tst                  mo_mt_sms.py:27: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f447851c158&gt;, timeout=10, timestep=1} [trial-840↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]  [trial-840↪sms:sysmo↪mo_mt_sms.py:27]
05:30:03.088995 tst                  mo_mt_sms.py:27: Test FAILED (82.2 sec)
05:30:03.124756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27070): Terminating (SIGTERM)
05:30:03.166204 run   osmo-hlr_10.42.42.2(pid=27071): Terminating (SIGTERM)
05:30:03.208873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27072): Terminating (SIGTERM)
05:30:03.252376 run   osmo-stp_10.42.42.5(pid=27073): Terminating (SIGTERM)
05:30:03.319031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27074): Terminating (SIGTERM)
05:30:03.378146 run   osmo-msc_10.42.42.6(pid=27075): Terminating (SIGTERM)
05:30:03.419632 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27076): Terminating (SIGTERM)
05:30:03.460863 run   osmo-mgw_10.42.42.3(pid=27077): Terminating (SIGTERM)
05:30:03.503284 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27078): Terminating (SIGTERM)
05:30:03.544456 run   osmo-mgw_10.42.42.4(pid=27079): Terminating (SIGTERM)
05:30:03.590571 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27080): Terminating (SIGTERM)
05:30:03.631819 run   osmo-bsc_10.42.42.7(pid=27081): Terminating (SIGTERM)
05:30:03.673199 run        osmo-bts-sysmo(pid=27095): Terminating (SIGTERM)
05:30:03.682834 ---      ParallelTerminationStrategy: PID 27070 died...
05:30:03.739351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27070): Terminated: ok {rc=0}
05:30:03.749777 ---      ParallelTerminationStrategy: PID 27071 died...
05:30:03.805227 run   osmo-hlr_10.42.42.2(pid=27071): Terminated: ok {rc=0}
05:30:03.815212 ---      ParallelTerminationStrategy: PID 27072 died...
05:30:03.870414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27072): Terminated: ok {rc=0}
05:30:03.880238 ---      ParallelTerminationStrategy: PID 27073 died...
05:30:03.935238 run   osmo-stp_10.42.42.5(pid=27073): Terminated: ok {rc=0}
05:30:03.945085 ---      ParallelTerminationStrategy: PID 27074 died...
05:30:03.999934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27074): Terminated: ok {rc=0}
05:30:04.009845 ---      ParallelTerminationStrategy: PID 27076 died...
05:30:04.065233 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27076): Terminated: ok {rc=0}
05:30:04.075078 ---      ParallelTerminationStrategy: PID 27077 died...
05:30:04.130644 run   osmo-mgw_10.42.42.3(pid=27077): Terminated {rc=15}
05:30:04.141090 ---      ParallelTerminationStrategy: PID 27078 died...
05:30:04.197775 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27078): Terminated: ok {rc=0}
05:30:04.208176 ---      ParallelTerminationStrategy: PID 27079 died...
05:30:04.264599 run   osmo-mgw_10.42.42.4(pid=27079): Terminated {rc=15}
05:30:04.275034 ---      ParallelTerminationStrategy: PID 27080 died...
05:30:04.331297 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27080): Terminated: ok {rc=0}
05:30:04.341785 ---      ParallelTerminationStrategy: PID 27095 died...
05:30:04.398553 run        osmo-bts-sysmo(pid=27095): Terminated: ok {rc=0}
05:30:04.409244 ---      ParallelTerminationStrategy: PID 27075 died...
05:30:04.465853 run   osmo-msc_10.42.42.6(pid=27075): Terminated: ok {rc=0}
05:30:04.644150 ---      ParallelTerminationStrategy: PID 27081 died...
05:30:04.701264 run   osmo-bsc_10.42.42.7(pid=27081): Terminated: ok {rc=0}
05:30:04.806399 bus                        /sierra_2: Setting Online False
05:30:05.892336 bus                        /sierra_2: Setting Powered False
05:30:11.961614 bus                        /sierra_2: Setting Powered False
05:30:13.066549 bus                        /sierra_2: Setting Powered False
05:30:14.192411 bus                        /sierra_1: Setting Online False
05:30:15.278396 bus                        /sierra_1: Setting Powered False
05:30:20.968557 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/sms/mo_mt_sms.py", line 27, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f447851c158>, timeout=10, timestep=1} [trial-840↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]