jenkins LTS upgrade
Failed
sms:sysmo.mo_mt_sms.py (from sms_sysmo)
Stacktrace
/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6e84290a60>, timeout=10, timestep=1} [trial-813↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]
Standard Output
---------------------------------------------- trial-813 sms:sysmo mo_mt_sms.py ---------------------------------------------- 19:13:56.993453 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 19:13:57.004147 tst sms:sysmo: Using 1 x bts (candidates: 1) 19:13:57.133136 tst mo_mt_sms.py: using LAC 8029 19:13:57.261205 tst mo_mt_sms.py: using RAC 124 19:13:57.381952 tst mo_mt_sms.py: using CellId 8029 19:13:57.502626 tst mo_mt_sms.py: using BVCI 8025 19:13:57.525495 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 19:13:57.536031 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 19:13:57.546477 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 19:13:57.556993 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 19:13:57.567444 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 19:13:57.577853 tst sms:sysmo: Using 1 x modem (candidates: 2) 19:13:57.680002 tst sms:sysmo: Using 1 x modem (candidates: 2) 19:13:57.870739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 19:13:59.525485 run create_hlr_db(pid=15907): Launched 19:13:59.710781 bus /sierra_1: Setting Powered False 19:14:00.731818 run create_hlr_db(pid=15907): Terminated: ok {rc=0} 19:14:01.135490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15909): Launched 19:14:01.436418 run osmo-hlr_10.42.42.2(pid=15910): Launched 19:14:01.546312 run osmo-stp_10.42.42.5: Starting osmo-stp 19:14:03.965873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15911): Launched 19:14:04.288230 run osmo-stp_10.42.42.5(pid=15912): Launched 19:14:04.404658 run osmo-msc_10.42.42.6: Starting osmo-msc 19:14:09.809924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15913): Launched 19:14:10.134141 run osmo-msc_10.42.42.6(pid=15914): Launched 19:14:13.308242 run osmo-mgw_10.42.42.3: Starting osmo-mgw 19:14:15.091277 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=15915): Launched 19:14:15.420257 run osmo-mgw_10.42.42.3(pid=15916): Launched 19:14:15.535948 run osmo-mgw_10.42.42.4: Starting osmo-mgw 19:14:16.086991 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=15917): Launched 19:14:16.410104 run osmo-mgw_10.42.42.4(pid=15918): Launched 19:14:16.527069 run osmo-bsc_10.42.42.7: Starting osmo-bsc 19:14:21.053903 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=15919): Launched 19:14:21.379117 run osmo-bsc_10.42.42.7(pid=15920): Launched 19:14:27.660146 run osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7 19:14:28.629017 run rm-remote-dir(pid=15921): Launched 19:14:30.830697 run rm-remote-dir(pid=15921): Terminated: ok {rc=0} 19:14:31.178562 run mk-remote-dir(pid=15922): Launched 19:14:33.377923 run mk-remote-dir(pid=15922): Terminated: ok {rc=0} 19:14:33.669985 run scp-inst-to-remote(pid=15923): Launched 19:14:45.884628 run scp-inst-to-remote(pid=15923): Terminated: ok {rc=0} 19:14:46.225836 run mk-remote-dir(pid=15925): Launched 19:14:48.418278 run mk-remote-dir(pid=15925): Terminated: ok {rc=0} 19:14:48.692975 run scp-cfg-to-remote(pid=15926): Launched 19:14:50.884927 run scp-cfg-to-remote(pid=15926): Terminated: ok {rc=0} 19:14:51.202011 run reload-dsp-firmware(pid=15928): Launched 19:14:54.386095 run reload-dsp-firmware(pid=15928): Terminated: ok {rc=0} 19:14:54.695578 run osmo-bts-sysmo(pid=15929): Launched 19:14:59.942629 tst mo_mt_sms.py: using MSISDN 5190 19:15:00.121869 bus /sierra_1: Setting Powered True 19:15:03.622245 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5190', subscriber_id=1} 19:15:03.767438 tst mo_mt_sms.py: using MSISDN 5191 19:15:03.944033 bus /sierra_2: Setting Powered True 19:15:16.305293 tst mo_mt_sms.py:27: ERR: Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6e84290a60>, timeout=10, timestep=1} [trial-813↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2] [trial-813↪sms:sysmo↪mo_mt_sms.py:27] 19:15:16.312308 tst mo_mt_sms.py:27: Test FAILED (79.3 sec) 19:15:16.347966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15909): Terminating (SIGTERM) 19:15:16.389693 run osmo-hlr_10.42.42.2(pid=15910): Terminating (SIGTERM) 19:15:16.433028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15911): Terminating (SIGTERM) 19:15:16.476407 run osmo-stp_10.42.42.5(pid=15912): Terminating (SIGTERM) 19:15:16.532742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15913): Terminating (SIGTERM) 19:15:16.583225 run osmo-msc_10.42.42.6(pid=15914): Terminating (SIGTERM) 19:15:16.630243 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=15915): Terminating (SIGTERM) 19:15:16.672575 run osmo-mgw_10.42.42.3(pid=15916): Terminating (SIGTERM) 19:15:16.714666 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=15917): Terminating (SIGTERM) 19:15:16.756836 run osmo-mgw_10.42.42.4(pid=15918): Terminating (SIGTERM) 19:15:16.813376 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=15919): Terminating (SIGTERM) 19:15:16.856396 run osmo-bsc_10.42.42.7(pid=15920): Terminating (SIGTERM) 19:15:16.898003 run osmo-bts-sysmo(pid=15929): Terminating (SIGTERM) 19:15:16.907452 --- ParallelTerminationStrategy: PID 15909 died... 19:15:16.963019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15909): Terminated: ok {rc=0} 19:15:16.972859 --- ParallelTerminationStrategy: PID 15910 died... 19:15:17.028624 run osmo-hlr_10.42.42.2(pid=15910): Terminated: ok {rc=0} 19:15:17.038952 --- ParallelTerminationStrategy: PID 15911 died... 19:15:17.094370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15911): Terminated: ok {rc=0} 19:15:17.104180 --- ParallelTerminationStrategy: PID 15912 died... 19:15:17.159094 run osmo-stp_10.42.42.5(pid=15912): Terminated: ok {rc=0} 19:15:17.168855 --- ParallelTerminationStrategy: PID 15913 died... 19:15:17.224040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15913): Terminated: ok {rc=0} 19:15:17.234049 --- ParallelTerminationStrategy: PID 15914 died... 19:15:17.289831 run osmo-msc_10.42.42.6(pid=15914): Terminated: ok {rc=0} 19:15:17.299814 --- ParallelTerminationStrategy: PID 15915 died... 19:15:17.355184 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=15915): Terminated: ok {rc=0} 19:15:17.365082 --- ParallelTerminationStrategy: PID 15916 died... 19:15:17.420185 run osmo-mgw_10.42.42.3(pid=15916): Terminated {rc=15} 19:15:17.430172 --- ParallelTerminationStrategy: PID 15917 died... 19:15:17.485188 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=15917): Terminated: ok {rc=0} 19:15:17.495615 --- ParallelTerminationStrategy: PID 15918 died... 19:15:17.551847 run osmo-mgw_10.42.42.4(pid=15918): Terminated {rc=15} 19:15:17.562176 --- ParallelTerminationStrategy: PID 15919 died... 19:15:17.618282 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=15919): Terminated: ok {rc=0} 19:15:17.628567 --- ParallelTerminationStrategy: PID 15929 died... 19:15:17.684778 run osmo-bts-sysmo(pid=15929): Terminated: ok {rc=0} 19:15:17.863259 --- ParallelTerminationStrategy: PID 15920 died... 19:15:17.920704 run osmo-bsc_10.42.42.7(pid=15920): Terminated: ok {rc=0} 19:15:18.027228 bus /sierra_2: Setting Online False 19:15:19.113294 bus /sierra_2: Setting Powered False 19:15:24.969117 bus /sierra_2: Setting Powered False 19:15:26.074842 bus /sierra_2: Setting Powered False 19:15:27.202038 bus /sierra_1: Setting Online False 19:15:28.288865 bus /sierra_1: Setting Powered False 19:15:33.972815 bus /sierra_1: Setting Powered False
Standard Error
Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run self.path) File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file spec.loader.exec_module( importlib.util.module_from_spec(spec) ) File "<frozen importlib._bootstrap_external>", line 728, in exec_module File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/sms/mo_mt_sms.py", line 27, in <module> hlr.subscriber_add(ms_mt) File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id, File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10) File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep) osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6e84290a60>, timeout=10, timestep=1} [trial-813↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]