jenkins LTS upgrade
Failed
sms:sysmo.mo_mt_sms.py (from sms_sysmo)
Stacktrace
/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f64d5b72378>, timeout=10, timestep=1} [trial-809↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]
Standard Output
---------------------------------------------- trial-809 sms:sysmo mo_mt_sms.py ---------------------------------------------- 14:15:26.762452 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 14:15:26.774008 tst sms:sysmo: Using 1 x bts (candidates: 1) 14:15:26.900605 tst mo_mt_sms.py: using LAC 7709 14:15:27.024829 tst mo_mt_sms.py: using RAC 59 14:15:27.146285 tst mo_mt_sms.py: using CellId 7709 14:15:27.269128 tst mo_mt_sms.py: using BVCI 7705 14:15:27.293805 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 14:15:27.304859 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 14:15:27.316088 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 14:15:27.327017 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 14:15:27.337930 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 14:15:27.348759 tst sms:sysmo: Using 1 x modem (candidates: 2) 14:15:27.450430 tst sms:sysmo: Using 1 x modem (candidates: 2) 14:15:27.634428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:15:29.226013 run create_hlr_db(pid=3647): Launched 14:15:29.399800 bus /sierra_1: Setting Powered False 14:15:30.420725 run create_hlr_db(pid=3647): Terminated: ok {rc=0} 14:15:30.825467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3649): Launched 14:15:31.126514 run osmo-hlr_10.42.42.2(pid=3650): Launched 14:15:31.235002 run osmo-stp_10.42.42.5: Starting osmo-stp 14:15:33.657770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3651): Launched 14:15:33.955939 run osmo-stp_10.42.42.5(pid=3652): Launched 14:15:34.063840 run osmo-msc_10.42.42.6: Starting osmo-msc 14:15:39.200359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3653): Launched 14:15:39.499338 run osmo-msc_10.42.42.6(pid=3654): Launched 14:15:42.661561 run osmo-mgw_10.42.42.3: Starting osmo-mgw 14:15:44.357379 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=3655): Launched 14:15:44.662551 run osmo-mgw_10.42.42.3(pid=3656): Launched 14:15:44.769936 run osmo-mgw_10.42.42.4: Starting osmo-mgw 14:15:45.278569 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3657): Launched 14:15:45.577061 run osmo-mgw_10.42.42.4(pid=3658): Launched 14:15:45.685464 run osmo-bsc_10.42.42.7: Starting osmo-bsc 14:15:50.013452 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=3659): Launched 14:15:50.313746 run osmo-bsc_10.42.42.7(pid=3660): Launched 14:15:56.573678 run osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7 14:15:57.484581 run rm-remote-dir(pid=3661): Launched 14:15:59.671981 run rm-remote-dir(pid=3661): Terminated: ok {rc=0} 14:15:59.995005 run mk-remote-dir(pid=3662): Launched 14:16:02.181513 run mk-remote-dir(pid=3662): Terminated: ok {rc=0} 14:16:02.455359 run scp-inst-to-remote(pid=3663): Launched 14:16:14.656851 run scp-inst-to-remote(pid=3663): Terminated: ok {rc=0} 14:16:14.973087 run mk-remote-dir(pid=3665): Launched 14:16:17.158298 run mk-remote-dir(pid=3665): Terminated: ok {rc=0} 14:16:17.429849 run scp-cfg-to-remote(pid=3666): Launched 14:16:19.613863 run scp-cfg-to-remote(pid=3666): Terminated: ok {rc=0} 14:16:19.927009 run reload-dsp-firmware(pid=3668): Launched 14:16:23.110159 run reload-dsp-firmware(pid=3668): Terminated: ok {rc=0} 14:16:23.413389 run osmo-bts-sysmo(pid=3669): Launched 14:16:27.648617 tst mo_mt_sms.py: using MSISDN 4978 14:16:27.823706 bus /sierra_1: Setting Powered True 14:16:31.285492 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4978', subscriber_id=1} 14:16:31.418039 tst mo_mt_sms.py: using MSISDN 4979 14:16:31.591912 bus /sierra_2: Setting Powered True 14:16:43.948274 tst mo_mt_sms.py:27: ERR: Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f64d5b72378>, timeout=10, timestep=1} [trial-809↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2] [trial-809↪sms:sysmo↪mo_mt_sms.py:27] 14:16:43.955181 tst mo_mt_sms.py:27: Test FAILED (77.2 sec) 14:16:43.990540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3649): Terminating (SIGTERM) 14:16:44.030952 run osmo-hlr_10.42.42.2(pid=3650): Terminating (SIGTERM) 14:16:44.072030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3651): Terminating (SIGTERM) 14:16:44.116034 run osmo-stp_10.42.42.5(pid=3652): Terminating (SIGTERM) 14:16:44.158771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3653): Terminating (SIGTERM) 14:16:44.200504 run osmo-msc_10.42.42.6(pid=3654): Terminating (SIGTERM) 14:16:44.251177 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=3655): Terminating (SIGTERM) 14:16:44.298355 run osmo-mgw_10.42.42.3(pid=3656): Terminating (SIGTERM) 14:16:44.342349 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3657): Terminating (SIGTERM) 14:16:44.386216 run osmo-mgw_10.42.42.4(pid=3658): Terminating (SIGTERM) 14:16:44.446617 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=3659): Terminating (SIGTERM) 14:16:44.489283 run osmo-bsc_10.42.42.7(pid=3660): Terminating (SIGTERM) 14:16:44.533063 run osmo-bts-sysmo(pid=3669): Terminating (SIGTERM) 14:16:44.543067 --- ParallelTerminationStrategy: PID 3649 died... 14:16:44.601932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3649): Terminated: ok {rc=0} 14:16:44.612393 --- ParallelTerminationStrategy: PID 3650 died... 14:16:44.670298 run osmo-hlr_10.42.42.2(pid=3650): Terminated: ok {rc=0} 14:16:44.680727 --- ParallelTerminationStrategy: PID 3651 died... 14:16:44.738514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3651): Terminated: ok {rc=0} 14:16:44.749030 --- ParallelTerminationStrategy: PID 3652 died... 14:16:44.806678 run osmo-stp_10.42.42.5(pid=3652): Terminated: ok {rc=0} 14:16:44.816785 --- ParallelTerminationStrategy: PID 3653 died... 14:16:44.873127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3653): Terminated: ok {rc=0} 14:16:44.883808 --- ParallelTerminationStrategy: PID 3654 died... 14:16:44.940749 run osmo-msc_10.42.42.6(pid=3654): Terminated: ok {rc=0} 14:16:44.950979 --- ParallelTerminationStrategy: PID 3655 died... 14:16:45.007825 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=3655): Terminated: ok {rc=0} 14:16:45.017985 --- ParallelTerminationStrategy: PID 3656 died... 14:16:45.074474 run osmo-mgw_10.42.42.3(pid=3656): Terminated {rc=15} 14:16:45.084584 --- ParallelTerminationStrategy: PID 3657 died... 14:16:45.142011 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3657): Terminated: ok {rc=0} 14:16:45.152075 --- ParallelTerminationStrategy: PID 3658 died... 14:16:45.208096 run osmo-mgw_10.42.42.4(pid=3658): Terminated {rc=15} 14:16:45.218645 --- ParallelTerminationStrategy: PID 3659 died... 14:16:45.275582 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=3659): Terminated: ok {rc=0} 14:16:45.285867 --- ParallelTerminationStrategy: PID 3660 died... 14:16:45.343026 run osmo-bsc_10.42.42.7(pid=3660): Terminated: ok {rc=0} 14:16:45.353229 --- ParallelTerminationStrategy: PID 3669 died... 14:16:45.410106 run osmo-bts-sysmo(pid=3669): Terminated: ok {rc=0} 14:16:45.518510 bus /sierra_2: Setting Online False 14:16:46.602345 bus /sierra_2: Setting Powered False 14:16:51.958517 bus /sierra_2: Setting Powered False 14:16:53.065425 bus /sierra_2: Setting Powered False 14:16:54.193543 bus /sierra_1: Setting Online False 14:16:55.282354 bus /sierra_1: Setting Powered False 14:17:00.967768 bus /sierra_1: Setting Powered False
Standard Error
Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run self.path) File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file spec.loader.exec_module( importlib.util.module_from_spec(spec) ) File "<frozen importlib._bootstrap_external>", line 728, in exec_module File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/sms/mo_mt_sms.py", line 27, in <module> hlr.subscriber_add(ms_mt) File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id, File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10) File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep) osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f64d5b72378>, timeout=10, timestep=1} [trial-809↪sms:sysmo↪mo_mt_sms.py:27↪mo_mt_sms.py↪/sierra_2]