Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 95 builds (Since #749 )
Took 1 min 12 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f57463c9488>, timeout=10, timestep=1} [trial-843↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-843 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
09:25:34.256695 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:25:34.268059 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
09:25:34.401646 tst                      handover.py: using LAC 10506
09:25:34.539780 tst                      handover.py: using RAC 51
09:25:34.672090 tst                      handover.py: using CellId 10506
09:25:34.804099 tst                      handover.py: using BVCI 10502
09:25:34.830194 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
09:25:34.976022 tst                      handover.py: using LAC 10507
09:25:35.107669 tst                      handover.py: using RAC 52
09:25:35.239596 tst                      handover.py: using CellId 10507
09:25:35.371580 tst                      handover.py: using BVCI 10503
09:25:35.397601 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:25:35.408988 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:25:35.420271 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:25:35.431460 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:25:35.442757 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:25:35.453957 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
09:25:35.557866 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
09:25:35.761061 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
09:25:36.277251 run          create_hlr_db(pid=2955): Launched
09:25:36.416269 bus                        /sierra_1: Setting Powered False
09:25:37.495758 run          create_hlr_db(pid=2955): Terminated: ok {rc=0}
09:25:37.902044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2957): Launched
09:25:38.227919 run    osmo-hlr_10.42.42.2(pid=2958): Launched
09:25:38.343552 run              osmo-stp_10.42.42.5: Starting osmo-stp
09:25:38.875439 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2959): Launched
09:25:39.200298 run    osmo-stp_10.42.42.5(pid=2960): Launched
09:25:39.314852 run              osmo-msc_10.42.42.6: Starting osmo-msc
09:25:39.874493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2961): Launched
09:25:40.200133 run    osmo-msc_10.42.42.6(pid=2962): Launched
09:25:43.372863 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
09:25:43.908143 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=2963): Launched
09:25:44.234758 run    osmo-mgw_10.42.42.3(pid=2964): Launched
09:25:44.349438 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
09:25:44.869514 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2965): Launched
09:25:45.195396 run    osmo-mgw_10.42.42.4(pid=2966): Launched
09:25:45.310408 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
09:25:46.013471 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=2967): Launched
09:25:46.336700 run    osmo-bsc_10.42.42.7(pid=2968): Launched
09:25:53.048148 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
09:25:53.590377 run          rm-remote-dir(pid=2969): Launched
09:25:55.797490 run          rm-remote-dir(pid=2969): Terminated: ok {rc=0}
09:25:56.160421 run          mk-remote-dir(pid=2970): Launched
09:25:58.367845 run          mk-remote-dir(pid=2970): Terminated: ok {rc=0}
09:25:58.674495 run     scp-inst-to-remote(pid=2971): Launched
09:26:12.901389 run     scp-inst-to-remote(pid=2971): Terminated: ok {rc=0}
09:26:13.260807 run          mk-remote-dir(pid=2973): Launched
09:26:15.466621 run          mk-remote-dir(pid=2973): Terminated: ok {rc=0}
09:26:15.772158 run      scp-cfg-to-remote(pid=2974): Launched
09:26:18.971673 run      scp-cfg-to-remote(pid=2974): Terminated: ok {rc=0}
09:26:19.305895 run    reload-dsp-firmware(pid=2976): Launched
09:26:22.498729 run    reload-dsp-firmware(pid=2976): Terminated: ok {rc=0}
09:26:22.824868 run         osmo-bts-sysmo(pid=2977): Launched
09:26:29.147932 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (36.0s)
09:26:29.299055 tst                      handover.py: using MSISDN 6831
09:26:29.484879 bus                        /sierra_1: Setting Powered True
09:26:32.974030 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6831', subscriber_id=1}
09:26:33.112616 tst                      handover.py: using MSISDN 6832
09:26:33.299368 bus                        /sierra_2: Setting Powered True
09:26:45.666575 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f57463c9488&gt;, timeout=10, timestep=1} [trial-843↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-843↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
09:26:45.674030 tst                   handover.py:45: Test FAILED (71.4 sec)
09:26:45.710109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2957): Terminating (SIGTERM)
09:26:45.751599 run    osmo-hlr_10.42.42.2(pid=2958): Terminating (SIGTERM)
09:26:45.794081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2959): Terminating (SIGTERM)
09:26:45.836659 run    osmo-stp_10.42.42.5(pid=2960): Terminating (SIGTERM)
09:26:45.906390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2961): Terminating (SIGTERM)
09:26:45.958613 run    osmo-msc_10.42.42.6(pid=2962): Terminating (SIGTERM)
09:26:46.001776 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=2963): Terminating (SIGTERM)
09:26:46.047579 run    osmo-mgw_10.42.42.3(pid=2964): Terminating (SIGTERM)
09:26:46.090631 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2965): Terminating (SIGTERM)
09:26:46.135792 run    osmo-mgw_10.42.42.4(pid=2966): Terminating (SIGTERM)
09:26:46.178921 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=2967): Terminating (SIGTERM)
09:26:46.221132 run    osmo-bsc_10.42.42.7(pid=2968): Terminating (SIGTERM)
09:26:46.262414 run         osmo-bts-sysmo(pid=2977): Terminating (SIGTERM)
09:26:46.271974 ---      ParallelTerminationStrategy: PID 2957 died...
09:26:46.327939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2957): Terminated: ok {rc=0}
09:26:46.338015 ---      ParallelTerminationStrategy: PID 2958 died...
09:26:46.393462 run    osmo-hlr_10.42.42.2(pid=2958): Terminated: ok {rc=0}
09:26:46.404041 ---      ParallelTerminationStrategy: PID 2959 died...
09:26:46.464708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2959): Terminated: ok {rc=0}
09:26:46.475322 ---      ParallelTerminationStrategy: PID 2960 died...
09:26:46.531656 run    osmo-stp_10.42.42.5(pid=2960): Terminated: ok {rc=0}
09:26:46.542100 ---      ParallelTerminationStrategy: PID 2961 died...
09:26:46.598461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2961): Terminated: ok {rc=0}
09:26:46.609024 ---      ParallelTerminationStrategy: PID 2962 died...
09:26:46.665586 run    osmo-msc_10.42.42.6(pid=2962): Terminated: ok {rc=0}
09:26:46.675616 ---      ParallelTerminationStrategy: PID 2963 died...
09:26:46.731287 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=2963): Terminated: ok {rc=0}
09:26:46.741466 ---      ParallelTerminationStrategy: PID 2964 died...
09:26:46.796895 run    osmo-mgw_10.42.42.3(pid=2964): Terminated {rc=15}
09:26:46.807027 ---      ParallelTerminationStrategy: PID 2965 died...
09:26:46.862649 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2965): Terminated: ok {rc=0}
09:26:46.872779 ---      ParallelTerminationStrategy: PID 2966 died...
09:26:46.928318 run    osmo-mgw_10.42.42.4(pid=2966): Terminated {rc=15}
09:26:46.938435 ---      ParallelTerminationStrategy: PID 2967 died...
09:26:46.993896 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=2967): Terminated: ok {rc=0}
09:26:47.004128 ---      ParallelTerminationStrategy: PID 2968 died...
09:26:47.060110 run    osmo-bsc_10.42.42.7(pid=2968): Terminated: ok {rc=0}
09:26:47.070258 ---      ParallelTerminationStrategy: PID 2977 died...
09:26:47.126149 run         osmo-bts-sysmo(pid=2977): Terminated: ok {rc=0}
09:26:47.233267 bus                        /sierra_2: Setting Online False
09:26:48.316211 bus                        /sierra_2: Setting Powered False
09:26:53.969822 bus                        /sierra_2: Setting Powered False
09:26:55.074190 bus                        /sierra_2: Setting Powered False
09:26:56.205992 bus                        /sierra_1: Setting Online False
09:26:57.292406 bus                        /sierra_1: Setting Powered False
09:27:02.968741 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f57463c9488>, timeout=10, timestep=1} [trial-843↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]