Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 85 builds (Since #749 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f5de445ce18>, timeout=10, timestep=1} [trial-833↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-833 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
21:26:18.225473 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
21:26:18.236813 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
21:26:18.372997 tst                      handover.py: using LAC 9706
21:26:18.510046 tst                      handover.py: using RAC 16
21:26:18.641758 tst                      handover.py: using CellId 9706
21:26:18.770450 tst                      handover.py: using BVCI 9702
21:26:18.795430 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
21:26:18.936209 tst                      handover.py: using LAC 9707
21:26:19.064219 tst                      handover.py: using RAC 17
21:26:19.192676 tst                      handover.py: using CellId 9707
21:26:19.321758 tst                      handover.py: using BVCI 9703
21:26:19.346582 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
21:26:19.357452 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
21:26:19.368025 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
21:26:19.379021 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
21:26:19.390131 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
21:26:19.400889 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
21:26:19.502541 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
21:26:19.705389 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
21:26:20.226461 run         create_hlr_db(pid=11765): Launched
21:26:20.366315 bus                        /sierra_1: Setting Powered False
21:26:21.446674 run         create_hlr_db(pid=11765): Terminated: ok {rc=0}
21:26:21.854134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11767): Launched
21:26:22.181953 run   osmo-hlr_10.42.42.2(pid=11768): Launched
21:26:22.298726 run              osmo-stp_10.42.42.5: Starting osmo-stp
21:26:22.833905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11769): Launched
21:26:23.157644 run   osmo-stp_10.42.42.5(pid=11770): Launched
21:26:23.272615 run              osmo-msc_10.42.42.6: Starting osmo-msc
21:26:23.836445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11771): Launched
21:26:24.161618 run   osmo-msc_10.42.42.6(pid=11772): Launched
21:26:27.333950 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
21:26:27.871695 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11773): Launched
21:26:28.199673 run   osmo-mgw_10.42.42.3(pid=11774): Launched
21:26:28.315089 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
21:26:28.840533 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11775): Launched
21:26:29.168206 run   osmo-mgw_10.42.42.4(pid=11776): Launched
21:26:29.283560 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
21:26:29.990275 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11777): Launched
21:26:30.318552 run   osmo-bsc_10.42.42.7(pid=11778): Launched
21:26:37.072479 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
21:26:37.654245 run         rm-remote-dir(pid=11779): Launched
21:26:39.864864 run         rm-remote-dir(pid=11779): Terminated: ok {rc=0}
21:26:40.233547 run         mk-remote-dir(pid=11780): Launched
21:26:42.442738 run         mk-remote-dir(pid=11780): Terminated: ok {rc=0}
21:26:42.751946 run    scp-inst-to-remote(pid=11781): Launched
21:26:55.967018 run    scp-inst-to-remote(pid=11781): Terminated: ok {rc=0}
21:26:56.309380 run         mk-remote-dir(pid=11783): Launched
21:26:59.505656 run         mk-remote-dir(pid=11783): Terminated: ok {rc=0}
21:26:59.798957 run     scp-cfg-to-remote(pid=11784): Launched
21:27:01.994876 run     scp-cfg-to-remote(pid=11784): Terminated: ok {rc=0}
21:27:02.331656 run   reload-dsp-firmware(pid=11786): Launched
21:27:05.524997 run   reload-dsp-firmware(pid=11786): Terminated: ok {rc=0}
21:27:05.853573 run        osmo-bts-sysmo(pid=11787): Launched
21:27:11.196902 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (34.0s)
21:27:11.352011 tst                      handover.py: using MSISDN 6301
21:27:11.529009 bus                        /sierra_1: Setting Powered True
21:27:15.023616 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6301', subscriber_id=1}
21:27:15.163368 tst                      handover.py: using MSISDN 6302
21:27:15.352289 bus                        /sierra_2: Setting Powered True
21:27:27.712316 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f5de445ce18&gt;, timeout=10, timestep=1} [trial-833↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-833↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
21:27:27.719596 tst                   handover.py:45: Test FAILED (69.5 sec)
21:27:27.755699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11767): Terminating (SIGTERM)
21:27:27.797361 run   osmo-hlr_10.42.42.2(pid=11768): Terminating (SIGTERM)
21:27:27.841703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11769): Terminating (SIGTERM)
21:27:27.886411 run   osmo-stp_10.42.42.5(pid=11770): Terminating (SIGTERM)
21:27:27.955263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11771): Terminating (SIGTERM)
21:27:28.000591 run   osmo-msc_10.42.42.6(pid=11772): Terminating (SIGTERM)
21:27:28.046397 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11773): Terminating (SIGTERM)
21:27:28.089742 run   osmo-mgw_10.42.42.3(pid=11774): Terminating (SIGTERM)
21:27:28.148178 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11775): Terminating (SIGTERM)
21:27:28.188604 run   osmo-mgw_10.42.42.4(pid=11776): Terminating (SIGTERM)
21:27:28.229949 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11777): Terminating (SIGTERM)
21:27:28.270455 run   osmo-bsc_10.42.42.7(pid=11778): Terminating (SIGTERM)
21:27:28.311166 run        osmo-bts-sysmo(pid=11787): Terminating (SIGTERM)
21:27:28.321360 ---      ParallelTerminationStrategy: PID 11767 died...
21:27:28.375518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11767): Terminated: ok {rc=0}
21:27:28.386227 ---      ParallelTerminationStrategy: PID 11768 died...
21:27:28.442541 run   osmo-hlr_10.42.42.2(pid=11768): Terminated: ok {rc=0}
21:27:28.452813 ---      ParallelTerminationStrategy: PID 11769 died...
21:27:28.508814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11769): Terminated: ok {rc=0}
21:27:28.519475 ---      ParallelTerminationStrategy: PID 11770 died...
21:27:28.573889 run   osmo-stp_10.42.42.5(pid=11770): Terminated: ok {rc=0}
21:27:28.584723 ---      ParallelTerminationStrategy: PID 11771 died...
21:27:28.639617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11771): Terminated: ok {rc=0}
21:27:28.649626 ---      ParallelTerminationStrategy: PID 11772 died...
21:27:28.703482 run   osmo-msc_10.42.42.6(pid=11772): Terminated: ok {rc=0}
21:27:28.714144 ---      ParallelTerminationStrategy: PID 11773 died...
21:27:28.768995 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11773): Terminated: ok {rc=0}
21:27:28.778923 ---      ParallelTerminationStrategy: PID 11774 died...
21:27:28.832645 run   osmo-mgw_10.42.42.3(pid=11774): Terminated {rc=15}
21:27:28.843277 ---      ParallelTerminationStrategy: PID 11775 died...
21:27:28.898039 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11775): Terminated: ok {rc=0}
21:27:28.907902 ---      ParallelTerminationStrategy: PID 11776 died...
21:27:28.961740 run   osmo-mgw_10.42.42.4(pid=11776): Terminated {rc=15}
21:27:28.972105 ---      ParallelTerminationStrategy: PID 11777 died...
21:27:29.026613 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11777): Terminated: ok {rc=0}
21:27:29.036786 ---      ParallelTerminationStrategy: PID 11778 died...
21:27:29.091596 run   osmo-bsc_10.42.42.7(pid=11778): Terminated: ok {rc=0}
21:27:29.101529 ---      ParallelTerminationStrategy: PID 11787 died...
21:27:29.155333 run        osmo-bts-sysmo(pid=11787): Terminated: ok {rc=0}
21:27:29.259420 bus                        /sierra_2: Setting Online False
21:27:30.345333 bus                        /sierra_2: Setting Powered False
21:27:35.965730 bus                        /sierra_2: Setting Powered False
21:27:37.067944 bus                        /sierra_2: Setting Powered False
21:27:38.201361 bus                        /sierra_1: Setting Online False
21:27:39.285961 bus                        /sierra_1: Setting Powered False
21:27:44.969838 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f5de445ce18>, timeout=10, timestep=1} [trial-833↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]