Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 56 builds (Since #749 )
Took 1 min 6 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f25009df840>, timeout=10, timestep=1} [trial-804↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-804 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
10:16:12.922367 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:16:12.933787 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
10:16:13.068314 tst                      handover.py: using LAC 7386
10:16:13.201851 tst                      handover.py: using RAC 246
10:16:13.336355 tst                      handover.py: using CellId 7386
10:16:13.470154 tst                      handover.py: using BVCI 7382
10:16:13.496057 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
10:16:13.647637 tst                      handover.py: using LAC 7387
10:16:13.782651 tst                      handover.py: using RAC 247
10:16:13.915238 tst                      handover.py: using CellId 7387
10:16:14.047316 tst                      handover.py: using BVCI 7383
10:16:14.073274 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:16:14.084768 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:16:14.096130 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:16:14.107949 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:16:14.119830 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:16:14.131647 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
10:16:14.237485 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
10:16:14.431145 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
10:16:14.914535 run         create_hlr_db(pid=25986): Launched
10:16:15.046344 bus                        /sierra_1: Setting Powered False
10:16:16.121507 run         create_hlr_db(pid=25986): Terminated: ok {rc=0}
10:16:16.523765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25992): Launched
10:16:16.846749 run   osmo-hlr_10.42.42.2(pid=25993): Launched
10:16:16.962393 run              osmo-stp_10.42.42.5: Starting osmo-stp
10:16:17.493747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25994): Launched
10:16:17.816733 run   osmo-stp_10.42.42.5(pid=25995): Launched
10:16:17.932098 run              osmo-msc_10.42.42.6: Starting osmo-msc
10:16:18.494717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25996): Launched
10:16:18.818421 run   osmo-msc_10.42.42.6(pid=25997): Launched
10:16:21.989854 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
10:16:22.519332 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=25998): Launched
10:16:22.843066 run   osmo-mgw_10.42.42.3(pid=25999): Launched
10:16:22.958411 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
10:16:23.484789 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26000): Launched
10:16:23.808122 run   osmo-mgw_10.42.42.4(pid=26001): Launched
10:16:23.922996 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
10:16:24.623339 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=26002): Launched
10:16:24.949386 run   osmo-bsc_10.42.42.7(pid=26003): Launched
10:16:31.676683 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
10:16:32.256337 run         rm-remote-dir(pid=26004): Launched
10:16:34.467239 run         rm-remote-dir(pid=26004): Terminated: ok {rc=0}
10:16:34.834142 run         mk-remote-dir(pid=26005): Launched
10:16:36.042630 run         mk-remote-dir(pid=26005): Terminated: ok {rc=0}
10:16:36.349821 run    scp-inst-to-remote(pid=26006): Launched
10:16:49.566298 run    scp-inst-to-remote(pid=26006): Terminated: ok {rc=0}
10:16:49.907065 run         mk-remote-dir(pid=26008): Launched
10:16:52.111470 run         mk-remote-dir(pid=26008): Terminated: ok {rc=0}
10:16:52.419003 run     scp-cfg-to-remote(pid=26009): Launched
10:16:53.623689 run     scp-cfg-to-remote(pid=26009): Terminated: ok {rc=0}
10:16:53.977820 run   reload-dsp-firmware(pid=26011): Launched
10:16:57.174702 run   reload-dsp-firmware(pid=26011): Terminated: ok {rc=0}
10:16:57.501895 run        osmo-bts-sysmo(pid=26012): Launched
10:17:01.821449 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (30.1s)
10:17:01.978668 tst                      handover.py: using MSISDN 4764
10:17:02.168747 bus                        /sierra_1: Setting Powered True
10:17:05.656369 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4764', subscriber_id=1}
10:17:05.794759 tst                      handover.py: using MSISDN 4765
10:17:05.970691 bus                        /sierra_2: Setting Powered True
10:17:18.334297 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f25009df840&gt;, timeout=10, timestep=1} [trial-804↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-804↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
10:17:18.340790 tst                   handover.py:45: Test FAILED (65.4 sec)
10:17:18.375579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25992): Terminating (SIGTERM)
10:17:18.415455 run   osmo-hlr_10.42.42.2(pid=25993): Terminating (SIGTERM)
10:17:18.456469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25994): Terminating (SIGTERM)
10:17:18.498745 run   osmo-stp_10.42.42.5(pid=25995): Terminating (SIGTERM)
10:17:18.544803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25996): Terminating (SIGTERM)
10:17:18.587528 run   osmo-msc_10.42.42.6(pid=25997): Terminating (SIGTERM)
10:17:18.633703 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=25998): Terminating (SIGTERM)
10:17:18.676210 run   osmo-mgw_10.42.42.3(pid=25999): Terminating (SIGTERM)
10:17:18.733002 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26000): Terminating (SIGTERM)
10:17:18.773711 run   osmo-mgw_10.42.42.4(pid=26001): Terminating (SIGTERM)
10:17:18.814177 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=26002): Terminating (SIGTERM)
10:17:18.854352 run   osmo-bsc_10.42.42.7(pid=26003): Terminating (SIGTERM)
10:17:18.895012 run        osmo-bts-sysmo(pid=26012): Terminating (SIGTERM)
10:17:18.904221 ---      ParallelTerminationStrategy: PID 25992 died...
10:17:18.958011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25992): Terminated: ok {rc=0}
10:17:18.967863 ---      ParallelTerminationStrategy: PID 25993 died...
10:17:19.021977 run   osmo-hlr_10.42.42.2(pid=25993): Terminated: ok {rc=0}
10:17:19.032044 ---      ParallelTerminationStrategy: PID 25994 died...
10:17:19.087039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25994): Terminated: ok {rc=0}
10:17:19.097287 ---      ParallelTerminationStrategy: PID 25995 died...
10:17:19.151599 run   osmo-stp_10.42.42.5(pid=25995): Terminated: ok {rc=0}
10:17:19.162037 ---      ParallelTerminationStrategy: PID 25996 died...
10:17:19.215277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25996): Terminated: ok {rc=0}
10:17:19.225118 ---      ParallelTerminationStrategy: PID 25997 died...
10:17:19.278344 run   osmo-msc_10.42.42.6(pid=25997): Terminated: ok {rc=0}
10:17:19.287963 ---      ParallelTerminationStrategy: PID 25998 died...
10:17:19.340865 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=25998): Terminated: ok {rc=0}
10:17:19.350758 ---      ParallelTerminationStrategy: PID 25999 died...
10:17:19.403808 run   osmo-mgw_10.42.42.3(pid=25999): Terminated {rc=15}
10:17:19.413487 ---      ParallelTerminationStrategy: PID 26000 died...
10:17:19.467219 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26000): Terminated: ok {rc=0}
10:17:19.476841 ---      ParallelTerminationStrategy: PID 26001 died...
10:17:19.529817 run   osmo-mgw_10.42.42.4(pid=26001): Terminated {rc=15}
10:17:19.539709 ---      ParallelTerminationStrategy: PID 26002 died...
10:17:19.592937 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=26002): Terminated: ok {rc=0}
10:17:19.602689 ---      ParallelTerminationStrategy: PID 26003 died...
10:17:19.655869 run   osmo-bsc_10.42.42.7(pid=26003): Terminated: ok {rc=0}
10:17:19.665816 ---      ParallelTerminationStrategy: PID 26012 died...
10:17:19.718940 run        osmo-bts-sysmo(pid=26012): Terminated: ok {rc=0}
10:17:19.827986 bus                        /sierra_2: Setting Online False
10:17:20.912701 bus                        /sierra_2: Setting Powered False
10:17:26.958655 bus                        /sierra_2: Setting Powered False
10:17:28.060365 bus                        /sierra_2: Setting Powered False
10:17:29.189906 bus                        /sierra_1: Setting Online False
10:17:30.275155 bus                        /sierra_1: Setting Powered False
10:17:35.960285 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f25009df840>, timeout=10, timestep=1} [trial-804↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]