Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 76 builds (Since #749 )
Took 1 min 9 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f0055b030d0>, timeout=10, timestep=1} [trial-824↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-824 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
10:21:35.676257 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:21:35.687002 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
10:21:35.812874 tst                      handover.py: using LAC 8986
10:21:35.938138 tst                      handover.py: using RAC 61
10:21:36.063565 tst                      handover.py: using CellId 8986
10:21:36.192203 tst                      handover.py: using BVCI 8982
10:21:36.216583 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
10:21:36.357325 tst                      handover.py: using LAC 8987
10:21:36.484037 tst                      handover.py: using RAC 62
10:21:36.609566 tst                      handover.py: using CellId 8987
10:21:36.736598 tst                      handover.py: using BVCI 8983
10:21:36.761053 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:21:36.771905 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:21:36.782572 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:21:36.793821 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:21:36.805317 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
10:21:36.816572 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
10:21:36.920696 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
10:21:37.116713 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
10:21:37.599488 run         create_hlr_db(pid=17867): Launched
10:21:37.731427 bus                        /sierra_1: Setting Powered False
10:21:38.807148 run         create_hlr_db(pid=17867): Terminated: ok {rc=0}
10:21:39.213030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17869): Launched
10:21:39.541008 run   osmo-hlr_10.42.42.2(pid=17870): Launched
10:21:39.658055 run              osmo-stp_10.42.42.5: Starting osmo-stp
10:21:40.197647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17871): Launched
10:21:40.529434 run   osmo-stp_10.42.42.5(pid=17872): Launched
10:21:40.645510 run              osmo-msc_10.42.42.6: Starting osmo-msc
10:21:41.211683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17873): Launched
10:21:41.543229 run   osmo-msc_10.42.42.6(pid=17874): Launched
10:21:44.716520 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
10:21:45.259664 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=17875): Launched
10:21:45.591818 run   osmo-mgw_10.42.42.3(pid=17876): Launched
10:21:45.708682 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
10:21:46.241444 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=17878): Launched
10:21:46.573984 run   osmo-mgw_10.42.42.4(pid=17879): Launched
10:21:46.690876 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
10:21:47.408158 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=17880): Launched
10:21:47.742855 run   osmo-bsc_10.42.42.7(pid=17881): Launched
10:21:54.477019 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
10:21:55.042622 run         rm-remote-dir(pid=17882): Launched
10:21:57.247298 run         rm-remote-dir(pid=17882): Terminated: ok {rc=0}
10:21:57.601947 run         mk-remote-dir(pid=17883): Launched
10:21:59.804767 run         mk-remote-dir(pid=17883): Terminated: ok {rc=0}
10:22:00.105114 run    scp-inst-to-remote(pid=17884): Launched
10:22:13.333821 run    scp-inst-to-remote(pid=17884): Terminated: ok {rc=0}
10:22:13.703523 run         mk-remote-dir(pid=17886): Launched
10:22:15.904277 run         mk-remote-dir(pid=17886): Terminated: ok {rc=0}
10:22:16.202273 run     scp-cfg-to-remote(pid=17888): Launched
10:22:18.402953 run     scp-cfg-to-remote(pid=17888): Terminated: ok {rc=0}
10:22:18.747321 run   reload-dsp-firmware(pid=17890): Launched
10:22:21.946035 run   reload-dsp-firmware(pid=17890): Terminated: ok {rc=0}
10:22:22.281101 run        osmo-bts-sysmo(pid=17891): Launched
10:22:27.610434 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (33.0s)
10:22:27.768928 tst                      handover.py: using MSISDN 5824
10:22:27.961574 bus                        /sierra_1: Setting Powered True
10:22:31.472124 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5824', subscriber_id=1}
10:22:31.631517 tst                      handover.py: using MSISDN 5825
10:22:31.811683 bus                        /sierra_2: Setting Powered True
10:22:44.188054 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f0055b030d0&gt;, timeout=10, timestep=1} [trial-824↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-824↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
10:22:44.194756 tst                   handover.py:45: Test FAILED (68.5 sec)
10:22:44.229912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17869): Terminating (SIGTERM)
10:22:44.269962 run   osmo-hlr_10.42.42.2(pid=17870): Terminating (SIGTERM)
10:22:44.311034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17871): Terminating (SIGTERM)
10:22:44.354387 run   osmo-stp_10.42.42.5(pid=17872): Terminating (SIGTERM)
10:22:44.396454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17873): Terminating (SIGTERM)
10:22:44.438601 run   osmo-msc_10.42.42.6(pid=17874): Terminating (SIGTERM)
10:22:44.485484 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=17875): Terminating (SIGTERM)
10:22:44.526855 run   osmo-mgw_10.42.42.3(pid=17876): Terminating (SIGTERM)
10:22:44.568265 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=17878): Terminating (SIGTERM)
10:22:44.609669 run   osmo-mgw_10.42.42.4(pid=17879): Terminating (SIGTERM)
10:22:44.650458 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=17880): Terminating (SIGTERM)
10:22:44.690668 run   osmo-bsc_10.42.42.7(pid=17881): Terminating (SIGTERM)
10:22:44.730901 run        osmo-bts-sysmo(pid=17891): Terminating (SIGTERM)
10:22:44.740186 ---      ParallelTerminationStrategy: PID 17869 died...
10:22:44.794409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=17869): Terminated: ok {rc=0}
10:22:44.804388 ---      ParallelTerminationStrategy: PID 17870 died...
10:22:44.859717 run   osmo-hlr_10.42.42.2(pid=17870): Terminated: ok {rc=0}
10:22:44.870060 ---      ParallelTerminationStrategy: PID 17871 died...
10:22:44.925007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=17871): Terminated: ok {rc=0}
10:22:44.935490 ---      ParallelTerminationStrategy: PID 17872 died...
10:22:44.990746 run   osmo-stp_10.42.42.5(pid=17872): Terminated: ok {rc=0}
10:22:45.000756 ---      ParallelTerminationStrategy: PID 17873 died...
10:22:45.054599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=17873): Terminated: ok {rc=0}
10:22:45.064606 ---      ParallelTerminationStrategy: PID 17874 died...
10:22:45.119109 run   osmo-msc_10.42.42.6(pid=17874): Terminated: ok {rc=0}
10:22:45.129305 ---      ParallelTerminationStrategy: PID 17875 died...
10:22:45.183411 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=17875): Terminated: ok {rc=0}
10:22:45.193365 ---      ParallelTerminationStrategy: PID 17876 died...
10:22:45.247120 run   osmo-mgw_10.42.42.3(pid=17876): Terminated {rc=15}
10:22:45.257216 ---      ParallelTerminationStrategy: PID 17878 died...
10:22:45.311463 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=17878): Terminated: ok {rc=0}
10:22:45.321630 ---      ParallelTerminationStrategy: PID 17879 died...
10:22:45.375376 run   osmo-mgw_10.42.42.4(pid=17879): Terminated {rc=15}
10:22:45.385564 ---      ParallelTerminationStrategy: PID 17880 died...
10:22:45.439622 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=17880): Terminated: ok {rc=0}
10:22:45.449856 ---      ParallelTerminationStrategy: PID 17881 died...
10:22:45.504270 run   osmo-bsc_10.42.42.7(pid=17881): Terminated: ok {rc=0}
10:22:45.514454 ---      ParallelTerminationStrategy: PID 17891 died...
10:22:45.568597 run        osmo-bts-sysmo(pid=17891): Terminated: ok {rc=0}
10:22:45.672180 bus                        /sierra_2: Setting Online False
10:22:46.759876 bus                        /sierra_2: Setting Powered False
10:22:52.129648 bus                        /sierra_2: Setting Powered False
10:22:53.233217 bus                        /sierra_2: Setting Powered False
10:22:54.366652 bus                        /sierra_1: Setting Online False
10:22:55.454837 bus                        /sierra_1: Setting Powered False
10:23:00.968424 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f0055b030d0>, timeout=10, timestep=1} [trial-824↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]