Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 63 builds (Since #749 )
Took 1 min 7 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f82f0e67ea0>, timeout=10, timestep=1} [trial-811↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-811 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
18:05:18.524773 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
18:05:18.535656 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
18:05:18.671193 tst                      handover.py: using LAC 7946
18:05:18.805564 tst                      handover.py: using RAC 41
18:05:18.942139 tst                      handover.py: using CellId 7946
18:05:19.076462 tst                      handover.py: using BVCI 7942
18:05:19.102688 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
18:05:19.249860 tst                      handover.py: using LAC 7947
18:05:19.385931 tst                      handover.py: using RAC 42
18:05:19.519374 tst                      handover.py: using CellId 7947
18:05:19.647384 tst                      handover.py: using BVCI 7943
18:05:19.671830 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
18:05:19.683045 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
18:05:19.693908 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
18:05:19.704849 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
18:05:19.715964 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
18:05:19.726997 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
18:05:19.834239 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
18:05:20.038814 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
18:05:20.557806 run         create_hlr_db(pid=13934): Launched
18:05:20.697984 bus                        /sierra_1: Setting Powered False
18:05:21.779069 run         create_hlr_db(pid=13934): Terminated: ok {rc=0}
18:05:22.184790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13936): Launched
18:05:22.512596 run   osmo-hlr_10.42.42.2(pid=13937): Launched
18:05:22.628055 run              osmo-stp_10.42.42.5: Starting osmo-stp
18:05:23.159336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13938): Launched
18:05:23.484345 run   osmo-stp_10.42.42.5(pid=13939): Launched
18:05:23.599099 run              osmo-msc_10.42.42.6: Starting osmo-msc
18:05:24.159552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13940): Launched
18:05:24.485248 run   osmo-msc_10.42.42.6(pid=13941): Launched
18:05:27.657611 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
18:05:28.189377 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13942): Launched
18:05:28.519645 run   osmo-mgw_10.42.42.3(pid=13943): Launched
18:05:28.634268 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
18:05:29.151377 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13944): Launched
18:05:29.473593 run   osmo-mgw_10.42.42.4(pid=13945): Launched
18:05:29.588398 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
18:05:30.285473 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13946): Launched
18:05:30.607973 run   osmo-bsc_10.42.42.7(pid=13947): Launched
18:05:37.315662 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
18:05:37.858134 run         rm-remote-dir(pid=13948): Launched
18:05:40.070588 run         rm-remote-dir(pid=13948): Terminated: ok {rc=0}
18:05:40.437276 run         mk-remote-dir(pid=13949): Launched
18:05:41.646171 run         mk-remote-dir(pid=13949): Terminated: ok {rc=0}
18:05:41.956414 run    scp-inst-to-remote(pid=13950): Launched
18:05:55.182349 run    scp-inst-to-remote(pid=13950): Terminated: ok {rc=0}
18:05:55.544536 run         mk-remote-dir(pid=13952): Launched
18:05:57.751639 run         mk-remote-dir(pid=13952): Terminated: ok {rc=0}
18:05:58.059119 run     scp-cfg-to-remote(pid=13953): Launched
18:06:00.267389 run     scp-cfg-to-remote(pid=13953): Terminated: ok {rc=0}
18:06:00.625478 run   reload-dsp-firmware(pid=13955): Launched
18:06:03.831229 run   reload-dsp-firmware(pid=13955): Terminated: ok {rc=0}
18:06:04.178295 run        osmo-bts-sysmo(pid=13956): Launched
18:06:08.500076 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (31.1s)
18:06:08.647959 tst                      handover.py: using MSISDN 5135
18:06:08.824697 bus                        /sierra_1: Setting Powered True
18:06:12.318693 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5135', subscriber_id=1}
18:06:12.458039 tst                      handover.py: using MSISDN 5136
18:06:12.646178 bus                        /sierra_2: Setting Powered True
18:06:25.025585 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f82f0e67ea0&gt;, timeout=10, timestep=1} [trial-811↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-811↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
18:06:25.032963 tst                   handover.py:45: Test FAILED (66.5 sec)
18:06:25.068893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13936): Terminating (SIGTERM)
18:06:25.110452 run   osmo-hlr_10.42.42.2(pid=13937): Terminating (SIGTERM)
18:06:25.153014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13938): Terminating (SIGTERM)
18:06:25.197316 run   osmo-stp_10.42.42.5(pid=13939): Terminating (SIGTERM)
18:06:25.281931 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13940): Terminating (SIGTERM)
18:06:25.328582 run   osmo-msc_10.42.42.6(pid=13941): Terminating (SIGTERM)
18:06:25.368779 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13942): Terminating (SIGTERM)
18:06:25.409614 run   osmo-mgw_10.42.42.3(pid=13943): Terminating (SIGTERM)
18:06:25.450217 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13944): Terminating (SIGTERM)
18:06:25.490148 run   osmo-mgw_10.42.42.4(pid=13945): Terminating (SIGTERM)
18:06:25.530798 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13946): Terminating (SIGTERM)
18:06:25.571288 run   osmo-bsc_10.42.42.7(pid=13947): Terminating (SIGTERM)
18:06:25.614255 run        osmo-bts-sysmo(pid=13956): Terminating (SIGTERM)
18:06:25.626453 ---      ParallelTerminationStrategy: PID 13936 died...
18:06:25.713332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13936): Terminated: ok {rc=0}
18:06:25.724001 ---      ParallelTerminationStrategy: PID 13937 died...
18:06:25.781350 run   osmo-hlr_10.42.42.2(pid=13937): Terminated: ok {rc=0}
18:06:25.791965 ---      ParallelTerminationStrategy: PID 13938 died...
18:06:25.849892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13938): Terminated: ok {rc=0}
18:06:25.860229 ---      ParallelTerminationStrategy: PID 13939 died...
18:06:25.915502 run   osmo-stp_10.42.42.5(pid=13939): Terminated: ok {rc=0}
18:06:25.925390 ---      ParallelTerminationStrategy: PID 13940 died...
18:06:25.980406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13940): Terminated: ok {rc=0}
18:06:25.990401 ---      ParallelTerminationStrategy: PID 13941 died...
18:06:26.045541 run   osmo-msc_10.42.42.6(pid=13941): Terminated: ok {rc=0}
18:06:26.055528 ---      ParallelTerminationStrategy: PID 13942 died...
18:06:26.110809 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13942): Terminated: ok {rc=0}
18:06:26.120666 ---      ParallelTerminationStrategy: PID 13943 died...
18:06:26.174971 run   osmo-mgw_10.42.42.3(pid=13943): Terminated {rc=15}
18:06:26.185468 ---      ParallelTerminationStrategy: PID 13944 died...
18:06:26.239787 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13944): Terminated: ok {rc=0}
18:06:26.250406 ---      ParallelTerminationStrategy: PID 13945 died...
18:06:26.305384 run   osmo-mgw_10.42.42.4(pid=13945): Terminated {rc=15}
18:06:26.315170 ---      ParallelTerminationStrategy: PID 13946 died...
18:06:26.369472 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13946): Terminated: ok {rc=0}
18:06:26.380188 ---      ParallelTerminationStrategy: PID 13947 died...
18:06:26.435259 run   osmo-bsc_10.42.42.7(pid=13947): Terminated: ok {rc=0}
18:06:26.445240 ---      ParallelTerminationStrategy: PID 13956 died...
18:06:26.504111 run        osmo-bts-sysmo(pid=13956): Terminated: ok {rc=0}
18:06:26.611107 bus                        /sierra_2: Setting Online False
18:06:27.697200 bus                        /sierra_2: Setting Powered False
18:06:33.033521 bus                        /sierra_2: Setting Powered False
18:06:34.139140 bus                        /sierra_2: Setting Powered False
18:06:35.267505 bus                        /sierra_1: Setting Online False
18:06:36.354377 bus                        /sierra_1: Setting Powered False
18:06:41.965118 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f82f0e67ea0>, timeout=10, timestep=1} [trial-811↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]