Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 100 builds (Since #749 )
Took 1 min 12 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f9bf5638598>, timeout=10, timestep=1} [trial-848↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-848 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
16:34:35.149127 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
16:34:35.160346 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
16:34:35.296362 tst                      handover.py: using LAC 10906
16:34:35.430020 tst                      handover.py: using RAC 196
16:34:35.569647 tst                      handover.py: using CellId 10906
16:34:35.700242 tst                      handover.py: using BVCI 10902
16:34:35.725355 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
16:34:35.867238 tst                      handover.py: using LAC 10907
16:34:35.995291 tst                      handover.py: using RAC 197
16:34:36.123476 tst                      handover.py: using CellId 10907
16:34:36.253568 tst                      handover.py: using BVCI 10903
16:34:36.278569 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
16:34:36.289696 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
16:34:36.300278 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
16:34:36.311238 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
16:34:36.322431 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
16:34:36.333523 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
16:34:36.435592 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
16:34:36.628421 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
16:34:37.112204 run         create_hlr_db(pid=26640): Launched
16:34:37.244071 bus                        /sierra_1: Setting Powered False
16:34:38.320298 run         create_hlr_db(pid=26640): Terminated: ok {rc=0}
16:34:38.747084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26642): Launched
16:34:39.090604 run   osmo-hlr_10.42.42.2(pid=26643): Launched
16:34:39.215329 run              osmo-stp_10.42.42.5: Starting osmo-stp
16:34:39.779777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26644): Launched
16:34:40.125255 run   osmo-stp_10.42.42.5(pid=26645): Launched
16:34:40.248706 run              osmo-msc_10.42.42.6: Starting osmo-msc
16:34:40.843129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26646): Launched
16:34:41.188438 run   osmo-msc_10.42.42.6(pid=26647): Launched
16:34:44.371400 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
16:34:44.937608 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=26648): Launched
16:34:45.283651 run   osmo-mgw_10.42.42.3(pid=26649): Launched
16:34:45.406309 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
16:34:45.962327 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26650): Launched
16:34:46.308465 run   osmo-mgw_10.42.42.4(pid=26651): Launched
16:34:46.431768 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
16:34:47.176036 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=26652): Launched
16:34:47.522667 run   osmo-bsc_10.42.42.7(pid=26653): Launched
16:34:54.278402 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
16:34:54.859644 run         rm-remote-dir(pid=26654): Launched
16:34:57.070380 run         rm-remote-dir(pid=26654): Terminated: ok {rc=0}
16:34:57.435285 run         mk-remote-dir(pid=26655): Launched
16:34:59.643984 run         mk-remote-dir(pid=26655): Terminated: ok {rc=0}
16:34:59.954104 run    scp-inst-to-remote(pid=26656): Launched
16:35:14.174146 run    scp-inst-to-remote(pid=26656): Terminated: ok {rc=0}
16:35:14.520713 run         mk-remote-dir(pid=26661): Launched
16:35:17.728403 run         mk-remote-dir(pid=26661): Terminated: ok {rc=0}
16:35:18.038131 run     scp-cfg-to-remote(pid=26662): Launched
16:35:20.244875 run     scp-cfg-to-remote(pid=26662): Terminated: ok {rc=0}
16:35:20.603286 run   reload-dsp-firmware(pid=26664): Launched
16:35:24.810401 run   reload-dsp-firmware(pid=26664): Terminated: ok {rc=0}
16:35:25.157912 run        osmo-bts-sysmo(pid=26665): Launched
16:35:30.502636 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (36.1s)
16:35:30.662999 tst                      handover.py: using MSISDN 7096
16:35:30.851308 bus                        /sierra_1: Setting Powered True
16:35:34.364782 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='7096', subscriber_id=1}
16:35:34.506267 tst                      handover.py: using MSISDN 7097
16:35:34.682786 bus                        /sierra_2: Setting Powered True
16:35:47.037778 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f9bf5638598&gt;, timeout=10, timestep=1} [trial-848↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-848↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
16:35:47.044811 tst                   handover.py:45: Test FAILED (71.9 sec)
16:35:47.080991 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26642): Terminating (SIGTERM)
16:35:47.122540 run   osmo-hlr_10.42.42.2(pid=26643): Terminating (SIGTERM)
16:35:47.165429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26644): Terminating (SIGTERM)
16:35:47.208691 run   osmo-stp_10.42.42.5(pid=26645): Terminating (SIGTERM)
16:35:47.275581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26646): Terminating (SIGTERM)
16:35:47.321029 run   osmo-msc_10.42.42.6(pid=26647): Terminating (SIGTERM)
16:35:47.368025 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=26648): Terminating (SIGTERM)
16:35:47.412961 run   osmo-mgw_10.42.42.3(pid=26649): Terminating (SIGTERM)
16:35:47.454314 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26650): Terminating (SIGTERM)
16:35:47.498172 run   osmo-mgw_10.42.42.4(pid=26651): Terminating (SIGTERM)
16:35:47.539557 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=26652): Terminating (SIGTERM)
16:35:47.579801 run   osmo-bsc_10.42.42.7(pid=26653): Terminating (SIGTERM)
16:35:47.621293 run        osmo-bts-sysmo(pid=26665): Terminating (SIGTERM)
16:35:47.633348 ---      ParallelTerminationStrategy: PID 26642 died...
16:35:47.689554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26642): Terminated: ok {rc=0}
16:35:47.699928 ---      ParallelTerminationStrategy: PID 26643 died...
16:35:47.755808 run   osmo-hlr_10.42.42.2(pid=26643): Terminated: ok {rc=0}
16:35:47.765718 ---      ParallelTerminationStrategy: PID 26644 died...
16:35:47.819928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26644): Terminated: ok {rc=0}
16:35:47.830366 ---      ParallelTerminationStrategy: PID 26645 died...
16:35:47.883835 run   osmo-stp_10.42.42.5(pid=26645): Terminated: ok {rc=0}
16:35:47.894347 ---      ParallelTerminationStrategy: PID 26646 died...
16:35:47.948509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26646): Terminated: ok {rc=0}
16:35:47.958410 ---      ParallelTerminationStrategy: PID 26647 died...
16:35:48.011776 run   osmo-msc_10.42.42.6(pid=26647): Terminated: ok {rc=0}
16:35:48.022361 ---      ParallelTerminationStrategy: PID 26648 died...
16:35:48.075720 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=26648): Terminated: ok {rc=0}
16:35:48.086161 ---      ParallelTerminationStrategy: PID 26649 died...
16:35:48.139018 run   osmo-mgw_10.42.42.3(pid=26649): Terminated {rc=15}
16:35:48.148801 ---      ParallelTerminationStrategy: PID 26650 died...
16:35:48.201761 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26650): Terminated: ok {rc=0}
16:35:48.211643 ---      ParallelTerminationStrategy: PID 26651 died...
16:35:48.264637 run   osmo-mgw_10.42.42.4(pid=26651): Terminated {rc=15}
16:35:48.274321 ---      ParallelTerminationStrategy: PID 26652 died...
16:35:48.327221 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=26652): Terminated: ok {rc=0}
16:35:48.337250 ---      ParallelTerminationStrategy: PID 26653 died...
16:35:48.390162 run   osmo-bsc_10.42.42.7(pid=26653): Terminated: ok {rc=0}
16:35:48.399892 ---      ParallelTerminationStrategy: PID 26665 died...
16:35:48.453329 run        osmo-bts-sysmo(pid=26665): Terminated: ok {rc=0}
16:35:48.560320 bus                        /sierra_2: Setting Online False
16:35:49.643081 bus                        /sierra_2: Setting Powered False
16:35:54.977445 bus                        /sierra_2: Setting Powered False
16:35:56.080132 bus                        /sierra_2: Setting Powered False
16:35:57.211253 bus                        /sierra_1: Setting Online False
16:35:58.296419 bus                        /sierra_1: Setting Powered False
16:36:03.958690 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f9bf5638598>, timeout=10, timestep=1} [trial-848↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]