Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 71 builds (Since #749 )
Took 1 min 8 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fb1158a3378>, timeout=10, timestep=1} [trial-819↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-819 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
04:03:18.863794 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
04:03:18.875216 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
04:03:19.004344 tst                      handover.py: using LAC 8586
04:03:19.139757 tst                      handover.py: using RAC 171
04:03:19.277719 tst                      handover.py: using CellId 8586
04:03:19.414677 tst                      handover.py: using BVCI 8582
04:03:19.441140 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
04:03:19.590757 tst                      handover.py: using LAC 8587
04:03:19.725894 tst                      handover.py: using RAC 172
04:03:19.862842 tst                      handover.py: using CellId 8587
04:03:19.998162 tst                      handover.py: using BVCI 8583
04:03:20.024581 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
04:03:20.035981 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
04:03:20.047211 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
04:03:20.058523 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
04:03:20.070057 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
04:03:20.081390 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
04:03:20.188686 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
04:03:20.393984 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
04:03:20.920237 run          create_hlr_db(pid=6311): Launched
04:03:21.060923 bus                        /sierra_1: Setting Powered False
04:03:22.140996 run          create_hlr_db(pid=6311): Terminated: ok {rc=0}
04:03:22.550544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6313): Launched
04:03:22.877529 run    osmo-hlr_10.42.42.2(pid=6314): Launched
04:03:22.995500 run              osmo-stp_10.42.42.5: Starting osmo-stp
04:03:23.531432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6315): Launched
04:03:23.858665 run    osmo-stp_10.42.42.5(pid=6316): Launched
04:03:23.974847 run              osmo-msc_10.42.42.6: Starting osmo-msc
04:03:24.539194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6317): Launched
04:03:24.867479 run    osmo-msc_10.42.42.6(pid=6318): Launched
04:03:28.041289 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
04:03:28.579540 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=6319): Launched
04:03:28.910754 run    osmo-mgw_10.42.42.3(pid=6320): Launched
04:03:29.027017 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
04:03:29.555359 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6321): Launched
04:03:29.886093 run    osmo-mgw_10.42.42.4(pid=6322): Launched
04:03:30.002405 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
04:03:30.715497 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=6323): Launched
04:03:31.046421 run    osmo-bsc_10.42.42.7(pid=6324): Launched
04:03:37.770584 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
04:03:38.323060 run          rm-remote-dir(pid=6325): Launched
04:03:40.523293 run          rm-remote-dir(pid=6325): Terminated: ok {rc=0}
04:03:40.874905 run          mk-remote-dir(pid=6326): Launched
04:03:43.075673 run          mk-remote-dir(pid=6326): Terminated: ok {rc=0}
04:03:43.372082 run     scp-inst-to-remote(pid=6327): Launched
04:03:56.601113 run     scp-inst-to-remote(pid=6327): Terminated: ok {rc=0}
04:03:56.968724 run          mk-remote-dir(pid=6329): Launched
04:03:59.179222 run          mk-remote-dir(pid=6329): Terminated: ok {rc=0}
04:03:59.492785 run      scp-cfg-to-remote(pid=6330): Launched
04:04:01.703493 run      scp-cfg-to-remote(pid=6330): Terminated: ok {rc=0}
04:04:02.066419 run    reload-dsp-firmware(pid=6332): Launched
04:04:05.274432 run    reload-dsp-firmware(pid=6332): Terminated: ok {rc=0}
04:04:05.627424 run         osmo-bts-sysmo(pid=6333): Launched
04:04:09.972454 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (32.1s)
04:04:10.141587 tst                      handover.py: using MSISDN 5559
04:04:10.323967 bus                        /sierra_1: Setting Powered True
04:04:13.831208 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5559', subscriber_id=1}
04:04:13.981978 tst                      handover.py: using MSISDN 5560
04:04:14.171177 bus                        /sierra_2: Setting Powered True
04:04:26.537101 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fb1158a3378&gt;, timeout=10, timestep=1} [trial-819↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-819↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
04:04:26.543816 tst                   handover.py:45: Test FAILED (67.7 sec)
04:04:26.578476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6313): Terminating (SIGTERM)
04:04:26.617936 run    osmo-hlr_10.42.42.2(pid=6314): Terminating (SIGTERM)
04:04:26.657869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6315): Terminating (SIGTERM)
04:04:26.699786 run    osmo-stp_10.42.42.5(pid=6316): Terminating (SIGTERM)
04:04:26.749448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6317): Terminating (SIGTERM)
04:04:26.791328 run    osmo-msc_10.42.42.6(pid=6318): Terminating (SIGTERM)
04:04:26.831677 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=6319): Terminating (SIGTERM)
04:04:26.870833 run    osmo-mgw_10.42.42.3(pid=6320): Terminating (SIGTERM)
04:04:26.910653 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6321): Terminating (SIGTERM)
04:04:26.949925 run    osmo-mgw_10.42.42.4(pid=6322): Terminating (SIGTERM)
04:04:26.990819 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=6323): Terminating (SIGTERM)
04:04:27.040992 run    osmo-bsc_10.42.42.7(pid=6324): Terminating (SIGTERM)
04:04:27.085448 run         osmo-bts-sysmo(pid=6333): Terminating (SIGTERM)
04:04:27.095741 ---      ParallelTerminationStrategy: PID 6313 died...
04:04:27.164803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6313): Terminated: ok {rc=0}
04:04:27.175018 ---      ParallelTerminationStrategy: PID 6314 died...
04:04:27.232669 run    osmo-hlr_10.42.42.2(pid=6314): Terminated: ok {rc=0}
04:04:27.242664 ---      ParallelTerminationStrategy: PID 6315 died...
04:04:27.296810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6315): Terminated: ok {rc=0}
04:04:27.306802 ---      ParallelTerminationStrategy: PID 6316 died...
04:04:27.359855 run    osmo-stp_10.42.42.5(pid=6316): Terminated: ok {rc=0}
04:04:27.369768 ---      ParallelTerminationStrategy: PID 6317 died...
04:04:27.422545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6317): Terminated: ok {rc=0}
04:04:27.432331 ---      ParallelTerminationStrategy: PID 6318 died...
04:04:27.485226 run    osmo-msc_10.42.42.6(pid=6318): Terminated: ok {rc=0}
04:04:27.495067 ---      ParallelTerminationStrategy: PID 6319 died...
04:04:27.548237 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=6319): Terminated: ok {rc=0}
04:04:27.558214 ---      ParallelTerminationStrategy: PID 6320 died...
04:04:27.611460 run    osmo-mgw_10.42.42.3(pid=6320): Terminated {rc=15}
04:04:27.621066 ---      ParallelTerminationStrategy: PID 6321 died...
04:04:27.674204 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6321): Terminated: ok {rc=0}
04:04:27.684103 ---      ParallelTerminationStrategy: PID 6322 died...
04:04:27.737342 run    osmo-mgw_10.42.42.4(pid=6322): Terminated {rc=15}
04:04:27.747064 ---      ParallelTerminationStrategy: PID 6323 died...
04:04:27.800224 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=6323): Terminated: ok {rc=0}
04:04:27.810087 ---      ParallelTerminationStrategy: PID 6324 died...
04:04:27.863728 run    osmo-bsc_10.42.42.7(pid=6324): Terminated: ok {rc=0}
04:04:27.873585 ---      ParallelTerminationStrategy: PID 6333 died...
04:04:27.926588 run         osmo-bts-sysmo(pid=6333): Terminated: ok {rc=0}
04:04:28.029832 bus                        /sierra_2: Setting Online False
04:04:29.111427 bus                        /sierra_2: Setting Powered False
04:04:34.971008 bus                        /sierra_2: Setting Powered False
04:04:36.071859 bus                        /sierra_2: Setting Powered False
04:04:37.197499 bus                        /sierra_1: Setting Online False
04:04:38.284846 bus                        /sierra_1: Setting Powered False
04:04:43.962300 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fb1158a3378>, timeout=10, timestep=1} [trial-819↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]