Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 60 builds (Since #749 )
Took 1 min 7 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7ff10037f488>, timeout=10, timestep=1} [trial-808↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-808 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
14:10:45.936443 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
14:10:45.948789 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
14:10:46.083400 tst                      handover.py: using LAC 7706
14:10:46.215589 tst                      handover.py: using RAC 56
14:10:46.348630 tst                      handover.py: using CellId 7706
14:10:46.480793 tst                      handover.py: using BVCI 7702
14:10:46.506874 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
14:10:46.651901 tst                      handover.py: using LAC 7707
14:10:46.785258 tst                      handover.py: using RAC 57
14:10:46.919920 tst                      handover.py: using CellId 7707
14:10:47.056160 tst                      handover.py: using BVCI 7703
14:10:47.082275 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
14:10:47.093573 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
14:10:47.104685 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
14:10:47.115914 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
14:10:47.127376 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
14:10:47.138707 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
14:10:47.241898 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
14:10:47.444304 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
14:10:47.961366 run          create_hlr_db(pid=3508): Launched
14:10:48.099160 bus                        /sierra_1: Setting Powered False
14:10:49.178380 run          create_hlr_db(pid=3508): Terminated: ok {rc=0}
14:10:49.583619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3510): Launched
14:10:49.912572 run    osmo-hlr_10.42.42.2(pid=3511): Launched
14:10:50.028985 run              osmo-stp_10.42.42.5: Starting osmo-stp
14:10:50.560882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3512): Launched
14:10:50.884240 run    osmo-stp_10.42.42.5(pid=3513): Launched
14:10:50.999223 run              osmo-msc_10.42.42.6: Starting osmo-msc
14:10:51.560611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3514): Launched
14:10:51.887654 run    osmo-msc_10.42.42.6(pid=3515): Launched
14:10:55.059765 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
14:10:55.594849 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=3517): Launched
14:10:55.921012 run    osmo-mgw_10.42.42.3(pid=3518): Launched
14:10:56.036043 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
14:10:56.558149 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3519): Launched
14:10:56.880858 run    osmo-mgw_10.42.42.4(pid=3520): Launched
14:10:56.997796 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
14:10:57.701604 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=3521): Launched
14:10:58.026545 run    osmo-bsc_10.42.42.7(pid=3522): Launched
14:11:04.740157 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
14:11:05.284137 run          rm-remote-dir(pid=3523): Launched
14:11:07.480869 run          rm-remote-dir(pid=3523): Terminated: ok {rc=0}
14:11:07.823318 run          mk-remote-dir(pid=3524): Launched
14:11:09.019214 run          mk-remote-dir(pid=3524): Terminated: ok {rc=0}
14:11:09.309089 run     scp-inst-to-remote(pid=3525): Launched
14:11:22.522085 run     scp-inst-to-remote(pid=3525): Terminated: ok {rc=0}
14:11:22.858494 run          mk-remote-dir(pid=3527): Launched
14:11:25.052831 run          mk-remote-dir(pid=3527): Terminated: ok {rc=0}
14:11:25.350645 run      scp-cfg-to-remote(pid=3528): Launched
14:11:27.556033 run      scp-cfg-to-remote(pid=3528): Terminated: ok {rc=0}
14:11:27.908782 run    reload-dsp-firmware(pid=3530): Launched
14:11:31.112875 run    reload-dsp-firmware(pid=3530): Terminated: ok {rc=0}
14:11:31.457073 run         osmo-bts-sysmo(pid=3531): Launched
14:11:35.793005 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (31.0s)
14:11:35.952638 tst                      handover.py: using MSISDN 4976
14:11:36.139813 bus                        /sierra_1: Setting Powered True
14:11:39.637531 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4976', subscriber_id=1}
14:11:39.781433 tst                      handover.py: using MSISDN 4977
14:11:39.957513 bus                        /sierra_2: Setting Powered True
14:11:52.314030 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7ff10037f488&gt;, timeout=10, timestep=1} [trial-808↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-808↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
14:11:52.321297 tst                   handover.py:45: Test FAILED (66.4 sec)
14:11:52.357098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3510): Terminating (SIGTERM)
14:11:52.398404 run    osmo-hlr_10.42.42.2(pid=3511): Terminating (SIGTERM)
14:11:52.440876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3512): Terminating (SIGTERM)
14:11:52.483433 run    osmo-stp_10.42.42.5(pid=3513): Terminating (SIGTERM)
14:11:52.530661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3514): Terminating (SIGTERM)
14:11:52.574894 run    osmo-msc_10.42.42.6(pid=3515): Terminating (SIGTERM)
14:11:52.639368 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=3517): Terminating (SIGTERM)
14:11:52.702789 run    osmo-mgw_10.42.42.3(pid=3518): Terminating (SIGTERM)
14:11:52.757317 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3519): Terminating (SIGTERM)
14:11:52.802310 run    osmo-mgw_10.42.42.4(pid=3520): Terminating (SIGTERM)
14:11:52.845275 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=3521): Terminating (SIGTERM)
14:11:52.887064 run    osmo-bsc_10.42.42.7(pid=3522): Terminating (SIGTERM)
14:11:52.928408 run         osmo-bts-sysmo(pid=3531): Terminating (SIGTERM)
14:11:52.938102 ---      ParallelTerminationStrategy: PID 3510 died...
14:11:52.994762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3510): Terminated: ok {rc=0}
14:11:53.004894 ---      ParallelTerminationStrategy: PID 3511 died...
14:11:53.061847 run    osmo-hlr_10.42.42.2(pid=3511): Terminated: ok {rc=0}
14:11:53.072327 ---      ParallelTerminationStrategy: PID 3512 died...
14:11:53.128954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3512): Terminated: ok {rc=0}
14:11:53.139650 ---      ParallelTerminationStrategy: PID 3513 died...
14:11:53.196409 run    osmo-stp_10.42.42.5(pid=3513): Terminated: ok {rc=0}
14:11:53.206920 ---      ParallelTerminationStrategy: PID 3514 died...
14:11:53.263892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3514): Terminated: ok {rc=0}
14:11:53.274163 ---      ParallelTerminationStrategy: PID 3515 died...
14:11:53.329954 run    osmo-msc_10.42.42.6(pid=3515): Terminated: ok {rc=0}
14:11:53.340044 ---      ParallelTerminationStrategy: PID 3517 died...
14:11:53.395421 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=3517): Terminated: ok {rc=0}
14:11:53.405654 ---      ParallelTerminationStrategy: PID 3518 died...
14:11:53.461062 run    osmo-mgw_10.42.42.3(pid=3518): Terminated {rc=15}
14:11:53.471252 ---      ParallelTerminationStrategy: PID 3519 died...
14:11:53.526909 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3519): Terminated: ok {rc=0}
14:11:53.537021 ---      ParallelTerminationStrategy: PID 3520 died...
14:11:53.592906 run    osmo-mgw_10.42.42.4(pid=3520): Terminated {rc=15}
14:11:53.603074 ---      ParallelTerminationStrategy: PID 3521 died...
14:11:53.658505 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=3521): Terminated: ok {rc=0}
14:11:53.668718 ---      ParallelTerminationStrategy: PID 3522 died...
14:11:53.724263 run    osmo-bsc_10.42.42.7(pid=3522): Terminated: ok {rc=0}
14:11:53.734421 ---      ParallelTerminationStrategy: PID 3531 died...
14:11:53.789863 run         osmo-bts-sysmo(pid=3531): Terminated: ok {rc=0}
14:11:53.895931 bus                        /sierra_2: Setting Online False
14:11:54.981890 bus                        /sierra_2: Setting Powered False
14:12:00.968420 bus                        /sierra_2: Setting Powered False
14:12:02.069676 bus                        /sierra_2: Setting Powered False
14:12:03.202258 bus                        /sierra_1: Setting Online False
14:12:04.285984 bus                        /sierra_1: Setting Powered False
14:12:09.963978 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7ff10037f488>, timeout=10, timestep=1} [trial-808↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]