Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 88 builds (Since #749 )
Took 1 min 11 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fee5a77b7b8>, timeout=10, timestep=1} [trial-836↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-836 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
01:06:54.307384 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
01:06:54.318258 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
01:06:54.449123 tst                      handover.py: using LAC 9946
01:06:54.577538 tst                      handover.py: using RAC 1
01:06:54.699668 tst                      handover.py: using CellId 9946
01:06:54.823651 tst                      handover.py: using BVCI 9942
01:06:54.847637 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
01:06:54.985354 tst                      handover.py: using LAC 9947
01:06:55.107102 tst                      handover.py: using RAC 2
01:06:55.234364 tst                      handover.py: using CellId 9947
01:06:55.356860 tst                      handover.py: using BVCI 9943
01:06:55.380875 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
01:06:55.391859 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
01:06:55.402728 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
01:06:55.413814 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
01:06:55.424888 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
01:06:55.435857 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
01:06:55.540564 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
01:06:55.740024 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
01:06:56.251612 run         create_hlr_db(pid=19082): Launched
01:06:56.389593 bus                        /sierra_1: Setting Powered False
01:06:57.468070 run         create_hlr_db(pid=19082): Terminated: ok {rc=0}
01:06:57.867660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19084): Launched
01:06:58.186978 run   osmo-hlr_10.42.42.2(pid=19085): Launched
01:06:58.300975 run              osmo-stp_10.42.42.5: Starting osmo-stp
01:06:58.826929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19086): Launched
01:06:59.146531 run   osmo-stp_10.42.42.5(pid=19087): Launched
01:06:59.259617 run              osmo-msc_10.42.42.6: Starting osmo-msc
01:06:59.810738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19088): Launched
01:07:00.128932 run   osmo-msc_10.42.42.6(pid=19089): Launched
01:07:03.297806 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
01:07:03.826983 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19090): Launched
01:07:04.143274 run   osmo-mgw_10.42.42.3(pid=19091): Launched
01:07:04.256341 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
01:07:04.770409 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19092): Launched
01:07:05.089677 run   osmo-mgw_10.42.42.4(pid=19093): Launched
01:07:05.202622 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
01:07:05.893438 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19094): Launched
01:07:06.214694 run   osmo-bsc_10.42.42.7(pid=19095): Launched
01:07:12.918597 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
01:07:13.458214 run         rm-remote-dir(pid=19096): Launched
01:07:15.654927 run         rm-remote-dir(pid=19096): Terminated: ok {rc=0}
01:07:15.993975 run         mk-remote-dir(pid=19097): Launched
01:07:18.190622 run         mk-remote-dir(pid=19097): Terminated: ok {rc=0}
01:07:18.477635 run    scp-inst-to-remote(pid=19098): Launched
01:07:32.690729 run    scp-inst-to-remote(pid=19098): Terminated: ok {rc=0}
01:07:33.024794 run         mk-remote-dir(pid=19100): Launched
01:07:35.218173 run         mk-remote-dir(pid=19100): Terminated: ok {rc=0}
01:07:35.509760 run     scp-cfg-to-remote(pid=19101): Launched
01:07:37.703945 run     scp-cfg-to-remote(pid=19101): Terminated: ok {rc=0}
01:07:38.034547 run   reload-dsp-firmware(pid=19103): Launched
01:07:42.228191 run   reload-dsp-firmware(pid=19103): Terminated: ok {rc=0}
01:07:42.550295 run        osmo-bts-sysmo(pid=19104): Launched
01:07:47.866352 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (34.9s)
01:07:48.014778 tst                      handover.py: using MSISDN 6460
01:07:48.200507 bus                        /sierra_1: Setting Powered True
01:07:51.691855 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6460', subscriber_id=1}
01:07:51.838787 tst                      handover.py: using MSISDN 6461
01:07:52.024125 bus                        /sierra_2: Setting Powered True
01:08:04.398117 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fee5a77b7b8&gt;, timeout=10, timestep=1} [trial-836↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-836↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
01:08:04.404816 tst                   handover.py:45: Test FAILED (70.1 sec)
01:08:04.440035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19084): Terminating (SIGTERM)
01:08:04.479740 run   osmo-hlr_10.42.42.2(pid=19085): Terminating (SIGTERM)
01:08:04.520962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19086): Terminating (SIGTERM)
01:08:04.563215 run   osmo-stp_10.42.42.5(pid=19087): Terminating (SIGTERM)
01:08:04.604581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19088): Terminating (SIGTERM)
01:08:04.647440 run   osmo-msc_10.42.42.6(pid=19089): Terminating (SIGTERM)
01:08:04.690628 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19090): Terminating (SIGTERM)
01:08:04.733400 run   osmo-mgw_10.42.42.3(pid=19091): Terminating (SIGTERM)
01:08:04.775441 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19092): Terminating (SIGTERM)
01:08:04.817352 run   osmo-mgw_10.42.42.4(pid=19093): Terminating (SIGTERM)
01:08:04.858335 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19094): Terminating (SIGTERM)
01:08:04.898270 run   osmo-bsc_10.42.42.7(pid=19095): Terminating (SIGTERM)
01:08:04.938261 run        osmo-bts-sysmo(pid=19104): Terminating (SIGTERM)
01:08:04.947757 ---      ParallelTerminationStrategy: PID 19084 died...
01:08:05.002799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19084): Terminated: ok {rc=0}
01:08:05.013386 ---      ParallelTerminationStrategy: PID 19085 died...
01:08:05.068979 run   osmo-hlr_10.42.42.2(pid=19085): Terminated: ok {rc=0}
01:08:05.079387 ---      ParallelTerminationStrategy: PID 19086 died...
01:08:05.135257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19086): Terminated: ok {rc=0}
01:08:05.144978 ---      ParallelTerminationStrategy: PID 19087 died...
01:08:05.199542 run   osmo-stp_10.42.42.5(pid=19087): Terminated: ok {rc=0}
01:08:05.209084 ---      ParallelTerminationStrategy: PID 19088 died...
01:08:05.262590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19088): Terminated: ok {rc=0}
01:08:05.272306 ---      ParallelTerminationStrategy: PID 19089 died...
01:08:05.325447 run   osmo-msc_10.42.42.6(pid=19089): Terminated: ok {rc=0}
01:08:05.335080 ---      ParallelTerminationStrategy: PID 19090 died...
01:08:05.388220 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19090): Terminated: ok {rc=0}
01:08:05.398140 ---      ParallelTerminationStrategy: PID 19091 died...
01:08:05.451562 run   osmo-mgw_10.42.42.3(pid=19091): Terminated {rc=15}
01:08:05.461277 ---      ParallelTerminationStrategy: PID 19092 died...
01:08:05.514687 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19092): Terminated: ok {rc=0}
01:08:05.524303 ---      ParallelTerminationStrategy: PID 19093 died...
01:08:05.577745 run   osmo-mgw_10.42.42.4(pid=19093): Terminated {rc=15}
01:08:05.587399 ---      ParallelTerminationStrategy: PID 19094 died...
01:08:05.640882 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19094): Terminated: ok {rc=0}
01:08:05.650698 ---      ParallelTerminationStrategy: PID 19095 died...
01:08:05.703981 run   osmo-bsc_10.42.42.7(pid=19095): Terminated: ok {rc=0}
01:08:05.714149 ---      ParallelTerminationStrategy: PID 19104 died...
01:08:05.767795 run        osmo-bts-sysmo(pid=19104): Terminated: ok {rc=0}
01:08:05.876627 bus                        /sierra_2: Setting Online False
01:08:06.959860 bus                        /sierra_2: Setting Powered False
01:08:12.961395 bus                        /sierra_2: Setting Powered False
01:08:14.062181 bus                        /sierra_2: Setting Powered False
01:08:15.194329 bus                        /sierra_1: Setting Online False
01:08:16.278693 bus                        /sierra_1: Setting Powered False
01:08:21.969767 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fee5a77b7b8>, timeout=10, timestep=1} [trial-836↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]