Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 68 builds (Since #749 )
Took 1 min 8 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f01a83e67b8>, timeout=10, timestep=1} [trial-816↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-816 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
01:05:47.453629 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
01:05:47.465000 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
01:05:47.603859 tst                      handover.py: using LAC 8346
01:05:47.736895 tst                      handover.py: using RAC 186
01:05:47.865768 tst                      handover.py: using CellId 8346
01:05:47.997052 tst                      handover.py: using BVCI 8342
01:05:48.022062 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
01:05:48.165607 tst                      handover.py: using LAC 8347
01:05:48.293630 tst                      handover.py: using RAC 187
01:05:48.419096 tst                      handover.py: using CellId 8347
01:05:48.545851 tst                      handover.py: using BVCI 8343
01:05:48.570389 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
01:05:48.581402 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
01:05:48.592207 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
01:05:48.603304 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
01:05:48.614448 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
01:05:48.625466 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
01:05:48.729101 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
01:05:48.923243 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
01:05:49.412647 run         create_hlr_db(pid=30587): Launched
01:05:49.544198 bus                        /sierra_1: Setting Powered False
01:05:50.620324 run         create_hlr_db(pid=30587): Terminated: ok {rc=0}
01:05:51.049125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30589): Launched
01:05:51.396422 run   osmo-hlr_10.42.42.2(pid=30590): Launched
01:05:51.520730 run              osmo-stp_10.42.42.5: Starting osmo-stp
01:05:52.090344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30591): Launched
01:05:52.437491 run   osmo-stp_10.42.42.5(pid=30592): Launched
01:05:52.559761 run              osmo-msc_10.42.42.6: Starting osmo-msc
01:05:53.159367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30593): Launched
01:05:53.507447 run   osmo-msc_10.42.42.6(pid=30594): Launched
01:05:56.691416 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
01:05:57.262263 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=30595): Launched
01:05:57.607984 run   osmo-mgw_10.42.42.3(pid=30596): Launched
01:05:57.730568 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
01:05:58.292102 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=30597): Launched
01:05:58.639331 run   osmo-mgw_10.42.42.4(pid=30598): Launched
01:05:58.763338 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
01:05:59.514318 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=30599): Launched
01:05:59.863730 run   osmo-bsc_10.42.42.7(pid=30600): Launched
01:06:06.627562 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
01:06:07.214387 run         rm-remote-dir(pid=30601): Launched
01:06:09.426563 run         rm-remote-dir(pid=30601): Terminated: ok {rc=0}
01:06:09.800519 run         mk-remote-dir(pid=30602): Launched
01:06:12.011082 run         mk-remote-dir(pid=30602): Terminated: ok {rc=0}
01:06:12.324597 run    scp-inst-to-remote(pid=30603): Launched
01:06:25.553200 run    scp-inst-to-remote(pid=30603): Terminated: ok {rc=0}
01:06:25.917426 run         mk-remote-dir(pid=30605): Launched
01:06:27.124515 run         mk-remote-dir(pid=30605): Terminated: ok {rc=0}
01:06:27.438313 run     scp-cfg-to-remote(pid=30606): Launched
01:06:29.645957 run     scp-cfg-to-remote(pid=30606): Terminated: ok {rc=0}
01:06:30.007900 run   reload-dsp-firmware(pid=30608): Launched
01:06:33.215056 run   reload-dsp-firmware(pid=30608): Terminated: ok {rc=0}
01:06:33.566923 run        osmo-bts-sysmo(pid=30609): Launched
01:06:38.910378 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (32.2s)
01:06:39.072647 tst                      handover.py: using MSISDN 5400
01:06:39.253816 bus                        /sierra_1: Setting Powered True
01:06:42.758270 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5400', subscriber_id=1}
01:06:42.896993 tst                      handover.py: using MSISDN 5401
01:06:43.083698 bus                        /sierra_2: Setting Powered True
01:06:55.432059 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f01a83e67b8&gt;, timeout=10, timestep=1} [trial-816↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-816↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
01:06:55.438927 tst                   handover.py:45: Test FAILED (68.0 sec)
01:06:55.474170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30589): Terminating (SIGTERM)
01:06:55.514717 run   osmo-hlr_10.42.42.2(pid=30590): Terminating (SIGTERM)
01:06:55.555351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30591): Terminating (SIGTERM)
01:06:55.597617 run   osmo-stp_10.42.42.5(pid=30592): Terminating (SIGTERM)
01:06:55.649544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30593): Terminating (SIGTERM)
01:06:55.691380 run   osmo-msc_10.42.42.6(pid=30594): Terminating (SIGTERM)
01:06:55.733966 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=30595): Terminating (SIGTERM)
01:06:55.778578 run   osmo-mgw_10.42.42.3(pid=30596): Terminating (SIGTERM)
01:06:55.821086 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=30597): Terminating (SIGTERM)
01:06:55.863673 run   osmo-mgw_10.42.42.4(pid=30598): Terminating (SIGTERM)
01:06:55.904166 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=30599): Terminating (SIGTERM)
01:06:55.944320 run   osmo-bsc_10.42.42.7(pid=30600): Terminating (SIGTERM)
01:06:55.985215 run        osmo-bts-sysmo(pid=30609): Terminating (SIGTERM)
01:06:55.994882 ---      ParallelTerminationStrategy: PID 30589 died...
01:06:56.049896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30589): Terminated: ok {rc=0}
01:06:56.060229 ---      ParallelTerminationStrategy: PID 30590 died...
01:06:56.115257 run   osmo-hlr_10.42.42.2(pid=30590): Terminated: ok {rc=0}
01:06:56.125494 ---      ParallelTerminationStrategy: PID 30591 died...
01:06:56.179377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30591): Terminated: ok {rc=0}
01:06:56.189251 ---      ParallelTerminationStrategy: PID 30592 died...
01:06:56.243510 run   osmo-stp_10.42.42.5(pid=30592): Terminated: ok {rc=0}
01:06:56.253557 ---      ParallelTerminationStrategy: PID 30593 died...
01:06:56.307516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30593): Terminated: ok {rc=0}
01:06:56.317489 ---      ParallelTerminationStrategy: PID 30594 died...
01:06:56.371106 run   osmo-msc_10.42.42.6(pid=30594): Terminated: ok {rc=0}
01:06:56.381122 ---      ParallelTerminationStrategy: PID 30595 died...
01:06:56.435282 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=30595): Terminated: ok {rc=0}
01:06:56.445065 ---      ParallelTerminationStrategy: PID 30596 died...
01:06:56.498657 run   osmo-mgw_10.42.42.3(pid=30596): Terminated {rc=15}
01:06:56.508629 ---      ParallelTerminationStrategy: PID 30597 died...
01:06:56.562864 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=30597): Terminated: ok {rc=0}
01:06:56.572827 ---      ParallelTerminationStrategy: PID 30598 died...
01:06:56.627023 run   osmo-mgw_10.42.42.4(pid=30598): Terminated {rc=15}
01:06:56.636924 ---      ParallelTerminationStrategy: PID 30599 died...
01:06:56.691006 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=30599): Terminated: ok {rc=0}
01:06:56.700955 ---      ParallelTerminationStrategy: PID 30600 died...
01:06:56.754952 run   osmo-bsc_10.42.42.7(pid=30600): Terminated: ok {rc=0}
01:06:56.764860 ---      ParallelTerminationStrategy: PID 30609 died...
01:06:56.818778 run        osmo-bts-sysmo(pid=30609): Terminated: ok {rc=0}
01:06:56.923070 bus                        /sierra_2: Setting Online False
01:06:58.010362 bus                        /sierra_2: Setting Powered False
01:07:03.971216 bus                        /sierra_2: Setting Powered False
01:07:05.076353 bus                        /sierra_2: Setting Powered False
01:07:06.203943 bus                        /sierra_1: Setting Online False
01:07:07.291459 bus                        /sierra_1: Setting Powered False
01:07:12.977808 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f01a83e67b8>, timeout=10, timestep=1} [trial-816↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]