Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 54 builds (Since #749 )
Took 1 min 6 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f710c49c9d8>, timeout=10, timestep=1} [trial-802↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-802 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
08:19:27.736265 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
08:19:27.747725 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
08:19:27.881691 tst                      handover.py: using LAC 7226
08:19:28.014774 tst                      handover.py: using RAC 86
08:19:28.146140 tst                      handover.py: using CellId 7226
08:19:28.278637 tst                      handover.py: using BVCI 7222
08:19:28.304470 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
08:19:28.447447 tst                      handover.py: using LAC 7227
08:19:28.574306 tst                      handover.py: using RAC 87
08:19:28.698106 tst                      handover.py: using CellId 7227
08:19:28.821555 tst                      handover.py: using BVCI 7223
08:19:28.845919 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
08:19:28.856927 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
08:19:28.867937 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
08:19:28.880487 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
08:19:28.891579 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
08:19:28.903975 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
08:19:29.011129 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
08:19:29.212243 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
08:19:29.723914 run         create_hlr_db(pid=21212): Launched
08:19:29.862524 bus                        /sierra_1: Setting Powered False
08:19:30.931726 run         create_hlr_db(pid=21212): Terminated: ok {rc=0}
08:19:31.332412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21214): Launched
08:19:31.654956 run   osmo-hlr_10.42.42.2(pid=21215): Launched
08:19:31.769258 run              osmo-stp_10.42.42.5: Starting osmo-stp
08:19:32.295488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21216): Launched
08:19:32.616589 run   osmo-stp_10.42.42.5(pid=21217): Launched
08:19:32.730413 run              osmo-msc_10.42.42.6: Starting osmo-msc
08:19:33.285377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21218): Launched
08:19:33.606661 run   osmo-msc_10.42.42.6(pid=21219): Launched
08:19:36.784207 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
08:19:37.341854 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=21220): Launched
08:19:37.680307 run   osmo-mgw_10.42.42.3(pid=21221): Launched
08:19:37.800417 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
08:19:38.347619 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=21222): Launched
08:19:38.686497 run   osmo-mgw_10.42.42.4(pid=21223): Launched
08:19:38.807384 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
08:19:39.542695 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=21224): Launched
08:19:39.882051 run   osmo-bsc_10.42.42.7(pid=21225): Launched
08:19:46.631091 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
08:19:47.205690 run         rm-remote-dir(pid=21226): Launched
08:19:49.413413 run         rm-remote-dir(pid=21226): Terminated: ok {rc=0}
08:19:49.776281 run         mk-remote-dir(pid=21227): Launched
08:19:50.982854 run         mk-remote-dir(pid=21227): Terminated: ok {rc=0}
08:19:51.291497 run    scp-inst-to-remote(pid=21228): Launched
08:20:04.516010 run    scp-inst-to-remote(pid=21228): Terminated: ok {rc=0}
08:20:04.874853 run         mk-remote-dir(pid=21233): Launched
08:20:07.079481 run         mk-remote-dir(pid=21233): Terminated: ok {rc=0}
08:20:07.387505 run     scp-cfg-to-remote(pid=21234): Launched
08:20:08.592647 run     scp-cfg-to-remote(pid=21234): Terminated: ok {rc=0}
08:20:08.945717 run   reload-dsp-firmware(pid=21236): Launched
08:20:12.149915 run   reload-dsp-firmware(pid=21236): Terminated: ok {rc=0}
08:20:12.492846 run        osmo-bts-sysmo(pid=21237): Launched
08:20:16.829728 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (30.1s)
08:20:16.989211 tst                      handover.py: using MSISDN 4658
08:20:17.176810 bus                        /sierra_1: Setting Powered True
08:20:20.683562 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4658', subscriber_id=1}
08:20:20.829395 tst                      handover.py: using MSISDN 4659
08:20:21.014474 bus                        /sierra_2: Setting Powered True
08:20:33.381486 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f710c49c9d8&gt;, timeout=10, timestep=1} [trial-802↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-802↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
08:20:33.388113 tst                   handover.py:45: Test FAILED (65.6 sec)
08:20:33.423120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21214): Terminating (SIGTERM)
08:20:33.462665 run   osmo-hlr_10.42.42.2(pid=21215): Terminating (SIGTERM)
08:20:33.503849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21216): Terminating (SIGTERM)
08:20:33.545069 run   osmo-stp_10.42.42.5(pid=21217): Terminating (SIGTERM)
08:20:33.596979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21218): Terminating (SIGTERM)
08:20:33.639312 run   osmo-msc_10.42.42.6(pid=21219): Terminating (SIGTERM)
08:20:33.683770 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=21220): Terminating (SIGTERM)
08:20:33.727003 run   osmo-mgw_10.42.42.3(pid=21221): Terminating (SIGTERM)
08:20:33.784157 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=21222): Terminating (SIGTERM)
08:20:33.826695 run   osmo-mgw_10.42.42.4(pid=21223): Terminating (SIGTERM)
08:20:33.866791 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=21224): Terminating (SIGTERM)
08:20:33.906632 run   osmo-bsc_10.42.42.7(pid=21225): Terminating (SIGTERM)
08:20:33.946200 run        osmo-bts-sysmo(pid=21237): Terminating (SIGTERM)
08:20:33.955668 ---      ParallelTerminationStrategy: PID 21214 died...
08:20:34.010091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21214): Terminated: ok {rc=0}
08:20:34.021290 ---      ParallelTerminationStrategy: PID 21215 died...
08:20:34.077055 run   osmo-hlr_10.42.42.2(pid=21215): Terminated: ok {rc=0}
08:20:34.087691 ---      ParallelTerminationStrategy: PID 21216 died...
08:20:34.143248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21216): Terminated: ok {rc=0}
08:20:34.152989 ---      ParallelTerminationStrategy: PID 21217 died...
08:20:34.206176 run   osmo-stp_10.42.42.5(pid=21217): Terminated: ok {rc=0}
08:20:34.215983 ---      ParallelTerminationStrategy: PID 21218 died...
08:20:34.269025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21218): Terminated: ok {rc=0}
08:20:34.278673 ---      ParallelTerminationStrategy: PID 21219 died...
08:20:34.331475 run   osmo-msc_10.42.42.6(pid=21219): Terminated: ok {rc=0}
08:20:34.341421 ---      ParallelTerminationStrategy: PID 21220 died...
08:20:34.398089 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=21220): Terminated: ok {rc=0}
08:20:34.407755 ---      ParallelTerminationStrategy: PID 21221 died...
08:20:34.460681 run   osmo-mgw_10.42.42.3(pid=21221): Terminated {rc=15}
08:20:34.470553 ---      ParallelTerminationStrategy: PID 21222 died...
08:20:34.523885 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=21222): Terminated: ok {rc=0}
08:20:34.533706 ---      ParallelTerminationStrategy: PID 21223 died...
08:20:34.586680 run   osmo-mgw_10.42.42.4(pid=21223): Terminated {rc=15}
08:20:34.596333 ---      ParallelTerminationStrategy: PID 21224 died...
08:20:34.649367 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=21224): Terminated: ok {rc=0}
08:20:34.659197 ---      ParallelTerminationStrategy: PID 21225 died...
08:20:34.711912 run   osmo-bsc_10.42.42.7(pid=21225): Terminated: ok {rc=0}
08:20:34.721869 ---      ParallelTerminationStrategy: PID 21237 died...
08:20:34.774439 run        osmo-bts-sysmo(pid=21237): Terminated: ok {rc=0}
08:20:34.883706 bus                        /sierra_2: Setting Online False
08:20:35.967054 bus                        /sierra_2: Setting Powered False
08:20:41.963542 bus                        /sierra_2: Setting Powered False
08:20:43.065470 bus                        /sierra_2: Setting Powered False
08:20:44.197618 bus                        /sierra_1: Setting Online False
08:20:45.281563 bus                        /sierra_1: Setting Powered False
08:20:50.961343 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f710c49c9d8>, timeout=10, timestep=1} [trial-802↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]