Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 94 builds (Since #749 )
Took 1 min 11 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f1919b59400>, timeout=10, timestep=1} [trial-842↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-842 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
08:25:00.530559 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
08:25:00.541614 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
08:25:00.671090 tst                      handover.py: using LAC 10426
08:25:00.799048 tst                      handover.py: using RAC 226
08:25:00.927151 tst                      handover.py: using CellId 10426
08:25:01.055129 tst                      handover.py: using BVCI 10422
08:25:01.079643 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
08:25:01.226080 tst                      handover.py: using LAC 10427
08:25:01.362234 tst                      handover.py: using RAC 227
08:25:01.501301 tst                      handover.py: using CellId 10427
08:25:01.636003 tst                      handover.py: using BVCI 10423
08:25:01.662384 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
08:25:01.673990 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
08:25:01.685352 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
08:25:01.696691 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
08:25:01.708196 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
08:25:01.719695 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
08:25:01.823648 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
08:25:02.026182 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
08:25:02.546077 run           create_hlr_db(pid=504): Launched
08:25:02.685802 bus                        /sierra_1: Setting Powered False
08:25:03.765597 run           create_hlr_db(pid=504): Terminated: ok {rc=0}
08:25:04.170512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=506): Launched
08:25:04.492638 run     osmo-hlr_10.42.42.2(pid=507): Launched
08:25:04.608661 run              osmo-stp_10.42.42.5: Starting osmo-stp
08:25:05.140631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=508): Launched
08:25:05.464792 run     osmo-stp_10.42.42.5(pid=509): Launched
08:25:05.580182 run              osmo-msc_10.42.42.6: Starting osmo-msc
08:25:06.139711 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=510): Launched
08:25:06.464771 run     osmo-msc_10.42.42.6(pid=511): Launched
08:25:09.640972 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
08:25:10.171464 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=512): Launched
08:25:10.495799 run     osmo-mgw_10.42.42.3(pid=513): Launched
08:25:10.610808 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
08:25:11.133445 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=514): Launched
08:25:11.456095 run     osmo-mgw_10.42.42.4(pid=515): Launched
08:25:11.571247 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
08:25:12.275141 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=516): Launched
08:25:12.605637 run     osmo-bsc_10.42.42.7(pid=517): Launched
08:25:19.320985 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
08:25:19.870302 run           rm-remote-dir(pid=518): Launched
08:25:22.069547 run           rm-remote-dir(pid=518): Terminated: ok {rc=0}
08:25:22.422806 run           mk-remote-dir(pid=519): Launched
08:25:24.632902 run           mk-remote-dir(pid=519): Terminated: ok {rc=0}
08:25:24.942419 run      scp-inst-to-remote(pid=520): Launched
08:25:39.169725 run      scp-inst-to-remote(pid=520): Terminated: ok {rc=0}
08:25:39.533712 run           mk-remote-dir(pid=522): Launched
08:25:41.729686 run           mk-remote-dir(pid=522): Terminated: ok {rc=0}
08:25:42.020439 run       scp-cfg-to-remote(pid=523): Launched
08:25:45.218803 run       scp-cfg-to-remote(pid=523): Terminated: ok {rc=0}
08:25:45.553412 run     reload-dsp-firmware(pid=525): Launched
08:25:48.746067 run     reload-dsp-firmware(pid=525): Terminated: ok {rc=0}
08:25:49.072203 run          osmo-bts-sysmo(pid=526): Launched
08:25:54.426762 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (35.0s)
08:25:54.579864 tst                      handover.py: using MSISDN 6778
08:25:54.757835 bus                        /sierra_1: Setting Powered True
08:25:58.245472 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6778', subscriber_id=1}
08:25:58.384687 tst                      handover.py: using MSISDN 6779
08:25:58.560352 bus                        /sierra_2: Setting Powered True
08:26:10.934483 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f1919b59400&gt;, timeout=10, timestep=1} [trial-842↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-842↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
08:26:10.941956 tst                   handover.py:45: Test FAILED (70.4 sec)
08:26:10.977842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=506): Terminating (SIGTERM)
08:26:11.019472 run     osmo-hlr_10.42.42.2(pid=507): Terminating (SIGTERM)
08:26:11.062544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=508): Terminating (SIGTERM)
08:26:11.107440 run     osmo-stp_10.42.42.5(pid=509): Terminating (SIGTERM)
08:26:11.157430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=510): Terminating (SIGTERM)
08:26:11.216422 run     osmo-msc_10.42.42.6(pid=511): Terminating (SIGTERM)
08:26:11.261342 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=512): Terminating (SIGTERM)
08:26:11.307617 run     osmo-mgw_10.42.42.3(pid=513): Terminating (SIGTERM)
08:26:11.350275 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=514): Terminating (SIGTERM)
08:26:11.392335 run     osmo-mgw_10.42.42.4(pid=515): Terminating (SIGTERM)
08:26:11.435530 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=516): Terminating (SIGTERM)
08:26:11.477772 run     osmo-bsc_10.42.42.7(pid=517): Terminating (SIGTERM)
08:26:11.517727 run          osmo-bts-sysmo(pid=526): Terminating (SIGTERM)
08:26:11.527815 ---      ParallelTerminationStrategy: PID 506 died...
08:26:11.581722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=506): Terminated: ok {rc=0}
08:26:11.592313 ---      ParallelTerminationStrategy: PID 507 died...
08:26:11.647609 run     osmo-hlr_10.42.42.2(pid=507): Terminated: ok {rc=0}
08:26:11.658110 ---      ParallelTerminationStrategy: PID 508 died...
08:26:11.713766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=508): Terminated: ok {rc=0}
08:26:11.724291 ---      ParallelTerminationStrategy: PID 509 died...
08:26:11.779277 run     osmo-stp_10.42.42.5(pid=509): Terminated: ok {rc=0}
08:26:11.790216 ---      ParallelTerminationStrategy: PID 510 died...
08:26:11.845427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=510): Terminated: ok {rc=0}
08:26:11.855367 ---      ParallelTerminationStrategy: PID 511 died...
08:26:11.909030 run     osmo-msc_10.42.42.6(pid=511): Terminated: ok {rc=0}
08:26:11.919534 ---      ParallelTerminationStrategy: PID 512 died...
08:26:11.973377 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=512): Terminated: ok {rc=0}
08:26:11.983802 ---      ParallelTerminationStrategy: PID 513 died...
08:26:12.038136 run     osmo-mgw_10.42.42.3(pid=513): Terminated {rc=15}
08:26:12.048151 ---      ParallelTerminationStrategy: PID 514 died...
08:26:12.102113 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=514): Terminated: ok {rc=0}
08:26:12.112523 ---      ParallelTerminationStrategy: PID 515 died...
08:26:12.166278 run     osmo-mgw_10.42.42.4(pid=515): Terminated {rc=15}
08:26:12.176676 ---      ParallelTerminationStrategy: PID 516 died...
08:26:12.231446 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=516): Terminated: ok {rc=0}
08:26:12.241603 ---      ParallelTerminationStrategy: PID 517 died...
08:26:12.299031 run     osmo-bsc_10.42.42.7(pid=517): Terminated: ok {rc=0}
08:26:12.309434 ---      ParallelTerminationStrategy: PID 526 died...
08:26:12.366056 run          osmo-bts-sysmo(pid=526): Terminated: ok {rc=0}
08:26:12.472378 bus                        /sierra_2: Setting Online False
08:26:13.559430 bus                        /sierra_2: Setting Powered False
08:26:18.963845 bus                        /sierra_2: Setting Powered False
08:26:20.066051 bus                        /sierra_2: Setting Powered False
08:26:21.196495 bus                        /sierra_1: Setting Online False
08:26:22.281617 bus                        /sierra_1: Setting Powered False
08:26:27.965823 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f1919b59400>, timeout=10, timestep=1} [trial-842↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]