Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 69 builds (Since #749 )
Took 1 min 8 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f28b43711e0>, timeout=10, timestep=1} [trial-817↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-817 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
02:05:02.689254 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
02:05:02.700769 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
02:05:02.839594 tst                      handover.py: using LAC 8426
02:05:02.974049 tst                      handover.py: using RAC 11
02:05:03.106380 tst                      handover.py: using CellId 8426
02:05:03.239091 tst                      handover.py: using BVCI 8422
02:05:03.265023 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
02:05:03.411892 tst                      handover.py: using LAC 8427
02:05:03.544455 tst                      handover.py: using RAC 12
02:05:03.676309 tst                      handover.py: using CellId 8427
02:05:03.808287 tst                      handover.py: using BVCI 8423
02:05:03.834460 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
02:05:03.845897 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
02:05:03.857121 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
02:05:03.868771 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
02:05:03.880344 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
02:05:03.891881 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
02:05:03.999529 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
02:05:04.198613 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
02:05:04.680923 run           create_hlr_db(pid=443): Launched
02:05:04.811203 bus                        /sierra_1: Setting Powered False
02:05:05.886830 run           create_hlr_db(pid=443): Terminated: ok {rc=0}
02:05:06.288349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=445): Launched
02:05:06.616233 run     osmo-hlr_10.42.42.2(pid=446): Launched
02:05:06.731223 run              osmo-stp_10.42.42.5: Starting osmo-stp
02:05:07.259155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=447): Launched
02:05:07.583266 run     osmo-stp_10.42.42.5(pid=448): Launched
02:05:07.696868 run              osmo-msc_10.42.42.6: Starting osmo-msc
02:05:08.252876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=449): Launched
02:05:08.577583 run     osmo-msc_10.42.42.6(pid=450): Launched
02:05:11.749435 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
02:05:12.276952 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=451): Launched
02:05:12.607266 run     osmo-mgw_10.42.42.3(pid=452): Launched
02:05:12.730627 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
02:05:13.283529 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=453): Launched
02:05:13.627133 run     osmo-mgw_10.42.42.4(pid=454): Launched
02:05:13.750353 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
02:05:14.496824 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=455): Launched
02:05:14.843440 run     osmo-bsc_10.42.42.7(pid=456): Launched
02:05:21.601897 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
02:05:22.181727 run           rm-remote-dir(pid=458): Launched
02:05:24.390981 run           rm-remote-dir(pid=458): Terminated: ok {rc=0}
02:05:24.759982 run           mk-remote-dir(pid=459): Launched
02:05:26.968243 run           mk-remote-dir(pid=459): Terminated: ok {rc=0}
02:05:27.278007 run      scp-inst-to-remote(pid=460): Launched
02:05:40.503113 run      scp-inst-to-remote(pid=460): Terminated: ok {rc=0}
02:05:40.864497 run           mk-remote-dir(pid=462): Launched
02:05:43.060227 run           mk-remote-dir(pid=462): Terminated: ok {rc=0}
02:05:43.351672 run       scp-cfg-to-remote(pid=463): Launched
02:05:45.546447 run       scp-cfg-to-remote(pid=463): Terminated: ok {rc=0}
02:05:45.881501 run     reload-dsp-firmware(pid=465): Launched
02:05:48.072748 run     reload-dsp-firmware(pid=465): Terminated: ok {rc=0}
02:05:48.398461 run          osmo-bts-sysmo(pid=466): Launched
02:05:53.722356 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (32.0s)
02:05:53.879853 tst                      handover.py: using MSISDN 5453
02:05:54.059743 bus                        /sierra_1: Setting Powered True
02:05:57.534655 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5453', subscriber_id=1}
02:05:57.672814 tst                      handover.py: using MSISDN 5454
02:05:57.847699 bus                        /sierra_2: Setting Powered True
02:06:10.219974 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f28b43711e0&gt;, timeout=10, timestep=1} [trial-817↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-817↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
02:06:10.227651 tst                   handover.py:45: Test FAILED (67.5 sec)
02:06:10.263716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=445): Terminating (SIGTERM)
02:06:10.305279 run     osmo-hlr_10.42.42.2(pid=446): Terminating (SIGTERM)
02:06:10.348698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=447): Terminating (SIGTERM)
02:06:10.392175 run     osmo-stp_10.42.42.5(pid=448): Terminating (SIGTERM)
02:06:10.465759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=449): Terminating (SIGTERM)
02:06:10.508712 run     osmo-msc_10.42.42.6(pid=450): Terminating (SIGTERM)
02:06:10.554522 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=451): Terminating (SIGTERM)
02:06:10.596484 run     osmo-mgw_10.42.42.3(pid=452): Terminating (SIGTERM)
02:06:10.652927 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=453): Terminating (SIGTERM)
02:06:10.694435 run     osmo-mgw_10.42.42.4(pid=454): Terminating (SIGTERM)
02:06:10.734870 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=455): Terminating (SIGTERM)
02:06:10.774236 run     osmo-bsc_10.42.42.7(pid=456): Terminating (SIGTERM)
02:06:10.813587 run          osmo-bts-sysmo(pid=466): Terminating (SIGTERM)
02:06:10.823021 ---      ParallelTerminationStrategy: PID 445 died...
02:06:10.876450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=445): Terminated: ok {rc=0}
02:06:10.886102 ---      ParallelTerminationStrategy: PID 446 died...
02:06:10.938589 run     osmo-hlr_10.42.42.2(pid=446): Terminated: ok {rc=0}
02:06:10.948437 ---      ParallelTerminationStrategy: PID 447 died...
02:06:11.002747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=447): Terminated: ok {rc=0}
02:06:11.012868 ---      ParallelTerminationStrategy: PID 448 died...
02:06:11.067121 run     osmo-stp_10.42.42.5(pid=448): Terminated: ok {rc=0}
02:06:11.077339 ---      ParallelTerminationStrategy: PID 449 died...
02:06:11.131380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=449): Terminated: ok {rc=0}
02:06:11.141081 ---      ParallelTerminationStrategy: PID 450 died...
02:06:11.194194 run     osmo-msc_10.42.42.6(pid=450): Terminated: ok {rc=0}
02:06:11.203750 ---      ParallelTerminationStrategy: PID 451 died...
02:06:11.257213 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=451): Terminated: ok {rc=0}
02:06:11.267011 ---      ParallelTerminationStrategy: PID 452 died...
02:06:11.320164 run     osmo-mgw_10.42.42.3(pid=452): Terminated {rc=15}
02:06:11.329893 ---      ParallelTerminationStrategy: PID 453 died...
02:06:11.383443 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=453): Terminated: ok {rc=0}
02:06:11.393099 ---      ParallelTerminationStrategy: PID 454 died...
02:06:11.446233 run     osmo-mgw_10.42.42.4(pid=454): Terminated {rc=15}
02:06:11.455859 ---      ParallelTerminationStrategy: PID 455 died...
02:06:11.509287 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=455): Terminated: ok {rc=0}
02:06:11.519441 ---      ParallelTerminationStrategy: PID 456 died...
02:06:11.573257 run     osmo-bsc_10.42.42.7(pid=456): Terminated: ok {rc=0}
02:06:11.582938 ---      ParallelTerminationStrategy: PID 466 died...
02:06:11.636420 run          osmo-bts-sysmo(pid=466): Terminated: ok {rc=0}
02:06:11.738469 bus                        /sierra_2: Setting Online False
02:06:12.825273 bus                        /sierra_2: Setting Powered False
02:06:18.163280 bus                        /sierra_2: Setting Powered False
02:06:19.269667 bus                        /sierra_2: Setting Powered False
02:06:20.398111 bus                        /sierra_1: Setting Online False
02:06:21.484184 bus                        /sierra_1: Setting Powered False
02:06:26.970742 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f28b43711e0>, timeout=10, timestep=1} [trial-817↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]