Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 75 builds (Since #749 )
Took 1 min 9 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fc0b444ac80>, timeout=10, timestep=1} [trial-823↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-823 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
09:21:53.276273 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:21:53.288655 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
09:21:53.424406 tst                      handover.py: using LAC 8906
09:21:53.556259 tst                      handover.py: using RAC 236
09:21:53.691090 tst                      handover.py: using CellId 8906
09:21:53.824487 tst                      handover.py: using BVCI 8902
09:21:53.850485 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
09:21:53.996241 tst                      handover.py: using LAC 8907
09:21:54.128788 tst                      handover.py: using RAC 237
09:21:54.260676 tst                      handover.py: using CellId 8907
09:21:54.392156 tst                      handover.py: using BVCI 8903
09:21:54.418605 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:21:54.430097 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:21:54.441403 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:21:54.452567 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:21:54.463848 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:21:54.474953 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
09:21:54.576669 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
09:21:54.772402 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
09:21:55.252993 run         create_hlr_db(pid=15526): Launched
09:21:55.384300 bus                        /sierra_1: Setting Powered False
09:21:56.461123 run         create_hlr_db(pid=15526): Terminated: ok {rc=0}
09:21:56.865911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15529): Launched
09:21:57.191236 run   osmo-hlr_10.42.42.2(pid=15530): Launched
09:21:57.306914 run              osmo-stp_10.42.42.5: Starting osmo-stp
09:21:57.838516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15531): Launched
09:21:58.160416 run   osmo-stp_10.42.42.5(pid=15532): Launched
09:21:58.274580 run              osmo-msc_10.42.42.6: Starting osmo-msc
09:21:58.832722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15533): Launched
09:21:59.155933 run   osmo-msc_10.42.42.6(pid=15534): Launched
09:22:02.327623 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
09:22:02.860610 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=15535): Launched
09:22:03.183903 run   osmo-mgw_10.42.42.3(pid=15536): Launched
09:22:03.298782 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
09:22:03.821901 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=15537): Launched
09:22:04.147302 run   osmo-mgw_10.42.42.4(pid=15538): Launched
09:22:04.262133 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
09:22:04.961047 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=15539): Launched
09:22:05.285313 run   osmo-bsc_10.42.42.7(pid=15540): Launched
09:22:12.033738 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
09:22:12.614694 run         rm-remote-dir(pid=15541): Launched
09:22:14.825595 run         rm-remote-dir(pid=15541): Terminated: ok {rc=0}
09:22:15.192368 run         mk-remote-dir(pid=15544): Launched
09:22:17.402991 run         mk-remote-dir(pid=15544): Terminated: ok {rc=0}
09:22:17.713437 run    scp-inst-to-remote(pid=15545): Launched
09:22:30.938742 run    scp-inst-to-remote(pid=15545): Terminated: ok {rc=0}
09:22:31.299156 run         mk-remote-dir(pid=15547): Launched
09:22:33.505027 run         mk-remote-dir(pid=15547): Terminated: ok {rc=0}
09:22:33.814167 run     scp-cfg-to-remote(pid=15548): Launched
09:22:36.020978 run     scp-cfg-to-remote(pid=15548): Terminated: ok {rc=0}
09:22:36.377123 run   reload-dsp-firmware(pid=15550): Launched
09:22:39.581738 run   reload-dsp-firmware(pid=15550): Terminated: ok {rc=0}
09:22:39.929042 run        osmo-bts-sysmo(pid=15551): Launched
09:22:45.270959 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (33.1s)
09:22:45.431005 tst                      handover.py: using MSISDN 5771
09:22:45.618394 bus                        /sierra_1: Setting Powered True
09:22:49.097864 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5771', subscriber_id=1}
09:22:49.236230 tst                      handover.py: using MSISDN 5772
09:22:49.411196 bus                        /sierra_2: Setting Powered True
09:23:01.778460 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fc0b444ac80&gt;, timeout=10, timestep=1} [trial-823↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-823↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
09:23:01.785402 tst                   handover.py:45: Test FAILED (68.5 sec)
09:23:01.820766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15529): Terminating (SIGTERM)
09:23:01.861216 run   osmo-hlr_10.42.42.2(pid=15530): Terminating (SIGTERM)
09:23:01.902687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15531): Terminating (SIGTERM)
09:23:01.945632 run   osmo-stp_10.42.42.5(pid=15532): Terminating (SIGTERM)
09:23:01.987030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15533): Terminating (SIGTERM)
09:23:02.031820 run   osmo-msc_10.42.42.6(pid=15534): Terminating (SIGTERM)
09:23:02.074017 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=15535): Terminating (SIGTERM)
09:23:02.116798 run   osmo-mgw_10.42.42.3(pid=15536): Terminating (SIGTERM)
09:23:02.159245 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=15537): Terminating (SIGTERM)
09:23:02.201490 run   osmo-mgw_10.42.42.4(pid=15538): Terminating (SIGTERM)
09:23:02.248424 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=15539): Terminating (SIGTERM)
09:23:02.291699 run   osmo-bsc_10.42.42.7(pid=15540): Terminating (SIGTERM)
09:23:02.335296 run        osmo-bts-sysmo(pid=15551): Terminating (SIGTERM)
09:23:02.345948 ---      ParallelTerminationStrategy: PID 15529 died...
09:23:02.405100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15529): Terminated: ok {rc=0}
09:23:02.416813 ---      ParallelTerminationStrategy: PID 15530 died...
09:23:02.476598 run   osmo-hlr_10.42.42.2(pid=15530): Terminated: ok {rc=0}
09:23:02.487493 ---      ParallelTerminationStrategy: PID 15531 died...
09:23:02.546232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15531): Terminated: ok {rc=0}
09:23:02.557401 ---      ParallelTerminationStrategy: PID 15532 died...
09:23:02.616096 run   osmo-stp_10.42.42.5(pid=15532): Terminated: ok {rc=0}
09:23:02.626632 ---      ParallelTerminationStrategy: PID 15533 died...
09:23:02.684702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15533): Terminated: ok {rc=0}
09:23:02.695330 ---      ParallelTerminationStrategy: PID 15534 died...
09:23:02.753055 run   osmo-msc_10.42.42.6(pid=15534): Terminated: ok {rc=0}
09:23:02.763619 ---      ParallelTerminationStrategy: PID 15535 died...
09:23:02.821060 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=15535): Terminated: ok {rc=0}
09:23:02.831573 ---      ParallelTerminationStrategy: PID 15536 died...
09:23:02.889230 run   osmo-mgw_10.42.42.3(pid=15536): Terminated {rc=15}
09:23:02.899691 ---      ParallelTerminationStrategy: PID 15537 died...
09:23:02.957707 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=15537): Terminated: ok {rc=0}
09:23:02.968512 ---      ParallelTerminationStrategy: PID 15538 died...
09:23:03.026666 run   osmo-mgw_10.42.42.4(pid=15538): Terminated {rc=15}
09:23:03.037012 ---      ParallelTerminationStrategy: PID 15539 died...
09:23:03.094736 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=15539): Terminated: ok {rc=0}
09:23:03.105310 ---      ParallelTerminationStrategy: PID 15540 died...
09:23:03.162967 run   osmo-bsc_10.42.42.7(pid=15540): Terminated: ok {rc=0}
09:23:03.173813 ---      ParallelTerminationStrategy: PID 15551 died...
09:23:03.231089 run        osmo-bts-sysmo(pid=15551): Terminated: ok {rc=0}
09:23:03.338597 bus                        /sierra_2: Setting Online False
09:23:04.426423 bus                        /sierra_2: Setting Powered False
09:23:09.968123 bus                        /sierra_2: Setting Powered False
09:23:11.071741 bus                        /sierra_2: Setting Powered False
09:23:12.204112 bus                        /sierra_1: Setting Online False
09:23:13.293062 bus                        /sierra_1: Setting Powered False
09:23:18.960008 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fc0b444ac80>, timeout=10, timestep=1} [trial-823↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]