Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 92 builds (Since #749 )
Took 1 min 11 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f44785ccbf8>, timeout=10, timestep=1} [trial-840↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-840 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
06:24:08.185886 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
06:24:08.197712 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
06:24:08.337578 tst                      handover.py: using LAC 10266
06:24:08.474947 tst                      handover.py: using RAC 66
06:24:08.606152 tst                      handover.py: using CellId 10266
06:24:08.739128 tst                      handover.py: using BVCI 10262
06:24:08.764509 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
06:24:08.910155 tst                      handover.py: using LAC 10267
06:24:09.042898 tst                      handover.py: using RAC 67
06:24:09.179896 tst                      handover.py: using CellId 10267
06:24:09.310869 tst                      handover.py: using BVCI 10263
06:24:09.336460 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
06:24:09.347678 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
06:24:09.358727 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
06:24:09.369891 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
06:24:09.380970 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
06:24:09.392055 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
06:24:09.493715 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
06:24:09.694959 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
06:24:10.202223 run         create_hlr_db(pid=28787): Launched
06:24:10.338869 bus                        /sierra_1: Setting Powered False
06:24:11.416970 run         create_hlr_db(pid=28787): Terminated: ok {rc=0}
06:24:11.837622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28789): Launched
06:24:12.176480 run   osmo-hlr_10.42.42.2(pid=28790): Launched
06:24:12.298421 run              osmo-stp_10.42.42.5: Starting osmo-stp
06:24:12.851206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28791): Launched
06:24:13.189944 run   osmo-stp_10.42.42.5(pid=28792): Launched
06:24:13.310066 run              osmo-msc_10.42.42.6: Starting osmo-msc
06:24:13.894386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28793): Launched
06:24:14.232621 run   osmo-msc_10.42.42.6(pid=28794): Launched
06:24:17.412090 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
06:24:17.964769 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=28795): Launched
06:24:18.302363 run   osmo-mgw_10.42.42.3(pid=28796): Launched
06:24:18.422360 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
06:24:18.965646 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=28797): Launched
06:24:19.302811 run   osmo-mgw_10.42.42.4(pid=28798): Launched
06:24:19.423405 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
06:24:20.154702 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=28799): Launched
06:24:20.492885 run   osmo-bsc_10.42.42.7(pid=28800): Launched
06:24:27.238151 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
06:24:27.776630 run         rm-remote-dir(pid=28801): Launched
06:24:29.972213 run         rm-remote-dir(pid=28801): Terminated: ok {rc=0}
06:24:30.311098 run         mk-remote-dir(pid=28802): Launched
06:24:32.504351 run         mk-remote-dir(pid=28802): Terminated: ok {rc=0}
06:24:32.788199 run    scp-inst-to-remote(pid=28803): Launched
06:24:47.000813 run    scp-inst-to-remote(pid=28803): Terminated: ok {rc=0}
06:24:47.335840 run         mk-remote-dir(pid=28805): Launched
06:24:49.527329 run         mk-remote-dir(pid=28805): Terminated: ok {rc=0}
06:24:49.812993 run     scp-cfg-to-remote(pid=28806): Launched
06:24:53.008908 run     scp-cfg-to-remote(pid=28806): Terminated: ok {rc=0}
06:24:53.338132 run   reload-dsp-firmware(pid=28808): Launched
06:24:56.528594 run   reload-dsp-firmware(pid=28808): Terminated: ok {rc=0}
06:24:56.847673 run        osmo-bts-sysmo(pid=28809): Launched
06:25:02.203290 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (34.9s)
06:25:02.359421 tst                      handover.py: using MSISDN 6672
06:25:02.543193 bus                        /sierra_1: Setting Powered True
06:25:06.022293 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6672', subscriber_id=1}
06:25:06.167822 tst                      handover.py: using MSISDN 6673
06:25:06.343890 bus                        /sierra_2: Setting Powered True
06:25:18.690128 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f44785ccbf8&gt;, timeout=10, timestep=1} [trial-840↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-840↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
06:25:18.696930 tst                   handover.py:45: Test FAILED (70.5 sec)
06:25:18.731551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28789): Terminating (SIGTERM)
06:25:18.770540 run   osmo-hlr_10.42.42.2(pid=28790): Terminating (SIGTERM)
06:25:18.810195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28791): Terminating (SIGTERM)
06:25:18.850859 run   osmo-stp_10.42.42.5(pid=28792): Terminating (SIGTERM)
06:25:18.902345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28793): Terminating (SIGTERM)
06:25:18.946701 run   osmo-msc_10.42.42.6(pid=28794): Terminating (SIGTERM)
06:25:18.994021 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=28795): Terminating (SIGTERM)
06:25:19.035783 run   osmo-mgw_10.42.42.3(pid=28796): Terminating (SIGTERM)
06:25:19.079101 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=28797): Terminating (SIGTERM)
06:25:19.121931 run   osmo-mgw_10.42.42.4(pid=28798): Terminating (SIGTERM)
06:25:19.163266 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=28799): Terminating (SIGTERM)
06:25:19.202188 run   osmo-bsc_10.42.42.7(pid=28800): Terminating (SIGTERM)
06:25:19.241321 run        osmo-bts-sysmo(pid=28809): Terminating (SIGTERM)
06:25:19.250635 ---      ParallelTerminationStrategy: PID 28789 died...
06:25:19.303554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28789): Terminated: ok {rc=0}
06:25:19.313468 ---      ParallelTerminationStrategy: PID 28790 died...
06:25:19.365631 run   osmo-hlr_10.42.42.2(pid=28790): Terminated: ok {rc=0}
06:25:19.375250 ---      ParallelTerminationStrategy: PID 28791 died...
06:25:19.428107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28791): Terminated: ok {rc=0}
06:25:19.437991 ---      ParallelTerminationStrategy: PID 28792 died...
06:25:19.490271 run   osmo-stp_10.42.42.5(pid=28792): Terminated: ok {rc=0}
06:25:19.499970 ---      ParallelTerminationStrategy: PID 28793 died...
06:25:19.552558 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28793): Terminated: ok {rc=0}
06:25:19.562234 ---      ParallelTerminationStrategy: PID 28794 died...
06:25:19.616242 run   osmo-msc_10.42.42.6(pid=28794): Terminated: ok {rc=0}
06:25:19.626546 ---      ParallelTerminationStrategy: PID 28795 died...
06:25:19.680439 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=28795): Terminated: ok {rc=0}
06:25:19.690853 ---      ParallelTerminationStrategy: PID 28796 died...
06:25:19.744572 run   osmo-mgw_10.42.42.3(pid=28796): Terminated {rc=15}
06:25:19.754400 ---      ParallelTerminationStrategy: PID 28797 died...
06:25:19.807086 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=28797): Terminated: ok {rc=0}
06:25:19.816959 ---      ParallelTerminationStrategy: PID 28798 died...
06:25:19.869621 run   osmo-mgw_10.42.42.4(pid=28798): Terminated {rc=15}
06:25:19.879397 ---      ParallelTerminationStrategy: PID 28799 died...
06:25:19.933218 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=28799): Terminated: ok {rc=0}
06:25:19.943183 ---      ParallelTerminationStrategy: PID 28800 died...
06:25:19.996390 run   osmo-bsc_10.42.42.7(pid=28800): Terminated: ok {rc=0}
06:25:20.006320 ---      ParallelTerminationStrategy: PID 28809 died...
06:25:20.059418 run        osmo-bts-sysmo(pid=28809): Terminated: ok {rc=0}
06:25:20.167557 bus                        /sierra_2: Setting Online False
06:25:21.250260 bus                        /sierra_2: Setting Powered False
06:25:26.971153 bus                        /sierra_2: Setting Powered False
06:25:28.073098 bus                        /sierra_2: Setting Powered False
06:25:29.206090 bus                        /sierra_1: Setting Online False
06:25:30.290080 bus                        /sierra_1: Setting Powered False
06:25:35.966000 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f44785ccbf8>, timeout=10, timestep=1} [trial-840↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]