Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 98 builds (Since #749 )
Took 1 min 12 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6091c9d488>, timeout=10, timestep=1} [trial-846↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-846 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
12:58:27.502923 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
12:58:27.514123 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
12:58:27.647823 tst                      handover.py: using LAC 10746
12:58:27.786141 tst                      handover.py: using RAC 36
12:58:27.918995 tst                      handover.py: using CellId 10746
12:58:28.052315 tst                      handover.py: using BVCI 10742
12:58:28.078451 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
12:58:28.222649 tst                      handover.py: using LAC 10747
12:58:28.358602 tst                      handover.py: using RAC 37
12:58:28.487376 tst                      handover.py: using CellId 10747
12:58:28.619987 tst                      handover.py: using BVCI 10743
12:58:28.646108 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
12:58:28.657446 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
12:58:28.668478 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
12:58:28.679574 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
12:58:28.690739 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
12:58:28.701851 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
12:58:28.809065 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
12:58:29.004076 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
12:58:29.484345 run         create_hlr_db(pid=21605): Launched
12:58:29.615802 bus                        /sierra_1: Setting Powered False
12:58:30.692227 run         create_hlr_db(pid=21605): Terminated: ok {rc=0}
12:58:31.119359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21607): Launched
12:58:31.464792 run   osmo-hlr_10.42.42.2(pid=21608): Launched
12:58:31.589267 run              osmo-stp_10.42.42.5: Starting osmo-stp
12:58:32.152949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21609): Launched
12:58:32.497855 run   osmo-stp_10.42.42.5(pid=21610): Launched
12:58:32.620231 run              osmo-msc_10.42.42.6: Starting osmo-msc
12:58:33.213099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21611): Launched
12:58:33.558859 run   osmo-msc_10.42.42.6(pid=21612): Launched
12:58:36.733415 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
12:58:37.266586 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=21613): Launched
12:58:37.596013 run   osmo-mgw_10.42.42.3(pid=21614): Launched
12:58:37.711053 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
12:58:38.234227 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=21615): Launched
12:58:38.560457 run   osmo-mgw_10.42.42.4(pid=21616): Launched
12:58:38.675714 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
12:58:39.378927 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=21617): Launched
12:58:39.704633 run   osmo-bsc_10.42.42.7(pid=21618): Launched
12:58:46.422660 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
12:58:46.972702 run         rm-remote-dir(pid=21619): Launched
12:58:49.172317 run         rm-remote-dir(pid=21619): Terminated: ok {rc=0}
12:58:49.517549 run         mk-remote-dir(pid=21620): Launched
12:58:51.716416 run         mk-remote-dir(pid=21620): Terminated: ok {rc=0}
12:58:52.007030 run    scp-inst-to-remote(pid=21621): Launched
12:59:06.222916 run    scp-inst-to-remote(pid=21621): Terminated: ok {rc=0}
12:59:06.562365 run         mk-remote-dir(pid=21623): Launched
12:59:09.759611 run         mk-remote-dir(pid=21623): Terminated: ok {rc=0}
12:59:10.049730 run     scp-cfg-to-remote(pid=21624): Launched
12:59:12.246716 run     scp-cfg-to-remote(pid=21624): Terminated: ok {rc=0}
12:59:12.583433 run   reload-dsp-firmware(pid=21626): Launched
12:59:16.779810 run   reload-dsp-firmware(pid=21626): Terminated: ok {rc=0}
12:59:17.105810 run        osmo-bts-sysmo(pid=21628): Launched
12:59:22.427383 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (35.9s)
12:59:22.578836 tst                      handover.py: using MSISDN 6990
12:59:22.767025 bus                        /sierra_1: Setting Powered True
12:59:26.247884 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6990', subscriber_id=1}
12:59:26.387101 tst                      handover.py: using MSISDN 6991
12:59:26.563600 bus                        /sierra_2: Setting Powered True
12:59:38.910504 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f6091c9d488&gt;, timeout=10, timestep=1} [trial-846↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-846↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
12:59:38.918022 tst                   handover.py:45: Test FAILED (71.4 sec)
12:59:38.954318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21607): Terminating (SIGTERM)
12:59:38.995886 run   osmo-hlr_10.42.42.2(pid=21608): Terminating (SIGTERM)
12:59:39.039394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21609): Terminating (SIGTERM)
12:59:39.083628 run   osmo-stp_10.42.42.5(pid=21610): Terminating (SIGTERM)
12:59:39.136644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21611): Terminating (SIGTERM)
12:59:39.182964 run   osmo-msc_10.42.42.6(pid=21612): Terminating (SIGTERM)
12:59:39.227102 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=21613): Terminating (SIGTERM)
12:59:39.271867 run   osmo-mgw_10.42.42.3(pid=21614): Terminating (SIGTERM)
12:59:39.330209 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=21615): Terminating (SIGTERM)
12:59:39.373087 run   osmo-mgw_10.42.42.4(pid=21616): Terminating (SIGTERM)
12:59:39.415871 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=21617): Terminating (SIGTERM)
12:59:39.456233 run   osmo-bsc_10.42.42.7(pid=21618): Terminating (SIGTERM)
12:59:39.497865 run        osmo-bts-sysmo(pid=21628): Terminating (SIGTERM)
12:59:39.507840 ---      ParallelTerminationStrategy: PID 21607 died...
12:59:39.562661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21607): Terminated: ok {rc=0}
12:59:39.573048 ---      ParallelTerminationStrategy: PID 21608 died...
12:59:39.628302 run   osmo-hlr_10.42.42.2(pid=21608): Terminated: ok {rc=0}
12:59:39.638474 ---      ParallelTerminationStrategy: PID 21609 died...
12:59:39.693527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21609): Terminated: ok {rc=0}
12:59:39.703362 ---      ParallelTerminationStrategy: PID 21610 died...
12:59:39.757769 run   osmo-stp_10.42.42.5(pid=21610): Terminated: ok {rc=0}
12:59:39.768816 ---      ParallelTerminationStrategy: PID 21611 died...
12:59:39.828642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21611): Terminated: ok {rc=0}
12:59:39.838856 ---      ParallelTerminationStrategy: PID 21612 died...
12:59:39.894962 run   osmo-msc_10.42.42.6(pid=21612): Terminated: ok {rc=0}
12:59:39.905414 ---      ParallelTerminationStrategy: PID 21613 died...
12:59:39.960272 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=21613): Terminated: ok {rc=0}
12:59:39.970116 ---      ParallelTerminationStrategy: PID 21614 died...
12:59:40.023330 run   osmo-mgw_10.42.42.3(pid=21614): Terminated {rc=15}
12:59:40.033399 ---      ParallelTerminationStrategy: PID 21615 died...
12:59:40.086895 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=21615): Terminated: ok {rc=0}
12:59:40.097357 ---      ParallelTerminationStrategy: PID 21616 died...
12:59:40.150952 run   osmo-mgw_10.42.42.4(pid=21616): Terminated {rc=15}
12:59:40.160796 ---      ParallelTerminationStrategy: PID 21617 died...
12:59:40.214272 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=21617): Terminated: ok {rc=0}
12:59:40.224017 ---      ParallelTerminationStrategy: PID 21618 died...
12:59:40.277514 run   osmo-bsc_10.42.42.7(pid=21618): Terminated: ok {rc=0}
12:59:40.287305 ---      ParallelTerminationStrategy: PID 21628 died...
12:59:40.340733 run        osmo-bts-sysmo(pid=21628): Terminated: ok {rc=0}
12:59:40.451028 bus                        /sierra_2: Setting Online False
12:59:41.535293 bus                        /sierra_2: Setting Powered False
12:59:46.956873 bus                        /sierra_2: Setting Powered False
12:59:48.062917 bus                        /sierra_2: Setting Powered False
12:59:49.191877 bus                        /sierra_1: Setting Online False
12:59:50.280178 bus                        /sierra_1: Setting Powered False
12:59:55.959646 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6091c9d488>, timeout=10, timestep=1} [trial-846↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]