Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 61 builds (Since #749 )
Took 1 min 7 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f64d59fe9d8>, timeout=10, timestep=1} [trial-809↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-809 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
15:09:18.333623 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
15:09:18.344988 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
15:09:18.477693 tst                      handover.py: using LAC 7786
15:09:18.612045 tst                      handover.py: using RAC 136
15:09:18.743892 tst                      handover.py: using CellId 7786
15:09:18.878327 tst                      handover.py: using BVCI 7782
15:09:18.904080 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
15:09:19.052332 tst                      handover.py: using LAC 7787
15:09:19.186776 tst                      handover.py: using RAC 137
15:09:19.315257 tst                      handover.py: using CellId 7787
15:09:19.441809 tst                      handover.py: using BVCI 7783
15:09:19.466095 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
15:09:19.477320 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
15:09:19.488179 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
15:09:19.500527 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
15:09:19.512228 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
15:09:19.523126 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
15:09:19.627230 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
15:09:19.830064 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
15:09:20.343217 run          create_hlr_db(pid=5872): Launched
15:09:20.481228 bus                        /sierra_1: Setting Powered False
15:09:21.560978 run          create_hlr_db(pid=5872): Terminated: ok {rc=0}
15:09:21.962904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5874): Launched
15:09:22.287725 run    osmo-hlr_10.42.42.2(pid=5875): Launched
15:09:22.401266 run              osmo-stp_10.42.42.5: Starting osmo-stp
15:09:22.928184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5876): Launched
15:09:23.248109 run    osmo-stp_10.42.42.5(pid=5877): Launched
15:09:23.364531 run              osmo-msc_10.42.42.6: Starting osmo-msc
15:09:23.918797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5878): Launched
15:09:24.240583 run    osmo-msc_10.42.42.6(pid=5879): Launched
15:09:27.410134 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
15:09:27.934788 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5880): Launched
15:09:28.254221 run    osmo-mgw_10.42.42.3(pid=5881): Launched
15:09:28.370699 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
15:09:28.886502 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5882): Launched
15:09:29.208382 run    osmo-mgw_10.42.42.4(pid=5883): Launched
15:09:29.321368 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
15:09:30.015734 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5884): Launched
15:09:30.338641 run    osmo-bsc_10.42.42.7(pid=5885): Launched
15:09:37.041931 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
15:09:37.579130 run          rm-remote-dir(pid=5886): Launched
15:09:39.774819 run          rm-remote-dir(pid=5886): Terminated: ok {rc=0}
15:09:40.113909 run          mk-remote-dir(pid=5887): Launched
15:09:42.319691 run          mk-remote-dir(pid=5887): Terminated: ok {rc=0}
15:09:42.627552 run     scp-inst-to-remote(pid=5888): Launched
15:09:54.850591 run     scp-inst-to-remote(pid=5888): Terminated: ok {rc=0}
15:09:55.208190 run          mk-remote-dir(pid=5890): Launched
15:09:57.413389 run          mk-remote-dir(pid=5890): Terminated: ok {rc=0}
15:09:57.718522 run      scp-cfg-to-remote(pid=5891): Launched
15:09:59.923952 run      scp-cfg-to-remote(pid=5891): Terminated: ok {rc=0}
15:10:00.277222 run    reload-dsp-firmware(pid=5893): Launched
15:10:03.480284 run    reload-dsp-firmware(pid=5893): Terminated: ok {rc=0}
15:10:03.823525 run         osmo-bts-sysmo(pid=5897): Launched
15:10:08.157594 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (31.0s)
15:10:08.315864 tst                      handover.py: using MSISDN 5029
15:10:08.501701 bus                        /sierra_1: Setting Powered True
15:10:11.990077 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5029', subscriber_id=1}
15:10:12.129815 tst                      handover.py: using MSISDN 5030
15:10:12.304414 bus                        /sierra_2: Setting Powered True
15:10:24.661466 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f64d59fe9d8&gt;, timeout=10, timestep=1} [trial-809↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-809↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
15:10:24.668272 tst                   handover.py:45: Test FAILED (66.3 sec)
15:10:24.703596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5874): Terminating (SIGTERM)
15:10:24.743469 run    osmo-hlr_10.42.42.2(pid=5875): Terminating (SIGTERM)
15:10:24.784062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5876): Terminating (SIGTERM)
15:10:24.827573 run    osmo-stp_10.42.42.5(pid=5877): Terminating (SIGTERM)
15:10:24.868594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5878): Terminating (SIGTERM)
15:10:24.911010 run    osmo-msc_10.42.42.6(pid=5879): Terminating (SIGTERM)
15:10:24.957704 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5880): Terminating (SIGTERM)
15:10:24.999097 run    osmo-mgw_10.42.42.3(pid=5881): Terminating (SIGTERM)
15:10:25.040231 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5882): Terminating (SIGTERM)
15:10:25.081398 run    osmo-mgw_10.42.42.4(pid=5883): Terminating (SIGTERM)
15:10:25.127783 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5884): Terminating (SIGTERM)
15:10:25.168191 run    osmo-bsc_10.42.42.7(pid=5885): Terminating (SIGTERM)
15:10:25.208093 run         osmo-bts-sysmo(pid=5897): Terminating (SIGTERM)
15:10:25.217762 ---      ParallelTerminationStrategy: PID 5874 died...
15:10:25.271648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5874): Terminated: ok {rc=0}
15:10:25.282010 ---      ParallelTerminationStrategy: PID 5875 died...
15:10:25.335695 run    osmo-hlr_10.42.42.2(pid=5875): Terminated: ok {rc=0}
15:10:25.345467 ---      ParallelTerminationStrategy: PID 5876 died...
15:10:25.399303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5876): Terminated: ok {rc=0}
15:10:25.409657 ---      ParallelTerminationStrategy: PID 5877 died...
15:10:25.464295 run    osmo-stp_10.42.42.5(pid=5877): Terminated: ok {rc=0}
15:10:25.474656 ---      ParallelTerminationStrategy: PID 5878 died...
15:10:25.529631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5878): Terminated: ok {rc=0}
15:10:25.539914 ---      ParallelTerminationStrategy: PID 5879 died...
15:10:25.593557 run    osmo-msc_10.42.42.6(pid=5879): Terminated: ok {rc=0}
15:10:25.603383 ---      ParallelTerminationStrategy: PID 5880 died...
15:10:25.656831 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5880): Terminated: ok {rc=0}
15:10:25.666853 ---      ParallelTerminationStrategy: PID 5881 died...
15:10:25.720126 run    osmo-mgw_10.42.42.3(pid=5881): Terminated {rc=15}
15:10:25.730092 ---      ParallelTerminationStrategy: PID 5882 died...
15:10:25.783564 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5882): Terminated: ok {rc=0}
15:10:25.793386 ---      ParallelTerminationStrategy: PID 5883 died...
15:10:25.846543 run    osmo-mgw_10.42.42.4(pid=5883): Terminated {rc=15}
15:10:25.856436 ---      ParallelTerminationStrategy: PID 5884 died...
15:10:25.909925 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5884): Terminated: ok {rc=0}
15:10:25.919772 ---      ParallelTerminationStrategy: PID 5885 died...
15:10:25.973744 run    osmo-bsc_10.42.42.7(pid=5885): Terminated: ok {rc=0}
15:10:25.983481 ---      ParallelTerminationStrategy: PID 5897 died...
15:10:26.037175 run         osmo-bts-sysmo(pid=5897): Terminated: ok {rc=0}
15:10:26.147475 bus                        /sierra_2: Setting Online False
15:10:27.231199 bus                        /sierra_2: Setting Powered False
15:10:32.968990 bus                        /sierra_2: Setting Powered False
15:10:34.076063 bus                        /sierra_2: Setting Powered False
15:10:35.205132 bus                        /sierra_1: Setting Online False
15:10:36.291449 bus                        /sierra_1: Setting Powered False
15:10:41.961955 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f64d59fe9d8>, timeout=10, timestep=1} [trial-809↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]