Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 66 builds (Since #749 )
Took 1 min 8 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f8282d13f28>, timeout=10, timestep=1} [trial-814↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-814 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
22:44:14.468975 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
22:44:14.479989 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
22:44:14.605517 tst                      handover.py: using LAC 8186
22:44:14.732035 tst                      handover.py: using RAC 26
22:44:14.857831 tst                      handover.py: using CellId 8186
22:44:14.989201 tst                      handover.py: using BVCI 8182
22:44:15.014952 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
22:44:15.159147 tst                      handover.py: using LAC 8187
22:44:15.286294 tst                      handover.py: using RAC 27
22:44:15.409032 tst                      handover.py: using CellId 8187
22:44:15.538577 tst                      handover.py: using BVCI 8183
22:44:15.564355 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
22:44:15.576048 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
22:44:15.587515 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
22:44:15.598902 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
22:44:15.610379 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
22:44:15.621732 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
22:44:15.725035 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
22:44:15.921752 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
22:44:16.429438 run         create_hlr_db(pid=21971): Launched
22:44:16.566193 bus                        /sierra_1: Setting Powered False
22:44:17.644763 run         create_hlr_db(pid=21971): Terminated: ok {rc=0}
22:44:18.045837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21973): Launched
22:44:18.365628 run   osmo-hlr_10.42.42.2(pid=21974): Launched
22:44:18.483773 run              osmo-stp_10.42.42.5: Starting osmo-stp
22:44:19.010526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21975): Launched
22:44:19.327680 run   osmo-stp_10.42.42.5(pid=21976): Launched
22:44:19.439950 run              osmo-msc_10.42.42.6: Starting osmo-msc
22:44:19.991852 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21977): Launched
22:44:20.312901 run   osmo-msc_10.42.42.6(pid=21978): Launched
22:44:23.482923 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
22:44:24.010485 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=21979): Launched
22:44:24.329245 run   osmo-mgw_10.42.42.3(pid=21980): Launched
22:44:24.449773 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
22:44:25.002869 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=21981): Launched
22:44:25.340161 run   osmo-mgw_10.42.42.4(pid=21982): Launched
22:44:25.461268 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
22:44:26.191212 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=21983): Launched
22:44:26.527846 run   osmo-bsc_10.42.42.7(pid=21984): Launched
22:44:33.227959 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
22:44:33.764814 run         rm-remote-dir(pid=21985): Launched
22:44:35.960216 run         rm-remote-dir(pid=21985): Terminated: ok {rc=0}
22:44:36.298594 run         mk-remote-dir(pid=21986): Launched
22:44:38.493584 run         mk-remote-dir(pid=21986): Terminated: ok {rc=0}
22:44:38.779528 run    scp-inst-to-remote(pid=21987): Launched
22:44:51.989842 run    scp-inst-to-remote(pid=21987): Terminated: ok {rc=0}
22:44:52.324459 run         mk-remote-dir(pid=21989): Launched
22:44:54.525106 run         mk-remote-dir(pid=21989): Terminated: ok {rc=0}
22:44:54.830169 run     scp-cfg-to-remote(pid=21990): Launched
22:44:56.032835 run     scp-cfg-to-remote(pid=21990): Terminated: ok {rc=0}
22:44:56.383754 run   reload-dsp-firmware(pid=21992): Launched
22:44:59.584621 run   reload-dsp-firmware(pid=21992): Terminated: ok {rc=0}
22:44:59.926070 run        osmo-bts-sysmo(pid=21993): Launched
22:45:05.246596 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (31.9s)
22:45:05.392231 tst                      handover.py: using MSISDN 5294
22:45:05.565374 bus                        /sierra_1: Setting Powered True
22:45:09.057294 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5294', subscriber_id=1}
22:45:09.200948 tst                      handover.py: using MSISDN 5295
22:45:09.384586 bus                        /sierra_2: Setting Powered True
22:45:21.740687 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f8282d13f28&gt;, timeout=10, timestep=1} [trial-814↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-814↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
22:45:21.747907 tst                   handover.py:45: Test FAILED (67.3 sec)
22:45:21.783801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21973): Terminating (SIGTERM)
22:45:21.824940 run   osmo-hlr_10.42.42.2(pid=21974): Terminating (SIGTERM)
22:45:21.867749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21975): Terminating (SIGTERM)
22:45:21.911935 run   osmo-stp_10.42.42.5(pid=21976): Terminating (SIGTERM)
22:45:21.976124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21977): Terminating (SIGTERM)
22:45:22.033864 run   osmo-msc_10.42.42.6(pid=21978): Terminating (SIGTERM)
22:45:22.075330 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=21979): Terminating (SIGTERM)
22:45:22.116411 run   osmo-mgw_10.42.42.3(pid=21980): Terminating (SIGTERM)
22:45:22.158282 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=21981): Terminating (SIGTERM)
22:45:22.199125 run   osmo-mgw_10.42.42.4(pid=21982): Terminating (SIGTERM)
22:45:22.242083 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=21983): Terminating (SIGTERM)
22:45:22.283419 run   osmo-bsc_10.42.42.7(pid=21984): Terminating (SIGTERM)
22:45:22.324821 run        osmo-bts-sysmo(pid=21993): Terminating (SIGTERM)
22:45:22.334565 ---      ParallelTerminationStrategy: PID 21973 died...
22:45:22.390152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21973): Terminated: ok {rc=0}
22:45:22.401401 ---      ParallelTerminationStrategy: PID 21974 died...
22:45:22.458888 run   osmo-hlr_10.42.42.2(pid=21974): Terminated: ok {rc=0}
22:45:22.469434 ---      ParallelTerminationStrategy: PID 21975 died...
22:45:22.525441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21975): Terminated: ok {rc=0}
22:45:22.535914 ---      ParallelTerminationStrategy: PID 21976 died...
22:45:22.592073 run   osmo-stp_10.42.42.5(pid=21976): Terminated: ok {rc=0}
22:45:22.602549 ---      ParallelTerminationStrategy: PID 21977 died...
22:45:22.658721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=21977): Terminated: ok {rc=0}
22:45:22.669314 ---      ParallelTerminationStrategy: PID 21978 died...
22:45:22.725531 run   osmo-msc_10.42.42.6(pid=21978): Terminated: ok {rc=0}
22:45:22.736050 ---      ParallelTerminationStrategy: PID 21979 died...
22:45:22.792500 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=21979): Terminated: ok {rc=0}
22:45:22.803282 ---      ParallelTerminationStrategy: PID 21980 died...
22:45:22.859433 run   osmo-mgw_10.42.42.3(pid=21980): Terminated {rc=15}
22:45:22.869983 ---      ParallelTerminationStrategy: PID 21981 died...
22:45:22.926168 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=21981): Terminated: ok {rc=0}
22:45:22.936284 ---      ParallelTerminationStrategy: PID 21982 died...
22:45:22.991495 run   osmo-mgw_10.42.42.4(pid=21982): Terminated {rc=15}
22:45:23.001643 ---      ParallelTerminationStrategy: PID 21983 died...
22:45:23.056980 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=21983): Terminated: ok {rc=0}
22:45:23.067184 ---      ParallelTerminationStrategy: PID 21984 died...
22:45:23.122280 run   osmo-bsc_10.42.42.7(pid=21984): Terminated: ok {rc=0}
22:45:23.132433 ---      ParallelTerminationStrategy: PID 21993 died...
22:45:23.187652 run        osmo-bts-sysmo(pid=21993): Terminated: ok {rc=0}
22:45:23.293710 bus                        /sierra_2: Setting Online False
22:45:24.378589 bus                        /sierra_2: Setting Powered False
22:45:29.967616 bus                        /sierra_2: Setting Powered False
22:45:31.069729 bus                        /sierra_2: Setting Powered False
22:45:32.201012 bus                        /sierra_1: Setting Online False
22:45:33.287921 bus                        /sierra_1: Setting Powered False
22:45:38.960238 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f8282d13f28>, timeout=10, timestep=1} [trial-814↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]