Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 84 builds (Since #749 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f11a40b8b70>, timeout=10, timestep=1} [trial-832↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-832 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
20:26:18.902906 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
20:26:18.914144 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
20:26:19.054084 tst                      handover.py: using LAC 9626
20:26:19.191694 tst                      handover.py: using RAC 191
20:26:19.331394 tst                      handover.py: using CellId 9626
20:26:19.470644 tst                      handover.py: using BVCI 9622
20:26:19.497382 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
20:26:19.641410 tst                      handover.py: using LAC 9627
20:26:19.771656 tst                      handover.py: using RAC 192
20:26:19.901041 tst                      handover.py: using CellId 9627
20:26:20.034924 tst                      handover.py: using BVCI 9623
20:26:20.060089 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
20:26:20.071182 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
20:26:20.082150 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
20:26:20.092919 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
20:26:20.103867 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
20:26:20.114663 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
20:26:20.221019 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
20:26:20.416987 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
20:26:20.902918 run          create_hlr_db(pid=9402): Launched
20:26:21.035775 bus                        /sierra_1: Setting Powered False
20:26:22.111871 run          create_hlr_db(pid=9402): Terminated: ok {rc=0}
20:26:22.543566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9404): Launched
20:26:22.893394 run    osmo-hlr_10.42.42.2(pid=9405): Launched
20:26:23.019159 run              osmo-stp_10.42.42.5: Starting osmo-stp
20:26:23.593338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9406): Launched
20:26:23.943353 run    osmo-stp_10.42.42.5(pid=9407): Launched
20:26:24.068131 run              osmo-msc_10.42.42.6: Starting osmo-msc
20:26:24.670932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9408): Launched
20:26:25.021708 run    osmo-msc_10.42.42.6(pid=9409): Launched
20:26:28.207702 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
20:26:28.781288 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=9410): Launched
20:26:29.131268 run    osmo-mgw_10.42.42.3(pid=9411): Launched
20:26:29.255944 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
20:26:29.817582 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9412): Launched
20:26:30.164843 run    osmo-mgw_10.42.42.4(pid=9413): Launched
20:26:30.287655 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
20:26:31.000173 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=9414): Launched
20:26:31.330998 run    osmo-bsc_10.42.42.7(pid=9415): Launched
20:26:38.054437 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
20:26:38.607699 run          rm-remote-dir(pid=9416): Launched
20:26:40.808731 run          rm-remote-dir(pid=9416): Terminated: ok {rc=0}
20:26:41.160181 run          mk-remote-dir(pid=9417): Launched
20:26:43.361597 run          mk-remote-dir(pid=9417): Terminated: ok {rc=0}
20:26:43.656410 run     scp-inst-to-remote(pid=9418): Launched
20:26:56.876884 run     scp-inst-to-remote(pid=9418): Terminated: ok {rc=0}
20:26:57.223191 run          mk-remote-dir(pid=9420): Launched
20:27:00.423538 run          mk-remote-dir(pid=9420): Terminated: ok {rc=0}
20:27:00.719078 run      scp-cfg-to-remote(pid=9421): Launched
20:27:02.917998 run      scp-cfg-to-remote(pid=9421): Terminated: ok {rc=0}
20:27:03.259258 run    reload-dsp-firmware(pid=9423): Launched
20:27:06.456216 run    reload-dsp-firmware(pid=9423): Terminated: ok {rc=0}
20:27:06.788348 run         osmo-bts-sysmo(pid=9424): Launched
20:27:12.133126 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (34.0s)
20:27:12.290910 tst                      handover.py: using MSISDN 6248
20:27:12.481517 bus                        /sierra_1: Setting Powered True
20:27:15.997051 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6248', subscriber_id=1}
20:27:16.143623 tst                      handover.py: using MSISDN 6249
20:27:16.334847 bus                        /sierra_2: Setting Powered True
20:27:28.686391 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f11a40b8b70&gt;, timeout=10, timestep=1} [trial-832↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-832↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
20:27:28.693914 tst                   handover.py:45: Test FAILED (69.8 sec)
20:27:28.728897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9404): Terminating (SIGTERM)
20:27:28.768324 run    osmo-hlr_10.42.42.2(pid=9405): Terminating (SIGTERM)
20:27:28.808790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9406): Terminating (SIGTERM)
20:27:28.852685 run    osmo-stp_10.42.42.5(pid=9407): Terminating (SIGTERM)
20:27:28.905072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9408): Terminating (SIGTERM)
20:27:28.949776 run    osmo-msc_10.42.42.6(pid=9409): Terminating (SIGTERM)
20:27:28.992896 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=9410): Terminating (SIGTERM)
20:27:29.036573 run    osmo-mgw_10.42.42.3(pid=9411): Terminating (SIGTERM)
20:27:29.079592 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9412): Terminating (SIGTERM)
20:27:29.122681 run    osmo-mgw_10.42.42.4(pid=9413): Terminating (SIGTERM)
20:27:29.166997 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=9414): Terminating (SIGTERM)
20:27:29.211371 run    osmo-bsc_10.42.42.7(pid=9415): Terminating (SIGTERM)
20:27:29.253747 run         osmo-bts-sysmo(pid=9424): Terminating (SIGTERM)
20:27:29.263460 ---      ParallelTerminationStrategy: PID 9404 died...
20:27:29.319463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9404): Terminated: ok {rc=0}
20:27:29.329642 ---      ParallelTerminationStrategy: PID 9405 died...
20:27:29.385593 run    osmo-hlr_10.42.42.2(pid=9405): Terminated: ok {rc=0}
20:27:29.395686 ---      ParallelTerminationStrategy: PID 9406 died...
20:27:29.453702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9406): Terminated: ok {rc=0}
20:27:29.464718 ---      ParallelTerminationStrategy: PID 9407 died...
20:27:29.521787 run    osmo-stp_10.42.42.5(pid=9407): Terminated: ok {rc=0}
20:27:29.532710 ---      ParallelTerminationStrategy: PID 9408 died...
20:27:29.590134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9408): Terminated: ok {rc=0}
20:27:29.601423 ---      ParallelTerminationStrategy: PID 9409 died...
20:27:29.659256 run    osmo-msc_10.42.42.6(pid=9409): Terminated: ok {rc=0}
20:27:29.669949 ---      ParallelTerminationStrategy: PID 9410 died...
20:27:29.726205 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=9410): Terminated: ok {rc=0}
20:27:29.736411 ---      ParallelTerminationStrategy: PID 9411 died...
20:27:29.792311 run    osmo-mgw_10.42.42.3(pid=9411): Terminated {rc=15}
20:27:29.802577 ---      ParallelTerminationStrategy: PID 9412 died...
20:27:29.858445 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9412): Terminated: ok {rc=0}
20:27:29.868633 ---      ParallelTerminationStrategy: PID 9413 died...
20:27:29.924696 run    osmo-mgw_10.42.42.4(pid=9413): Terminated {rc=15}
20:27:29.934959 ---      ParallelTerminationStrategy: PID 9414 died...
20:27:29.991012 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=9414): Terminated: ok {rc=0}
20:27:30.001382 ---      ParallelTerminationStrategy: PID 9415 died...
20:27:30.057049 run    osmo-bsc_10.42.42.7(pid=9415): Terminated: ok {rc=0}
20:27:30.067300 ---      ParallelTerminationStrategy: PID 9424 died...
20:27:30.123170 run         osmo-bts-sysmo(pid=9424): Terminated: ok {rc=0}
20:27:30.230509 bus                        /sierra_2: Setting Online False
20:27:31.314279 bus                        /sierra_2: Setting Powered False
20:27:36.973536 bus                        /sierra_2: Setting Powered False
20:27:38.076675 bus                        /sierra_2: Setting Powered False
20:27:39.208160 bus                        /sierra_1: Setting Online False
20:27:40.291938 bus                        /sierra_1: Setting Powered False
20:27:45.961042 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f11a40b8b70>, timeout=10, timestep=1} [trial-832↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]