Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 72 builds (Since #749 )
Took 1 min 8 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fb3400ecf28>, timeout=10, timestep=1} [trial-820↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-820 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
06:23:43.078244 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
06:23:43.089631 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
06:23:43.229557 tst                      handover.py: using LAC 8666
06:23:43.364759 tst                      handover.py: using RAC 251
06:23:43.499724 tst                      handover.py: using CellId 8666
06:23:43.633784 tst                      handover.py: using BVCI 8662
06:23:43.660021 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
06:23:43.803222 tst                      handover.py: using LAC 8667
06:23:43.930715 tst                      handover.py: using RAC 252
06:23:44.056076 tst                      handover.py: using CellId 8667
06:23:44.181573 tst                      handover.py: using BVCI 8663
06:23:44.206473 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
06:23:44.217540 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
06:23:44.228339 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
06:23:44.239643 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
06:23:44.250881 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
06:23:44.261884 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
06:23:44.368666 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
06:23:44.564063 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
06:23:45.049376 run          create_hlr_db(pid=9448): Launched
06:23:45.180982 bus                        /sierra_1: Setting Powered False
06:23:46.256894 run          create_hlr_db(pid=9448): Terminated: ok {rc=0}
06:23:46.684880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9450): Launched
06:23:47.032989 run    osmo-hlr_10.42.42.2(pid=9451): Launched
06:23:47.158596 run              osmo-stp_10.42.42.5: Starting osmo-stp
06:23:47.727848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9452): Launched
06:23:48.076735 run    osmo-stp_10.42.42.5(pid=9453): Launched
06:23:48.199645 run              osmo-msc_10.42.42.6: Starting osmo-msc
06:23:48.797014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9454): Launched
06:23:49.145569 run    osmo-msc_10.42.42.6(pid=9455): Launched
06:23:52.330009 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
06:23:52.898043 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=9456): Launched
06:23:53.246659 run    osmo-mgw_10.42.42.3(pid=9457): Launched
06:23:53.369737 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
06:23:53.929616 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9458): Launched
06:23:54.278996 run    osmo-mgw_10.42.42.4(pid=9459): Launched
06:23:54.403679 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
06:23:55.154596 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=9460): Launched
06:23:55.505669 run    osmo-bsc_10.42.42.7(pid=9461): Launched
06:24:02.276887 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
06:24:02.863258 run          rm-remote-dir(pid=9462): Launched
06:24:05.075449 run          rm-remote-dir(pid=9462): Terminated: ok {rc=0}
06:24:05.445877 run          mk-remote-dir(pid=9463): Launched
06:24:07.656258 run          mk-remote-dir(pid=9463): Terminated: ok {rc=0}
06:24:07.970499 run     scp-inst-to-remote(pid=9464): Launched
06:24:21.197121 run     scp-inst-to-remote(pid=9464): Terminated: ok {rc=0}
06:24:21.562940 run          mk-remote-dir(pid=9466): Launched
06:24:23.759358 run          mk-remote-dir(pid=9466): Terminated: ok {rc=0}
06:24:24.054153 run      scp-cfg-to-remote(pid=9467): Launched
06:24:26.251401 run      scp-cfg-to-remote(pid=9467): Terminated: ok {rc=0}
06:24:26.591083 run    reload-dsp-firmware(pid=9469): Launched
06:24:29.784312 run    reload-dsp-firmware(pid=9469): Terminated: ok {rc=0}
06:24:30.116269 run         osmo-bts-sysmo(pid=9470): Launched
06:24:34.437986 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (32.1s)
06:24:34.593321 tst                      handover.py: using MSISDN 5612
06:24:34.782259 bus                        /sierra_1: Setting Powered True
06:24:38.289613 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5612', subscriber_id=1}
06:24:38.437003 tst                      handover.py: using MSISDN 5613
06:24:38.625347 bus                        /sierra_2: Setting Powered True
06:24:50.994895 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fb3400ecf28&gt;, timeout=10, timestep=1} [trial-820↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-820↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
06:24:51.002194 tst                   handover.py:45: Test FAILED (67.9 sec)
06:24:51.038392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9450): Terminating (SIGTERM)
06:24:51.080599 run    osmo-hlr_10.42.42.2(pid=9451): Terminating (SIGTERM)
06:24:51.123914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9452): Terminating (SIGTERM)
06:24:51.167421 run    osmo-stp_10.42.42.5(pid=9453): Terminating (SIGTERM)
06:24:51.236244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9454): Terminating (SIGTERM)
06:24:51.282837 run    osmo-msc_10.42.42.6(pid=9455): Terminating (SIGTERM)
06:24:51.324316 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=9456): Terminating (SIGTERM)
06:24:51.365666 run    osmo-mgw_10.42.42.3(pid=9457): Terminating (SIGTERM)
06:24:51.407933 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9458): Terminating (SIGTERM)
06:24:51.449346 run    osmo-mgw_10.42.42.4(pid=9459): Terminating (SIGTERM)
06:24:51.491485 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=9460): Terminating (SIGTERM)
06:24:51.532784 run    osmo-bsc_10.42.42.7(pid=9461): Terminating (SIGTERM)
06:24:51.574388 run         osmo-bts-sysmo(pid=9470): Terminating (SIGTERM)
06:24:51.584029 ---      ParallelTerminationStrategy: PID 9450 died...
06:24:51.641269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9450): Terminated: ok {rc=0}
06:24:51.652174 ---      ParallelTerminationStrategy: PID 9451 died...
06:24:51.709212 run    osmo-hlr_10.42.42.2(pid=9451): Terminated: ok {rc=0}
06:24:51.720011 ---      ParallelTerminationStrategy: PID 9452 died...
06:24:51.776914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9452): Terminated: ok {rc=0}
06:24:51.787819 ---      ParallelTerminationStrategy: PID 9453 died...
06:24:51.845009 run    osmo-stp_10.42.42.5(pid=9453): Terminated: ok {rc=0}
06:24:51.855918 ---      ParallelTerminationStrategy: PID 9454 died...
06:24:51.911598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9454): Terminated: ok {rc=0}
06:24:51.921824 ---      ParallelTerminationStrategy: PID 9456 died...
06:24:51.977805 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=9456): Terminated: ok {rc=0}
06:24:51.987939 ---      ParallelTerminationStrategy: PID 9457 died...
06:24:52.043910 run    osmo-mgw_10.42.42.3(pid=9457): Terminated {rc=15}
06:24:52.054244 ---      ParallelTerminationStrategy: PID 9458 died...
06:24:52.110580 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9458): Terminated: ok {rc=0}
06:24:52.120831 ---      ParallelTerminationStrategy: PID 9459 died...
06:24:52.176904 run    osmo-mgw_10.42.42.4(pid=9459): Terminated {rc=15}
06:24:52.187148 ---      ParallelTerminationStrategy: PID 9460 died...
06:24:52.243680 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=9460): Terminated: ok {rc=0}
06:24:52.254758 ---      ParallelTerminationStrategy: PID 9461 died...
06:24:52.311799 run    osmo-bsc_10.42.42.7(pid=9461): Terminated: ok {rc=0}
06:24:52.322847 ---      ParallelTerminationStrategy: PID 9470 died...
06:24:52.379902 run         osmo-bts-sysmo(pid=9470): Terminated: ok {rc=0}
06:24:52.558764 ---      ParallelTerminationStrategy: PID 9455 died...
06:24:52.615998 run    osmo-msc_10.42.42.6(pid=9455): Terminated: ok {rc=0}
06:24:52.723231 bus                        /sierra_2: Setting Online False
06:24:53.809859 bus                        /sierra_2: Setting Powered False
06:24:59.164386 bus                        /sierra_2: Setting Powered False
06:25:00.264857 bus                        /sierra_2: Setting Powered False
06:25:01.395035 bus                        /sierra_1: Setting Online False
06:25:02.480011 bus                        /sierra_1: Setting Powered False
06:25:07.957686 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fb3400ecf28>, timeout=10, timestep=1} [trial-820↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]