Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 86 builds (Since #749 )
Took 1 min 12 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f1d3d6618c8>, timeout=10, timestep=1} [trial-834↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-834 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
22:26:32.578091 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
22:26:32.591160 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
22:26:32.742494 tst                      handover.py: using LAC 9786
22:26:32.882786 tst                      handover.py: using RAC 96
22:26:33.019366 tst                      handover.py: using CellId 9786
22:26:33.161599 tst                      handover.py: using BVCI 9782
22:26:33.188850 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
22:26:33.347564 tst                      handover.py: using LAC 9787
22:26:33.482806 tst                      handover.py: using RAC 97
22:26:33.617098 tst                      handover.py: using CellId 9787
22:26:33.752545 tst                      handover.py: using BVCI 9783
22:26:33.779952 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
22:26:33.792243 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
22:26:33.804692 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
22:26:33.816615 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
22:26:33.828964 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
22:26:33.841980 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
22:26:33.947466 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
22:26:34.153088 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
22:26:34.686325 run         create_hlr_db(pid=14204): Launched
22:26:34.841617 bus                        /sierra_1: Setting Powered False
22:26:35.952669 run         create_hlr_db(pid=14204): Terminated: ok {rc=0}
22:26:36.433976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14206): Launched
22:26:36.850310 run   osmo-hlr_10.42.42.2(pid=14207): Launched
22:26:36.991024 run              osmo-stp_10.42.42.5: Starting osmo-stp
22:26:37.615172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14208): Launched
22:26:37.978227 run   osmo-stp_10.42.42.5(pid=14209): Launched
22:26:38.110700 run              osmo-msc_10.42.42.6: Starting osmo-msc
22:26:38.787416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14210): Launched
22:26:39.190056 run   osmo-msc_10.42.42.6(pid=14211): Launched
22:26:42.392115 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
22:26:43.070753 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14212): Launched
22:26:43.552135 run   osmo-mgw_10.42.42.3(pid=14213): Launched
22:26:43.715031 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
22:26:44.315570 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14214): Launched
22:26:44.802157 run   osmo-mgw_10.42.42.4(pid=14215): Launched
22:26:44.949915 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
22:26:45.724929 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14216): Launched
22:26:46.259207 run   osmo-bsc_10.42.42.7(pid=14217): Launched
22:26:53.100427 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
22:26:53.801410 run         rm-remote-dir(pid=14218): Launched
22:26:56.056895 run         rm-remote-dir(pid=14218): Terminated: ok {rc=0}
22:26:56.477631 run         mk-remote-dir(pid=14219): Launched
22:26:58.711233 run         mk-remote-dir(pid=14219): Terminated: ok {rc=0}
22:26:59.114880 run    scp-inst-to-remote(pid=14220): Launched
22:27:12.338945 run    scp-inst-to-remote(pid=14220): Terminated: ok {rc=0}
22:27:12.708912 run         mk-remote-dir(pid=14222): Launched
22:27:14.918996 run         mk-remote-dir(pid=14222): Terminated: ok {rc=0}
22:27:15.230884 run     scp-cfg-to-remote(pid=14224): Launched
22:27:18.446463 run     scp-cfg-to-remote(pid=14224): Terminated: ok {rc=0}
22:27:18.818137 run   reload-dsp-firmware(pid=14226): Launched
22:27:22.027830 run   reload-dsp-firmware(pid=14226): Terminated: ok {rc=0}
22:27:22.396017 run        osmo-bts-sysmo(pid=14227): Launched
22:27:27.776787 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (34.6s)
22:27:27.965031 tst                      handover.py: using MSISDN 6354
22:27:28.206351 bus                        /sierra_1: Setting Powered True
22:27:31.745416 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6354', subscriber_id=1}
22:27:31.901322 tst                      handover.py: using MSISDN 6355
22:27:32.085828 bus                        /sierra_2: Setting Powered True
22:27:44.483111 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f1d3d6618c8&gt;, timeout=10, timestep=1} [trial-834↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-834↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
22:27:44.491029 tst                   handover.py:45: Test FAILED (71.9 sec)
22:27:44.553059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14206): Terminating (SIGTERM)
22:27:44.597660 run   osmo-hlr_10.42.42.2(pid=14207): Terminating (SIGTERM)
22:27:44.670135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14208): Terminating (SIGTERM)
22:27:44.715180 run   osmo-stp_10.42.42.5(pid=14209): Terminating (SIGTERM)
22:27:44.852378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14210): Terminating (SIGTERM)
22:27:44.944938 run   osmo-msc_10.42.42.6(pid=14211): Terminating (SIGTERM)
22:27:44.989344 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14212): Terminating (SIGTERM)
22:27:45.034705 run   osmo-mgw_10.42.42.3(pid=14213): Terminating (SIGTERM)
22:27:45.079687 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14214): Terminating (SIGTERM)
22:27:45.125116 run   osmo-mgw_10.42.42.4(pid=14215): Terminating (SIGTERM)
22:27:45.169918 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14216): Terminating (SIGTERM)
22:27:45.214047 run   osmo-bsc_10.42.42.7(pid=14217): Terminating (SIGTERM)
22:27:45.258466 run        osmo-bts-sysmo(pid=14227): Terminating (SIGTERM)
22:27:45.270160 ---      ParallelTerminationStrategy: PID 14206 died...
22:27:45.331310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14206): Terminated: ok {rc=0}
22:27:45.343451 ---      ParallelTerminationStrategy: PID 14207 died...
22:27:45.402114 run   osmo-hlr_10.42.42.2(pid=14207): Terminated: ok {rc=0}
22:27:45.412919 ---      ParallelTerminationStrategy: PID 14208 died...
22:27:45.553131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14208): Terminated: ok {rc=0}
22:27:45.612452 ---      ParallelTerminationStrategy: PID 14209 died...
22:27:45.724559 run   osmo-stp_10.42.42.5(pid=14209): Terminated: ok {rc=0}
22:27:45.735307 ---      ParallelTerminationStrategy: PID 14210 died...
22:27:45.831707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14210): Terminated: ok {rc=0}
22:27:45.842483 ---      ParallelTerminationStrategy: PID 14211 died...
22:27:45.902829 run   osmo-msc_10.42.42.6(pid=14211): Terminated: ok {rc=0}
22:27:45.918482 ---      ParallelTerminationStrategy: PID 14212 died...
22:27:45.981365 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14212): Terminated: ok {rc=0}
22:27:45.994921 ---      ParallelTerminationStrategy: PID 14213 died...
22:27:46.055019 run   osmo-mgw_10.42.42.3(pid=14213): Terminated {rc=15}
22:27:46.068641 ---      ParallelTerminationStrategy: PID 14214 died...
22:27:46.148411 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14214): Terminated: ok {rc=0}
22:27:46.159192 ---      ParallelTerminationStrategy: PID 14215 died...
22:27:46.216449 run   osmo-mgw_10.42.42.4(pid=14215): Terminated {rc=15}
22:27:46.227756 ---      ParallelTerminationStrategy: PID 14216 died...
22:27:46.286105 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14216): Terminated: ok {rc=0}
22:27:46.297568 ---      ParallelTerminationStrategy: PID 14217 died...
22:27:46.357517 run   osmo-bsc_10.42.42.7(pid=14217): Terminated: ok {rc=0}
22:27:46.368566 ---      ParallelTerminationStrategy: PID 14227 died...
22:27:46.426620 run        osmo-bts-sysmo(pid=14227): Terminated: ok {rc=0}
22:27:46.539758 bus                        /sierra_2: Setting Online False
22:27:47.629411 bus                        /sierra_2: Setting Powered False
22:27:52.992247 bus                        /sierra_2: Setting Powered False
22:27:54.140642 bus                        /sierra_2: Setting Powered False
22:27:55.293346 bus                        /sierra_1: Setting Online False
22:27:56.404309 bus                        /sierra_1: Setting Powered False
22:28:02.009001 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f1d3d6618c8>, timeout=10, timestep=1} [trial-834↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]