Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 81 builds (Since #749 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fe8d2476a60>, timeout=10, timestep=1} [trial-829↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-829 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
17:26:16.996164 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
17:26:17.007221 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
17:26:17.136594 tst                      handover.py: using LAC 9386
17:26:17.261888 tst                      handover.py: using RAC 206
17:26:17.392859 tst                      handover.py: using CellId 9386
17:26:17.525973 tst                      handover.py: using BVCI 9382
17:26:17.552044 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
17:26:17.700021 tst                      handover.py: using LAC 9387
17:26:17.832758 tst                      handover.py: using RAC 207
17:26:17.965124 tst                      handover.py: using CellId 9387
17:26:18.096701 tst                      handover.py: using BVCI 9383
17:26:18.122988 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
17:26:18.134609 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
17:26:18.146030 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
17:26:18.157256 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
17:26:18.168442 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
17:26:18.179722 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
17:26:18.285459 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
17:26:18.480987 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
17:26:18.961746 run          create_hlr_db(pid=2920): Launched
17:26:19.092469 bus                        /sierra_1: Setting Powered False
17:26:20.167549 run          create_hlr_db(pid=2920): Terminated: ok {rc=0}
17:26:20.570448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2922): Launched
17:26:20.892013 run    osmo-hlr_10.42.42.2(pid=2923): Launched
17:26:21.006400 run              osmo-stp_10.42.42.5: Starting osmo-stp
17:26:21.541524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2924): Launched
17:26:21.864185 run    osmo-stp_10.42.42.5(pid=2925): Launched
17:26:21.977940 run              osmo-msc_10.42.42.6: Starting osmo-msc
17:26:22.536392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2926): Launched
17:26:22.860623 run    osmo-msc_10.42.42.6(pid=2927): Launched
17:26:26.030964 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
17:26:26.564217 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=2928): Launched
17:26:26.888936 run    osmo-mgw_10.42.42.3(pid=2929): Launched
17:26:27.002935 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
17:26:27.525902 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2930): Launched
17:26:27.850662 run    osmo-mgw_10.42.42.4(pid=2931): Launched
17:26:27.964785 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
17:26:28.664388 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=2932): Launched
17:26:28.989018 run    osmo-bsc_10.42.42.7(pid=2933): Launched
17:26:35.738299 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
17:26:36.318281 run          rm-remote-dir(pid=2934): Launched
17:26:38.527798 run          rm-remote-dir(pid=2934): Terminated: ok {rc=0}
17:26:38.893547 run          mk-remote-dir(pid=2935): Launched
17:26:41.101633 run          mk-remote-dir(pid=2935): Terminated: ok {rc=0}
17:26:41.412486 run     scp-inst-to-remote(pid=2936): Launched
17:26:54.635788 run     scp-inst-to-remote(pid=2936): Terminated: ok {rc=0}
17:26:54.995960 run          mk-remote-dir(pid=2938): Launched
17:26:57.201342 run          mk-remote-dir(pid=2938): Terminated: ok {rc=0}
17:26:57.515574 run      scp-cfg-to-remote(pid=2939): Launched
17:27:00.724362 run      scp-cfg-to-remote(pid=2939): Terminated: ok {rc=0}
17:27:01.080704 run    reload-dsp-firmware(pid=2941): Launched
17:27:04.284704 run    reload-dsp-firmware(pid=2941): Terminated: ok {rc=0}
17:27:04.632869 run         osmo-bts-sysmo(pid=2942): Launched
17:27:09.973084 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (34.1s)
17:27:10.133833 tst                      handover.py: using MSISDN 6089
17:27:10.321519 bus                        /sierra_1: Setting Powered True
17:27:13.818615 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6089', subscriber_id=1}
17:27:13.962492 tst                      handover.py: using MSISDN 6090
17:27:14.147928 bus                        /sierra_2: Setting Powered True
17:27:26.526572 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fe8d2476a60&gt;, timeout=10, timestep=1} [trial-829↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-829↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
17:27:26.533294 tst                   handover.py:45: Test FAILED (69.5 sec)
17:27:26.568061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2922): Terminating (SIGTERM)
17:27:26.607941 run    osmo-hlr_10.42.42.2(pid=2923): Terminating (SIGTERM)
17:27:26.647923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2924): Terminating (SIGTERM)
17:27:26.689800 run    osmo-stp_10.42.42.5(pid=2925): Terminating (SIGTERM)
17:27:26.743508 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2926): Terminating (SIGTERM)
17:27:26.787813 run    osmo-msc_10.42.42.6(pid=2927): Terminating (SIGTERM)
17:27:26.835598 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=2928): Terminating (SIGTERM)
17:27:26.881112 run    osmo-mgw_10.42.42.3(pid=2929): Terminating (SIGTERM)
17:27:26.927614 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2930): Terminating (SIGTERM)
17:27:26.973806 run    osmo-mgw_10.42.42.4(pid=2931): Terminating (SIGTERM)
17:27:27.016717 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=2932): Terminating (SIGTERM)
17:27:27.061674 run    osmo-bsc_10.42.42.7(pid=2933): Terminating (SIGTERM)
17:27:27.104199 run         osmo-bts-sysmo(pid=2942): Terminating (SIGTERM)
17:27:27.114715 ---      ParallelTerminationStrategy: PID 2922 died...
17:27:27.172446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2922): Terminated: ok {rc=0}
17:27:27.182850 ---      ParallelTerminationStrategy: PID 2923 died...
17:27:27.239636 run    osmo-hlr_10.42.42.2(pid=2923): Terminated: ok {rc=0}
17:27:27.251059 ---      ParallelTerminationStrategy: PID 2924 died...
17:27:27.309117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2924): Terminated: ok {rc=0}
17:27:27.319938 ---      ParallelTerminationStrategy: PID 2925 died...
17:27:27.378431 run    osmo-stp_10.42.42.5(pid=2925): Terminated: ok {rc=0}
17:27:27.389219 ---      ParallelTerminationStrategy: PID 2926 died...
17:27:27.450884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2926): Terminated: ok {rc=0}
17:27:27.461683 ---      ParallelTerminationStrategy: PID 2927 died...
17:27:27.518862 run    osmo-msc_10.42.42.6(pid=2927): Terminated: ok {rc=0}
17:27:27.529719 ---      ParallelTerminationStrategy: PID 2928 died...
17:27:27.585741 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=2928): Terminated: ok {rc=0}
17:27:27.596058 ---      ParallelTerminationStrategy: PID 2929 died...
17:27:27.652434 run    osmo-mgw_10.42.42.3(pid=2929): Terminated {rc=15}
17:27:27.663062 ---      ParallelTerminationStrategy: PID 2930 died...
17:27:27.718793 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2930): Terminated: ok {rc=0}
17:27:27.729064 ---      ParallelTerminationStrategy: PID 2931 died...
17:27:27.785063 run    osmo-mgw_10.42.42.4(pid=2931): Terminated {rc=15}
17:27:27.795391 ---      ParallelTerminationStrategy: PID 2932 died...
17:27:27.851183 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=2932): Terminated: ok {rc=0}
17:27:27.861655 ---      ParallelTerminationStrategy: PID 2933 died...
17:27:27.917267 run    osmo-bsc_10.42.42.7(pid=2933): Terminated: ok {rc=0}
17:27:27.927635 ---      ParallelTerminationStrategy: PID 2942 died...
17:27:27.983868 run         osmo-bts-sysmo(pid=2942): Terminated: ok {rc=0}
17:27:28.089783 bus                        /sierra_2: Setting Online False
17:27:29.172882 bus                        /sierra_2: Setting Powered False
17:27:34.962321 bus                        /sierra_2: Setting Powered False
17:27:36.069193 bus                        /sierra_2: Setting Powered False
17:27:37.196034 bus                        /sierra_1: Setting Online False
17:27:38.282245 bus                        /sierra_1: Setting Powered False
17:27:43.968110 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fe8d2476a60>, timeout=10, timestep=1} [trial-829↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]