Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 51 builds (Since #749 )
Took 1 min 6 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f8aada87400>, timeout=10, timestep=1} [trial-799↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-799 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
04:03:48.945798 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
04:03:48.957334 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
04:03:49.091931 tst                      handover.py: using LAC 6986
04:03:49.226428 tst                      handover.py: using RAC 101
04:03:49.352164 tst                      handover.py: using CellId 6986
04:03:49.489258 tst                      handover.py: using BVCI 6982
04:03:49.515634 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
04:03:49.665968 tst                      handover.py: using LAC 6987
04:03:49.804532 tst                      handover.py: using RAC 102
04:03:49.940336 tst                      handover.py: using CellId 6987
04:03:50.075436 tst                      handover.py: using BVCI 6983
04:03:50.101772 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
04:03:50.113332 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
04:03:50.124524 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
04:03:50.135870 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
04:03:50.147406 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
04:03:50.158789 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
04:03:50.265711 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
04:03:50.468816 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
04:03:50.987233 run         create_hlr_db(pid=12293): Launched
04:03:51.127140 bus                        /sierra_1: Setting Powered False
04:03:52.206199 run         create_hlr_db(pid=12293): Terminated: ok {rc=0}
04:03:52.616790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12295): Launched
04:03:52.940547 run   osmo-hlr_10.42.42.2(pid=12296): Launched
04:03:53.056771 run              osmo-stp_10.42.42.5: Starting osmo-stp
04:03:53.592201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12297): Launched
04:03:53.917596 run   osmo-stp_10.42.42.5(pid=12298): Launched
04:03:54.032979 run              osmo-msc_10.42.42.6: Starting osmo-msc
04:03:54.592521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12299): Launched
04:03:54.917265 run   osmo-msc_10.42.42.6(pid=12300): Launched
04:03:58.089506 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
04:03:58.625867 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=12301): Launched
04:03:58.952477 run   osmo-mgw_10.42.42.3(pid=12302): Launched
04:03:59.067565 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
04:03:59.589664 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=12303): Launched
04:03:59.914553 run   osmo-mgw_10.42.42.4(pid=12304): Launched
04:04:00.029657 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
04:04:00.731586 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=12305): Launched
04:04:01.056188 run   osmo-bsc_10.42.42.7(pid=12306): Launched
04:04:07.775842 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
04:04:08.324469 run         rm-remote-dir(pid=12307): Launched
04:04:10.523242 run         rm-remote-dir(pid=12307): Terminated: ok {rc=0}
04:04:10.870486 run         mk-remote-dir(pid=12308): Launched
04:04:12.067404 run         mk-remote-dir(pid=12308): Terminated: ok {rc=0}
04:04:12.359898 run    scp-inst-to-remote(pid=12309): Launched
04:04:25.576195 run    scp-inst-to-remote(pid=12309): Terminated: ok {rc=0}
04:04:25.919154 run         mk-remote-dir(pid=12311): Launched
04:04:28.115558 run         mk-remote-dir(pid=12311): Terminated: ok {rc=0}
04:04:28.407518 run     scp-cfg-to-remote(pid=12312): Launched
04:04:29.602562 run     scp-cfg-to-remote(pid=12312): Terminated: ok {rc=0}
04:04:29.938493 run   reload-dsp-firmware(pid=12314): Launched
04:04:33.133488 run   reload-dsp-firmware(pid=12314): Terminated: ok {rc=0}
04:04:33.460221 run        osmo-bts-sysmo(pid=12315): Launched
04:04:37.781111 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (29.9s)
04:04:37.943001 tst                      handover.py: using MSISDN 4499
04:04:38.123997 bus                        /sierra_1: Setting Powered True
04:04:41.597946 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4499', subscriber_id=1}
04:04:41.737714 tst                      handover.py: using MSISDN 4500
04:04:41.924886 bus                        /sierra_2: Setting Powered True
04:04:54.281297 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f8aada87400&gt;, timeout=10, timestep=1} [trial-799↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-799↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
04:04:54.287727 tst                   handover.py:45: Test FAILED (65.3 sec)
04:04:54.322342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12295): Terminating (SIGTERM)
04:04:54.362009 run   osmo-hlr_10.42.42.2(pid=12296): Terminating (SIGTERM)
04:04:54.403074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12297): Terminating (SIGTERM)
04:04:54.445942 run   osmo-stp_10.42.42.5(pid=12298): Terminating (SIGTERM)
04:04:54.488023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12299): Terminating (SIGTERM)
04:04:54.530121 run   osmo-msc_10.42.42.6(pid=12300): Terminating (SIGTERM)
04:04:54.572782 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=12301): Terminating (SIGTERM)
04:04:54.615546 run   osmo-mgw_10.42.42.3(pid=12302): Terminating (SIGTERM)
04:04:54.671559 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=12303): Terminating (SIGTERM)
04:04:54.712821 run   osmo-mgw_10.42.42.4(pid=12304): Terminating (SIGTERM)
04:04:54.752992 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=12305): Terminating (SIGTERM)
04:04:54.792296 run   osmo-bsc_10.42.42.7(pid=12306): Terminating (SIGTERM)
04:04:54.831891 run        osmo-bts-sysmo(pid=12315): Terminating (SIGTERM)
04:04:54.841288 ---      ParallelTerminationStrategy: PID 12295 died...
04:04:54.894344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12295): Terminated: ok {rc=0}
04:04:54.904107 ---      ParallelTerminationStrategy: PID 12296 died...
04:04:54.956857 run   osmo-hlr_10.42.42.2(pid=12296): Terminated: ok {rc=0}
04:04:54.966517 ---      ParallelTerminationStrategy: PID 12297 died...
04:04:55.019349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12297): Terminated: ok {rc=0}
04:04:55.028885 ---      ParallelTerminationStrategy: PID 12298 died...
04:04:55.081750 run   osmo-stp_10.42.42.5(pid=12298): Terminated: ok {rc=0}
04:04:55.091936 ---      ParallelTerminationStrategy: PID 12299 died...
04:04:55.146933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12299): Terminated: ok {rc=0}
04:04:55.157305 ---      ParallelTerminationStrategy: PID 12300 died...
04:04:55.211536 run   osmo-msc_10.42.42.6(pid=12300): Terminated: ok {rc=0}
04:04:55.221919 ---      ParallelTerminationStrategy: PID 12301 died...
04:04:55.275999 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=12301): Terminated: ok {rc=0}
04:04:55.286212 ---      ParallelTerminationStrategy: PID 12302 died...
04:04:55.339057 run   osmo-mgw_10.42.42.3(pid=12302): Terminated {rc=15}
04:04:55.348888 ---      ParallelTerminationStrategy: PID 12303 died...
04:04:55.401827 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=12303): Terminated: ok {rc=0}
04:04:55.411708 ---      ParallelTerminationStrategy: PID 12304 died...
04:04:55.464593 run   osmo-mgw_10.42.42.4(pid=12304): Terminated {rc=15}
04:04:55.474434 ---      ParallelTerminationStrategy: PID 12305 died...
04:04:55.527303 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=12305): Terminated: ok {rc=0}
04:04:55.537355 ---      ParallelTerminationStrategy: PID 12306 died...
04:04:55.590152 run   osmo-bsc_10.42.42.7(pid=12306): Terminated: ok {rc=0}
04:04:55.600051 ---      ParallelTerminationStrategy: PID 12315 died...
04:04:55.653229 run        osmo-bts-sysmo(pid=12315): Terminated: ok {rc=0}
04:04:55.761384 bus                        /sierra_2: Setting Online False
04:04:56.844976 bus                        /sierra_2: Setting Powered False
04:05:02.189858 bus                        /sierra_2: Setting Powered False
04:05:03.294431 bus                        /sierra_2: Setting Powered False
04:05:04.422356 bus                        /sierra_1: Setting Online False
04:05:05.508972 bus                        /sierra_1: Setting Powered False
04:05:10.956673 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f8aada87400>, timeout=10, timestep=1} [trial-799↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]