Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 90 builds (Since #749 )
Took 1 min 11 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f428ab82730>, timeout=10, timestep=1} [trial-838↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-838 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
03:07:36.395512 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
03:07:36.406377 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
03:07:36.535004 tst                      handover.py: using LAC 10106
03:07:36.664825 tst                      handover.py: using RAC 161
03:07:36.795590 tst                      handover.py: using CellId 10106
03:07:36.925881 tst                      handover.py: using BVCI 10102
03:07:36.951024 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
03:07:37.093903 tst                      handover.py: using LAC 10107
03:07:37.223798 tst                      handover.py: using RAC 162
03:07:37.359637 tst                      handover.py: using CellId 10107
03:07:37.497706 tst                      handover.py: using BVCI 10103
03:07:37.524414 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
03:07:37.535794 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
03:07:37.547116 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
03:07:37.558317 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
03:07:37.569762 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
03:07:37.580803 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
03:07:37.684683 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
03:07:37.879845 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
03:07:38.366289 run         create_hlr_db(pid=23282): Launched
03:07:38.499369 bus                        /sierra_1: Setting Powered False
03:07:39.575098 run         create_hlr_db(pid=23282): Terminated: ok {rc=0}
03:07:40.005549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23284): Launched
03:07:40.357967 run   osmo-hlr_10.42.42.2(pid=23285): Launched
03:07:40.483549 run              osmo-stp_10.42.42.5: Starting osmo-stp
03:07:41.052994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23286): Launched
03:07:41.404867 run   osmo-stp_10.42.42.5(pid=23287): Launched
03:07:41.528315 run              osmo-msc_10.42.42.6: Starting osmo-msc
03:07:42.129578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23288): Launched
03:07:42.481987 run   osmo-msc_10.42.42.6(pid=23289): Launched
03:07:45.666943 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
03:07:46.242626 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=23290): Launched
03:07:46.594775 run   osmo-mgw_10.42.42.3(pid=23291): Launched
03:07:46.718526 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
03:07:47.278201 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23292): Launched
03:07:47.626046 run   osmo-mgw_10.42.42.4(pid=23293): Launched
03:07:47.753075 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
03:07:48.503245 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=23298): Launched
03:07:48.851109 run   osmo-bsc_10.42.42.7(pid=23299): Launched
03:07:55.576000 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
03:07:56.129999 run         rm-remote-dir(pid=23300): Launched
03:07:58.331298 run         rm-remote-dir(pid=23300): Terminated: ok {rc=0}
03:07:58.678671 run         mk-remote-dir(pid=23301): Launched
03:08:00.879186 run         mk-remote-dir(pid=23301): Terminated: ok {rc=0}
03:08:01.174912 run    scp-inst-to-remote(pid=23302): Launched
03:08:15.392401 run    scp-inst-to-remote(pid=23302): Terminated: ok {rc=0}
03:08:15.736056 run         mk-remote-dir(pid=23304): Launched
03:08:17.932960 run         mk-remote-dir(pid=23304): Terminated: ok {rc=0}
03:08:18.226920 run     scp-cfg-to-remote(pid=23305): Launched
03:08:20.423897 run     scp-cfg-to-remote(pid=23305): Terminated: ok {rc=0}
03:08:20.762459 run   reload-dsp-firmware(pid=23307): Launched
03:08:24.969117 run   reload-dsp-firmware(pid=23307): Terminated: ok {rc=0}
03:08:25.319758 run        osmo-bts-sysmo(pid=23308): Launched
03:08:30.664725 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (35.0s)
03:08:30.826393 tst                      handover.py: using MSISDN 6566
03:08:31.008293 bus                        /sierra_1: Setting Powered True
03:08:34.519495 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6566', subscriber_id=1}
03:08:34.660630 tst                      handover.py: using MSISDN 6567
03:08:34.850347 bus                        /sierra_2: Setting Powered True
03:08:47.235705 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f428ab82730&gt;, timeout=10, timestep=1} [trial-838↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-838↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
03:08:47.243307 tst                   handover.py:45: Test FAILED (70.8 sec)
03:08:47.279596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23284): Terminating (SIGTERM)
03:08:47.321743 run   osmo-hlr_10.42.42.2(pid=23285): Terminating (SIGTERM)
03:08:47.364740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23286): Terminating (SIGTERM)
03:08:47.408042 run   osmo-stp_10.42.42.5(pid=23287): Terminating (SIGTERM)
03:08:47.457074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23288): Terminating (SIGTERM)
03:08:47.516065 run   osmo-msc_10.42.42.6(pid=23289): Terminating (SIGTERM)
03:08:47.560008 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=23290): Terminating (SIGTERM)
03:08:47.611307 run   osmo-mgw_10.42.42.3(pid=23291): Terminating (SIGTERM)
03:08:47.656260 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23292): Terminating (SIGTERM)
03:08:47.699576 run   osmo-mgw_10.42.42.4(pid=23293): Terminating (SIGTERM)
03:08:47.758746 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=23298): Terminating (SIGTERM)
03:08:47.801416 run   osmo-bsc_10.42.42.7(pid=23299): Terminating (SIGTERM)
03:08:47.844958 run        osmo-bts-sysmo(pid=23308): Terminating (SIGTERM)
03:08:47.855018 ---      ParallelTerminationStrategy: PID 23284 died...
03:08:47.913685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23284): Terminated: ok {rc=0}
03:08:47.924382 ---      ParallelTerminationStrategy: PID 23285 died...
03:08:47.983491 run   osmo-hlr_10.42.42.2(pid=23285): Terminated: ok {rc=0}
03:08:47.994557 ---      ParallelTerminationStrategy: PID 23286 died...
03:08:48.052843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23286): Terminated: ok {rc=0}
03:08:48.063678 ---      ParallelTerminationStrategy: PID 23287 died...
03:08:48.121543 run   osmo-stp_10.42.42.5(pid=23287): Terminated: ok {rc=0}
03:08:48.131670 ---      ParallelTerminationStrategy: PID 23288 died...
03:08:48.188738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23288): Terminated: ok {rc=0}
03:08:48.199090 ---      ParallelTerminationStrategy: PID 23289 died...
03:08:48.255544 run   osmo-msc_10.42.42.6(pid=23289): Terminated: ok {rc=0}
03:08:48.266313 ---      ParallelTerminationStrategy: PID 23290 died...
03:08:48.322169 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=23290): Terminated: ok {rc=0}
03:08:48.332702 ---      ParallelTerminationStrategy: PID 23291 died...
03:08:48.388565 run   osmo-mgw_10.42.42.3(pid=23291): Terminated {rc=15}
03:08:48.398780 ---      ParallelTerminationStrategy: PID 23292 died...
03:08:48.454845 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23292): Terminated: ok {rc=0}
03:08:48.465619 ---      ParallelTerminationStrategy: PID 23293 died...
03:08:48.521461 run   osmo-mgw_10.42.42.4(pid=23293): Terminated {rc=15}
03:08:48.531651 ---      ParallelTerminationStrategy: PID 23298 died...
03:08:48.587863 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=23298): Terminated: ok {rc=0}
03:08:48.598252 ---      ParallelTerminationStrategy: PID 23299 died...
03:08:48.654161 run   osmo-bsc_10.42.42.7(pid=23299): Terminated: ok {rc=0}
03:08:48.664394 ---      ParallelTerminationStrategy: PID 23308 died...
03:08:48.720469 run        osmo-bts-sysmo(pid=23308): Terminated: ok {rc=0}
03:08:48.827137 bus                        /sierra_2: Setting Online False
03:08:49.912855 bus                        /sierra_2: Setting Powered False
03:08:55.963027 bus                        /sierra_2: Setting Powered False
03:08:57.064110 bus                        /sierra_2: Setting Powered False
03:08:58.191013 bus                        /sierra_1: Setting Online False
03:08:59.277520 bus                        /sierra_1: Setting Powered False
03:09:04.965620 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f428ab82730>, timeout=10, timestep=1} [trial-838↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]