Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 79 builds (Since #749 )
Took 1 min 9 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f0b542ce488>, timeout=10, timestep=1} [trial-827↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-827 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
13:25:19.906327 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
13:25:19.917726 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
13:25:20.046303 tst                      handover.py: using LAC 9226
13:25:20.180105 tst                      handover.py: using RAC 46
13:25:20.309449 tst                      handover.py: using CellId 9226
13:25:20.441959 tst                      handover.py: using BVCI 9222
13:25:20.468274 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
13:25:20.614617 tst                      handover.py: using LAC 9227
13:25:20.752178 tst                      handover.py: using RAC 47
13:25:20.886234 tst                      handover.py: using CellId 9227
13:25:21.019125 tst                      handover.py: using BVCI 9223
13:25:21.045342 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
13:25:21.056602 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
13:25:21.067779 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
13:25:21.079017 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
13:25:21.090293 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
13:25:21.101482 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
13:25:21.204811 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
13:25:21.399150 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
13:25:21.882550 run         create_hlr_db(pid=24364): Launched
13:25:22.014924 bus                        /sierra_1: Setting Powered False
13:25:23.090529 run         create_hlr_db(pid=24364): Terminated: ok {rc=0}
13:25:23.519397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24366): Launched
13:25:23.864133 run   osmo-hlr_10.42.42.2(pid=24367): Launched
13:25:23.988701 run              osmo-stp_10.42.42.5: Starting osmo-stp
13:25:24.555890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24368): Launched
13:25:24.901999 run   osmo-stp_10.42.42.5(pid=24369): Launched
13:25:25.024479 run              osmo-msc_10.42.42.6: Starting osmo-msc
13:25:25.620572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24370): Launched
13:25:25.965520 run   osmo-msc_10.42.42.6(pid=24371): Launched
13:25:29.149246 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
13:25:29.717791 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=24372): Launched
13:25:30.061419 run   osmo-mgw_10.42.42.3(pid=24373): Launched
13:25:30.183865 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
13:25:30.743055 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=24374): Launched
13:25:31.082280 run   osmo-mgw_10.42.42.4(pid=24375): Launched
13:25:31.198356 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
13:25:31.901817 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=24376): Launched
13:25:32.229484 run   osmo-bsc_10.42.42.7(pid=24377): Launched
13:25:38.947487 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
13:25:39.496232 run         rm-remote-dir(pid=24378): Launched
13:25:41.694824 run         rm-remote-dir(pid=24378): Terminated: ok {rc=0}
13:25:42.039478 run         mk-remote-dir(pid=24379): Launched
13:25:44.236787 run         mk-remote-dir(pid=24379): Terminated: ok {rc=0}
13:25:44.527495 run    scp-inst-to-remote(pid=24380): Launched
13:25:57.753648 run    scp-inst-to-remote(pid=24380): Terminated: ok {rc=0}
13:25:58.117415 run         mk-remote-dir(pid=24382): Launched
13:26:00.324518 run         mk-remote-dir(pid=24382): Terminated: ok {rc=0}
13:26:00.633933 run     scp-cfg-to-remote(pid=24383): Launched
13:26:02.843934 run     scp-cfg-to-remote(pid=24383): Terminated: ok {rc=0}
13:26:03.200304 run   reload-dsp-firmware(pid=24385): Launched
13:26:07.407122 run   reload-dsp-firmware(pid=24385): Terminated: ok {rc=0}
13:26:07.755248 run        osmo-bts-sysmo(pid=24387): Launched
13:26:12.076120 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (33.0s)
13:26:12.226894 tst                      handover.py: using MSISDN 5983
13:26:12.414873 bus                        /sierra_1: Setting Powered True
13:26:15.919572 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5983', subscriber_id=1}
13:26:16.067585 tst                      handover.py: using MSISDN 5984
13:26:16.247805 bus                        /sierra_2: Setting Powered True
13:26:28.617575 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f0b542ce488&gt;, timeout=10, timestep=1} [trial-827↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-827↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
13:26:28.624088 tst                   handover.py:45: Test FAILED (68.7 sec)
13:26:28.659277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24366): Terminating (SIGTERM)
13:26:28.698987 run   osmo-hlr_10.42.42.2(pid=24367): Terminating (SIGTERM)
13:26:28.741931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24368): Terminating (SIGTERM)
13:26:28.786648 run   osmo-stp_10.42.42.5(pid=24369): Terminating (SIGTERM)
13:26:28.829581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24370): Terminating (SIGTERM)
13:26:28.872842 run   osmo-msc_10.42.42.6(pid=24371): Terminating (SIGTERM)
13:26:28.916529 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=24372): Terminating (SIGTERM)
13:26:28.960244 run   osmo-mgw_10.42.42.3(pid=24373): Terminating (SIGTERM)
13:26:29.004386 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=24374): Terminating (SIGTERM)
13:26:29.047740 run   osmo-mgw_10.42.42.4(pid=24375): Terminating (SIGTERM)
13:26:29.089309 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=24376): Terminating (SIGTERM)
13:26:29.129200 run   osmo-bsc_10.42.42.7(pid=24377): Terminating (SIGTERM)
13:26:29.169740 run        osmo-bts-sysmo(pid=24387): Terminating (SIGTERM)
13:26:29.179713 ---      ParallelTerminationStrategy: PID 24366 died...
13:26:29.234100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24366): Terminated: ok {rc=0}
13:26:29.244515 ---      ParallelTerminationStrategy: PID 24367 died...
13:26:29.299104 run   osmo-hlr_10.42.42.2(pid=24367): Terminated: ok {rc=0}
13:26:29.309442 ---      ParallelTerminationStrategy: PID 24368 died...
13:26:29.365237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24368): Terminated: ok {rc=0}
13:26:29.375594 ---      ParallelTerminationStrategy: PID 24369 died...
13:26:29.430562 run   osmo-stp_10.42.42.5(pid=24369): Terminated: ok {rc=0}
13:26:29.441566 ---      ParallelTerminationStrategy: PID 24370 died...
13:26:29.496663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24370): Terminated: ok {rc=0}
13:26:29.506521 ---      ParallelTerminationStrategy: PID 24371 died...
13:26:29.560471 run   osmo-msc_10.42.42.6(pid=24371): Terminated: ok {rc=0}
13:26:29.570808 ---      ParallelTerminationStrategy: PID 24372 died...
13:26:29.624671 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=24372): Terminated: ok {rc=0}
13:26:29.635155 ---      ParallelTerminationStrategy: PID 24373 died...
13:26:29.688836 run   osmo-mgw_10.42.42.3(pid=24373): Terminated {rc=15}
13:26:29.699275 ---      ParallelTerminationStrategy: PID 24374 died...
13:26:29.752992 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=24374): Terminated: ok {rc=0}
13:26:29.763346 ---      ParallelTerminationStrategy: PID 24375 died...
13:26:29.817006 run   osmo-mgw_10.42.42.4(pid=24375): Terminated {rc=15}
13:26:29.827441 ---      ParallelTerminationStrategy: PID 24376 died...
13:26:29.882107 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=24376): Terminated: ok {rc=0}
13:26:29.892048 ---      ParallelTerminationStrategy: PID 24377 died...
13:26:29.946082 run   osmo-bsc_10.42.42.7(pid=24377): Terminated: ok {rc=0}
13:26:29.956562 ---      ParallelTerminationStrategy: PID 24387 died...
13:26:30.011368 run        osmo-bts-sysmo(pid=24387): Terminated: ok {rc=0}
13:26:30.120887 bus                        /sierra_2: Setting Online False
13:26:31.206724 bus                        /sierra_2: Setting Powered False
13:26:36.971238 bus                        /sierra_2: Setting Powered False
13:26:38.075292 bus                        /sierra_2: Setting Powered False
13:26:39.209300 bus                        /sierra_1: Setting Online False
13:26:40.293342 bus                        /sierra_1: Setting Powered False
13:26:45.963203 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f0b542ce488>, timeout=10, timestep=1} [trial-827↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]