Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 78 builds (Since #749 )
Took 1 min 9 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f2fd02f4048>, timeout=10, timestep=1} [trial-826↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-826 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
12:20:51.033596 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
12:20:51.044437 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
12:20:51.172985 tst                      handover.py: using LAC 9146
12:20:51.299724 tst                      handover.py: using RAC 221
12:20:51.426465 tst                      handover.py: using CellId 9146
12:20:51.552978 tst                      handover.py: using BVCI 9142
12:20:51.577257 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
12:20:51.717748 tst                      handover.py: using LAC 9147
12:20:51.844331 tst                      handover.py: using RAC 222
12:20:51.968945 tst                      handover.py: using CellId 9147
12:20:52.095244 tst                      handover.py: using BVCI 9143
12:20:52.119451 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
12:20:52.130460 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
12:20:52.141301 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
12:20:52.152228 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
12:20:52.163313 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
12:20:52.174308 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
12:20:52.279797 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
12:20:52.473591 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
12:20:52.951657 run         create_hlr_db(pid=22026): Launched
12:20:53.082269 bus                        /sierra_1: Setting Powered False
12:20:54.158360 run         create_hlr_db(pid=22026): Terminated: ok {rc=0}
12:20:54.584139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22028): Launched
12:20:54.926830 run   osmo-hlr_10.42.42.2(pid=22029): Launched
12:20:55.050427 run              osmo-stp_10.42.42.5: Starting osmo-stp
12:20:55.611329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22030): Launched
12:20:55.954591 run   osmo-stp_10.42.42.5(pid=22031): Launched
12:20:56.075878 run              osmo-msc_10.42.42.6: Starting osmo-msc
12:20:56.667941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22032): Launched
12:20:57.011460 run   osmo-msc_10.42.42.6(pid=22033): Launched
12:21:00.192450 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
12:21:00.756605 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22034): Launched
12:21:01.100042 run   osmo-mgw_10.42.42.3(pid=22035): Launched
12:21:01.222334 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
12:21:01.774390 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22036): Launched
12:21:02.114915 run   osmo-mgw_10.42.42.4(pid=22038): Launched
12:21:02.236755 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
12:21:02.972272 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22039): Launched
12:21:03.312833 run   osmo-bsc_10.42.42.7(pid=22040): Launched
12:21:10.027004 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
12:21:10.567469 run         rm-remote-dir(pid=22041): Launched
12:21:12.764975 run         rm-remote-dir(pid=22041): Terminated: ok {rc=0}
12:21:13.105993 run         mk-remote-dir(pid=22042): Launched
12:21:15.301499 run         mk-remote-dir(pid=22042): Terminated: ok {rc=0}
12:21:15.589225 run    scp-inst-to-remote(pid=22043): Launched
12:21:28.802291 run    scp-inst-to-remote(pid=22043): Terminated: ok {rc=0}
12:21:29.137696 run         mk-remote-dir(pid=22045): Launched
12:21:31.331145 run         mk-remote-dir(pid=22045): Terminated: ok {rc=0}
12:21:31.618504 run     scp-cfg-to-remote(pid=22046): Launched
12:21:33.813077 run     scp-cfg-to-remote(pid=22046): Terminated: ok {rc=0}
12:21:34.144549 run   reload-dsp-firmware(pid=22048): Launched
12:21:38.338058 run   reload-dsp-firmware(pid=22048): Terminated: ok {rc=0}
12:21:38.663728 run        osmo-bts-sysmo(pid=22049): Launched
12:21:43.008239 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (32.9s)
12:21:43.168677 tst                      handover.py: using MSISDN 5930
12:21:43.346217 bus                        /sierra_1: Setting Powered True
12:21:46.835177 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5930', subscriber_id=1}
12:21:46.981720 tst                      handover.py: using MSISDN 5931
12:21:47.159977 bus                        /sierra_2: Setting Powered True
12:21:59.515896 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f2fd02f4048&gt;, timeout=10, timestep=1} [trial-826↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-826↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
12:21:59.523303 tst                   handover.py:45: Test FAILED (68.5 sec)
12:21:59.559310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22028): Terminating (SIGTERM)
12:21:59.600666 run   osmo-hlr_10.42.42.2(pid=22029): Terminating (SIGTERM)
12:21:59.643506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22030): Terminating (SIGTERM)
12:21:59.688836 run   osmo-stp_10.42.42.5(pid=22031): Terminating (SIGTERM)
12:21:59.739627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22032): Terminating (SIGTERM)
12:21:59.781752 run   osmo-msc_10.42.42.6(pid=22033): Terminating (SIGTERM)
12:21:59.823953 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22034): Terminating (SIGTERM)
12:21:59.871380 run   osmo-mgw_10.42.42.3(pid=22035): Terminating (SIGTERM)
12:21:59.914726 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22036): Terminating (SIGTERM)
12:21:59.958096 run   osmo-mgw_10.42.42.4(pid=22038): Terminating (SIGTERM)
12:22:00.014786 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22039): Terminating (SIGTERM)
12:22:00.055111 run   osmo-bsc_10.42.42.7(pid=22040): Terminating (SIGTERM)
12:22:00.095375 run        osmo-bts-sysmo(pid=22049): Terminating (SIGTERM)
12:22:00.104682 ---      ParallelTerminationStrategy: PID 22028 died...
12:22:00.158264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22028): Terminated: ok {rc=0}
12:22:00.168084 ---      ParallelTerminationStrategy: PID 22029 died...
12:22:00.221504 run   osmo-hlr_10.42.42.2(pid=22029): Terminated: ok {rc=0}
12:22:00.231435 ---      ParallelTerminationStrategy: PID 22030 died...
12:22:00.284803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22030): Terminated: ok {rc=0}
12:22:00.294580 ---      ParallelTerminationStrategy: PID 22031 died...
12:22:00.347765 run   osmo-stp_10.42.42.5(pid=22031): Terminated: ok {rc=0}
12:22:00.357779 ---      ParallelTerminationStrategy: PID 22032 died...
12:22:00.417504 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22032): Terminated: ok {rc=0}
12:22:00.428145 ---      ParallelTerminationStrategy: PID 22033 died...
12:22:00.486844 run   osmo-msc_10.42.42.6(pid=22033): Terminated: ok {rc=0}
12:22:00.497622 ---      ParallelTerminationStrategy: PID 22034 died...
12:22:00.555329 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22034): Terminated: ok {rc=0}
12:22:00.566019 ---      ParallelTerminationStrategy: PID 22035 died...
12:22:00.623201 run   osmo-mgw_10.42.42.3(pid=22035): Terminated {rc=15}
12:22:00.634187 ---      ParallelTerminationStrategy: PID 22036 died...
12:22:00.692718 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22036): Terminated: ok {rc=0}
12:22:00.703425 ---      ParallelTerminationStrategy: PID 22038 died...
12:22:00.760025 run   osmo-mgw_10.42.42.4(pid=22038): Terminated {rc=15}
12:22:00.770310 ---      ParallelTerminationStrategy: PID 22039 died...
12:22:00.826944 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22039): Terminated: ok {rc=0}
12:22:00.837318 ---      ParallelTerminationStrategy: PID 22040 died...
12:22:00.893326 run   osmo-bsc_10.42.42.7(pid=22040): Terminated: ok {rc=0}
12:22:00.903954 ---      ParallelTerminationStrategy: PID 22049 died...
12:22:00.960686 run        osmo-bts-sysmo(pid=22049): Terminated: ok {rc=0}
12:22:01.067566 bus                        /sierra_2: Setting Online False
12:22:02.153484 bus                        /sierra_2: Setting Powered False
12:22:07.967466 bus                        /sierra_2: Setting Powered False
12:22:09.069253 bus                        /sierra_2: Setting Powered False
12:22:10.200089 bus                        /sierra_1: Setting Online False
12:22:11.284822 bus                        /sierra_1: Setting Powered False
12:22:16.960675 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f2fd02f4048>, timeout=10, timestep=1} [trial-826↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]