Skip to content

Failed

handover_2G:sysmo+bts1-trx-b200.handover.py (from handover_2G_sysmo+bts1-trx-b200)

Failing for the past 55 builds (Since #749 )
Took 1 min 6 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6ea0248950>, timeout=10, timestep=1} [trial-803↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-803 handover_2G:sysmo+bts1-trx-b200 handover.py
----------------------------------------------
09:17:49.764032 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:17:49.775223 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
09:17:49.915027 tst                      handover.py: using LAC 7306
09:17:50.049290 tst                      handover.py: using RAC 166
09:17:50.184974 tst                      handover.py: using CellId 7306
09:17:50.320464 tst                      handover.py: using BVCI 7302
09:17:50.346840 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2)
09:17:50.493388 tst                      handover.py: using LAC 7307
09:17:50.629259 tst                      handover.py: using RAC 167
09:17:50.764349 tst                      handover.py: using CellId 7307
09:17:50.898103 tst                      handover.py: using BVCI 7303
09:17:50.924271 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:17:50.935770 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:17:50.947090 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:17:50.958818 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:17:50.970653 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6)
09:17:50.982421 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
09:17:51.088624 tst  handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2)
09:17:51.282154 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
09:17:51.764506 run         create_hlr_db(pid=23591): Launched
09:17:51.896700 bus                        /sierra_1: Setting Powered False
09:17:52.972596 run         create_hlr_db(pid=23591): Terminated: ok {rc=0}
09:17:53.378879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23593): Launched
09:17:53.707060 run   osmo-hlr_10.42.42.2(pid=23594): Launched
09:17:53.822496 run              osmo-stp_10.42.42.5: Starting osmo-stp
09:17:54.357857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23595): Launched
09:17:54.689803 run   osmo-stp_10.42.42.5(pid=23596): Launched
09:17:54.806178 run              osmo-msc_10.42.42.6: Starting osmo-msc
09:17:55.370707 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23597): Launched
09:17:55.698214 run   osmo-msc_10.42.42.6(pid=23598): Launched
09:17:58.871847 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
09:17:59.408749 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=23599): Launched
09:17:59.737614 run   osmo-mgw_10.42.42.3(pid=23600): Launched
09:17:59.852556 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
09:18:00.382486 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23601): Launched
09:18:00.707505 run   osmo-mgw_10.42.42.4(pid=23602): Launched
09:18:00.822829 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
09:18:01.530143 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=23603): Launched
09:18:01.858266 run   osmo-bsc_10.42.42.7(pid=23604): Launched
09:18:08.577551 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
09:18:09.126278 run         rm-remote-dir(pid=23605): Launched
09:18:11.325303 run         rm-remote-dir(pid=23605): Terminated: ok {rc=0}
09:18:11.672330 run         mk-remote-dir(pid=23606): Launched
09:18:12.869480 run         mk-remote-dir(pid=23606): Terminated: ok {rc=0}
09:18:13.164629 run    scp-inst-to-remote(pid=23607): Launched
09:18:26.390184 run    scp-inst-to-remote(pid=23607): Terminated: ok {rc=0}
09:18:26.753613 run         mk-remote-dir(pid=23609): Launched
09:18:28.961900 run         mk-remote-dir(pid=23609): Terminated: ok {rc=0}
09:18:29.274632 run     scp-cfg-to-remote(pid=23610): Launched
09:18:30.482773 run     scp-cfg-to-remote(pid=23610): Terminated: ok {rc=0}
09:18:30.843509 run   reload-dsp-firmware(pid=23612): Launched
09:18:34.050744 run   reload-dsp-firmware(pid=23612): Terminated: ok {rc=0}
09:18:34.401768 run        osmo-bts-sysmo(pid=23613): Launched
09:18:38.743813 tst                   handover.py:42: ----- Report fragment: handover_2G:sysmo+bts1-trx-b200/handover.py/01_bts0_started: pass (30.1s)
09:18:38.907014 tst                      handover.py: using MSISDN 4711
09:18:39.096343 bus                        /sierra_1: Setting Powered True
09:18:42.582721 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4711', subscriber_id=1}
09:18:42.728499 tst                      handover.py: using MSISDN 4712
09:18:42.917616 bus                        /sierra_2: Setting Powered True
09:18:55.284622 tst                   handover.py:45: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f6ea0248950&gt;, timeout=10, timestep=1} [trial-803↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]  [trial-803↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45]
09:18:55.291963 tst                   handover.py:45: Test FAILED (65.5 sec)
09:18:55.328379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23593): Terminating (SIGTERM)
09:18:55.370343 run   osmo-hlr_10.42.42.2(pid=23594): Terminating (SIGTERM)
09:18:55.418818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23595): Terminating (SIGTERM)
09:18:55.464309 run   osmo-stp_10.42.42.5(pid=23596): Terminating (SIGTERM)
09:18:55.529680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23597): Terminating (SIGTERM)
09:18:55.574512 run   osmo-msc_10.42.42.6(pid=23598): Terminating (SIGTERM)
09:18:55.618805 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=23599): Terminating (SIGTERM)
09:18:55.664518 run   osmo-mgw_10.42.42.3(pid=23600): Terminating (SIGTERM)
09:18:55.720531 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23601): Terminating (SIGTERM)
09:18:55.766459 run   osmo-mgw_10.42.42.4(pid=23602): Terminating (SIGTERM)
09:18:55.811553 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=23603): Terminating (SIGTERM)
09:18:55.855024 run   osmo-bsc_10.42.42.7(pid=23604): Terminating (SIGTERM)
09:18:55.896995 run        osmo-bts-sysmo(pid=23613): Terminating (SIGTERM)
09:18:55.906776 ---      ParallelTerminationStrategy: PID 23593 died...
09:18:55.964207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23593): Terminated: ok {rc=0}
09:18:55.974836 ---      ParallelTerminationStrategy: PID 23594 died...
09:18:56.033010 run   osmo-hlr_10.42.42.2(pid=23594): Terminated: ok {rc=0}
09:18:56.043627 ---      ParallelTerminationStrategy: PID 23595 died...
09:18:56.100757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23595): Terminated: ok {rc=0}
09:18:56.111375 ---      ParallelTerminationStrategy: PID 23596 died...
09:18:56.168704 run   osmo-stp_10.42.42.5(pid=23596): Terminated: ok {rc=0}
09:18:56.179544 ---      ParallelTerminationStrategy: PID 23597 died...
09:18:56.238014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23597): Terminated: ok {rc=0}
09:18:56.248126 ---      ParallelTerminationStrategy: PID 23598 died...
09:18:56.303273 run   osmo-msc_10.42.42.6(pid=23598): Terminated: ok {rc=0}
09:18:56.313403 ---      ParallelTerminationStrategy: PID 23599 died...
09:18:56.368872 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=23599): Terminated: ok {rc=0}
09:18:56.378999 ---      ParallelTerminationStrategy: PID 23600 died...
09:18:56.433700 run   osmo-mgw_10.42.42.3(pid=23600): Terminated {rc=15}
09:18:56.444190 ---      ParallelTerminationStrategy: PID 23601 died...
09:18:56.498742 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=23601): Terminated: ok {rc=0}
09:18:56.509323 ---      ParallelTerminationStrategy: PID 23602 died...
09:18:56.564171 run   osmo-mgw_10.42.42.4(pid=23602): Terminated {rc=15}
09:18:56.574099 ---      ParallelTerminationStrategy: PID 23603 died...
09:18:56.629320 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=23603): Terminated: ok {rc=0}
09:18:56.639411 ---      ParallelTerminationStrategy: PID 23604 died...
09:18:56.694665 run   osmo-bsc_10.42.42.7(pid=23604): Terminated: ok {rc=0}
09:18:56.704713 ---      ParallelTerminationStrategy: PID 23613 died...
09:18:56.760203 run        osmo-bts-sysmo(pid=23613): Terminated: ok {rc=0}
09:18:56.870054 bus                        /sierra_2: Setting Online False
09:18:57.955271 bus                        /sierra_2: Setting Powered False
09:19:03.969323 bus                        /sierra_2: Setting Powered False
09:19:05.072403 bus                        /sierra_2: Setting Powered False
09:19:06.200932 bus                        /sierra_1: Setting Online False
09:19:07.288147 bus                        /sierra_1: Setting Powered False
09:19:12.969047 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 45, in <module>
    hlr.subscriber_add(ms1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6ea0248950>, timeout=10, timestep=1} [trial-803↪handover_2G:sysmo+bts1-trx-b200↪handover.py:45↪handover.py↪/sierra_2]