![[Jenkins]](/jenkins/static/342c126a/images/svgs/logo.svg){kind=logo}
Failed
handover_2G:trx-lms+bts1-sysmo.handover.py (from handover_2G_trx-lms+bts1-sysmo)
Stacktrace
/sierra_2: Failed to find Network Operator {attempts=4, mcc_mnc=('901', '70')} [trial-160↪handover_2G:trx-lms+bts1-sysmo↪handover.py:57↪handover.py↪/sierra_2]Standard Output
----------------------------------------------
trial-160 handover_2G:trx-lms+bts1-sysmo handover.py
----------------------------------------------
05:49:05.959390 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6)
05:49:05.973220 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2)
05:49:06.131326 tst handover.py: using LAC 16135
05:49:06.262522 tst handover.py: using RAC 70
05:49:06.393852 tst handover.py: using CellId 16134
05:49:06.527048 tst handover.py: using BVCI 2813
05:49:06.553158 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2)
05:49:06.692803 tst handover.py: using LAC 16136
05:49:06.823734 tst handover.py: using RAC 71
05:49:06.955048 tst handover.py: using CellId 16135
05:49:07.089267 tst handover.py: using BVCI 2814
05:49:07.115070 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6)
05:49:07.128821 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6)
05:49:07.142421 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6)
05:49:07.155902 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6)
05:49:07.169522 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6)
05:49:07.182950 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2)
05:49:07.318577 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2)
05:49:07.546820 run osmo-hlr_10.42.42.2: Starting osmo-hlr
05:49:08.050433 run create_hlr_db(pid=29511): Launched
05:49:08.190722 bus /sierra_2: Setting Powered False
05:49:09.274295 run create_hlr_db(pid=29511): Terminated: ok {rc=0}
05:49:09.697988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29513): Launched
05:49:10.035546 run osmo-hlr_10.42.42.2(pid=29514): Launched
05:49:10.155866 run osmo-stp_10.42.42.5: Starting osmo-stp
05:49:10.715361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29515): Launched
05:49:11.052442 run osmo-stp_10.42.42.5(pid=29516): Launched
05:49:11.172735 run osmo-msc_10.42.42.6: Starting osmo-msc
05:49:11.763433 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29517): Launched
05:49:12.100497 run osmo-msc_10.42.42.6(pid=29518): Launched
05:49:12.222762 run osmo-mgw_10.42.42.3: Starting osmo-mgw
05:49:12.784499 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=29519): Launched
05:49:13.120316 run osmo-mgw_10.42.42.3(pid=29520): Launched
05:49:13.239975 run osmo-mgw_10.42.42.4: Starting osmo-mgw
05:49:13.789105 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29521): Launched
05:49:14.125813 run osmo-mgw_10.42.42.4(pid=29522): Launched
05:49:14.245492 run osmo-bsc_10.42.42.7: Starting osmo-bsc
05:49:15.004314 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=29523): Launched
05:49:15.358636 run osmo-bsc_10.42.42.7(pid=29524): Launched
05:49:19.053294 run osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
05:49:19.517748 run osmo-trx-lms: OSMOTRX CONF: {'osmo_trx': {'dev_args': 'LimeSDR-USB,serial=00090706024F0A22', 'bts_ip': '10.42.42.53', 'trx_ip': '10.42.42.117', 'channels': [{'rx_path': 'LNAW'}], 'remote_user': 'jenkins', 'type': 'lms', 'launch_trx': 'True', 'egprs': 'disable', 'clock_reference': 'external'}}
05:49:20.124285 run uname-m(pid=29525): Launched
05:49:21.350400 run uname-m(pid=29525): Terminated: ok {rc=0}
05:49:21.741166 run rm-remote-dir(pid=29526): Launched
05:49:22.957416 run rm-remote-dir(pid=29526): Terminated: ok {rc=0}
05:49:23.342523 run mk-remote-dir(pid=29527): Launched
05:49:24.570249 run mk-remote-dir(pid=29527): Terminated: ok {rc=0}
05:49:24.956136 run mk-remote-dir(pid=29528): Launched
05:49:26.168973 run mk-remote-dir(pid=29528): Terminated: ok {rc=0}
05:49:26.483859 run scp-inst-to-remote(pid=29529): Launched
05:49:28.698888 run scp-inst-to-remote(pid=29529): Terminated: ok {rc=0}
05:49:29.069237 run mk-remote-dir(pid=29531): Launched
05:49:30.281932 run mk-remote-dir(pid=29531): Terminated: ok {rc=0}
05:49:30.596742 run scp-cfg-to-remote(pid=29532): Launched
05:49:31.809405 run scp-cfg-to-remote(pid=29532): Terminated: ok {rc=0}
05:49:32.184130 run mk-remote-dir(pid=29534): Launched
05:49:33.400436 run mk-remote-dir(pid=29534): Terminated: ok {rc=0}
05:49:33.733025 run scp-wrapper-to-remote(pid=29535): Launched
05:49:34.962118 run scp-wrapper-to-remote(pid=29535): Terminated: ok {rc=0}
05:49:35.338586 run osmo-trx-lms(pid=29537): Launched
05:49:35.467772 run osmo-bts-trx: Waiting for osmo-trx-lms to start up...
05:49:36.777969 run osmo-bts-trx(pid=29538): Launched
05:49:39.354967 tst handover.py:43: ----- Report fragment: handover_2G:trx-lms+bts1-sysmo/handover.py/01_bts0_started: pass (20.2s)
05:49:39.551790 tst handover.py: using MSISDN 13032
05:49:39.786104 bus /sierra_2: Setting Powered True
05:49:43.420738 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015252', msisdn='13032', subscriber_id=1}
05:49:43.606217 tst handover.py: using MSISDN 13033
05:49:43.822842 bus /sierra_3: Setting Powered True
05:49:59.073350 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015253', msisdn='13033', subscriber_id=2}
05:49:59.419265 bus /sierra_2: Setting Online False
05:50:00.657390 bus /sierra_2: Setting Powered False
05:50:06.912203 bus /sierra_2: Setting Powered True
05:50:08.318011 bus /sierra_2: Setting Online True
05:50:11.067489 tst /sierra_2: Connect to ('901', '70')
05:50:11.466427 bus /sierra_3: Setting Online False
05:50:12.705132 bus /sierra_3: Setting Powered False
05:50:21.006388 bus /sierra_3: Setting Powered True
05:50:34.597417 bus /sierra_3: Setting Online True
05:50:40.656028 tst /sierra_3: Connect to ('901', '70')
05:50:40.861940 tst /sierra_2: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054228053'
05:50:41.009668 tst /sierra_3: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054229028'
05:50:41.247615 tst handover.py:54: waiting for modems to attach...
05:50:58.237209 tst handover.py:57: ----- Report fragment: handover_2G:trx-lms+bts1-sysmo/handover.py/02.1_ms0_attach: FAIL (16.9s)
05:50:58.248866 tst handover.py:57: ERR: Error: /sierra_2: Failed to find Network Operator {attempts=4, mcc_mnc=('901', '70')} [trial-160↪handover_2G:trx-lms+bts1-sysmo↪handover.py:57↪handover.py↪/sierra_2] [trial-160↪handover_2G:trx-lms+bts1-sysmo↪handover.py:57]
05:50:58.259725 tst handover.py:57: Test FAILED (112.3 sec)
05:50:58.308739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29513): Terminating (SIGTERM)
05:50:58.364670 run osmo-hlr_10.42.42.2(pid=29514): Terminating (SIGTERM)
05:50:58.422211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29515): Terminating (SIGTERM)
05:50:58.480844 run osmo-stp_10.42.42.5(pid=29516): Terminating (SIGTERM)
05:50:58.546522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29517): Terminating (SIGTERM)
05:50:58.618150 run osmo-msc_10.42.42.6(pid=29518): Terminating (SIGTERM)
05:50:58.686578 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=29519): Terminating (SIGTERM)
05:50:58.754606 run osmo-mgw_10.42.42.3(pid=29520): Terminating (SIGTERM)
05:50:58.824362 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29521): Terminating (SIGTERM)
05:50:58.892197 run osmo-mgw_10.42.42.4(pid=29522): Terminating (SIGTERM)
05:50:58.960108 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=29523): Terminating (SIGTERM)
05:50:59.027573 run osmo-bsc_10.42.42.7(pid=29524): Terminating (SIGTERM)
05:50:59.094648 run osmo-trx-lms(pid=29537): Terminating (SIGTERM)
05:50:59.155380 run osmo-bts-trx(pid=29538): Terminating (SIGTERM)
05:50:59.169175 --- ParallelTerminationStrategy: PID 29513 died...
05:50:59.245574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29513): Terminated: ok {rc=0}
05:50:59.259239 --- ParallelTerminationStrategy: PID 29514 died...
05:50:59.336033 run osmo-hlr_10.42.42.2(pid=29514): Terminated: ok {rc=0}
05:50:59.349817 --- ParallelTerminationStrategy: PID 29515 died...
05:50:59.425980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29515): Terminated: ok {rc=0}
05:50:59.439592 --- ParallelTerminationStrategy: PID 29516 died...
05:50:59.515671 run osmo-stp_10.42.42.5(pid=29516): Terminated: ok {rc=0}
05:50:59.529576 --- ParallelTerminationStrategy: PID 29517 died...
05:50:59.605317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29517): Terminated: ok {rc=0}
05:50:59.618895 --- ParallelTerminationStrategy: PID 29519 died...
05:50:59.694063 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=29519): Terminated: ok {rc=0}
05:50:59.707557 --- ParallelTerminationStrategy: PID 29520 died...
05:50:59.784314 run osmo-mgw_10.42.42.3(pid=29520): Terminated {rc=15}
05:50:59.798043 --- ParallelTerminationStrategy: PID 29521 died...
05:50:59.873945 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29521): Terminated: ok {rc=0}
05:50:59.887540 --- ParallelTerminationStrategy: PID 29522 died...
05:50:59.963301 run osmo-mgw_10.42.42.4(pid=29522): Terminated {rc=15}
05:50:59.977321 --- ParallelTerminationStrategy: PID 29523 died...
05:51:00.053184 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=29523): Terminated: ok {rc=0}
05:51:00.066747 --- ParallelTerminationStrategy: PID 29537 died...
05:51:00.137646 run osmo-trx-lms(pid=29537): Terminated {rc=36608}
05:51:02.166193 --- ParallelTerminationStrategy: PID 29518 died...
05:51:02.237570 run osmo-msc_10.42.42.6(pid=29518): Terminated: ok {rc=0}
05:51:02.249795 --- ParallelTerminationStrategy: PID 29524 died...
05:51:02.317306 run osmo-bsc_10.42.42.7(pid=29524): Terminated: ok {rc=0}
05:51:06.177853 run osmo-bts-trx(pid=29538): Terminating (SIGINT)
05:51:06.361359 --- ParallelTerminationStrategy: PID 29538 died...
05:51:06.431945 run osmo-bts-trx(pid=29538): Terminated: ok {rc=0}
05:51:06.611767 bus /sierra_3: Setting Online False
05:51:08.096145 bus /sierra_3: Setting Powered False
05:51:13.914704 bus /sierra_3: Setting Powered False
05:51:15.035676 bus /sierra_3: Setting Powered False
05:51:16.215792 bus /sierra_2: Setting Online False
05:51:17.369704 bus /sierra_2: Setting Powered False
05:51:22.875875 bus /sierra_2: Setting Powered False
Standard Error
Traceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 673, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 57, in <module>
wait(ms0.is_registered, msc.mcc_mnc())
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 581, in scan_cb_register
self.schedule_scan_register(mcc_mnc)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 524, in schedule_scan_register
raise log.Error('Failed to find Network Operator', mcc_mnc=mcc_mnc, attempts=self.register_attempts)
osmo_gsm_tester.core.log.Error: /sierra_2: Failed to find Network Operator {attempts=4, mcc_mnc=('901', '70')} [trial-160↪handover_2G:trx-lms+bts1-sysmo↪handover.py:57↪handover.py↪/sierra_2]