![[Jenkins]](/jenkins/static/342c126a/images/svgs/logo.svg){kind=logo}
Failed
handover_2G:trx-lms+bts1-trx-sysmocell5000.handover.py (from handover_2G_trx-lms+bts1-trx-sysmocell5000)
Stacktrace
/sierra_2: Failed to find Network Operator {attempts=4, mcc_mnc=('901', '70')} [trial-162↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:57↪handover.py↪/sierra_2]Standard Output
----------------------------------------------
trial-162 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py
----------------------------------------------
10:37:51.028666 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
10:37:51.042436 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2)
10:37:51.200192 tst handover.py: using LAC 16277
10:37:51.333607 tst handover.py: using RAC 212
10:37:51.465746 tst handover.py: using CellId 16276
10:37:51.597728 tst handover.py: using BVCI 2955
10:37:51.623160 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2)
10:37:51.778017 tst handover.py: using LAC 16278
10:37:51.910403 tst handover.py: using RAC 213
10:37:52.046204 tst handover.py: using CellId 16277
10:37:52.174924 tst handover.py: using BVCI 2956
10:37:52.200621 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
10:37:52.214410 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
10:37:52.228042 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
10:37:52.241806 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
10:37:52.255692 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6)
10:37:52.269492 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2)
10:37:52.402138 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2)
10:37:52.627495 run osmo-hlr_10.42.42.2: Starting osmo-hlr
10:37:53.127827 run create_hlr_db(pid=5754): Launched
10:37:53.267052 bus /sierra_2: Setting Powered False
10:37:54.351066 run create_hlr_db(pid=5754): Terminated: ok {rc=0}
10:37:54.787776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5756): Launched
10:37:55.121781 run osmo-hlr_10.42.42.2(pid=5757): Launched
10:37:55.241587 run osmo-stp_10.42.42.5: Starting osmo-stp
10:37:55.798352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5758): Launched
10:37:56.142036 run osmo-stp_10.42.42.5(pid=5759): Launched
10:37:56.267697 run osmo-msc_10.42.42.6: Starting osmo-msc
10:37:56.879318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5760): Launched
10:37:57.223262 run osmo-msc_10.42.42.6(pid=5761): Launched
10:37:57.358833 run osmo-mgw_10.42.42.3: Starting osmo-mgw
10:37:57.954209 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5762): Launched
10:37:58.299471 run osmo-mgw_10.42.42.3(pid=5763): Launched
10:37:58.424749 run osmo-mgw_10.42.42.4: Starting osmo-mgw
10:37:58.991043 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5764): Launched
10:37:59.329362 run osmo-mgw_10.42.42.4(pid=5765): Launched
10:37:59.448863 run osmo-bsc_10.42.42.7: Starting osmo-bsc
10:38:00.206564 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5766): Launched
10:38:00.561187 run osmo-bsc_10.42.42.7(pid=5767): Launched
10:38:04.286660 run osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
10:38:04.769207 run osmo-trx-lms: OSMOTRX CONF: {'osmo_trx': {'launch_trx': 'True', 'dev_args': 'LimeSDR-USB,serial=00090706024F0A22', 'clock_reference': 'external', 'trx_ip': '10.42.42.117', 'egprs': 'disable', 'channels': [{'rx_path': 'LNAW'}], 'type': 'lms', 'bts_ip': '10.42.42.53', 'remote_user': 'jenkins'}}
10:38:05.397104 run uname-m(pid=5768): Launched
10:38:06.621773 run uname-m(pid=5768): Terminated: ok {rc=0}
10:38:07.010558 run rm-remote-dir(pid=5769): Launched
10:38:08.228730 run rm-remote-dir(pid=5769): Terminated: ok {rc=0}
10:38:08.605500 run mk-remote-dir(pid=5770): Launched
10:38:09.823721 run mk-remote-dir(pid=5770): Terminated: ok {rc=0}
10:38:10.194190 run mk-remote-dir(pid=5771): Launched
10:38:11.409145 run mk-remote-dir(pid=5771): Terminated: ok {rc=0}
10:38:11.737430 run scp-inst-to-remote(pid=5772): Launched
10:38:13.954513 run scp-inst-to-remote(pid=5772): Terminated: ok {rc=0}
10:38:14.324759 run mk-remote-dir(pid=5774): Launched
10:38:15.538574 run mk-remote-dir(pid=5774): Terminated: ok {rc=0}
10:38:15.863673 run scp-cfg-to-remote(pid=5775): Launched
10:38:17.087196 run scp-cfg-to-remote(pid=5775): Terminated: ok {rc=0}
10:38:17.478974 run mk-remote-dir(pid=5777): Launched
10:38:18.695750 run mk-remote-dir(pid=5777): Terminated: ok {rc=0}
10:38:19.029530 run scp-wrapper-to-remote(pid=5778): Launched
10:38:20.257640 run scp-wrapper-to-remote(pid=5778): Terminated: ok {rc=0}
10:38:20.628967 run osmo-trx-lms(pid=5780): Launched
10:38:20.750015 run osmo-bts-trx: Waiting for osmo-trx-lms to start up...
10:38:22.050830 run osmo-bts-trx(pid=5781): Launched
10:38:24.506816 tst handover.py:43: ----- Report fragment: handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/01_bts0_started: pass (20.1s)
10:38:24.669998 tst handover.py: using MSISDN 13138
10:38:24.859058 bus /sierra_2: Setting Powered True
10:38:28.378525 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015252', msisdn='13138', subscriber_id=1}
10:38:28.532239 tst handover.py: using MSISDN 13139
10:38:28.719518 bus /sierra_3: Setting Powered True
10:38:42.530695 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015253', msisdn='13139', subscriber_id=2}
10:38:42.827624 bus /sierra_2: Setting Online False
10:38:44.034274 bus /sierra_2: Setting Powered False
10:38:49.844479 bus /sierra_2: Setting Powered True
10:38:51.209150 bus /sierra_2: Setting Online True
10:38:53.800436 tst /sierra_2: Connect to ('901', '70')
10:38:54.141379 bus /sierra_3: Setting Online False
10:38:55.349386 bus /sierra_3: Setting Powered False
10:39:02.724990 bus /sierra_3: Setting Powered True
10:39:15.005388 bus /sierra_3: Setting Online True
10:39:21.172020 tst /sierra_3: Connect to ('901', '70')
10:39:21.412722 tst /sierra_2: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054228053'
10:39:21.540645 tst /sierra_3: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054229028'
10:39:21.743560 tst handover.py:54: waiting for modems to attach...
10:39:34.651340 tst handover.py:57: ----- Report fragment: handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/02.1_ms0_attach: FAIL (12.9s)
10:39:34.660488 tst handover.py:57: ERR: Error: /sierra_2: Failed to find Network Operator {attempts=4, mcc_mnc=('901', '70')} [trial-162↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:57↪handover.py↪/sierra_2] [trial-162↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:57]
10:39:34.669466 tst handover.py:57: Test FAILED (103.6 sec)
10:39:34.712150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5756): Terminating (SIGTERM)
10:39:34.761129 run osmo-hlr_10.42.42.2(pid=5757): Terminating (SIGTERM)
10:39:34.809902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5758): Terminating (SIGTERM)
10:39:34.861969 run osmo-stp_10.42.42.5(pid=5759): Terminating (SIGTERM)
10:39:34.934831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5760): Terminating (SIGTERM)
10:39:34.998158 run osmo-msc_10.42.42.6(pid=5761): Terminating (SIGTERM)
10:39:35.046501 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5762): Terminating (SIGTERM)
10:39:35.095321 run osmo-mgw_10.42.42.3(pid=5763): Terminating (SIGTERM)
10:39:35.144133 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5764): Terminating (SIGTERM)
10:39:35.192705 run osmo-mgw_10.42.42.4(pid=5765): Terminating (SIGTERM)
10:39:35.247189 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5766): Terminating (SIGTERM)
10:39:35.296660 run osmo-bsc_10.42.42.7(pid=5767): Terminating (SIGTERM)
10:39:35.344945 run osmo-trx-lms(pid=5780): Terminating (SIGTERM)
10:39:35.395048 run osmo-bts-trx(pid=5781): Terminating (SIGTERM)
10:39:35.406008 --- ParallelTerminationStrategy: PID 5756 died...
10:39:35.469697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5756): Terminated: ok {rc=0}
10:39:35.481264 --- ParallelTerminationStrategy: PID 5757 died...
10:39:35.544664 run osmo-hlr_10.42.42.2(pid=5757): Terminated: ok {rc=0}
10:39:35.556025 --- ParallelTerminationStrategy: PID 5758 died...
10:39:35.619684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5758): Terminated: ok {rc=0}
10:39:35.631224 --- ParallelTerminationStrategy: PID 5759 died...
10:39:35.694781 run osmo-stp_10.42.42.5(pid=5759): Terminated: ok {rc=0}
10:39:35.706608 --- ParallelTerminationStrategy: PID 5760 died...
10:39:35.770603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5760): Terminated: ok {rc=0}
10:39:35.782154 --- ParallelTerminationStrategy: PID 5762 died...
10:39:35.845927 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5762): Terminated: ok {rc=0}
10:39:35.857486 --- ParallelTerminationStrategy: PID 5763 died...
10:39:35.921088 run osmo-mgw_10.42.42.3(pid=5763): Terminated {rc=15}
10:39:35.932775 --- ParallelTerminationStrategy: PID 5764 died...
10:39:35.996570 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5764): Terminated: ok {rc=0}
10:39:36.008181 --- ParallelTerminationStrategy: PID 5765 died...
10:39:36.071945 run osmo-mgw_10.42.42.4(pid=5765): Terminated {rc=15}
10:39:36.083499 --- ParallelTerminationStrategy: PID 5766 died...
10:39:36.147358 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5766): Terminated: ok {rc=0}
10:39:36.158969 --- ParallelTerminationStrategy: PID 5780 died...
10:39:36.223224 run osmo-trx-lms(pid=5780): Terminated {rc=36608}
10:39:38.251870 --- ParallelTerminationStrategy: PID 5761 died...
10:39:38.317340 run osmo-msc_10.42.42.6(pid=5761): Terminated: ok {rc=0}
10:39:38.995993 --- ParallelTerminationStrategy: PID 5767 died...
10:39:39.062739 run osmo-bsc_10.42.42.7(pid=5767): Terminated: ok {rc=0}
10:39:42.253401 run osmo-bts-trx(pid=5781): Terminating (SIGINT)
10:39:42.432656 --- ParallelTerminationStrategy: PID 5781 died...
10:39:42.498608 run osmo-bts-trx(pid=5781): Terminated: ok {rc=0}
10:39:42.669941 bus /sierra_3: Setting Online False
10:39:44.139645 bus /sierra_3: Setting Powered False
10:39:49.952995 bus /sierra_3: Setting Powered False
10:39:51.077247 bus /sierra_3: Setting Powered False
10:39:52.262603 bus /sierra_2: Setting Online False
10:39:53.404843 bus /sierra_2: Setting Powered False
10:39:59.639381 bus /sierra_2: Setting Powered False
Standard Error
Traceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 673, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 57, in <module>
wait(ms0.is_registered, msc.mcc_mnc())
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 581, in scan_cb_register
self.schedule_scan_register(mcc_mnc)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 524, in schedule_scan_register
raise log.Error('Failed to find Network Operator', mcc_mnc=mcc_mnc, attempts=self.register_attempts)
osmo_gsm_tester.core.log.Error: /sierra_2: Failed to find Network Operator {attempts=4, mcc_mnc=('901', '70')} [trial-162↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:57↪handover.py↪/sierra_2]