![[Jenkins]](/jenkins/static/342c126a/images/svgs/logo.svg){kind=logo}
Failed
handover_2G:trx-lms+bts1-trx-umtrx.handover.py (from handover_2G_trx-lms+bts1-trx-umtrx)
Stacktrace
/sierra_2: Failed to find Network Operator {attempts=4, mcc_mnc=('901', '70')} [trial-159↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:57↪handover.py↪/sierra_2]Standard Output
----------------------------------------------
trial-159 handover_2G:trx-lms+bts1-trx-umtrx handover.py
----------------------------------------------
00:55:38.789308 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6)
00:55:38.802834 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2)
00:55:38.964125 tst handover.py: using LAC 16043
00:55:39.095636 tst handover.py: using RAC 233
00:55:39.231841 tst handover.py: using CellId 16042
00:55:39.364561 tst handover.py: using BVCI 2721
00:55:39.390794 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2)
00:55:39.544574 tst handover.py: using LAC 16044
00:55:39.675358 tst handover.py: using RAC 234
00:55:39.806488 tst handover.py: using CellId 16043
00:55:39.936614 tst handover.py: using BVCI 2722
00:55:39.962628 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6)
00:55:39.976203 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6)
00:55:39.989721 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6)
00:55:40.003125 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6)
00:55:40.016477 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6)
00:55:40.029823 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2)
00:55:40.158154 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2)
00:55:40.393275 run osmo-hlr_10.42.42.2: Starting osmo-hlr
00:55:40.920486 run create_hlr_db(pid=14960): Launched
00:55:41.061621 bus /sierra_2: Setting Powered False
00:55:42.143363 run create_hlr_db(pid=14960): Terminated: ok {rc=0}
00:55:42.589848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14962): Launched
00:55:42.930913 run osmo-hlr_10.42.42.2(pid=14963): Launched
00:55:43.052484 run osmo-stp_10.42.42.5: Starting osmo-stp
00:55:43.614132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14964): Launched
00:55:43.954294 run osmo-stp_10.42.42.5(pid=14965): Launched
00:55:44.075325 run osmo-msc_10.42.42.6: Starting osmo-msc
00:55:44.668571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14966): Launched
00:55:45.010080 run osmo-msc_10.42.42.6(pid=14967): Launched
00:55:45.133363 run osmo-mgw_10.42.42.3: Starting osmo-mgw
00:55:45.706221 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14968): Launched
00:55:46.069805 run osmo-mgw_10.42.42.3(pid=14969): Launched
00:55:46.198634 run osmo-mgw_10.42.42.4: Starting osmo-mgw
00:55:46.774802 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14970): Launched
00:55:47.125358 run osmo-mgw_10.42.42.4(pid=14971): Launched
00:55:47.254201 run osmo-bsc_10.42.42.7: Starting osmo-bsc
00:55:48.046110 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14972): Launched
00:55:48.419541 run osmo-bsc_10.42.42.7(pid=14973): Launched
00:55:52.118652 run osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.7
00:55:52.583357 run osmo-trx-lms: OSMOTRX CONF: {'osmo_trx': {'clock_reference': 'external', 'trx_ip': '10.42.42.117', 'dev_args': 'LimeSDR-USB,serial=00090706024F0A22', 'remote_user': 'jenkins', 'bts_ip': '10.42.42.53', 'channels': [{'rx_path': 'LNAW'}], 'egprs': 'disable', 'type': 'lms', 'launch_trx': 'True'}}
00:55:53.197034 run uname-m(pid=14974): Launched
00:55:54.424903 run uname-m(pid=14974): Terminated: ok {rc=0}
00:55:54.829280 run rm-remote-dir(pid=14975): Launched
00:55:56.060047 run rm-remote-dir(pid=14975): Terminated: ok {rc=0}
00:55:56.455600 run mk-remote-dir(pid=14976): Launched
00:55:57.674319 run mk-remote-dir(pid=14976): Terminated: ok {rc=0}
00:55:58.048097 run mk-remote-dir(pid=14977): Launched
00:55:59.264462 run mk-remote-dir(pid=14977): Terminated: ok {rc=0}
00:55:59.583969 run scp-inst-to-remote(pid=14978): Launched
00:56:01.810514 run scp-inst-to-remote(pid=14978): Terminated: ok {rc=0}
00:56:02.198290 run mk-remote-dir(pid=14980): Launched
00:56:03.414954 run mk-remote-dir(pid=14980): Terminated: ok {rc=0}
00:56:03.743933 run scp-cfg-to-remote(pid=14981): Launched
00:56:04.971775 run scp-cfg-to-remote(pid=14981): Terminated: ok {rc=0}
00:56:05.373059 run mk-remote-dir(pid=14983): Launched
00:56:06.602700 run mk-remote-dir(pid=14983): Terminated: ok {rc=0}
00:56:06.947559 run scp-wrapper-to-remote(pid=14984): Launched
00:56:08.177542 run scp-wrapper-to-remote(pid=14984): Terminated: ok {rc=0}
00:56:08.559751 run osmo-trx-lms(pid=14986): Launched
00:56:08.691496 run osmo-bts-trx: Waiting for osmo-trx-lms to start up...
00:56:10.007233 run osmo-bts-trx(pid=14987): Launched
00:56:12.478897 tst handover.py:43: ----- Report fragment: handover_2G:trx-lms+bts1-trx-umtrx/handover.py/01_bts0_started: pass (20.3s)
00:56:12.682505 tst handover.py: using MSISDN 12934
00:56:12.884189 bus /sierra_2: Setting Powered True
00:56:16.412267 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015252', msisdn='12934', subscriber_id=1}
00:56:16.572376 tst handover.py: using MSISDN 12935
00:56:16.757273 bus /sierra_3: Setting Powered True
00:56:30.499676 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000015253', msisdn='12935', subscriber_id=2}
00:56:30.800971 bus /sierra_2: Setting Online False
00:56:32.006628 bus /sierra_2: Setting Powered False
00:56:38.008069 bus /sierra_2: Setting Powered True
00:56:39.409888 bus /sierra_2: Setting Online True
00:56:41.921391 tst /sierra_2: Connect to ('901', '70')
00:56:42.262112 bus /sierra_3: Setting Online False
00:56:43.536779 bus /sierra_3: Setting Powered False
00:56:51.582984 bus /sierra_3: Setting Powered True
00:57:03.493822 bus /sierra_3: Setting Online True
00:57:08.986868 tst /sierra_3: Connect to ('901', '70')
00:57:09.167646 tst /sierra_2: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054228053'
00:57:09.296890 tst /sierra_3: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054229028'
00:57:09.502517 tst handover.py:54: waiting for modems to attach...
00:57:21.404156 tst handover.py:57: ----- Report fragment: handover_2G:trx-lms+bts1-trx-umtrx/handover.py/02.1_ms0_attach: FAIL (11.8s)
00:57:21.415590 tst handover.py:57: ERR: Error: /sierra_2: Failed to find Network Operator {attempts=4, mcc_mnc=('901', '70')} [trial-159↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:57↪handover.py↪/sierra_2] [trial-159↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:57]
00:57:21.427064 tst handover.py:57: Test FAILED (102.6 sec)
00:57:21.476138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14962): Terminating (SIGTERM)
00:57:21.531860 run osmo-hlr_10.42.42.2(pid=14963): Terminating (SIGTERM)
00:57:21.589578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14964): Terminating (SIGTERM)
00:57:21.650023 run osmo-stp_10.42.42.5(pid=14965): Terminating (SIGTERM)
00:57:21.712002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14966): Terminating (SIGTERM)
00:57:21.771458 run osmo-msc_10.42.42.6(pid=14967): Terminating (SIGTERM)
00:57:21.827184 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14968): Terminating (SIGTERM)
00:57:21.883178 run osmo-mgw_10.42.42.3(pid=14969): Terminating (SIGTERM)
00:57:21.939517 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14970): Terminating (SIGTERM)
00:57:21.994872 run osmo-mgw_10.42.42.4(pid=14971): Terminating (SIGTERM)
00:57:22.050584 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14972): Terminating (SIGTERM)
00:57:22.106320 run osmo-bsc_10.42.42.7(pid=14973): Terminating (SIGTERM)
00:57:22.161799 run osmo-trx-lms(pid=14986): Terminating (SIGTERM)
00:57:22.214681 run osmo-bts-trx(pid=14987): Terminating (SIGTERM)
00:57:22.226514 --- ParallelTerminationStrategy: PID 14962 died...
00:57:22.296568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14962): Terminated: ok {rc=0}
00:57:22.309414 --- ParallelTerminationStrategy: PID 14963 died...
00:57:22.377779 run osmo-hlr_10.42.42.2(pid=14963): Terminated: ok {rc=0}
00:57:22.390024 --- ParallelTerminationStrategy: PID 14964 died...
00:57:22.458537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14964): Terminated: ok {rc=0}
00:57:22.470878 --- ParallelTerminationStrategy: PID 14965 died...
00:57:22.539339 run osmo-stp_10.42.42.5(pid=14965): Terminated: ok {rc=0}
00:57:22.551745 --- ParallelTerminationStrategy: PID 14966 died...
00:57:22.620368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14966): Terminated: ok {rc=0}
00:57:22.632747 --- ParallelTerminationStrategy: PID 14968 died...
00:57:22.701554 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14968): Terminated: ok {rc=0}
00:57:22.713963 --- ParallelTerminationStrategy: PID 14969 died...
00:57:22.782891 run osmo-mgw_10.42.42.3(pid=14969): Terminated {rc=15}
00:57:22.795251 --- ParallelTerminationStrategy: PID 14970 died...
00:57:22.864755 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14970): Terminated: ok {rc=0}
00:57:22.877393 --- ParallelTerminationStrategy: PID 14971 died...
00:57:22.946270 run osmo-mgw_10.42.42.4(pid=14971): Terminated {rc=15}
00:57:22.958732 --- ParallelTerminationStrategy: PID 14972 died...
00:57:23.027754 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14972): Terminated: ok {rc=0}
00:57:23.040252 --- ParallelTerminationStrategy: PID 14986 died...
00:57:23.109189 run osmo-trx-lms(pid=14986): Terminated {rc=36608}
00:57:25.137855 --- ParallelTerminationStrategy: PID 14967 died...
00:57:25.208247 run osmo-msc_10.42.42.6(pid=14967): Terminated: ok {rc=0}
00:57:25.887132 --- ParallelTerminationStrategy: PID 14973 died...
00:57:25.953181 run osmo-bsc_10.42.42.7(pid=14973): Terminated: ok {rc=0}
00:57:29.143538 run osmo-bts-trx(pid=14987): Terminating (SIGINT)
00:57:29.326750 --- ParallelTerminationStrategy: PID 14987 died...
00:57:29.397074 run osmo-bts-trx(pid=14987): Terminated: ok {rc=0}
00:57:29.577795 bus /sierra_3: Setting Online False
00:57:31.069777 bus /sierra_3: Setting Powered False
00:57:36.923854 bus /sierra_3: Setting Powered False
00:57:38.043867 bus /sierra_3: Setting Powered False
00:57:39.224522 bus /sierra_2: Setting Online False
00:57:40.358203 bus /sierra_2: Setting Powered False
00:57:45.867683 bus /sierra_2: Setting Powered False
Standard Error
Traceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 673, in exec_module
File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/sysmocom/suites/handover_2G/handover.py", line 57, in <module>
wait(ms0.is_registered, msc.mcc_mnc())
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 581, in scan_cb_register
self.schedule_scan_register(mcc_mnc)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod_handover/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 524, in schedule_scan_register
raise log.Error('Failed to find Network Operator', mcc_mnc=mcc_mnc, attempts=self.register_attempts)
osmo_gsm_tester.core.log.Error: /sierra_2: Failed to find Network Operator {attempts=4, mcc_mnc=('901', '70')} [trial-159↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:57↪handover.py↪/sierra_2]