FailedConsole Output

Started by user Pau Espin Pedrol
Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_manual-run-all
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url git://git.osmocom.org/osmo-gsm-tester # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
Fetching upstream changes from git://git.osmocom.org/osmo-gsm-tester
 > git --version # timeout=10
 > git fetch --tags --progress git://git.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/*
 > git rev-parse pespin/nanobts^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/pespin/nanobts^{commit} # timeout=10
Checking out Revision d5b0f0470df67dce7f631157b91262c47f376506 (refs/remotes/origin/pespin/nanobts)
Commit message: "default-suites.conf: Add nanobts related tests"
 > git config core.sparsecheckout # timeout=10
 > git checkout -f d5b0f0470df67dce7f631157b91262c47f376506
 > git rev-list d5b0f0470df67dce7f631157b91262c47f376506 # timeout=10
Copied 26 artifacts from "osmo-gsm-tester_manual-build-all" build number 55
[osmo-gsm-tester_manual-run-all] $ /bin/sh /tmp/jenkins5973212708524619281.sh
+ export OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_manual-run-all/osmo-gsm-tester/example
+ unlink osmo-gsm-tester/example/resources.conf
unlink: cannot unlink 'osmo-gsm-tester/example/resources.conf': No such file or directory
+ true
+ ln -s resources.conf.prod osmo-gsm-tester/example/resources.conf
+ PATH=/home/jenkins/workspace/osmo-gsm-tester_manual-run-all/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh
+ base=/home/jenkins/workspace/osmo-gsm-tester_manual-run-all
+ date +%F %T
+ time_start=2018-03-15 15:04:53
+ trial_dir_prefix=trial-
+ rm -rf trial-672 trial-672-bin.tgz trial-672-run.tgz
+ trial_dir=trial-673
+ mkdir -p trial-673
+ mv osmo-bsc.build-55.tgz osmo-bts-sysmo.build-55.tgz osmo-bts.build-55.tgz osmo-ggsn.build-55.tgz osmo-hlr.build-55.tgz osmo-mgw.build-55.tgz osmo-msc.build-55.tgz osmo-nitb.build-55.tgz osmo-pcu-sysmo.build-55.tgz osmo-pcu.build-55.tgz osmo-sgsn.build-55.tgz osmo-stp.build-55.tgz osmo-trx.build-55.tgz trial-673
+ cat osmo-bsc.build-55.md5 osmo-bts-sysmo.build-55.md5 osmo-bts.build-55.md5 osmo-ggsn.build-55.md5 osmo-hlr.build-55.md5 osmo-mgw.build-55.md5 osmo-msc.build-55.md5 osmo-nitb.build-55.md5 osmo-pcu-sysmo.build-55.md5 osmo-pcu.build-55.md5 osmo-sgsn.build-55.md5 osmo-stp.build-55.md5 osmo-trx.build-55.md5
+ rm osmo-bsc.build-55.md5 osmo-bts-sysmo.build-55.md5 osmo-bts.build-55.md5 osmo-ggsn.build-55.md5 osmo-hlr.build-55.md5 osmo-mgw.build-55.md5 osmo-msc.build-55.md5 osmo-nitb.build-55.md5 osmo-pcu-sysmo.build-55.md5 osmo-pcu.build-55.md5 osmo-sgsn.build-55.md5 osmo-stp.build-55.md5 osmo-trx.build-55.md5
+ exit_code=1
+ which osmo-gsm-tester.py
+ python3 -u /home/jenkins/workspace/osmo-gsm-tester_manual-run-all/osmo-gsm-tester/src/osmo-gsm-tester.py trial-673 -s sms:nanobts -s aoip_sms:nanobts -s ussd:nanobts -s aoip_ussd:nanobts -s voice:nanobts -s gprs:nanobts
combinations: ['sms:nanobts', 'aoip_sms:nanobts', 'ussd:nanobts', 'aoip_ussd:nanobts', 'voice:nanobts', 'gprs:nanobts']
series: None
trial: 'trial-673'
tests: None

--------------------------------------------------------------------------------------------
trial-673
--------------------------------------------------------------------------------------------
15:04:55.011058 tst                        trial-673: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_manual-run-all/trial-673/run.2018-03-15_15-04-55/log

---------------------------------------------------------------------
trial-673 sms:nanobts
---------------------------------------------------------------------
15:04:57.015791 tst                      sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ...
15:04:57.048672 tst                      sms:nanobts: Reserving 1 x bts (candidates: 5)
15:04:57.075063 tst                      sms:nanobts: Reserving 1 x ip_address (candidates: 8)
15:04:57.083562 tst                      sms:nanobts: Reserving 2 x modem (candidates: 4)

----------------------------------------------
trial-673 sms:nanobts mo_mt_sms.py
----------------------------------------------
15:04:57.309417 tst                      sms:nanobts: Using 1 x ip_address (candidates: 1)
15:04:57.321486 tst                      sms:nanobts: Using 1 x bts (candidates: 1)
15:04:57.361953 tst                      sms:nanobts: using LAC 5314
15:04:57.377771 tst                      sms:nanobts: using RAC 214
15:04:57.392038 tst                      sms:nanobts: using CellId 5314
15:04:57.405752 tst                      sms:nanobts: using BVCI 5315
15:04:57.407358 tst                      sms:nanobts: Using 1 x modem (candidates: 2)
15:04:57.477072 tst                      sms:nanobts: Using 1 x modem (candidates: 2)
15:04:57.538123 tst                   mo_mt_sms.py:9: start nitb and bts...
15:04:57.658112 run             osmo-nitb_10.42.42.2: Starting osmo-nitb
15:04:59.941781 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4845): Launched
15:04:59.953922 run   osmo-nitb_10.42.42.2(pid=4846): Launched
15:05:01.190848 run pcap-recorder_enp2s0(filters='host 10.42.42.53 and port not 22')(pid=4852): Launched
15:05:01.192271 run              nanobts_10.42.42.53: Finding nanobts 10.42.42.53...
15:05:02.880196 run              abisip-find-preconf: Setting RPATH for abisip-find
15:05:02.892395 run               patchelf(pid=4853): Launched
15:05:03.897508 run               patchelf(pid=4853): Terminated: ok {rc=0}
15:05:03.899424 run              abisip-find-preconf: Applying CAP_NET_RAW capability to abisip-find
15:05:03.912537 run osmo-gsm-tester_setcap_net_raw.sh(pid=4854): Launched
15:05:04.917550 run osmo-gsm-tester_setcap_net_raw.sh(pid=4854): Terminated: ok {rc=0}
15:05:04.930981 run            abisip-find(pid=4857): Launched
15:07:12.196894 run              nanobts_10.42.42.53: Found nanobts 10.42.42.53 with unit_id 9
15:07:12.197997 run            abisip-find(pid=4857): Terminating (SIGINT)
15:07:12.368310 run            abisip-find(pid=4857): Terminated {rc=-2}
15:07:12.382979 run        ipaccess-config(pid=4859): Launched
15:07:13.388044 run        ipaccess-config(pid=4859): Terminated: ok {rc=0}
15:07:33.421308 run              nanobts_10.42.42.53: Starting to connect to osmo-nitb_10.42.42.2
15:07:33.424360 run             abisip-find-postconf: Setting RPATH for abisip-find
15:07:33.437757 run               patchelf(pid=4861): Launched
15:07:34.442857 run               patchelf(pid=4861): Terminated: ok {rc=0}
15:07:34.444210 run             abisip-find-postconf: Applying CAP_NET_RAW capability to abisip-find
15:07:34.457303 run osmo-gsm-tester_setcap_net_raw.sh(pid=4862): Launched
15:07:35.462272 run osmo-gsm-tester_setcap_net_raw.sh(pid=4862): Terminated: ok {rc=0}
15:07:35.475623 run            abisip-find(pid=4865): Launched
15:09:32.719619 run              nanobts_10.42.42.53: nanoBTS configured and running
15:09:32.720809 run            abisip-find(pid=4865): Terminating (SIGINT)
15:09:32.890928 run            abisip-find(pid=4865): Terminated {rc=-2}
15:09:49.031702 run              nanobts_10.42.42.53: nanoBTS connected to BSC
15:09:49.070835 bus                        /sierra_2: Setting Powered True
15:09:51.335641 run             osmo-nitb_10.42.42.2: Add subscriber {imsi='901700000015252', msisdn='9440'}
15:09:51.440363 bus                        /sierra_3: Setting Powered True
15:09:53.697941 run             osmo-nitb_10.42.42.2: Add subscriber {imsi='901700000015253', msisdn='9441'}
15:09:54.814518 bus                        /sierra_2: Setting Online False
15:09:54.828914 bus                        /sierra_2: Setting Powered False
15:09:55.302683 bus                        /sierra_2: Setting Powered True
15:09:55.476122 bus                        /sierra_2: Setting Online True
15:09:57.783740 tst                        /sierra_2: Connect to ('901', '70')
15:09:58.813642 bus                        /sierra_3: Setting Online False
15:09:58.827958 bus                        /sierra_3: Setting Powered False
15:09:59.303394 bus                        /sierra_3: Setting Powered True
15:09:59.508895 bus                        /sierra_3: Setting Online True
15:10:01.794465 tst                        /sierra_3: Connect to ('901', '70')
15:10:01.805410 tst                        /sierra_2: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054228053'
15:10:01.814628 tst                        /sierra_3: Manufacturer: 'Sierra Wireless, Incorporated', Model: 'MC7304', Revision: 'SWI9X15C_06.03.32.04 r28324 CNSHZ-AR-BUILD 2015/05/25 01:09:15', Serial: '356853054229028'
15:10:01.815551 tst                  mo_mt_sms.py:24: waiting for modems to attach...
15:10:31.185507 tst                        /sierra_2: Registering with operator /sierra_2/operator/90170 ('901', '70')
15:10:37.276156 tst                        /sierra_3: Registering with operator /sierra_3/operator/90170 ('901', '70')
15:10:42.391587 tst                        /sierra_2: sending sms to MSISDN 9441 {sms='message nr. 1, from /sierra_2, to /sierra_3, from 9440, to 9441'}
15:10:49.411234 tst                        /sierra_3: Incoming SMS: 'message nr. 1, from /sierra_2, to /sierra_3, from 9440, to 9441'
15:10:49.413037 tst                        /sierra_3: SMS received as expected: 'message nr. 1, from /sierra_2, to /sierra_3, from 9440, to 9441'
15:10:49.414399 tst                     mo_mt_sms.py: Test passed (352.1 sec)
15:10:49.461469 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4845): Terminating (SIGINT)
15:10:49.631897 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4845): Terminated: ok {rc=0}
15:10:49.632925 run   osmo-nitb_10.42.42.2(pid=4846): Terminating (SIGINT)
15:10:53.039541 run   osmo-nitb_10.42.42.2(pid=4846): Terminated: ok {rc=0}
15:10:53.040544 run pcap-recorder_enp2s0(filters='host 10.42.42.53 and port not 22')(pid=4852): Terminating (SIGINT)
15:10:53.211532 run pcap-recorder_enp2s0(filters='host 10.42.42.53 and port not 22')(pid=4852): Terminated: ok {rc=0}
15:10:53.228567 bus                        /sierra_3: Setting Online False
15:10:53.654602 bus                        /sierra_3: Setting Powered False
15:10:55.300997 bus                        /sierra_3: Setting Powered False
15:10:55.312451 bus                        /sierra_3: Setting Powered False
15:10:55.336079 bus                        /sierra_2: Setting Online False
15:10:55.413247 bus                        /sierra_2: Setting Powered False
15:10:56.480344 bus                        /sierra_2: Setting Powered False
---------------------------------------------------------------------
trial-673 sms:nanobts PASS
---------------------------------------------------------------------

---------------------------------------------------------------------
trial-673 aoip_sms:nanobts
---------------------------------------------------------------------
15:10:56.630521 tst                 aoip_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ...
15:10:56.645214 tst                 aoip_sms:nanobts: Reserving 1 x bts (candidates: 5)
15:10:56.669830 tst                 aoip_sms:nanobts: Reserving 6 x ip_address (candidates: 8)
15:10:56.702216 tst                 aoip_sms:nanobts: Reserving 2 x modem (candidates: 4)

----------------------------------------------
trial-673 aoip_sms:nanobts mo_mt_sms.py
----------------------------------------------
15:10:56.879628 tst                 aoip_sms:nanobts: Using 1 x ip_address (candidates: 6)
15:10:56.891867 tst                 aoip_sms:nanobts: Using 1 x bts (candidates: 1)
15:10:56.931544 tst                 aoip_sms:nanobts: using LAC 5315
15:10:56.946653 tst                 aoip_sms:nanobts: using RAC 215
15:10:56.961120 tst                 aoip_sms:nanobts: using CellId 5315
15:10:56.975725 tst                 aoip_sms:nanobts: using BVCI 5316
15:10:56.977458 tst                 aoip_sms:nanobts: Using 1 x ip_address (candidates: 6)
15:10:56.991810 tst                 aoip_sms:nanobts: Using 1 x ip_address (candidates: 6)
15:10:57.004028 tst                 aoip_sms:nanobts: Using 1 x ip_address (candidates: 6)
15:10:57.016389 tst                 aoip_sms:nanobts: Using 1 x ip_address (candidates: 6)
15:10:57.028779 tst                 aoip_sms:nanobts: Using 1 x ip_address (candidates: 6)
15:10:57.041127 tst                 aoip_sms:nanobts: Using 1 x modem (candidates: 2)
15:10:57.105734 tst                 aoip_sms:nanobts: Using 1 x modem (candidates: 2)
15:10:57.167446 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
15:10:57.742998 run          create_hlr_db(pid=4867): Launched
15:10:57.745578 bus                        /sierra_2: Setting Powered False
15:10:58.759830 run          create_hlr_db(pid=4867): Terminated: ok {rc=0}
15:10:58.774098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4869): Launched
15:10:58.788951 run    osmo-hlr_10.42.42.2(pid=4870): Launched
15:10:58.790087 run              osmo-stp_10.42.42.5: Starting osmo-stp
15:11:00.321262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4871): Launched
15:11:00.335136 run    osmo-stp_10.42.42.5(pid=4872): Launched
15:11:00.337163 run              osmo-msc_10.42.42.6: Starting osmo-msc
15:11:02.194459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4873): Launched
15:11:02.208093 run    osmo-msc_10.42.42.6(pid=4874): Launched
15:11:02.209915 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
15:11:02.899587 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=4875): Launched
15:11:02.913835 run    osmo-mgw_10.42.42.3(pid=4876): Launched
15:11:02.915783 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
15:11:03.048965 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=4877): Launched
15:11:03.063207 run    osmo-mgw_10.42.42.4(pid=4878): Launched
15:11:03.065024 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
15:11:03.479881 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=4879): Launched
15:11:03.494472 run    osmo-bsc_10.42.42.7(pid=4880): Launched
15:11:03.659178 tst                  mo_mt_sms.py:23: ERR: USBError: [Errno 16] Resource busy  [trial-673↪aoip_sms:nanobts↪mo_mt_sms.py:23]
15:11:03.665885 tst                  mo_mt_sms.py:23: Test FAILED (6.8 sec)
15:11:03.670950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4869): Terminating (SIGINT)
15:11:03.841111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4869): Terminated: ok {rc=0}
15:11:03.842053 run    osmo-hlr_10.42.42.2(pid=4870): Terminating (SIGINT)
15:11:04.011961 run    osmo-hlr_10.42.42.2(pid=4870): Terminated: ok {rc=0}
15:11:04.012963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4871): Terminating (SIGINT)
15:11:04.182945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4871): Terminated: ok {rc=0}
15:11:04.183955 run    osmo-stp_10.42.42.5(pid=4872): Terminating (SIGINT)
15:11:04.354303 run    osmo-stp_10.42.42.5(pid=4872): Terminated: ok {rc=0}
15:11:04.355245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4873): Terminating (SIGINT)
15:11:04.525938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4873): Terminated: ok {rc=0}
15:11:04.526942 run    osmo-msc_10.42.42.6(pid=4874): Terminating (SIGINT)
15:11:07.934156 run    osmo-msc_10.42.42.6(pid=4874): Terminated: ok {rc=0}
15:11:07.935098 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=4875): Terminating (SIGINT)
15:11:08.105827 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=4875): Terminated: ok {rc=0}
15:11:08.106783 run    osmo-mgw_10.42.42.3(pid=4876): Terminating (SIGINT)
15:11:08.277861 run    osmo-mgw_10.42.42.3(pid=4876): Terminated {rc=-2}
15:11:08.278872 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=4877): Terminating (SIGINT)
15:11:08.449101 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=4877): Terminated: ok {rc=0}
15:11:08.450135 run    osmo-mgw_10.42.42.4(pid=4878): Terminating (SIGINT)
15:11:08.453393 run    osmo-mgw_10.42.42.4(pid=4878): Terminated {rc=-2}
15:11:08.454364 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=4879): Terminating (SIGINT)
15:11:08.624641 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=4879): Terminated: ok {rc=0}
15:11:08.625688 run    osmo-bsc_10.42.42.7(pid=4880): Terminating (SIGINT)
15:11:12.032960 run    osmo-bsc_10.42.42.7(pid=4880): Terminated: ok {rc=0}
15:11:12.042333 bus                        /sierra_3: Setting Powered False
15:11:12.055095 bus                        /sierra_3: Setting Powered False
15:11:12.072525 bus                        /sierra_2: Setting Powered False
---------------------------------------------------------------------
trial-673 aoip_sms:nanobts FAIL
---------------------------------------------------------------------

---------------------------------------------------------------------
trial-673 ussd:nanobts
---------------------------------------------------------------------
15:11:12.313399 tst                     ussd:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ...
15:11:12.328529 tst                     ussd:nanobts: Reserving 1 x bts (candidates: 5)
15:11:12.354081 tst                     ussd:nanobts: Reserving 1 x ip_address (candidates: 8)
15:11:12.362484 tst                     ussd:nanobts: Reserving 1 x modem (candidates: 4)

----------------------------------------------
trial-673 ussd:nanobts assert_extension.py
----------------------------------------------
15:11:12.464659 tst                     ussd:nanobts: Using 1 x ip_address (candidates: 1)
15:11:12.476726 tst                     ussd:nanobts: Using 1 x bts (candidates: 1)
15:11:12.518994 tst                     ussd:nanobts: using LAC 5316
15:11:12.532712 tst                     ussd:nanobts: using RAC 216
15:11:12.545987 tst                     ussd:nanobts: using CellId 5316
15:11:12.559889 tst                     ussd:nanobts: using BVCI 5317
15:11:12.561519 tst                     ussd:nanobts: Using 1 x modem (candidates: 1)
15:11:12.624448 tst           assert_extension.py:10: start nitb and bts...
15:11:12.741075 run             osmo-nitb_10.42.42.2: Starting osmo-nitb
15:11:13.100846 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4881): Launched
15:11:13.113246 run   osmo-nitb_10.42.42.2(pid=4882): Launched
15:11:13.282805 tst           assert_extension.py:13: ERR: USBError: [Errno 16] Resource busy  [trial-673↪ussd:nanobts↪assert_extension.py:13]
15:11:13.291568 tst           assert_extension.py:13: Test FAILED (0.8 sec)
15:11:13.298090 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4881): Terminating (SIGINT)
15:11:13.468642 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4881): Terminated: ok {rc=0}
15:11:13.469527 run   osmo-nitb_10.42.42.2(pid=4882): Terminating (SIGINT)
15:11:16.876944 run   osmo-nitb_10.42.42.2(pid=4882): Terminated: ok {rc=0}
15:11:16.878757 bus                        /sierra_2: Setting Powered False
15:11:16.898370 bus                        /sierra_2: Setting Powered False
---------------------------------------------------------------------
trial-673 ussd:nanobts FAIL
---------------------------------------------------------------------

---------------------------------------------------------------------
trial-673 aoip_ussd:nanobts
---------------------------------------------------------------------
15:11:17.014986 tst                aoip_ussd:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ...
15:11:17.031517 tst                aoip_ussd:nanobts: Reserving 1 x bts (candidates: 5)
15:11:17.057056 tst                aoip_ussd:nanobts: Reserving 6 x ip_address (candidates: 8)
15:11:17.090868 tst                aoip_ussd:nanobts: Reserving 1 x modem (candidates: 4)

----------------------------------------------
trial-673 aoip_ussd:nanobts assert_extension.py
----------------------------------------------
15:11:17.228179 tst                aoip_ussd:nanobts: Using 1 x ip_address (candidates: 6)
15:11:17.240466 tst                aoip_ussd:nanobts: Using 1 x bts (candidates: 1)
15:11:17.282713 tst                aoip_ussd:nanobts: using LAC 5317
15:11:17.296775 tst                aoip_ussd:nanobts: using RAC 217
15:11:17.310249 tst                aoip_ussd:nanobts: using CellId 5317
15:11:17.323251 tst                aoip_ussd:nanobts: using BVCI 5318
15:11:17.324805 tst                aoip_ussd:nanobts: Using 1 x ip_address (candidates: 6)
15:11:17.337039 tst                aoip_ussd:nanobts: Using 1 x ip_address (candidates: 6)
15:11:17.348442 tst                aoip_ussd:nanobts: Using 1 x ip_address (candidates: 6)
15:11:17.359809 tst                aoip_ussd:nanobts: Using 1 x ip_address (candidates: 6)
15:11:17.371258 tst                aoip_ussd:nanobts: Using 1 x ip_address (candidates: 6)
15:11:17.382616 tst                aoip_ussd:nanobts: Using 1 x modem (candidates: 1)
15:11:17.444302 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
15:11:17.578718 run          create_hlr_db(pid=4883): Launched
15:11:17.581125 bus                        /sierra_2: Setting Powered False
15:11:18.595493 run          create_hlr_db(pid=4883): Terminated: ok {rc=0}
15:11:18.610059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4885): Launched
15:11:18.623596 run    osmo-hlr_10.42.42.2(pid=4886): Launched
15:11:18.625374 run              osmo-stp_10.42.42.5: Starting osmo-stp
15:11:18.755670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4887): Launched
15:11:18.770128 run    osmo-stp_10.42.42.5(pid=4888): Launched
15:11:18.771817 run              osmo-msc_10.42.42.6: Starting osmo-msc
15:11:18.907259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4889): Launched
15:11:18.921586 run    osmo-msc_10.42.42.6(pid=4890): Launched
15:11:18.923622 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
15:11:19.057158 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=4891): Launched
15:11:19.075908 run    osmo-mgw_10.42.42.3(pid=4892): Launched
15:11:19.077401 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
15:11:19.212456 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=4893): Launched
15:11:19.226583 run    osmo-mgw_10.42.42.4(pid=4894): Launched
15:11:19.227747 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
15:11:19.589744 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=4895): Launched
15:11:19.604066 run    osmo-bsc_10.42.42.7(pid=4896): Launched
15:11:19.763018 tst           assert_extension.py:24: ERR: USBError: [Errno 16] Resource busy  [trial-673↪aoip_ussd:nanobts↪assert_extension.py:24]
15:11:19.770353 tst           assert_extension.py:24: Test FAILED (2.5 sec)
15:11:19.775822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4885): Terminating (SIGINT)
15:11:19.946580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4885): Terminated: ok {rc=0}
15:11:19.947615 run    osmo-hlr_10.42.42.2(pid=4886): Terminating (SIGINT)
15:11:19.952826 run    osmo-hlr_10.42.42.2(pid=4886): Terminated: ok {rc=0}
15:11:19.953813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4887): Terminating (SIGINT)
15:11:20.123944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4887): Terminated: ok {rc=0}
15:11:20.125787 run    osmo-stp_10.42.42.5(pid=4888): Terminating (SIGINT)
15:11:20.295779 run    osmo-stp_10.42.42.5(pid=4888): Terminated: ok {rc=0}
15:11:20.296902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4889): Terminating (SIGINT)
15:11:20.467096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4889): Terminated: ok {rc=0}
15:11:20.468220 run    osmo-msc_10.42.42.6(pid=4890): Terminating (SIGINT)
15:11:23.875660 run    osmo-msc_10.42.42.6(pid=4890): Terminated: ok {rc=0}
15:11:23.876769 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=4891): Terminating (SIGINT)
15:11:24.047240 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=4891): Terminated: ok {rc=0}
15:11:24.048473 run    osmo-mgw_10.42.42.3(pid=4892): Terminating (SIGINT)
15:11:24.051670 run    osmo-mgw_10.42.42.3(pid=4892): Terminated {rc=-2}
15:11:24.052785 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=4893): Terminating (SIGINT)
15:11:24.222915 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=4893): Terminated: ok {rc=0}
15:11:24.237638 run    osmo-mgw_10.42.42.4(pid=4894): Terminating (SIGINT)
15:11:24.241129 run    osmo-mgw_10.42.42.4(pid=4894): Terminated {rc=-2}
15:11:24.242629 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=4895): Terminating (SIGINT)
15:11:24.412932 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=4895): Terminated: ok {rc=0}
15:11:24.413998 run    osmo-bsc_10.42.42.7(pid=4896): Terminating (SIGINT)
15:11:27.821714 run    osmo-bsc_10.42.42.7(pid=4896): Terminated: ok {rc=0}
15:11:27.830754 bus                        /sierra_2: Setting Powered False
---------------------------------------------------------------------
trial-673 aoip_ussd:nanobts FAIL
---------------------------------------------------------------------

---------------------------------------------------------------------
trial-673 voice:nanobts
---------------------------------------------------------------------
15:11:27.985952 tst                    voice:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ...
15:11:28.001048 tst                    voice:nanobts: Reserving 1 x bts (candidates: 5)
15:11:28.026267 tst                    voice:nanobts: Reserving 6 x ip_address (candidates: 8)
15:11:28.059906 tst                    voice:nanobts: Reserving 2 x modem (candidates: 4)

----------------------------------------------
trial-673 voice:nanobts mo_mt_call.py
----------------------------------------------
15:11:28.244156 tst                    voice:nanobts: Using 1 x ip_address (candidates: 6)
15:11:28.256675 tst                    voice:nanobts: Using 1 x bts (candidates: 1)
15:11:28.298387 tst                    voice:nanobts: using LAC 5318
15:11:28.312072 tst                    voice:nanobts: using RAC 218
15:11:28.326252 tst                    voice:nanobts: using CellId 5318
15:11:28.340475 tst                    voice:nanobts: using BVCI 5319
15:11:28.342051 tst                    voice:nanobts: Using 1 x ip_address (candidates: 6)
15:11:28.354593 tst                    voice:nanobts: Using 1 x ip_address (candidates: 6)
15:11:28.367087 tst                    voice:nanobts: Using 1 x ip_address (candidates: 6)
15:11:28.379119 tst                    voice:nanobts: Using 1 x ip_address (candidates: 6)
15:11:28.391182 tst                    voice:nanobts: Using 1 x ip_address (candidates: 6)
15:11:28.403272 tst                    voice:nanobts: Using 1 x modem (candidates: 2)
15:11:28.466731 tst                    voice:nanobts: Using 1 x modem (candidates: 2)
15:11:28.529245 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
15:11:28.663000 run          create_hlr_db(pid=4897): Launched
15:11:28.665504 bus                        /sierra_2: Setting Powered False
15:11:29.679638 run          create_hlr_db(pid=4897): Terminated: ok {rc=0}
15:11:29.694425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4899): Launched
15:11:29.708887 run    osmo-hlr_10.42.42.2(pid=4900): Launched
15:11:29.710684 run              osmo-stp_10.42.42.5: Starting osmo-stp
15:11:29.846573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4901): Launched
15:11:29.859674 run    osmo-stp_10.42.42.5(pid=4902): Launched
15:11:29.861447 run              osmo-msc_10.42.42.6: Starting osmo-msc
15:11:29.995417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4903): Launched
15:11:30.008626 run    osmo-msc_10.42.42.6(pid=4904): Launched
15:11:30.009756 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
15:11:30.171321 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=4905): Launched
15:11:30.184854 run    osmo-mgw_10.42.42.3(pid=4906): Launched
15:11:30.186056 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
15:11:30.324374 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=4907): Launched
15:11:30.338613 run    osmo-mgw_10.42.42.4(pid=4908): Launched
15:11:30.339864 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
15:11:30.726117 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=4909): Launched
15:11:30.761762 run    osmo-bsc_10.42.42.7(pid=4910): Launched
15:11:30.922048 tst                 mo_mt_call.py:23: ERR: USBError: [Errno 16] Resource busy  [trial-673↪voice:nanobts↪mo_mt_call.py:23]
15:11:30.929195 tst                 mo_mt_call.py:23: Test FAILED (2.7 sec)
15:11:30.934749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4899): Terminating (SIGINT)
15:11:31.105054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4899): Terminated: ok {rc=0}
15:11:31.106079 run    osmo-hlr_10.42.42.2(pid=4900): Terminating (SIGINT)
15:11:31.276315 run    osmo-hlr_10.42.42.2(pid=4900): Terminated: ok {rc=0}
15:11:31.277348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4901): Terminating (SIGINT)
15:11:31.447441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4901): Terminated: ok {rc=0}
15:11:31.448589 run    osmo-stp_10.42.42.5(pid=4902): Terminating (SIGINT)
15:11:31.618644 run    osmo-stp_10.42.42.5(pid=4902): Terminated: ok {rc=0}
15:11:31.619656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4903): Terminating (SIGINT)
15:11:31.790480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4903): Terminated: ok {rc=0}
15:11:31.791516 run    osmo-msc_10.42.42.6(pid=4904): Terminating (SIGINT)
15:11:35.199514 run    osmo-msc_10.42.42.6(pid=4904): Terminated: ok {rc=0}
15:11:35.200541 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=4905): Terminating (SIGINT)
15:11:35.371825 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=4905): Terminated: ok {rc=0}
15:11:35.373114 run    osmo-mgw_10.42.42.3(pid=4906): Terminating (SIGINT)
15:11:35.376375 run    osmo-mgw_10.42.42.3(pid=4906): Terminated {rc=-2}
15:11:35.377391 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=4907): Terminating (SIGINT)
15:11:35.548163 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=4907): Terminated: ok {rc=0}
15:11:35.549317 run    osmo-mgw_10.42.42.4(pid=4908): Terminating (SIGINT)
15:11:35.719419 run    osmo-mgw_10.42.42.4(pid=4908): Terminated {rc=-2}
15:11:35.892455 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=4909): Terminating (SIGINT)
15:11:36.063293 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=4909): Terminated: ok {rc=0}
15:11:36.064444 run    osmo-bsc_10.42.42.7(pid=4910): Terminating (SIGINT)
15:11:39.471983 run    osmo-bsc_10.42.42.7(pid=4910): Terminated: ok {rc=0}
15:11:39.481546 bus                        /sierra_3: Setting Powered False
15:11:39.493009 bus                        /sierra_3: Setting Powered False
15:11:39.511990 bus                        /sierra_2: Setting Powered False
---------------------------------------------------------------------
trial-673 voice:nanobts FAIL
---------------------------------------------------------------------

---------------------------------------------------------------------
trial-673 gprs:nanobts
---------------------------------------------------------------------
15:11:39.688991 tst                     gprs:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ...
15:11:39.705343 tst                     gprs:nanobts: Reserving 1 x bts (candidates: 5)
15:11:39.732841 tst                     gprs:nanobts: Reserving 8 x ip_address (candidates: 8)
15:11:39.776159 tst                     gprs:nanobts: Reserving 1 x modem (candidates: 4)

----------------------------------------------
trial-673 gprs:nanobts ping.py
----------------------------------------------
15:11:39.928047 tst                     gprs:nanobts: Using 1 x ip_address (candidates: 8)
15:11:39.940137 tst                     gprs:nanobts: Using 1 x bts (candidates: 1)
15:11:39.982312 tst                     gprs:nanobts: using LAC 5319
15:11:39.995545 tst                     gprs:nanobts: using RAC 219
15:11:40.008967 tst                     gprs:nanobts: using CellId 5319
15:11:40.023832 tst                     gprs:nanobts: using BVCI 5320
15:11:40.025603 tst                     gprs:nanobts: Using 1 x ip_address (candidates: 8)
15:11:40.037620 tst                     gprs:nanobts: Using 1 x ip_address (candidates: 8)
15:11:40.049061 tst                     gprs:nanobts: Using 1 x ip_address (candidates: 8)
15:11:40.060855 tst                     gprs:nanobts: Using 1 x ip_address (candidates: 8)
15:11:40.072095 tst                     gprs:nanobts: Using 1 x ip_address (candidates: 8)
15:11:40.083405 tst                     gprs:nanobts: Using 1 x ip_address (candidates: 8)
15:11:40.094849 tst                     gprs:nanobts: Using 1 x ip_address (candidates: 8)
15:11:40.106441 tst                     gprs:nanobts: Using 1 x modem (candidates: 1)
15:11:40.168960 tst                       ping.py:19: start network...
15:11:40.292407 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
15:11:40.429360 run          create_hlr_db(pid=4911): Launched
15:11:40.431781 bus                        /sierra_2: Setting Powered False
15:11:41.446492 run          create_hlr_db(pid=4911): Terminated: ok {rc=0}
15:11:41.460986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4913): Launched
15:11:41.474131 run    osmo-hlr_10.42.42.2(pid=4914): Launched
15:11:41.475929 run              osmo-stp_10.42.42.5: Starting osmo-stp
15:11:41.611955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4915): Launched
15:11:41.626217 run    osmo-stp_10.42.42.5(pid=4916): Launched
15:11:41.628385 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
15:11:42.177258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4917): Launched
15:11:42.179335 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
15:11:42.192175 run               patchelf(pid=4918): Launched
15:11:43.197346 run               patchelf(pid=4918): Terminated: ok {rc=0}
15:11:43.198630 run             osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn
15:11:43.212109 run osmo-gsm-tester_setcap_net_admin.sh(pid=4919): Launched
15:11:44.217617 run osmo-gsm-tester_setcap_net_admin.sh(pid=4919): Terminated: ok {rc=0}
15:11:44.230992 run   osmo-ggsn_10.42.42.6(pid=4922): Launched
15:11:44.233091 run             osmo-sgsn_10.42.42.7: Starting osmo-sgsn
15:11:46.018724 run pcap-recorder_any(filters='host 10.42.42.7')(pid=5089): Launched
15:11:46.031124 run   osmo-sgsn_10.42.42.7(pid=5090): Launched
15:11:46.032937 run              osmo-msc_10.42.42.8: Starting osmo-msc
15:11:46.166430 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=5091): Launched
15:11:46.180761 run    osmo-msc_10.42.42.8(pid=5092): Launched
15:11:46.182543 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
15:11:46.321596 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5093): Launched
15:11:46.335868 run    osmo-mgw_10.42.42.3(pid=5094): Launched
15:11:46.337968 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
15:11:46.483924 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5095): Launched
15:11:46.498745 run    osmo-mgw_10.42.42.4(pid=5096): Launched
15:11:46.500936 run              osmo-bsc_10.42.42.9: Starting osmo-bsc
15:11:46.875920 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=5097): Launched
15:11:46.889836 run    osmo-bsc_10.42.42.9(pid=5098): Launched
15:11:47.043200 tst                       ping.py:29: ERR: USBError: [Errno 16] Resource busy  [trial-673↪gprs:nanobts↪ping.py:29]
15:11:47.049995 tst                       ping.py:29: Test FAILED (7.1 sec)
15:11:47.057731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4913): Terminating (SIGINT)
15:11:47.228357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4913): Terminated: ok {rc=0}
15:11:47.229457 run    osmo-hlr_10.42.42.2(pid=4914): Terminating (SIGINT)
15:11:47.399513 run    osmo-hlr_10.42.42.2(pid=4914): Terminated: ok {rc=0}
15:11:47.400634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4915): Terminating (SIGINT)
15:11:47.570890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4915): Terminated: ok {rc=0}
15:11:47.571950 run    osmo-stp_10.42.42.5(pid=4916): Terminating (SIGINT)
15:11:47.577710 run    osmo-stp_10.42.42.5(pid=4916): Terminated: ok {rc=0}
15:11:47.578676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4917): Terminating (SIGINT)
15:11:47.749407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4917): Terminated: ok {rc=0}
15:11:47.750394 run   osmo-ggsn_10.42.42.6(pid=4922): Terminating (SIGINT)
15:11:47.920832 run   osmo-ggsn_10.42.42.6(pid=4922): Terminated {rc=1}
15:11:47.921817 run pcap-recorder_any(filters='host 10.42.42.7')(pid=5089): Terminating (SIGINT)
15:11:48.091966 run pcap-recorder_any(filters='host 10.42.42.7')(pid=5089): Terminated: ok {rc=0}
15:11:48.093373 run   osmo-sgsn_10.42.42.7(pid=5090): Terminating (SIGINT)
15:11:49.512487 run   osmo-sgsn_10.42.42.7(pid=5090): Terminated: ok {rc=0}
15:11:49.513447 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=5091): Terminating (SIGINT)
15:11:49.684152 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=5091): Terminated: ok {rc=0}
15:11:49.685364 run    osmo-msc_10.42.42.8(pid=5092): Terminating (SIGINT)
15:11:53.092870 run    osmo-msc_10.42.42.8(pid=5092): Terminated: ok {rc=0}
15:11:53.093836 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5093): Terminating (SIGINT)
15:11:53.263972 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5093): Terminated: ok {rc=0}
15:11:53.265391 run    osmo-mgw_10.42.42.3(pid=5094): Terminating (SIGINT)
15:11:53.268778 run    osmo-mgw_10.42.42.3(pid=5094): Terminated {rc=-2}
15:11:53.269775 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5095): Terminating (SIGINT)
15:11:53.439892 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5095): Terminated: ok {rc=0}
15:11:53.440990 run    osmo-mgw_10.42.42.4(pid=5096): Terminating (SIGINT)
15:11:53.611066 run    osmo-mgw_10.42.42.4(pid=5096): Terminated {rc=-2}
15:11:53.612012 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=5097): Terminating (SIGINT)
15:11:53.782317 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=5097): Terminated: ok {rc=0}
15:11:53.783323 run    osmo-bsc_10.42.42.9(pid=5098): Terminating (SIGINT)
15:11:57.191062 run    osmo-bsc_10.42.42.9(pid=5098): Terminated: ok {rc=0}
15:11:57.200612 bus                        /sierra_2: Setting Powered False
---------------------------------------------------------------------
trial-673 gprs:nanobts FAIL
---------------------------------------------------------------------
15:11:57.381192 tst                        trial-673: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_manual-run-all/trial-673/run.2018-03-15_15-04-55/trial-673.xml

--------------------------------------------------------------------------------------------
trial-673 FAIL
--------------------------------------------------------------------------------------------
15:11:57.453983 tst                        trial-673: trial-673: FAIL, 5 suites failed, 1 suites passed
FAIL: aoip_sms:nanobts (fail: 1)
    FAIL: mo_mt_sms.py (6.8 sec) USBError: [Errno 16] Resource busy
FAIL: ussd:nanobts (fail: 1)
    FAIL: assert_extension.py (0.8 sec) USBError: [Errno 16] Resource busy
FAIL: aoip_ussd:nanobts (fail: 1)
    FAIL: assert_extension.py (2.5 sec) USBError: [Errno 16] Resource busy
FAIL: voice:nanobts (fail: 1)
    FAIL: mo_mt_call.py (2.7 sec) USBError: [Errno 16] Resource busy
FAIL: gprs:nanobts (fail: 1)
    FAIL: ping.py (7.1 sec) USBError: [Errno 16] Resource busy
+ rm -rf trial-673/inst
+ cd trial-673
+ readlink last_run
+ journalctl -u ofono -o short-precise --since 2018-03-15 15:04:53
+ readlink last_run
+ tar czf /home/jenkins/workspace/osmo-gsm-tester_manual-run-all/trial-673-run.tgz run.2018-03-15_15-04-55
+ tar czf /home/jenkins/workspace/osmo-gsm-tester_manual-run-all/trial-673-bin.tgz checksums.md5 osmo-bsc.build-55.tgz osmo-bts-sysmo.build-55.tgz osmo-bts.build-55.tgz osmo-ggsn.build-55.tgz osmo-hlr.build-55.tgz osmo-mgw.build-55.tgz osmo-msc.build-55.tgz osmo-nitb.build-55.tgz osmo-pcu-sysmo.build-55.tgz osmo-pcu.build-55.tgz osmo-sgsn.build-55.tgz osmo-stp.build-55.tgz osmo-trx.build-55.tgz
+ exit 1
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
Finished: FAILURE