![[Jenkins]](/jenkins/static/342c126a/images/svgs/logo.svg){kind=logo}
Started by user Pau Espin Pedrol Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_manual-run No credentials specified > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git fetch --tags --progress https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* > git rev-parse refs/remotes/origin/pespin/tmp^{commit} # timeout=10 > git rev-parse refs/remotes/origin/refs/heads/pespin/tmp^{commit} # timeout=10 Checking out Revision 1cef89f2e04e6b2f15fcdc6d59ef0241edb4f53f (refs/remotes/origin/pespin/tmp) > git config core.sparsecheckout # timeout=10 > git checkout -f 1cef89f2e04e6b2f15fcdc6d59ef0241edb4f53f Commit message: "pcu_{sysmo,oc2g}: Inherit from pcu abstract class" > git rev-list --no-walk 3fdc7168cff8bbccd09c773ad26a0c6b9d765990 # timeout=10 First time build. Skipping changelog. Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 6699 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 1690 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 4054 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 4069 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 2424 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 2386 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 3995 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 14834 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 8837 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 4084 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 4456 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 14154 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 3035 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 1967 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 1561 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 1148 [osmo-gsm-tester_manual-run] $ /bin/sh /tmp/jenkins7335937860108373296.sh + export OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/example + unlink osmo-gsm-tester/example/resources.conf unlink: cannot unlink 'osmo-gsm-tester/example/resources.conf': No such file or directory + true + ln -s resources.conf.prod osmo-gsm-tester/example/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_manual-run + date +%F %T + time_start=2020-04-10 01:56:00 + trial_dir_prefix=trial- + rm -rf trial-269 trial-269-bin.tgz trial-269-run.tgz + trial_dir=trial-270 + mkdir -p trial-270 + mv osmo-bsc.build-8837.tgz osmo-bts-oc2g.build-1561.tgz osmo-bts-sysmo.build-4069.tgz osmo-bts.build-4054.tgz osmo-ggsn.build-3035.tgz osmo-hlr.build-3995.tgz osmo-mgw.build-4084.tgz osmo-msc.build-14834.tgz osmo-nitb.build-6699.tgz osmo-pcu-oc2g.build-1148.tgz osmo-pcu-sysmo.build-2424.tgz osmo-pcu.build-2386.tgz osmo-sgsn.build-14154.tgz osmo-stp.build-4456.tgz osmo-trx.build-1690.tgz osmocom-bb.build-1967.tgz trial-270 + cat osmo-bsc.build-8837.md5 osmo-bts-oc2g.build-1561.md5 osmo-bts-sysmo.build-4069.md5 osmo-bts.build-4054.md5 osmo-ggsn.build-3035.md5 osmo-hlr.build-3995.md5 osmo-mgw.build-4084.md5 osmo-msc.build-14834.md5 osmo-nitb.build-6699.md5 osmo-pcu-oc2g.build-1148.md5 osmo-pcu-sysmo.build-2424.md5 osmo-pcu.build-2386.md5 osmo-sgsn.build-14154.md5 osmo-stp.build-4456.md5 osmo-trx.build-1690.md5 osmocom-bb.build-1967.md5 + rm osmo-bsc.build-8837.md5 osmo-bts-oc2g.build-1561.md5 osmo-bts-sysmo.build-4069.md5 osmo-bts.build-4054.md5 osmo-ggsn.build-3035.md5 osmo-hlr.build-3995.md5 osmo-mgw.build-4084.md5 osmo-msc.build-14834.md5 osmo-nitb.build-6699.md5 osmo-pcu-oc2g.build-1148.md5 osmo-pcu-sysmo.build-2424.md5 osmo-pcu.build-2386.md5 osmo-sgsn.build-14154.md5 osmo-stp.build-4456.md5 osmo-trx.build-1690.md5 osmocom-bb.build-1967.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/src/osmo-gsm-tester.py trial-270 -s gprs:trx-b200 -s gprs:sysmo -s gprs:oc2g -T -t =ping.py combinations: ['gprs:trx-b200', 'gprs:sysmo', 'gprs:oc2g'] series: None trial: 'trial-270' tests: ['=ping.py'] ['ping.py'] -------------------------------------------------------------------------------------------- trial-270 -------------------------------------------------------------------------------------------- 01:56:02.622675 tst trial-270: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_manual-run/trial-270/run.2020-04-10_01-56-02/log --------------------------------------------------------------------- trial-270 gprs:trx-b200 --------------------------------------------------------------------- 01:56:05.617595 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:56:05.653428 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 01:56:05.690943 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 01:56:05.741541 tst gprs:trx-b200: Reserving 4 x modem (candidates: 10) ---------------------------------------------- trial-270 gprs:trx-b200 ping.py ---------------------------------------------- 01:56:06.218085 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:56:06.231775 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 01:56:07.602084 tst gprs:trx-b200: using LAC 6012 01:56:07.622070 tst gprs:trx-b200: using RAC 147 01:56:07.641766 tst gprs:trx-b200: using CellId 6012 01:56:07.661635 tst gprs:trx-b200: using BVCI 6013 01:56:07.664594 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:56:07.679836 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:56:07.693835 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:56:07.707726 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:56:07.721337 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:56:07.735106 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:56:07.748611 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 01:56:07.762499 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 01:56:07.852476 tst ping.py:19: start network... 01:56:08.069046 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:56:09.494850 run create_hlr_db(pid=8200): Launched 01:56:10.501205 run create_hlr_db(pid=8200): Terminated: ok {rc=0} 01:56:10.522230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8202): Launched 01:56:10.540510 run osmo-hlr_10.42.42.2(pid=8203): Launched 01:56:10.542941 run osmo-stp_10.42.42.5: Starting osmo-stp 01:56:12.998333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8204): Launched 01:56:13.017302 run osmo-stp_10.42.42.5(pid=8205): Launched 01:56:13.019592 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:56:14.348548 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8206): Launched 01:56:14.350086 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:56:14.375736 run patchelf(pid=8207): Launched 01:56:15.381093 run patchelf(pid=8207): Terminated: ok {rc=0} 01:56:15.383213 run osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn 01:56:15.405279 run osmo-gsm-tester_setcap_net_admin.sh(pid=8208): Launched 01:56:16.412763 run osmo-gsm-tester_setcap_net_admin.sh(pid=8208): Terminated: ok {rc=0} 01:56:16.429846 run osmo-ggsn_10.42.42.6(pid=8211): Launched 01:56:16.432640 run osmo-sgsn_10.42.42.7: Starting osmo-sgsn 01:56:20.710736 run pcap-recorder_any(filters='host 10.42.42.7')(pid=8440): Launched 01:56:20.728345 run osmo-sgsn_10.42.42.7(pid=8441): Launched 01:56:20.731079 run osmo-msc_10.42.42.8: Starting osmo-msc 01:56:25.498821 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=8445): Launched 01:56:25.516093 run osmo-msc_10.42.42.8(pid=8446): Launched 01:56:25.518363 run osmo-mgw_10.42.42.3: Starting osmo-mgw 01:56:27.047777 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=8447): Launched 01:56:27.065124 run osmo-mgw_10.42.42.3(pid=8448): Launched 01:56:27.067469 run osmo-mgw_10.42.42.4: Starting osmo-mgw 01:56:27.407871 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8449): Launched 01:56:27.440954 run osmo-mgw_10.42.42.4(pid=8450): Launched 01:56:27.442533 run osmo-bsc_10.42.42.9: Starting osmo-bsc 01:56:31.393570 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=8451): Launched 01:56:31.413160 run osmo-bsc_10.42.42.9(pid=8452): Launched 01:56:31.415988 run osmo-bts-trx: Starting to connect to osmo-bsc_10.42.42.9 01:56:32.758391 run osmo-trx-uhd: OSMOTRX CONF: {'osmo_trx': {'trx_ip': '10.42.42.116', 'channels': [{}], 'launch_trx': 'True', 'egprs': 'disable', 'dev_args': 'type=b200,serial=306BD11', 'remote_user': 'jenkins', 'bts_ip': '10.42.42.50', 'clock_reference': 'external', 'multi_arfcn': 'True', 'type': 'uhd'}} 01:56:32.812335 run uname-m(pid=8453): Launched 01:56:33.820139 run uname-m(pid=8453): Terminated: ok {rc=0} 01:56:34.770683 run rm-remote-dir(pid=8459): Launched 01:56:35.776213 run rm-remote-dir(pid=8459): Terminated: ok {rc=0} 01:56:35.797173 run mk-remote-dir(pid=8460): Launched 01:56:36.803187 run mk-remote-dir(pid=8460): Terminated: ok {rc=0} 01:56:36.823053 run mk-remote-dir(pid=8463): Launched 01:56:37.830710 run mk-remote-dir(pid=8463): Terminated: ok {rc=0} 01:56:37.853820 run scp-inst-to-remote(pid=8464): Launched 01:56:39.861460 run scp-inst-to-remote(pid=8464): Terminated: ok {rc=0} 01:56:39.880730 run mk-remote-dir(pid=8466): Launched 01:56:40.886753 run mk-remote-dir(pid=8466): Terminated: ok {rc=0} 01:56:40.906975 run scp-cfg-to-remote(pid=8467): Launched 01:56:41.913064 run scp-cfg-to-remote(pid=8467): Terminated: ok {rc=0} 01:56:41.933329 run mk-remote-dir(pid=8469): Launched 01:56:42.939164 run mk-remote-dir(pid=8469): Terminated: ok {rc=0} 01:56:42.959094 run scp-wrapper-to-remote(pid=8470): Launched 01:56:43.964946 run scp-wrapper-to-remote(pid=8470): Terminated: ok {rc=0} 01:56:43.985318 run osmo-trx-uhd(pid=8472): Launched 01:56:43.988123 run osmo-bts-trx: Waiting for osmo-trx-uhd to start up... 01:56:47.654250 run osmo-bts-trx(pid=8473): Launched 01:56:48.667894 tst ping.py:31: Waiting for bts to be ready... 01:56:51.856669 run osmo-pcu(pid=8474): Launched 01:56:51.891091 bus /gobi_11: Setting Powered True 01:56:55.154620 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000010978', msisdn='11070', subscriber_id=1} 01:56:55.187048 bus /gobi_11: Setting Online False 01:56:56.204502 bus /gobi_11: Setting Powered False 01:57:03.127293 bus /gobi_11: Setting Powered True 01:57:04.339814 bus /gobi_11: Setting Online True 01:57:06.420708 tst /gobi_11: Connect to ('901', '70') 01:57:06.455967 tst /gobi_11: Manufacturer: 'Quectel', Model: 'EC20', Revision: 'EC20EQAR02A13E2G 1 [Jul 5 2017 10:49:17]', Serial: '868323024273648' 01:57:06.458358 tst ping.py:42: waiting for modems to attach... 01:57:18.953447 tst /gobi_11: Registering with operator /gobi_11/operator/90170 ('901', '70') 01:57:24.756290 tst ping.py:46: waiting for modems to attach to data services... 01:57:36.236591 tst /gobi_11: context activated {apn='inet46', path='/gobi_11/context2', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={}, Name='Internet', Password='', Protocol='ip', Settings={Address='176.16.46.1', DomainNameServers=['192.168.100.1', '8.8.8.8'], Gateway='176.16.46.2', Interface='r665e664179cf4a', Method='static', Netmask='255.255.255.252'}, Type='internet', Username='ogt'}, user='ogt'} 01:57:36.239573 tst ping.py:51: Setting up data plan for "'/gobi_11/context2'" 01:57:36.544052 run move_netns(pid=8488): Launched 01:57:37.549606 run move_netns(pid=8488): Terminated: ok {rc=0} 01:57:37.580091 run ifup(pid=8491): Launched 01:57:38.586392 run ifup(pid=8491): Terminated: ok {rc=0} 01:57:38.615580 run dhcp(pid=8496): Launched 01:57:39.621767 run dhcp(pid=8496): Terminated: ok {rc=0} 01:57:39.625375 tst ping.py:53: Running 10 ping requests for "'/gobi_11/context2'" 01:57:39.907376 run ping(pid=8512): Launched 01:57:49.926991 run ping(pid=8512): Terminated: ok {rc=0} 01:57:51.825754 tst /gobi_11: context deactivated {path='/gobi_11/context2'} 01:58:00.112595 tst /gobi_11: context activated {apn='inet46', path='/gobi_11/context2', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={Interface='r665e664179cf4a'}, Name='Internet', Password='', Protocol='ipv6', Settings={}, Type='internet', Username='ogt'}, user='ogt'} 01:58:07.863361 tst /gobi_11: context deactivated {path='/gobi_11/context2'} 01:58:07.865633 tst ping.py:70: (launched: 2020-04-10_01:57:39.890370) 01:58:08.104749 tst ping.py:70: 8513: waiting for 8514 01:58:08.334593 tst ping.py:70: PING 10.42.42.6 (10.42.42.6) 56(84) bytes of data. 01:58:08.572069 tst ping.py:70: 64 bytes from 10.42.42.6: icmp_seq=1 ttl=64 time=1050 ms 01:58:08.812779 tst ping.py:70: 64 bytes from 10.42.42.6: icmp_seq=2 ttl=64 time=989 ms 01:58:09.037039 tst ping.py:70: 64 bytes from 10.42.42.6: icmp_seq=3 ttl=64 time=871 ms 01:58:09.257120 tst ping.py:70: 64 bytes from 10.42.42.6: icmp_seq=4 ttl=64 time=729 ms 01:58:09.476175 tst ping.py:70: 64 bytes from 10.42.42.6: icmp_seq=5 ttl=64 time=851 ms 01:58:09.696949 tst ping.py:70: 64 bytes from 10.42.42.6: icmp_seq=6 ttl=64 time=932 ms 01:58:09.917542 tst ping.py:70: 64 bytes from 10.42.42.6: icmp_seq=7 ttl=64 time=832 ms 01:58:10.144053 tst ping.py:70: 64 bytes from 10.42.42.6: icmp_seq=8 ttl=64 time=991 ms 01:58:10.363372 tst ping.py:70: 64 bytes from 10.42.42.6: icmp_seq=9 ttl=64 time=892 ms 01:58:10.583994 tst ping.py:70: 64 bytes from 10.42.42.6: icmp_seq=10 ttl=64 time=774 ms 01:58:10.803329 tst ping.py:70: 01:58:11.024249 tst ping.py:70: --- 10.42.42.6 ping statistics --- 01:58:11.244052 tst ping.py:70: 10 packets transmitted, 10 received, 0% packet loss, time 9016ms 01:58:11.464384 tst ping.py:70: rtt min/avg/max/mdev = 729.984/891.606/1050.119/95.728 ms, pipe 2 01:58:11.684471 tst ping.py:70: child exited with 0 01:58:11.904365 tst ping.py:70: 01:58:12.128743 tst ping.py: Test passed (125.9 sec) 01:58:12.193180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8202): Terminating (SIGTERM) 01:58:12.194682 run osmo-hlr_10.42.42.2(pid=8203): Terminating (SIGTERM) 01:58:12.195510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8204): Terminating (SIGTERM) 01:58:12.196198 run osmo-stp_10.42.42.5(pid=8205): Terminating (SIGTERM) 01:58:12.196807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8206): Terminating (SIGTERM) 01:58:12.198130 run osmo-ggsn_10.42.42.6(pid=8211): Terminating (SIGTERM) 01:58:12.198948 run pcap-recorder_any(filters='host 10.42.42.7')(pid=8440): Terminating (SIGTERM) 01:58:12.199606 run osmo-sgsn_10.42.42.7(pid=8441): Terminating (SIGTERM) 01:58:12.200272 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=8445): Terminating (SIGTERM) 01:58:12.200912 run osmo-msc_10.42.42.8(pid=8446): Terminating (SIGTERM) 01:58:12.201547 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=8447): Terminating (SIGTERM) 01:58:12.202827 run osmo-mgw_10.42.42.3(pid=8448): Terminating (SIGTERM) 01:58:12.204833 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8449): Terminating (SIGTERM) 01:58:12.205678 run osmo-mgw_10.42.42.4(pid=8450): Terminating (SIGTERM) 01:58:12.216949 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=8451): Terminating (SIGTERM) 01:58:12.218442 run osmo-bsc_10.42.42.9(pid=8452): Terminating (SIGTERM) 01:58:12.219878 run osmo-trx-uhd(pid=8472): Terminating (SIGTERM) 01:58:12.223254 run osmo-bts-trx(pid=8473): Terminating (SIGTERM) 01:58:12.224599 run osmo-pcu(pid=8474): Terminating (SIGTERM) 01:58:12.233319 --- ParallelTerminationStrategy: PID 8202 died... 01:58:12.235753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8202): Terminated: ok {rc=0} 01:58:12.237111 --- ParallelTerminationStrategy: PID 8204 died... 01:58:12.238840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8204): Terminated: ok {rc=0} 01:58:12.240194 --- ParallelTerminationStrategy: PID 8206 died... 01:58:12.241922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8206): Terminated: ok {rc=0} 01:58:12.243116 --- ParallelTerminationStrategy: PID 8440 died... 01:58:12.244144 run pcap-recorder_any(filters='host 10.42.42.7')(pid=8440): Terminated: ok {rc=0} 01:58:12.245019 --- ParallelTerminationStrategy: PID 8445 died... 01:58:12.245914 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=8445): Terminated: ok {rc=0} 01:58:12.246880 --- ParallelTerminationStrategy: PID 8447 died... 01:58:12.249404 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=8447): Terminated: ok {rc=0} 01:58:12.250917 --- ParallelTerminationStrategy: PID 8449 died... 01:58:12.252590 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8449): Terminated: ok {rc=0} 01:58:12.254092 --- ParallelTerminationStrategy: PID 8450 died... 01:58:12.255543 run osmo-mgw_10.42.42.4(pid=8450): Terminated {rc=15} 01:58:12.257194 --- ParallelTerminationStrategy: PID 8451 died... 01:58:12.258778 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=8451): Terminated: ok {rc=0} 01:58:12.260210 --- ParallelTerminationStrategy: PID 8472 died... 01:58:12.261883 run osmo-trx-uhd(pid=8472): Terminated {rc=36608} 01:58:12.431312 --- ParallelTerminationStrategy: PID 8203 died... 01:58:12.433149 run osmo-hlr_10.42.42.2(pid=8203): Terminated: ok {rc=0} 01:58:12.434538 --- ParallelTerminationStrategy: PID 8205 died... 01:58:12.435869 run osmo-stp_10.42.42.5(pid=8205): Terminated: ok {rc=0} 01:58:12.437381 --- ParallelTerminationStrategy: PID 8448 died... 01:58:12.438774 run osmo-mgw_10.42.42.3(pid=8448): Terminated {rc=15} 01:58:12.440084 --- ParallelTerminationStrategy: PID 8474 died... 01:58:12.441681 run osmo-pcu(pid=8474): Terminated: ok {rc=0} 01:58:12.750255 --- ParallelTerminationStrategy: PID 8211 died... 01:58:12.752746 run osmo-ggsn_10.42.42.6(pid=8211): Terminated: ok {rc=0} 01:58:13.696427 --- ParallelTerminationStrategy: PID 8441 died... 01:58:13.697908 run osmo-sgsn_10.42.42.7(pid=8441): Terminated: ok {rc=0} 01:58:15.687636 --- ParallelTerminationStrategy: PID 8446 died... 01:58:15.689180 run osmo-msc_10.42.42.8(pid=8446): Terminated: ok {rc=0} 01:58:15.690582 --- ParallelTerminationStrategy: PID 8452 died... 01:58:15.691831 run osmo-bsc_10.42.42.9(pid=8452): Terminated: ok {rc=0} 01:58:15.693026 --- ParallelTerminationStrategy: PID 8473 died... 01:58:15.694254 run osmo-bts-trx(pid=8473): Terminated {rc=10752} 01:58:15.760207 bus /gobi_11: Setting Online False 01:58:18.806728 bus /gobi_11: Setting Powered False 01:58:36.126461 bus /gobi_11: Setting Powered False --------------------------------------------------------------------- trial-270 gprs:trx-b200 PASS --------------------------------------------------------------------- --------------------------------------------------------------------- trial-270 gprs:sysmo --------------------------------------------------------------------- 01:58:37.421005 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:37.436992 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 01:58:37.459312 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 01:58:37.508500 tst gprs:sysmo: Reserving 4 x modem (candidates: 10) ---------------------------------------------- trial-270 gprs:sysmo ping.py ---------------------------------------------- 01:58:37.823018 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 01:58:37.836091 tst gprs:sysmo: Using 1 x bts (candidates: 1) 01:58:39.122649 tst gprs:sysmo: using LAC 6013 01:58:39.133317 tst gprs:sysmo: using RAC 148 01:58:39.141866 tst gprs:sysmo: using CellId 6013 01:58:39.150390 tst gprs:sysmo: using BVCI 6014 01:58:39.155647 tst ping.py:6: ERR: NameError: name 'symobts' is not defined [trial-270↪gprs:sysmo↪ping.py:6] 01:58:39.160668 tst ping.py:6: TRACEBACK: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/src/osmo_gsm_tester/test.py", line 64, in run self.path) File "/home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/src/osmo_gsm_tester/util.py", line 367, in run_python_file spec.loader.exec_module( importlib.util.module_from_spec(spec) ) File "<frozen importlib._bootstrap_external>", line 673, in exec_module File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed File "/home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/example/suites/gprs/ping.py", line 6, in <module> pcu = bts.pcu() File "/home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/src/osmo_gsm_tester/bts_osmo.py", line 70, in pcu self._pcu = self.create_pcu() File "/home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/src/osmo_gsm_tester/bts_sysmo.py", line 46, in create_pcu return pcu_sysmo.OsmoPcuSysmo(self.suite_run, self, self.conf) File "/home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/src/osmo_gsm_tester/pcu_sysmo.py", line 31, in __init__ super().__init__(suite_run, symobts, conf, self.PCU_SYSMO_BIN) NameError: name 'symobts' is not defined [trial-270↪gprs:sysmo↪ping.py:6] 01:58:39.164445 tst ping.py:6: Test FAILED (1.3 sec) --------------------------------------------------------------------- trial-270 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-270 gprs:oc2g --------------------------------------------------------------------- 01:58:39.483317 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 01:58:39.499344 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 01:58:39.523763 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 01:58:39.574210 tst gprs:oc2g: Reserving 4 x modem (candidates: 10) ---------------------------------------------- trial-270 gprs:oc2g ping.py ---------------------------------------------- 01:58:39.892913 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 01:58:39.907025 tst gprs:oc2g: Using 1 x bts (candidates: 1) 01:58:41.195713 tst gprs:oc2g: using LAC 6014 01:58:41.204756 tst gprs:oc2g: using RAC 149 01:58:41.212750 tst gprs:oc2g: using CellId 6014 01:58:41.229789 tst gprs:oc2g: using BVCI 6015 01:58:41.232387 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 01:58:41.246646 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 01:58:41.259649 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 01:58:41.272573 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 01:58:41.285444 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 01:58:41.298381 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 01:58:41.311314 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 01:58:41.324138 tst gprs:oc2g: Using 1 x modem (candidates: 4) 01:58:41.400349 tst ping.py:19: start network... 01:58:41.614221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 01:58:41.948639 run create_hlr_db(pid=8561): Launched 01:58:41.951167 bus /gobi_11: Setting Powered False 01:58:42.954450 run create_hlr_db(pid=8561): Terminated: ok {rc=0} 01:58:42.979252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8563): Launched 01:58:42.995966 run osmo-hlr_10.42.42.2(pid=8564): Launched 01:58:42.997637 run osmo-stp_10.42.42.5: Starting osmo-stp 01:58:43.336731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8565): Launched 01:58:43.355253 run osmo-stp_10.42.42.5(pid=8566): Launched 01:58:43.356827 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 01:58:43.694706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8567): Launched 01:58:43.696339 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 01:58:43.714054 run patchelf(pid=8568): Launched 01:58:44.719187 run patchelf(pid=8568): Terminated: ok {rc=0} 01:58:44.721170 run osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn 01:58:44.742355 run osmo-gsm-tester_setcap_net_admin.sh(pid=8569): Launched 01:58:45.749134 run osmo-gsm-tester_setcap_net_admin.sh(pid=8569): Terminated: ok {rc=0} 01:58:45.766697 run osmo-ggsn_10.42.42.6(pid=8572): Launched 01:58:45.769495 run osmo-sgsn_10.42.42.7: Starting osmo-sgsn 01:58:46.216853 run pcap-recorder_any(filters='host 10.42.42.7')(pid=8721): Launched 01:58:46.244402 run osmo-sgsn_10.42.42.7(pid=8734): Launched 01:58:46.245849 run osmo-msc_10.42.42.8: Starting osmo-msc 01:58:46.713713 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=8801): Launched 01:58:46.731928 run osmo-msc_10.42.42.8(pid=8802): Launched 01:58:46.734458 run osmo-mgw_10.42.42.3: Starting osmo-mgw 01:58:47.107599 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=8803): Launched 01:58:47.130254 run osmo-mgw_10.42.42.3(pid=8804): Launched 01:58:47.134483 run osmo-mgw_10.42.42.4: Starting osmo-mgw 01:58:47.488659 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8805): Launched 01:58:47.506469 run osmo-mgw_10.42.42.4(pid=8806): Launched 01:58:47.509154 run osmo-bsc_10.42.42.9: Starting osmo-bsc 01:58:48.516657 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=8807): Launched 01:58:48.537621 run osmo-bsc_10.42.42.9(pid=8808): Launched 01:58:48.539277 run osmo-bts-oc2g: Starting OsmoBtsOC2G to connect to osmo-bsc_10.42.42.9 01:58:49.241413 tst ping.py:29: ERR: NameError: name 'remote' is not defined [trial-270↪gprs:oc2g↪ping.py:29] 01:58:49.245902 tst ping.py:29: TRACEBACK: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/src/osmo_gsm_tester/test.py", line 64, in run self.path) File "/home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/src/osmo_gsm_tester/util.py", line 367, in run_python_file spec.loader.exec_module( importlib.util.module_from_spec(spec) ) File "<frozen importlib._bootstrap_external>", line 673, in exec_module File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed File "/home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/example/suites/gprs/ping.py", line 29, in <module> bts.start() File "/home/jenkins/workspace/osmo-gsm-tester_manual-run/osmo-gsm-tester/src/osmo_gsm_tester/bts_oc2g.py", line 111, in start rem_host = remote.RemoteHost(self.run_dir, self.remote_user, self.remote_addr()) NameError: name 'remote' is not defined [trial-270↪gprs:oc2g↪ping.py:29] 01:58:49.249213 tst ping.py:29: Test FAILED (9.4 sec) 01:58:49.255068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8563): Terminating (SIGTERM) 01:58:49.255908 run osmo-hlr_10.42.42.2(pid=8564): Terminating (SIGTERM) 01:58:49.257008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8565): Terminating (SIGTERM) 01:58:49.258248 run osmo-stp_10.42.42.5(pid=8566): Terminating (SIGTERM) 01:58:49.259274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8567): Terminating (SIGTERM) 01:58:49.260726 run osmo-ggsn_10.42.42.6(pid=8572): Terminating (SIGTERM) 01:58:49.264133 run pcap-recorder_any(filters='host 10.42.42.7')(pid=8721): Terminating (SIGTERM) 01:58:49.270514 run osmo-sgsn_10.42.42.7(pid=8734): Terminating (SIGTERM) 01:58:49.272273 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=8801): Terminating (SIGTERM) 01:58:49.275344 run osmo-msc_10.42.42.8(pid=8802): Terminating (SIGTERM) 01:58:49.277151 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=8803): Terminating (SIGTERM) 01:58:49.281484 run osmo-mgw_10.42.42.3(pid=8804): Terminating (SIGTERM) 01:58:49.293063 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8805): Terminating (SIGTERM) 01:58:49.299676 run osmo-mgw_10.42.42.4(pid=8806): Terminating (SIGTERM) 01:58:49.311365 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=8807): Terminating (SIGTERM) 01:58:49.313709 run osmo-bsc_10.42.42.9(pid=8808): Terminating (SIGTERM) 01:58:49.316058 --- ParallelTerminationStrategy: PID 8563 died... 01:58:49.318360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8563): Terminated: ok {rc=0} 01:58:49.321331 --- ParallelTerminationStrategy: PID 8565 died... 01:58:49.323718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8565): Terminated: ok {rc=0} 01:58:49.325660 --- ParallelTerminationStrategy: PID 8567 died... 01:58:49.333734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8567): Terminated: ok {rc=0} 01:58:49.356929 --- ParallelTerminationStrategy: PID 8721 died... 01:58:49.359066 run pcap-recorder_any(filters='host 10.42.42.7')(pid=8721): Terminated: ok {rc=0} 01:58:49.362479 --- ParallelTerminationStrategy: PID 8801 died... 01:58:49.367555 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=8801): Terminated: ok {rc=0} 01:58:49.375241 --- ParallelTerminationStrategy: PID 8803 died... 01:58:49.383446 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=8803): Terminated: ok {rc=0} 01:58:49.386300 --- ParallelTerminationStrategy: PID 8804 died... 01:58:49.388332 run osmo-mgw_10.42.42.3(pid=8804): Terminated {rc=15} 01:58:49.391590 --- ParallelTerminationStrategy: PID 8805 died... 01:58:49.396338 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8805): Terminated: ok {rc=0} 01:58:49.404123 --- ParallelTerminationStrategy: PID 8806 died... 01:58:49.406227 run osmo-mgw_10.42.42.4(pid=8806): Terminated {rc=15} 01:58:49.408408 --- ParallelTerminationStrategy: PID 8807 died... 01:58:49.411455 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=8807): Terminated: ok {rc=0} 01:58:49.586778 --- ParallelTerminationStrategy: PID 8564 died... 01:58:49.588353 run osmo-hlr_10.42.42.2(pid=8564): Terminated: ok {rc=0} 01:58:49.589534 --- ParallelTerminationStrategy: PID 8566 died... 01:58:49.591037 run osmo-stp_10.42.42.5(pid=8566): Terminated: ok {rc=0} 01:58:49.592195 --- ParallelTerminationStrategy: PID 8572 died... 01:58:49.593504 run osmo-ggsn_10.42.42.6(pid=8572): Terminated: ok {rc=0} 01:58:50.843436 --- ParallelTerminationStrategy: PID 8734 died... 01:58:50.844912 run osmo-sgsn_10.42.42.7(pid=8734): Terminated: ok {rc=0} 01:58:52.834494 --- ParallelTerminationStrategy: PID 8802 died... 01:58:52.835983 run osmo-msc_10.42.42.8(pid=8802): Terminated: ok {rc=0} 01:58:52.837187 --- ParallelTerminationStrategy: PID 8808 died... 01:58:52.838521 run osmo-bsc_10.42.42.9(pid=8808): Terminated: ok {rc=0} 01:58:52.848040 bus /gobi_11: Setting Powered False --------------------------------------------------------------------- trial-270 gprs:oc2g FAIL --------------------------------------------------------------------- 01:58:54.124495 tst trial-270: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_manual-run/trial-270/run.2020-04-10_01-56-02/trial-270.xml -------------------------------------------------------------------------------------------- trial-270 FAIL -------------------------------------------------------------------------------------------- 01:58:54.327421 tst trial-270: trial-270: FAIL, 2 suites failed, 1 suites passed FAIL: gprs:sysmo (fail: 1, skip: 4) skip: cs_paging_gprs_active.py skip: iperf3.py skip: iperf3m4.py FAIL: ping.py (1.3 sec) NameError: name 'symobts' is not defined skip: ping_idle_ping.py FAIL: gprs:oc2g (fail: 1, skip: 4) skip: cs_paging_gprs_active.py skip: iperf3.py skip: iperf3m4.py FAIL: ping.py (9.4 sec) NameError: name 'remote' is not defined skip: ping_idle_ping.py + rm -rf trial-270/inst + cd trial-270 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2020-04-10 01:56:00 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_manual-run/trial-270-run.tgz run.2020-04-10_01-56-02 + tar czf /home/jenkins/workspace/osmo-gsm-tester_manual-run/trial-270-bin.tgz checksums.md5 osmo-bsc.build-8837.tgz osmo-bts-oc2g.build-1561.tgz osmo-bts-sysmo.build-4069.tgz osmo-bts.build-4054.tgz osmo-ggsn.build-3035.tgz osmo-hlr.build-3995.tgz osmo-mgw.build-4084.tgz osmo-msc.build-14834.tgz osmo-nitb.build-6699.tgz osmo-pcu-oc2g.build-1148.tgz osmo-pcu-sysmo.build-2424.tgz osmo-pcu.build-2386.tgz osmo-sgsn.build-14154.tgz osmo-stp.build-4456.tgz osmo-trx.build-1690.tgz osmocom-bb.build-1967.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results Finished: FAILURE