Skipping 81 KB..
Full Log17:09:42.591946 tst cs_paging_gprs_active.py:38: ERR: KeyError: 'sum_sent' [trial-2068↪gprs:sysmo↪cs_paging_gprs_active.py:38]
17:09:42.600494 tst cs_paging_gprs_active.py:38: Test FAILED (231.6 sec)
17:09:42.607557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31602): Terminating (SIGTERM)
17:09:42.652204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31604): Terminating (SIGTERM)
17:09:42.697114 run iperf3-srv_10.42.42.10(pid=31605): Terminating (SIGTERM)
17:09:42.741257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31608): Terminating (SIGTERM)
17:09:42.784866 run osmo-hlr_10.42.42.2(pid=31609): Terminating (SIGTERM)
17:09:42.828932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31610): Terminating (SIGTERM)
17:09:42.874975 run osmo-stp_10.42.42.5(pid=31611): Terminating (SIGTERM)
17:09:42.921188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31612): Terminating (SIGTERM)
17:09:42.994675 run osmo-ggsn_10.42.42.6(pid=31617): Terminating (SIGTERM)
17:09:43.042663 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31644): Terminating (SIGTERM)
17:09:43.096885 run osmo-sgsn_10.42.42.7(pid=31645): Terminating (SIGTERM)
17:09:43.157210 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31646): Terminating (SIGTERM)
17:09:43.202568 run osmo-msc_10.42.42.8(pid=31647): Terminating (SIGTERM)
17:09:43.254848 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31648): Terminating (SIGTERM)
17:09:43.300029 run osmo-mgw_10.42.42.3(pid=31649): Terminating (SIGTERM)
17:09:43.344178 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31650): Terminating (SIGTERM)
17:09:43.390583 run osmo-mgw_10.42.42.4(pid=31651): Terminating (SIGTERM)
17:09:43.434482 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31652): Terminating (SIGTERM)
17:09:43.479856 run osmo-bsc_10.42.42.9(pid=31653): Terminating (SIGTERM)
17:09:43.531114 run osmo-bts-sysmo(pid=31662): Terminating (SIGTERM)
17:09:43.573462 run osmo-pcu(pid=31674): Terminating (SIGTERM)
17:09:43.623132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727): Terminating (SIGTERM)
17:09:43.768020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727)-killSignals.SIGTERM(pid=31760): Launched
17:09:44.879035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727)-killSignals.SIGTERM(pid=31760): Terminated: ok {rc=0}
17:09:44.946126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730): Terminating (SIGTERM)
17:09:45.090650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730)-killSignals.SIGTERM(pid=31765): Launched
17:09:46.181779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730)-killSignals.SIGTERM(pid=31765): Terminated: ok {rc=0}
17:09:46.249260 --- ParallelTerminationStrategy: PID 31602 died...
17:09:46.269444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31602): Terminated: ok {rc=0}
17:09:46.316720 --- ParallelTerminationStrategy: PID 31604 died...
17:09:46.336793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31604): Terminated: ok {rc=0}
17:09:46.383775 --- ParallelTerminationStrategy: PID 31605 died...
17:09:46.403616 run iperf3-srv_10.42.42.10(pid=31605): Terminated {rc=256}
17:09:46.450224 --- ParallelTerminationStrategy: PID 31608 died...
17:09:46.470380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31608): Terminated: ok {rc=0}
17:09:46.517248 --- ParallelTerminationStrategy: PID 31609 died...
17:09:46.537624 run osmo-hlr_10.42.42.2(pid=31609): Terminated: ok {rc=0}
17:09:46.584257 --- ParallelTerminationStrategy: PID 31610 died...
17:09:46.604289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31610): Terminated: ok {rc=0}
17:09:46.651172 --- ParallelTerminationStrategy: PID 31611 died...
17:09:46.671167 run osmo-stp_10.42.42.5(pid=31611): Terminated: ok {rc=0}
17:09:46.717873 --- ParallelTerminationStrategy: PID 31612 died...
17:09:46.737850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31612): Terminated: ok {rc=0}
17:09:46.784496 --- ParallelTerminationStrategy: PID 31617 died...
17:09:46.804501 run osmo-ggsn_10.42.42.6(pid=31617): Terminated: ok {rc=0}
17:09:46.851302 --- ParallelTerminationStrategy: PID 31644 died...
17:09:46.871329 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31644): Terminated: ok {rc=0}
17:09:46.918176 --- ParallelTerminationStrategy: PID 31645 died...
17:09:46.938247 run osmo-sgsn_10.42.42.7(pid=31645): Terminated: ok {rc=0}
17:09:46.984948 --- ParallelTerminationStrategy: PID 31646 died...
17:09:47.004960 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31646): Terminated: ok {rc=0}
17:09:47.051702 --- ParallelTerminationStrategy: PID 31647 died...
17:09:47.071635 run osmo-msc_10.42.42.8(pid=31647): Terminated: ok {rc=0}
17:09:47.118381 --- ParallelTerminationStrategy: PID 31648 died...
17:09:47.138505 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31648): Terminated: ok {rc=0}
17:09:47.185145 --- ParallelTerminationStrategy: PID 31649 died...
17:09:47.205165 run osmo-mgw_10.42.42.3(pid=31649): Terminated {rc=15}
17:09:47.252003 --- ParallelTerminationStrategy: PID 31650 died...
17:09:47.271823 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31650): Terminated: ok {rc=0}
17:09:47.318597 --- ParallelTerminationStrategy: PID 31651 died...
17:09:47.338632 run osmo-mgw_10.42.42.4(pid=31651): Terminated {rc=15}
17:09:47.385827 --- ParallelTerminationStrategy: PID 31652 died...
17:09:47.405777 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31652): Terminated: ok {rc=0}
17:09:47.452453 --- ParallelTerminationStrategy: PID 31653 died...
17:09:47.472325 run osmo-bsc_10.42.42.9(pid=31653): Terminated: ok {rc=0}
17:09:47.519085 --- ParallelTerminationStrategy: PID 31662 died...
17:09:47.539077 run osmo-bts-sysmo(pid=31662): Terminated: ok {rc=0}
17:09:47.585672 --- ParallelTerminationStrategy: PID 31674 died...
17:09:47.605479 run osmo-pcu(pid=31674): Terminated: ok {rc=0}
17:09:53.474790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727): Terminating (SIGINT)
17:09:53.619377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727)-killSignals.SIGINT(pid=31768): Launched
17:09:54.704386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727)-killSignals.SIGINT(pid=31768): Terminated: ok {rc=0}
17:09:54.767583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730): Terminating (SIGINT)
17:09:54.904971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730)-killSignals.SIGINT(pid=31771): Launched
17:09:55.991939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730)-killSignals.SIGINT(pid=31771): Terminated: ok {rc=0}
17:10:01.877865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727): Terminating (SIGKILL)
17:10:02.015661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727)-killSignals.SIGUSR1(pid=31781): Launched
17:10:03.104503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727)-killSignals.SIGUSR1(pid=31781): Terminated: ok {rc=0}
17:10:03.167812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730): Terminating (SIGKILL)
17:10:03.304544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730)-killSignals.SIGUSR1(pid=31784): Launched
17:10:04.390026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730)-killSignals.SIGUSR1(pid=31784): Terminated: ok {rc=0}
17:10:04.684549 bus /gobi_0: Setting Online False
17:10:07.660740 bus /gobi_0: Setting Powered False
17:10:24.940073 bus /gobi_0: Setting Powered False
17:10:26.038957 bus /gobi_0: Setting Powered False
17:10:27.201109 bus /gobi_6: Setting Online False
17:10:28.343337 bus /gobi_6: Setting Powered False
17:10:36.104686 bus /gobi_6: Setting Powered False
----------------------------------------------
trial-2068 gprs:sysmo iperf3.py
----------------------------------------------
17:10:37.311348 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:10:37.323270 tst gprs:sysmo: Using 1 x bts (candidates: 1)
17:10:37.360030 tst iperf3.py: using LAC 4435
17:10:37.488117 tst iperf3.py: using RAC 100
17:10:37.619119 tst iperf3.py: using CellId 4435
17:10:37.746263 tst iperf3.py: using BVCI 4436
17:10:37.864882 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:10:37.876058 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:10:37.887229 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:10:37.898253 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:10:37.909474 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:10:37.920788 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:10:37.932180 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:10:37.943224 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:10:37.954397 tst gprs:sysmo: Using 1 x modem (candidates: 4)
17:10:38.076557 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003...
17:10:38.298891 run iperf3-srv_10.42.42.10: Starting iperf3-srv
17:10:38.629989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31787): Launched
17:10:38.918789 run iperf3-srv_10.42.42.10(pid=31788): Launched
17:10:39.043748 tst iperf3.py:8: start network...
17:10:39.265398 run osmo-hlr_10.42.42.2: Starting osmo-hlr
17:10:39.777445 run create_hlr_db(pid=31790): Launched
17:10:39.903937 bus /gobi_6: Setting Powered False
17:10:40.968102 run create_hlr_db(pid=31790): Terminated: ok {rc=0}
17:10:41.408179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31792): Launched
17:10:41.717322 run osmo-hlr_10.42.42.2(pid=31793): Launched
17:10:41.835305 run osmo-stp_10.42.42.5: Starting osmo-stp
17:10:42.359561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31794): Launched
17:10:42.668374 run osmo-stp_10.42.42.5(pid=31795): Launched
17:10:42.785896 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn
17:10:43.310660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31796): Launched
17:10:43.427568 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
17:10:43.689404 run patchelf(pid=31797): Launched
17:10:44.864841 run patchelf(pid=31797): Terminated: ok {rc=0}
17:10:44.993824 run osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn
17:10:45.257682 run osmo-gsm-tester_setcap_net_admin.sh(pid=31798): Launched
17:10:46.435612 run osmo-gsm-tester_setcap_net_admin.sh(pid=31798): Terminated: ok {rc=0}
17:10:46.756422 run osmo-ggsn_10.42.42.6(pid=31801): Launched
17:10:46.889085 run osmo-sgsn_10.42.42.7: Starting osmo-sgsn
17:10:47.596777 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31822): Launched
17:10:47.928334 run osmo-sgsn_10.42.42.7(pid=31823): Launched
17:10:48.054272 run osmo-msc_10.42.42.8: Starting osmo-msc
17:10:48.652433 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31824): Launched
17:10:48.983020 run osmo-msc_10.42.42.8(pid=31825): Launched
17:10:52.169364 run osmo-mgw_10.42.42.3: Starting osmo-mgw
17:10:52.733432 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31826): Launched
17:10:53.062145 run osmo-mgw_10.42.42.3(pid=31827): Launched
17:10:53.189048 run osmo-mgw_10.42.42.4: Starting osmo-mgw
17:10:53.740501 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31828): Launched
17:10:54.069851 run osmo-mgw_10.42.42.4(pid=31829): Launched
17:10:54.196218 run osmo-bsc_10.42.42.9: Starting osmo-bsc
17:10:54.873717 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31830): Launched
17:10:55.203825 run osmo-bsc_10.42.42.9(pid=31831): Launched
17:11:01.492011 run osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.9
17:11:02.067509 run rm-remote-dir(pid=31832): Launched
17:11:04.264479 run rm-remote-dir(pid=31832): Terminated: ok {rc=0}
17:11:04.626479 run mk-remote-dir(pid=31833): Launched
17:11:05.820628 run mk-remote-dir(pid=31833): Terminated: ok {rc=0}
17:11:06.128875 run scp-inst-to-remote(pid=31834): Launched
17:11:18.334431 run scp-inst-to-remote(pid=31834): Terminated: ok {rc=0}
17:11:18.668504 run mk-remote-dir(pid=31836): Launched
17:11:19.846493 run mk-remote-dir(pid=31836): Terminated: ok {rc=0}
17:11:20.135120 run scp-cfg-to-remote(pid=31837): Launched
17:11:22.315592 run scp-cfg-to-remote(pid=31837): Terminated: ok {rc=0}
17:11:22.645952 run reload-dsp-firmware(pid=31839): Launched
17:11:24.825390 run reload-dsp-firmware(pid=31839): Terminated: ok {rc=0}
17:11:25.148781 run osmo-bts-sysmo(pid=31840): Launched
17:11:29.372933 tst iperf3.py:8: Waiting for bts to be ready...
17:11:31.051425 run rm-remote-dir(pid=31841): Launched
17:11:33.226379 run rm-remote-dir(pid=31841): Terminated: ok {rc=0}
17:11:33.550651 run mk-remote-dir(pid=31846): Launched
17:11:35.727690 run mk-remote-dir(pid=31846): Terminated: ok {rc=0}
17:11:36.025676 run scp-inst-to-bts(pid=31847): Launched
17:11:49.224401 run scp-inst-to-bts(pid=31847): Terminated: ok {rc=0}
17:11:49.550146 run mk-remote-run-dir(pid=31849): Launched
17:11:51.725425 run mk-remote-run-dir(pid=31849): Terminated: ok {rc=0}
17:11:52.006614 run scp-cfg-to-sysmobts(pid=31850): Launched
17:11:54.179815 run scp-cfg-to-sysmobts(pid=31850): Terminated: ok {rc=0}
17:11:54.505151 run osmo-pcu(pid=31852): Launched
17:11:54.632233 tst iperf3.py: using MSISDN 4030
17:11:54.806408 bus /gobi_6: Setting Powered True
17:11:58.317957 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000010978', msisdn='4030', subscriber_id=1}
17:11:58.594938 bus /gobi_6: Setting Online False
17:11:59.786914 bus /gobi_6: Setting Powered False
17:12:07.131674 bus /gobi_6: Setting Powered True
17:12:08.514991 bus /gobi_6: Setting Online True
17:12:11.039540 tst /gobi_6: Connect to ('901', '70')
17:12:11.308528 tst /gobi_6: Manufacturer: 'Quectel', Model: 'EC20', Revision: 'EC20EQAR02A13E2G 1 [Jul 5 2017 10:49:17]', Serial: '868323024273648'
17:12:11.417624 tst iperf3.py:8: waiting for modems to attach...
17:12:19.817554 tst /gobi_6: Already registered with network ('901', '70')
17:12:29.859883 tst iperf3.py:8: waiting for modems to attach to data services...
17:12:46.092462 tst /gobi_6: context activated {apn='inet46', path='/gobi_6/context3', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={}, Name='Internet', Password='', Protocol='ip', Settings={Address='176.16.46.1', DomainNameServers=['192.168.100.1', '8.8.8.8'], Gateway='176.16.46.2', Interface='r433306bbc2604b', Method='static', Netmask='255.255.255.252'}, Type='internet', Username='ogt'}, user='ogt'}
17:12:46.211377 tst iperf3.py:8: Setting up data plan for "'/gobi_6/context3'"
17:12:46.668215 run move_netns(pid=31859): Launched
17:12:47.862812 run move_netns(pid=31859): Terminated: ok {rc=0}
17:12:48.219956 run ifup(pid=31863): Launched
17:12:49.415135 run ifup(pid=31863): Terminated: ok {rc=0}
17:12:49.771816 run dhcp(pid=31867): Launched
17:12:50.962478 run dhcp(pid=31867): Terminated: ok {rc=0}
17:12:51.101949 tst iperf3.py:8: Running iperf3 client to 10.42.42.10:5003 through "'/gobi_6/context3'"
17:12:51.329331 run iperf3-cli_10.42.42.10: Preparing iperf3-client connecting to 10.42.42.10:5003 (proto=tcp,time=60s)
17:12:51.722790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31883): Launched
17:12:52.066843 run iperf3-cli_10.42.42.10(pid=31886): Launched
17:14:06.390845 run iperf3-cli_10.42.42.10(pid=31886): ERR: Terminated: ERROR {rc=1} [trial-2068↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪iperf3-srv_10.42.42.10↪iperf3-cli_10.42.42.10↪iperf3-cli_10.42.42.10(pid=31886)]
17:14:06.519822 run iperf3-cli_10.42.42.10(pid=31886): stdout:
| "bits_per_second": 0,
| "retransmits": 0,
| "omitted": false
| }
| }],
| "end": {
| },
| "error": "error - control socket has closed unexpectedly"
| }
| child exited with 1
17:14:06.648794 run iperf3-cli_10.42.42.10(pid=31886): stderr:
| (launched: 2022-12-01_17:12:52.050181)
17:14:06.777358 run iperf3-srv_10.42.42.10(pid=31788): Terminating (SIGINT)
17:14:07.109542 run iperf3-srv_10.42.42.10(pid=31788): Terminated {rc=1}
17:14:07.224948 tst iperf3.py:8: Results for 10.42.42.10:5003 through "'/gobi_6/context3'"
Exception while using iperf3 client results: "{'start': {'connected': [{'socket': 5, 'local_host': '176.16.46.1', 'local_port': 34234, 'remote_host': '10.42.42.10', 'remote_port': 5003}], 'version': 'iperf 3.6', 'system_info': 'Linux osmo-gsm-tester-prod 4.19.0-14-amd64 #1 SMP Debian 4.19.171-2 (2021-01-30) x86_64', 'timestamp': {'time': 'Thu, 01 Dec 2022 16:12:58 GMT', 'timesecs': 1669911178}, 'connecting_to': {'host': '10.42.42.10', 'port': 5003}, 'cookie': 't42p3x2s2lznteo6jrtxclz4bdmw2aken2mu', 'tcp_mss_default': 1448, 'sock_bufsize': 0, 'sndbuf_actual': 16384, 'rcvbuf_actual': 131072, 'test_start': {'protocol': 'TCP', 'num_streams': 1, 'blksize': 131072, 'omit': 0, 'duration': 60, 'bytes': 0, 'blocks': 0, 'reverse': 0, 'tos': 0}}, 'intervals': [{'streams': [{'socket': 5, 'start': 0, 'end': 1.0008671283721924, 'seconds': 1.0008671283721924, 'bytes': 101360, 'bits_per_second': 810177.4721274072, 'retransmits': 0, 'snd_cwnd': 14480, 'rtt': 416241, 'rttvar': 179216, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 0, 'end': 1.0008671283721924, 'seconds': 1.0008671283721924, 'bytes': 101360, 'bits_per_second': 810177.4721274072, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 1.0008671283721924, 'end': 2.0014710426330566, 'seconds': 1.0006039142608643, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 15928, 'rtt': 504350, 'rttvar': 310628, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 1.0008671283721924, 'end': 2.0014710426330566, 'seconds': 1.0006039142608643, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 2.0014710426330566, 'end': 3.000446081161499, 'seconds': 0.9989750385284424, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 18824, 'rtt': 883479, 'rttvar': 854657, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 2.0014710426330566, 'end': 3.000446081161499, 'seconds': 0.9989750385284424, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 3.000446081161499, 'end': 4.000234127044678, 'seconds': 0.9997880458831787, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 20272, 'rtt': 1162900, 'rttvar': 1199836, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 3.000446081161499, 'end': 4.000234127044678, 'seconds': 0.9997880458831787, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 4.000234127044678, 'end': 5.001321077346802, 'seconds': 1.001086950302124, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 21720, 'rtt': 1495095, 'rttvar': 1564266, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 4.000234127044678, 'end': 5.001321077346802, 'seconds': 1.001086950302124, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 5.001321077346802, 'end': 6.000485181808472, 'seconds': 0.9991641044616699, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 24616, 'rtt': 2293596, 'rttvar': 2286564, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 5.001321077346802, 'end': 6.000485181808472, 'seconds': 0.9991641044616699, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 6.000485181808472, 'end': 7.000270128250122, 'seconds': 0.9997849464416504, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 26064, 'rtt': 2746964, 'rttvar': 2621659, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 6.000485181808472, 'end': 7.000270128250122, 'seconds': 0.9997849464416504, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 7.000270128250122, 'end': 8.001212120056152, 'seconds': 1.0009419918060303, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 28960, 'rtt': 3741653, 'rttvar': 3222191, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 7.000270128250122, 'end': 8.001212120056152, 'seconds': 1.0009419918060303, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 8.001212120056152, 'end': 9.001330137252808, 'seconds': 1.0001180171966553, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 30408, 'rtt': 4168277, 'rttvar': 3269891, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 8.001212120056152, 'end': 9.001330137252808, 'seconds': 1.0001180171966553, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 9.001330137252808, 'end': 10.0002920627594, 'seconds': 0.9989619255065918, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 33304, 'rtt': 4982328, 'rttvar': 3251734, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 9.001330137252808, 'end': 10.0002920627594, 'seconds': 0.9989619255065918, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 10.0002920627594, 'end': 11.001477003097534, 'seconds': 1.0011849403381348, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 34752, 'rtt': 5404873, 'rttvar': 3283889, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 10.0002920627594, 'end': 11.001477003097534, 'seconds': 1.0011849403381348, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 11.001477003097534, 'end': 12.001142024993896, 'seconds': 0.9996650218963623, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 36200, 'rtt': 5776249, 'rttvar': 3205669, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 11.001477003097534, 'end': 12.001142024993896, 'seconds': 0.9996650218963623, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 12.001142024993896, 'end': 13.000625133514404, 'seconds': 0.9994831085205078, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 39096, 'rtt': 6569624, 'rttvar': 3180968, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 12.001142024993896, 'end': 13.000625133514404, 'seconds': 0.9994831085205078, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 13.000625133514404, 'end': 14.001475095748901, 'seconds': 1.000849962234497, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 40544, 'rtt': 6995610, 'rttvar': 3237699, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 13.000625133514404, 'end': 14.001475095748901, 'seconds': 1.000849962234497, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 14.001475095748901, 'end': 15.000265121459961, 'seconds': 0.9987900257110596, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 41992, 'rtt': 7388606, 'rttvar': 3214265, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 14.001475095748901, 'end': 15.000265121459961, 'seconds': 0.9987900257110596, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 15.000265121459961, 'end': 16.001266956329346, 'seconds': 1.0010018348693848, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 43440, 'rtt': 8218114, 'rttvar': 3245235, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 15.000265121459961, 'end': 16.001266956329346, 'seconds': 1.0010018348693848, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 16.001266956329346, 'end': 17.001285076141357, 'seconds': 1.0000181198120117, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 43440, 'rtt': 8642872, 'rttvar': 3283442, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 16.001266956329346, 'end': 17.001285076141357, 'seconds': 1.0000181198120117, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 17.001285076141357, 'end': 18.00114917755127, 'seconds': 0.9998641014099121, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 43440, 'rtt': 9017444, 'rttvar': 3211726, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 17.001285076141357, 'end': 18.00114917755127, 'seconds': 0.9998641014099121, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 18.00114917755127, 'end': 19.00126600265503, 'seconds': 1.0001168251037598, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 44888, 'rtt': 9793357, 'rttvar': 3150739, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 18.00114917755127, 'end': 19.00126600265503, 'seconds': 1.0001168251037598, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 19.00126600265503, 'end': 20.00126600265503, 'seconds': 1, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 46336, 'rtt': 10196470, 'rttvar': 3169281, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 19.00126600265503, 'end': 20.00126600265503, 'seconds': 1, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 20.00126600265503, 'end': 21.00035309791565, 'seconds': 0.9990870952606201, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 47784, 'rtt': 10947834, 'rttvar': 3109078, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 20.00126600265503, 'end': 21.00035309791565, 'seconds': 0.9990870952606201, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 21.00035309791565, 'end': 22.000527143478394, 'seconds': 1.0001740455627441, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 49232, 'rtt': 11576176, 'rttvar': 2859977, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 21.00035309791565, 'end': 22.000527143478394, 'seconds': 1.0001740455627441, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 22.000527143478394, 'end': 23.001222133636475, 'seconds': 1.000694990158081, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 49232, 'rtt': 11876427, 'rttvar': 2745485, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 22.000527143478394, 'end': 23.001222133636475, 'seconds': 1.000694990158081, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 23.001222133636475, 'end': 24.000349044799805, 'seconds': 0.9991269111633301, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 50680, 'rtt': 12530077, 'rttvar': 2676726, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 23.001222133636475, 'end': 24.000349044799805, 'seconds': 0.9991269111633301, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 24.000349044799805, 'end': 25.000483989715576, 'seconds': 1.0001349449157715, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 52128, 'rtt': 12885949, 'rttvar': 2719288, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 24.000349044799805, 'end': 25.000483989715576, 'seconds': 1.0001349449157715, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 25.000483989715576, 'end': 26.001019954681396, 'seconds': 1.0005359649658203, 'bytes': 244712, 'bits_per_second': 1956647.305593735, 'retransmits': 0, 'snd_cwnd': 52128, 'rtt': 13202538, 'rttvar': 2672645, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 25.000483989715576, 'end': 26.001019954681396, 'seconds': 1.0005359649658203, 'bytes': 244712, 'bits_per_second': 1956647.305593735, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 26.001019954681396, 'end': 27.00048804283142, 'seconds': 0.9994680881500244, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 53576, 'rtt': 13904735, 'rttvar': 2723119, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 26.001019954681396, 'end': 27.00048804283142, 'seconds': 0.9994680881500244, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 27.00048804283142, 'end': 28.00034809112549, 'seconds': 0.9998600482940674, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 55024, 'rtt': 14306316, 'rttvar': 2845502, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 27.00048804283142, 'end': 28.00034809112549, 'seconds': 0.9998600482940674, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 28.00034809112549, 'end': 29.0014750957489, 'seconds': 1.001127004623413, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 55024, 'rtt': 14673240, 'rttvar': 2867974, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 28.00034809112549, 'end': 29.0014750957489, 'seconds': 1.001127004623413, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 29.0014750957489, 'end': 30.00132918357849, 'seconds': 0.9998540878295898, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 56472, 'rtt': 15425777, 'rttvar': 2914212, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 29.0014750957489, 'end': 30.00132918357849, 'seconds': 0.9998540878295898, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 30.00132918357849, 'end': 31.000250101089478, 'seconds': 0.9989209175109863, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 57920, 'rtt': 15817144, 'rttvar': 2968394, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 30.00132918357849, 'end': 31.000250101089478, 'seconds': 0.9989209175109863, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 31.000250101089478, 'end': 32.00117802619934, 'seconds': 1.0009279251098633, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 59368, 'rtt': 16533557, 'rttvar': 2934723, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 31.000250101089478, 'end': 32.00117802619934, 'seconds': 1.0009279251098633, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 32.00117802619934, 'end': 33.001230001449585, 'seconds': 1.0000519752502441, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 59368, 'rtt': 16856844, 'rttvar': 2847617, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 32.00117802619934, 'end': 33.001230001449585, 'seconds': 1.0000519752502441, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 33.001230001449585, 'end': 34.00049710273743, 'seconds': 0.9992671012878418, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 60816, 'rtt': 17227444, 'rttvar': 2876913, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 33.001230001449585, 'end': 34.00049710273743, 'seconds': 0.9992671012878418, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 34.00049710273743, 'end': 35.001230001449585, 'seconds': 1.0007328987121582, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 62264, 'rtt': 17879631, 'rttvar': 2772110, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 34.00049710273743, 'end': 35.001230001449585, 'seconds': 1.0007328987121582, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 35.001230001449585, 'end': 36.00132918357849, 'seconds': 1.0000991821289062, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 62264, 'rtt': 18174218, 'rttvar': 2668255, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 35.001230001449585, 'end': 36.00132918357849, 'seconds': 1.0000991821289062, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 36.00132918357849, 'end': 37.001224994659424, 'seconds': 0.9998958110809326, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 63712, 'rtt': 18773929, 'rttvar': 2524994, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 36.00132918357849, 'end': 37.001224994659424, 'seconds': 0.9998958110809326, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 37.001224994659424, 'end': 38.00122809410095, 'seconds': 1.0000030994415283, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 65160, 'rtt': 19178389, 'rttvar': 2121410, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 37.001224994659424, 'end': 38.00122809410095, 'seconds': 1.0000030994415283, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 38.00122809410095, 'end': 39.00132918357849, 'seconds': 1.000101089477539, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 66608, 'rtt': 19340656, 'rttvar': 1915592, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 38.00122809410095, 'end': 39.00132918357849, 'seconds': 1.000101089477539, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 39.00132918357849, 'end': 40.001275062561035, 'seconds': 0.999945878982544, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 68056, 'rtt': 19776478, 'rttvar': 1834316, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 39.00132918357849, 'end': 40.001275062561035, 'seconds': 0.999945878982544, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 40.001275062561035, 'end': 41.00122904777527, 'seconds': 0.9999539852142334, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 68056, 'rtt': 19956272, 'rttvar': 1735324, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 40.001275062561035, 'end': 41.00122904777527, 'seconds': 0.9999539852142334, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 41.00122904777527, 'end': 42.000489950180054, 'seconds': 0.9992609024047852, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 69504, 'rtt': 20198992, 'rttvar': 1786933, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 41.00122904777527, 'end': 42.000489950180054, 'seconds': 0.9992609024047852, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 42.000489950180054, 'end': 43.00028204917908, 'seconds': 0.9997920989990234, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 70952, 'rtt': 20597527, 'rttvar': 1694531, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 42.000489950180054, 'end': 43.00028204917908, 'seconds': 0.9997920989990234, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 43.00028204917908, 'end': 44.000489950180054, 'seconds': 1.0002079010009766, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 70952, 'rtt': 20847813, 'rttvar': 1771470, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 43.00028204917908, 'end': 44.000489950180054, 'seconds': 1.0002079010009766, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 44.000489950180054, 'end': 45.00133013725281, 'seconds': 1.000840187072754, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 72400, 'rtt': 21368817, 'rttvar': 1900132, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 44.000489950180054, 'end': 45.00133013725281, 'seconds': 1.000840187072754, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 45.00133013725281, 'end': 46.000324010849, 'seconds': 0.9989938735961914, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 73848, 'rtt': 21670377, 'rttvar': 2028219, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 45.00133013725281, 'end': 46.000324010849, 'seconds': 0.9989938735961914, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 46.000324010849, 'end': 47.001320123672485, 'seconds': 1.0009961128234863, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 75296, 'rtt': 22154768, 'rttvar': 1980634, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 46.000324010849, 'end': 47.001320123672485, 'seconds': 1.0009961128234863, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 47.001320123672485, 'end': 48.001227140426636, 'seconds': 0.9999070167541504, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 75296, 'rtt': 22442815, 'rttvar': 2061568, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 47.001320123672485, 'end': 48.001227140426636, 'seconds': 0.9999070167541504, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 48.001227140426636, 'end': 49.000312089920044, 'seconds': 0.9990849494934082, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 76744, 'rtt': 22694928, 'rttvar': 2050403, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 48.001227140426636, 'end': 49.000312089920044, 'seconds': 0.9990849494934082, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 49.000312089920044, 'end': 50.00120306015015, 'seconds': 1.0008909702301025, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 78192, 'rtt': 23186386, 'rttvar': 2028606, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 49.000312089920044, 'end': 50.00120306015015, 'seconds': 1.0008909702301025, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 50.00120306015015, 'end': 51.00133204460144, 'seconds': 1.000128984451294, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 78192, 'rtt': 23425075, 'rttvar': 1998832, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 50.00120306015015, 'end': 51.00133204460144, 'seconds': 1.000128984451294, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 51.00133204460144, 'end': 52.00132203102112, 'seconds': 0.9999899864196777, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 79640, 'rtt': 23900241, 'rttvar': 1971340, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 51.00133204460144, 'end': 52.00132203102112, 'seconds': 0.9999899864196777, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 52.00132203102112, 'end': 53.00127196311951, 'seconds': 0.9999499320983887, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 81088, 'rtt': 24137509, 'rttvar': 1953041, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 52.00132203102112, 'end': 53.00127196311951, 'seconds': 0.9999499320983887, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 53.00127196311951, 'end': 54.00025701522827, 'seconds': 0.9989850521087646, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 81088, 'rtt': 24320243, 'rttvar': 1830247, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 53.00127196311951, 'end': 54.00025701522827, 'seconds': 0.9989850521087646, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 54.00025701522827, 'end': 55.0013210773468, 'seconds': 1.0010640621185303, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 82536, 'rtt': 24768261, 'rttvar': 1802103, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 54.00025701522827, 'end': 55.0013210773468, 'seconds': 1.0010640621185303, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 55.0013210773468, 'end': 56.0012640953064, 'seconds': 0.9999430179595947, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 83984, 'rtt': 24947100, 'rttvar': 1709254, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 55.0013210773468, 'end': 56.0012640953064, 'seconds': 0.9999430179595947, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 56.0012640953064, 'end': 57.001177072525024, 'seconds': 0.9999129772186279, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 85432, 'rtt': 25409642, 'rttvar': 1764444, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 56.0012640953064, 'end': 57.001177072525024, 'seconds': 0.9999129772186279, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 57.001177072525024, 'end': 58.0002601146698, 'seconds': 0.9990830421447754, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 85432, 'rtt': 25598237, 'rttvar': 1700524, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 57.001177072525024, 'end': 58.0002601146698, 'seconds': 0.9990830421447754, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 58.0002601146698, 'end': 59.00131916999817, 'seconds': 1.0010590553283691, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 86880, 'rtt': 26076199, 'rttvar': 1786407, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 58.0002601146698, 'end': 59.00131916999817, 'seconds': 1.0010590553283691, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}], 'end': {}, 'error': 'error - control socket has closed unexpectedly'}"
17:14:07.442012 tst iperf3.py:8: ERR: KeyError: 'sum_sent' [trial-2068↪gprs:sysmo↪iperf3.py:8]
17:14:07.449844 tst iperf3.py:8: Test FAILED (210.2 sec)
17:14:07.456461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31787): Terminating (SIGTERM)
17:14:07.500352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31792): Terminating (SIGTERM)
17:14:07.543865 run osmo-hlr_10.42.42.2(pid=31793): Terminating (SIGTERM)
17:14:07.585178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31794): Terminating (SIGTERM)
17:14:07.628564 run osmo-stp_10.42.42.5(pid=31795): Terminating (SIGTERM)
17:14:07.672719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31796): Terminating (SIGTERM)
17:14:07.715456 run osmo-ggsn_10.42.42.6(pid=31801): Terminating (SIGTERM)
17:14:07.758044 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31822): Terminating (SIGTERM)
17:14:07.804920 run osmo-sgsn_10.42.42.7(pid=31823): Terminating (SIGTERM)
17:14:07.864416 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31824): Terminating (SIGTERM)
17:14:07.909637 run osmo-msc_10.42.42.8(pid=31825): Terminating (SIGTERM)
17:14:07.956588 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31826): Terminating (SIGTERM)
17:14:08.006501 run osmo-mgw_10.42.42.3(pid=31827): Terminating (SIGTERM)
17:14:08.064268 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31828): Terminating (SIGTERM)
17:14:08.112309 run osmo-mgw_10.42.42.4(pid=31829): Terminating (SIGTERM)
17:14:08.154568 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31830): Terminating (SIGTERM)
17:14:08.196694 run osmo-bsc_10.42.42.9(pid=31831): Terminating (SIGTERM)
17:14:08.238658 run osmo-bts-sysmo(pid=31840): Terminating (SIGTERM)
17:14:08.281933 run osmo-pcu(pid=31852): Terminating (SIGTERM)
17:14:08.325816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31883): Terminating (SIGTERM)
17:14:08.466544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31883)-killSignals.SIGTERM(pid=31909): Launched
17:14:09.580352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31883)-killSignals.SIGTERM(pid=31909): Terminated: ok {rc=0}
17:14:09.648137 --- ParallelTerminationStrategy: PID 31787 died...
17:14:09.668403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31787): Terminated: ok {rc=0}
17:14:09.715645 --- ParallelTerminationStrategy: PID 31792 died...
17:14:09.735766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31792): Terminated: ok {rc=0}
17:14:09.783102 --- ParallelTerminationStrategy: PID 31793 died...
17:14:09.803188 run osmo-hlr_10.42.42.2(pid=31793): Terminated: ok {rc=0}
17:14:09.850051 --- ParallelTerminationStrategy: PID 31794 died...
17:14:09.870327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31794): Terminated: ok {rc=0}
17:14:09.917097 --- ParallelTerminationStrategy: PID 31795 died...
17:14:09.936975 run osmo-stp_10.42.42.5(pid=31795): Terminated: ok {rc=0}
17:14:09.983683 --- ParallelTerminationStrategy: PID 31796 died...
17:14:10.003758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31796): Terminated: ok {rc=0}
17:14:10.050914 --- ParallelTerminationStrategy: PID 31801 died...
17:14:10.070791 run osmo-ggsn_10.42.42.6(pid=31801): Terminated: ok {rc=0}
17:14:10.117671 --- ParallelTerminationStrategy: PID 31822 died...
17:14:10.137785 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31822): Terminated: ok {rc=0}
17:14:10.184530 --- ParallelTerminationStrategy: PID 31823 died...
17:14:10.204545 run osmo-sgsn_10.42.42.7(pid=31823): Terminated: ok {rc=0}
17:14:10.251459 --- ParallelTerminationStrategy: PID 31824 died...
17:14:10.271522 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31824): Terminated: ok {rc=0}
17:14:10.318295 --- ParallelTerminationStrategy: PID 31825 died...
17:14:10.338254 run osmo-msc_10.42.42.8(pid=31825): Terminated: ok {rc=0}
17:14:10.385397 --- ParallelTerminationStrategy: PID 31826 died...
17:14:10.405340 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31826): Terminated: ok {rc=0}
17:14:10.452410 --- ParallelTerminationStrategy: PID 31827 died...
17:14:10.472393 run osmo-mgw_10.42.42.3(pid=31827): Terminated {rc=15}
17:14:10.519749 --- ParallelTerminationStrategy: PID 31828 died...
17:14:10.539945 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31828): Terminated: ok {rc=0}
17:14:10.586925 --- ParallelTerminationStrategy: PID 31829 died...
17:14:10.607096 run osmo-mgw_10.42.42.4(pid=31829): Terminated {rc=15}
17:14:10.654214 --- ParallelTerminationStrategy: PID 31830 died...
17:14:10.674281 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31830): Terminated: ok {rc=0}
17:14:10.721469 --- ParallelTerminationStrategy: PID 31831 died...
17:14:10.741582 run osmo-bsc_10.42.42.9(pid=31831): Terminated: ok {rc=0}
17:14:10.788675 --- ParallelTerminationStrategy: PID 31840 died...
17:14:10.808924 run osmo-bts-sysmo(pid=31840): Terminated: ok {rc=0}
17:14:10.856387 --- ParallelTerminationStrategy: PID 31852 died...
17:14:10.876651 run osmo-pcu(pid=31852): Terminated: ok {rc=0}
17:14:16.748030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31883): Terminating (SIGINT)
17:14:16.894211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31883)-killSignals.SIGINT(pid=31914): Launched
17:14:17.986547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31883)-killSignals.SIGINT(pid=31914): Terminated: ok {rc=0}
17:14:23.876830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31883): Terminating (SIGKILL)
17:14:24.022183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31883)-killSignals.SIGUSR1(pid=31917): Launched
17:14:25.114118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31883)-killSignals.SIGUSR1(pid=31917): Terminated: ok {rc=0}
17:14:25.379896 bus /gobi_6: Setting Online False
17:14:28.429206 bus /gobi_6: Setting Powered False
17:14:36.170999 bus /gobi_6: Setting Powered False
----------------------------------------------
trial-2068 gprs:sysmo iperf3m4.py
----------------------------------------------
17:14:37.374327 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:14:37.385697 tst gprs:sysmo: Using 1 x bts (candidates: 1)
17:14:37.425422 tst iperf3m4.py: using LAC 4436
17:14:37.544471 tst iperf3m4.py: using RAC 101
17:14:37.672576 tst iperf3m4.py: using CellId 4436
17:14:37.799297 tst iperf3m4.py: using BVCI 4437
17:14:37.918927 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:14:37.930319 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:14:37.941547 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:14:37.953242 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:14:37.964664 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:14:37.976035 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:14:37.987667 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:14:37.999196 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:14:38.010849 tst gprs:sysmo: Using 1 x modem (candidates: 4)
17:14:38.132713 tst gprs:sysmo: Using 1 x modem (candidates: 4)
17:14:38.256031 tst gprs:sysmo: Using 1 x modem (candidates: 4)
17:14:38.378327 tst gprs:sysmo: Using 1 x modem (candidates: 4)
17:14:38.496831 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003...
17:14:38.718903 run iperf3-srv_10.42.42.10: Starting iperf3-srv
17:14:39.053769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31920): Launched
17:14:39.344044 run iperf3-srv_10.42.42.10(pid=31921): Launched
17:14:39.468717 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004...
17:14:39.690028 run iperf3-srv_10.42.42.10: Starting iperf3-srv
17:14:40.021430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31922): Launched
17:14:40.308341 run iperf3-srv_10.42.42.10(pid=31923): Launched
17:14:40.430984 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005...
17:14:40.650651 run iperf3-srv_10.42.42.10: Starting iperf3-srv
17:14:40.981514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31924): Launched
17:14:41.268410 run iperf3-srv_10.42.42.10(pid=31925): Launched
17:14:41.393342 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006...
17:14:41.613956 run iperf3-srv_10.42.42.10: Starting iperf3-srv
17:14:41.944828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31926): Launched
17:14:42.231125 run iperf3-srv_10.42.42.10(pid=31927): Launched
17:14:42.355455 tst iperf3m4.py:8: start network...
17:14:42.576121 run osmo-hlr_10.42.42.2: Starting osmo-hlr
17:14:43.086634 run create_hlr_db(pid=31928): Launched
17:14:43.211904 bus /gobi_6: Setting Powered False
17:14:44.277861 run create_hlr_db(pid=31928): Terminated: ok {rc=0}
17:14:44.735652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31930): Launched
17:14:45.066074 run osmo-hlr_10.42.42.2(pid=31931): Launched
17:14:45.191622 run osmo-stp_10.42.42.5: Starting osmo-stp
17:14:45.753776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31932): Launched
17:14:46.084303 run osmo-stp_10.42.42.5(pid=31933): Launched
17:14:46.207931 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn
17:14:46.769447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31934): Launched
17:14:46.893976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
17:14:47.172552 run patchelf(pid=31935): Launched
17:14:48.358050 run patchelf(pid=31935): Terminated: ok {rc=0}
17:14:48.496404 run osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn
17:14:48.776263 run osmo-gsm-tester_setcap_net_admin.sh(pid=31936): Launched
17:14:49.964120 run osmo-gsm-tester_setcap_net_admin.sh(pid=31936): Terminated: ok {rc=0}
17:14:50.305176 run osmo-ggsn_10.42.42.6(pid=31939): Launched
17:14:50.429984 run osmo-sgsn_10.42.42.7: Starting osmo-sgsn
17:14:51.157575 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31965): Launched
17:14:51.486851 run osmo-sgsn_10.42.42.7(pid=31966): Launched
17:14:51.614191 run osmo-msc_10.42.42.8: Starting osmo-msc
17:14:52.217116 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31967): Launched
17:14:52.547697 run osmo-msc_10.42.42.8(pid=31970): Launched
17:14:55.732314 run osmo-mgw_10.42.42.3: Starting osmo-mgw
17:14:56.308070 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31971): Launched
17:14:56.615027 run osmo-mgw_10.42.42.3(pid=31972): Launched
17:14:56.733057 run osmo-mgw_10.42.42.4: Starting osmo-mgw
17:14:57.245434 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31973): Launched
17:14:57.595792 run osmo-mgw_10.42.42.4(pid=31974): Launched
17:14:57.723072 run osmo-bsc_10.42.42.9: Starting osmo-bsc
17:14:58.401950 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31979): Launched
17:14:58.736368 run osmo-bsc_10.42.42.9(pid=31980): Launched
17:15:05.027180 run osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.9
17:15:05.601267 run rm-remote-dir(pid=31989): Launched
17:15:07.792255 run rm-remote-dir(pid=31989): Terminated: ok {rc=0}
17:15:08.130863 run mk-remote-dir(pid=31990): Launched
17:15:09.311051 run mk-remote-dir(pid=31990): Terminated: ok {rc=0}
17:15:09.598202 run scp-inst-to-remote(pid=31991): Launched
17:15:21.793210 run scp-inst-to-remote(pid=31991): Terminated: ok {rc=0}
17:15:22.148818 run mk-remote-dir(pid=31993): Launched
17:15:23.338223 run mk-remote-dir(pid=31993): Terminated: ok {rc=0}
17:15:23.643131 run scp-cfg-to-remote(pid=31994): Launched
17:15:24.833506 run scp-cfg-to-remote(pid=31994): Terminated: ok {rc=0}
17:15:25.185686 run reload-dsp-firmware(pid=31996): Launched
17:15:27.376897 run reload-dsp-firmware(pid=31996): Terminated: ok {rc=0}
17:15:27.721440 run osmo-bts-sysmo(pid=31997): Launched
17:15:31.961220 tst iperf3m4.py:8: Waiting for bts to be ready...
17:15:33.688754 run rm-remote-dir(pid=31998): Launched
17:15:35.878569 run rm-remote-dir(pid=31998): Terminated: ok {rc=0}
17:15:36.226434 run mk-remote-dir(pid=31999): Launched
17:15:38.413824 run mk-remote-dir(pid=31999): Terminated: ok {rc=0}
17:15:38.712529 run scp-inst-to-bts(pid=32000): Launched
17:15:51.920875 run scp-inst-to-bts(pid=32000): Terminated: ok {rc=0}
17:15:52.269407 run mk-remote-run-dir(pid=32002): Launched
17:15:54.455035 run mk-remote-run-dir(pid=32002): Terminated: ok {rc=0}
17:15:54.735299 run scp-cfg-to-sysmobts(pid=32003): Launched
17:15:56.910103 run scp-cfg-to-sysmobts(pid=32003): Terminated: ok {rc=0}
17:15:57.236024 run osmo-pcu(pid=32005): Launched
17:15:57.360507 tst iperf3m4.py: using MSISDN 4031
17:15:57.532485 bus /gobi_6: Setting Powered True
17:16:01.033885 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000010978', msisdn='4031', subscriber_id=1}
17:16:01.308304 bus /gobi_6: Setting Online False
17:16:02.495484 bus /gobi_6: Setting Powered False
17:16:09.236266 bus /gobi_6: Setting Powered True
17:16:10.621841 bus /gobi_6: Setting Online True
17:16:13.103950 tst /gobi_6: Connect to ('901', '70')
17:16:13.392715 tst /gobi_6: Manufacturer: 'Quectel', Model: 'EC20', Revision: 'EC20EQAR02A13E2G 1 [Jul 5 2017 10:49:17]', Serial: '868323024273648'
17:16:13.512715 tst iperf3m4.py: using MSISDN 4032
17:16:13.737363 bus /gobi_0: Setting Powered True
17:16:17.242223 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000023847', msisdn='4032', subscriber_id=2}
17:16:17.512168 bus /gobi_0: Setting Online False
17:16:18.700038 bus /gobi_0: Setting Powered False
17:16:26.133592 bus /gobi_0: Setting Powered True
17:16:27.519189 bus /gobi_0: Setting Online True
17:16:30.108403 tst /gobi_0: Connect to ('901', '70')
17:16:30.397163 tst /gobi_0: Manufacturer: 'Quectel', Model: 'EC20', Revision: 'EC20EQAR02A05E2G 1 [Mar 14 2016 19:33:01]', Serial: '868323024271873'
17:16:30.528944 tst iperf3m4.py: using MSISDN 4033
17:16:30.763586 tst /gobi_6: Already registered with network ('901', '70')
17:16:30.945081 bus /gobi_1: Setting Powered True
17:16:34.545246 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000023848', msisdn='4033', subscriber_id=3}
17:16:34.866246 bus /gobi_1: Setting Online False
17:16:36.050161 bus /gobi_1: Setting Powered False
17:16:43.125335 bus /gobi_1: Setting Powered True
17:16:44.516371 bus /gobi_1: Setting Online True
17:16:45.539203 tst /gobi_0: Already registered with network ('901', '70')
17:16:47.173939 tst /gobi_1: Connect to ('901', '70')
17:16:47.436016 tst /gobi_1: Manufacturer: 'Quectel', Model: 'EC20', Revision: 'EC20EQAR02A05E2G 1 [Mar 14 2016 19:33:01]', Serial: '868323024272103'
17:16:47.564975 tst iperf3m4.py: using MSISDN 4034
17:16:47.750472 bus /gobi_4: Setting Powered True
17:16:51.256264 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000023849', msisdn='4034', subscriber_id=4}
17:16:51.540727 bus /gobi_4: Setting Online False
17:16:52.734504 bus /gobi_4: Setting Powered False
17:17:00.134467 bus /gobi_4: Setting Powered True
17:17:01.509788 bus /gobi_4: Setting Online True
17:17:03.984992 tst /gobi_4: Connect to ('901', '70')
17:17:04.273540 tst /gobi_4: Manufacturer: 'Quectel', Model: 'EC20', Revision: 'EC20EQAR02A08E2G 1 [Jul 21 2016 10:00:50]', Serial: '868323025161511'
17:17:04.391969 tst iperf3m4.py:8: waiting for modems to attach...
17:17:05.129932 tst /gobi_1: Already registered with network ('901', '70')
17:17:22.416234 tst /gobi_4: Already registered with network ('901', '70')
17:17:27.282462 tst iperf3m4.py:8: waiting for modems to attach to data services...
17:17:30.480027 tst /gobi_6: context activated {apn='inet46', path='/gobi_6/context2', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={}, Name='Internet', Password='', Protocol='ip', Settings={Address='176.16.46.1', DomainNameServers=['192.168.100.1', '8.8.8.8'], Gateway='176.16.46.2', Interface='r433306bbc2604b', Method='static', Netmask='255.255.255.252'}, Type='internet', Username='ogt'}, user='ogt'}
17:17:30.591419 tst iperf3m4.py:8: Setting up data plan for "'/gobi_6/context2'"
17:17:31.010992 run move_netns(pid=32014): Launched
17:17:32.199433 run move_netns(pid=32014): Terminated: ok {rc=0}
17:17:32.531191 run ifup(pid=32017): Launched
17:17:33.711230 run ifup(pid=32017): Terminated: ok {rc=0}
17:17:34.042480 run dhcp(pid=32020): Launched
17:17:35.217858 run dhcp(pid=32020): Terminated: ok {rc=0}
17:17:38.220876 tst /gobi_0: context activated {apn='inet46', path='/gobi_0/context2', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={}, Name='Internet', Password='', Protocol='ip', Settings={Address='176.16.46.2', DomainNameServers=['192.168.100.1', '8.8.8.8'], Gateway='176.16.46.1', Interface='r82dcf628584c1c', Method='static', Netmask='255.255.255.252'}, Type='internet', Username='ogt'}, user='ogt'}
17:17:38.340315 tst iperf3m4.py:8: Setting up data plan for "'/gobi_0/context2'"
17:17:38.792231 run move_netns(pid=32038): Launched
17:17:39.984724 run move_netns(pid=32038): Terminated: ok {rc=0}
17:17:40.342209 run ifup(pid=32041): Launched
17:17:41.531058 run ifup(pid=32041): Terminated: ok {rc=0}
17:17:41.885065 run dhcp(pid=32044): Launched
17:17:43.071028 run dhcp(pid=32044): Terminated: ok {rc=0}
17:17:51.406618 tst /gobi_1: context activated {apn='inet46', path='/gobi_1/context13', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={}, Name='Internet', Password='', Protocol='ip', Settings={Address='176.16.46.3', DomainNameServers=['192.168.100.1', '8.8.8.8'], Gateway='176.16.46.1', Interface='rf303c5eb721dad', Method='static', Netmask='255.255.255.248'}, Type='internet', Username='ogt'}, user='ogt'}
17:17:51.517253 tst iperf3m4.py:8: Setting up data plan for "'/gobi_1/context13'"
17:17:51.936720 run move_netns(pid=32062): Launched
17:17:53.122336 run move_netns(pid=32062): Terminated: ok {rc=0}
17:17:53.454238 run ifup(pid=32065): Launched
17:17:54.647066 run ifup(pid=32065): Terminated: ok {rc=0}
17:17:55.001069 run dhcp(pid=32068): Launched
17:17:56.194142 run dhcp(pid=32068): Terminated: ok {rc=0}
17:17:59.213965 tst /gobi_4: context activated {apn='inet46', path='/gobi_4/context2', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={}, Name='Internet', Password='', Protocol='ip', Settings={Address='176.16.46.4', DomainNameServers=['192.168.100.1', '8.8.8.8'], Gateway='176.16.46.5', Interface='r9d788e55295d1b', Method='static', Netmask='255.255.255.252'}, Type='internet', Username='ogt'}, user='ogt'}
17:17:59.324867 tst iperf3m4.py:8: Setting up data plan for "'/gobi_4/context2'"
17:17:59.743421 run move_netns(pid=32088): Launched
17:18:00.929485 run move_netns(pid=32088): Terminated: ok {rc=0}
17:18:01.285949 run ifup(pid=32092): Launched
17:18:02.477336 run ifup(pid=32092): Terminated: ok {rc=0}
17:18:02.830206 run dhcp(pid=32095): Launched
17:18:04.019447 run dhcp(pid=32095): Terminated: ok {rc=0}
17:18:04.157767 tst iperf3m4.py:8: Running iperf3 client to 10.42.42.10:5003 through "'/gobi_6/context2'"
17:18:04.383946 run iperf3-cli_10.42.42.10: Preparing iperf3-client connecting to 10.42.42.10:5003 (proto=tcp,time=60s)
17:18:04.774878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32111): Launched
17:18:04.990548 tst iperf3m4.py:8: Running iperf3 client to 10.42.42.10:5004 through "'/gobi_0/context2'"
17:18:05.215588 run iperf3-cli_10.42.42.10: Preparing iperf3-client connecting to 10.42.42.10:5004 (proto=tcp,time=60s)
17:18:05.608191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32114): Launched
17:18:05.828255 tst iperf3m4.py:8: Running iperf3 client to 10.42.42.10:5005 through "'/gobi_1/context13'"
17:18:06.053850 run iperf3-cli_10.42.42.10: Preparing iperf3-client connecting to 10.42.42.10:5005 (proto=tcp,time=60s)
17:18:06.446158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32117): Launched
17:18:06.661411 tst iperf3m4.py:8: Running iperf3 client to 10.42.42.10:5006 through "'/gobi_4/context2'"
17:18:06.886640 run iperf3-cli_10.42.42.10: Preparing iperf3-client connecting to 10.42.42.10:5006 (proto=tcp,time=60s)
17:18:07.277501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32120): Launched
17:18:07.623385 run iperf3-cli_10.42.42.10(pid=32123): Launched
17:18:07.913054 run iperf3-cli_10.42.42.10(pid=32126): Launched
17:18:08.207924 run iperf3-cli_10.42.42.10(pid=32129): Launched
17:18:08.490566 run iperf3-cli_10.42.42.10(pid=32132): Launched
17:19:22.834080 run iperf3-cli_10.42.42.10(pid=32123): ERR: Terminated: ERROR {rc=1} [trial-2068↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪iperf3-srv_10.42.42.10↪iperf3-cli_10.42.42.10↪iperf3-cli_10.42.42.10(pid=32123)]
17:19:22.978393 run iperf3-cli_10.42.42.10(pid=32123): stdout:
| "bits_per_second": 0,
| "retransmits": 0,
| "omitted": false
| }
| }],
| "end": {
| },
| "error": "error - control socket has closed unexpectedly"
| }
| child exited with 1
17:19:23.122313 run iperf3-cli_10.42.42.10(pid=32123): stderr:
| (launched: 2022-12-01_17:18:07.606904)
17:19:24.325556 run iperf3-cli_10.42.42.10(pid=32126): ERR: Terminated: ERROR {rc=1} [trial-2068↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪iperf3-srv_10.42.42.10↪iperf3-cli_10.42.42.10↪iperf3-cli_10.42.42.10(pid=32126)]
17:19:24.467980 run iperf3-cli_10.42.42.10(pid=32126): stdout:
| "bits_per_second": 0,
| "retransmits": 0,
| "omitted": false
| }
| }],
| "end": {
| },
| "error": "error - control socket has closed unexpectedly"
| }
| child exited with 1
17:19:24.601864 run iperf3-cli_10.42.42.10(pid=32126): stderr:
| (launched: 2022-12-01_17:18:07.896232)
17:19:25.787108 run iperf3-cli_10.42.42.10(pid=32129): ERR: Terminated: ERROR {rc=1} [trial-2068↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪iperf3-srv_10.42.42.10↪iperf3-cli_10.42.42.10↪iperf3-cli_10.42.42.10(pid=32129)]
17:19:25.915786 run iperf3-cli_10.42.42.10(pid=32129): stdout:
| "bits_per_second": 0,
| "retransmits": 0,
| "omitted": false
| }
| }],
| "end": {
| },
| "error": "error - control socket has closed unexpectedly"
| }
| child exited with 1
17:19:26.045870 run iperf3-cli_10.42.42.10(pid=32129): stderr:
| (launched: 2022-12-01_17:18:08.190002)
17:19:27.231863 run iperf3-cli_10.42.42.10(pid=32132): ERR: Terminated: ERROR {rc=1} [trial-2068↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪iperf3-srv_10.42.42.10↪iperf3-cli_10.42.42.10↪iperf3-cli_10.42.42.10(pid=32132)]
17:19:27.359894 run iperf3-cli_10.42.42.10(pid=32132): stdout:
| "bits_per_second": 0,
| "retransmits": 0,
| "omitted": false
| }
| }],
| "end": {
| },
| "error": "error - control socket has closed unexpectedly"
| }
| child exited with 1
17:19:27.488583 run iperf3-cli_10.42.42.10(pid=32132): stderr:
| (launched: 2022-12-01_17:18:08.474417)
17:19:27.616618 run iperf3-srv_10.42.42.10(pid=31921): Terminating (SIGINT)
17:19:27.947500 run iperf3-srv_10.42.42.10(pid=31921): Terminated {rc=1}
17:19:28.063299 tst iperf3m4.py:8: Results for 10.42.42.10:5003 through "'/gobi_6/context2'"
Exception while using iperf3 client results: "{'start': {'connected': [{'socket': 5, 'local_host': '176.16.46.1', 'local_port': 34282, 'remote_host': '10.42.42.10', 'remote_port': 5003}], 'version': 'iperf 3.6', 'system_info': 'Linux osmo-gsm-tester-prod 4.19.0-14-amd64 #1 SMP Debian 4.19.171-2 (2021-01-30) x86_64', 'timestamp': {'time': 'Thu, 01 Dec 2022 16:18:14 GMT', 'timesecs': 1669911494}, 'connecting_to': {'host': '10.42.42.10', 'port': 5003}, 'cookie': 'hcn54i4iq45p5avm6wayzfw5vzriyllwbs2j', 'tcp_mss_default': 1448, 'sock_bufsize': 0, 'sndbuf_actual': 16384, 'rcvbuf_actual': 131072, 'test_start': {'protocol': 'TCP', 'num_streams': 1, 'blksize': 131072, 'omit': 0, 'duration': 60, 'bytes': 0, 'blocks': 0, 'reverse': 0, 'tos': 0}}, 'intervals': [{'streams': [{'socket': 5, 'start': 0, 'end': 1.0006568431854248, 'seconds': 1.0006568431854248, 'bytes': 101360, 'bits_per_second': 810347.7286166337, 'retransmits': 0, 'snd_cwnd': 14480, 'rtt': 513339, 'rttvar': 271893, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 0, 'end': 1.0006568431854248, 'seconds': 1.0006568431854248, 'bytes': 101360, 'bits_per_second': 810347.7286166337, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 1.0006568431854248, 'end': 2.001067876815796, 'seconds': 1.000411033630371, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 14480, 'rtt': 513339, 'rttvar': 271893, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 1.0006568431854248, 'end': 2.001067876815796, 'seconds': 1.000411033630371, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 2.001067876815796, 'end': 3.0011708736419678, 'seconds': 1.0001029968261719, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 15928, 'rtt': 684503, 'rttvar': 546247, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 2.001067876815796, 'end': 3.0011708736419678, 'seconds': 1.0001029968261719, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 3.0011708736419678, 'end': 4.001204013824463, 'seconds': 1.0000331401824951, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 1, 'snd_cwnd': 17376, 'rtt': 1018815, 'rttvar': 1078309, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 3.0011708736419678, 'end': 4.001204013824463, 'seconds': 1.0000331401824951, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 1, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 4.001204013824463, 'end': 5.00116491317749, 'seconds': 0.9999608993530273, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 17376, 'rtt': 1018815, 'rttvar': 1078309, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 4.001204013824463, 'end': 5.00116491317749, 'seconds': 0.9999608993530273, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 5.00116491317749, 'end': 6.001163005828857, 'seconds': 0.9999980926513672, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 18824, 'rtt': 1504043, 'rttvar': 1779187, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 5.00116491317749, 'end': 6.001163005828857, 'seconds': 0.9999980926513672, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 6.001163005828857, 'end': 7.001262903213501, 'seconds': 1.0000998973846436, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 18824, 'rtt': 1504043, 'rttvar': 1779187, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 6.001163005828857, 'end': 7.001262903213501, 'seconds': 1.0000998973846436, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 7.001262903213501, 'end': 8.001099824905396, 'seconds': 0.9998369216918945, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 20272, 'rtt': 2116141, 'rttvar': 2558587, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 7.001262903213501, 'end': 8.001099824905396, 'seconds': 0.9998369216918945, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 8.001099824905396, 'end': 9.001163005828857, 'seconds': 1.000063180923462, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 21720, 'rtt': 2846632, 'rttvar': 3379923, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 8.001099824905396, 'end': 9.001163005828857, 'seconds': 1.000063180923462, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 9.001163005828857, 'end': 10.001266956329346, 'seconds': 1.0001039505004883, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 21720, 'rtt': 2846632, 'rttvar': 3379923, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 9.001163005828857, 'end': 10.001266956329346, 'seconds': 1.0001039505004883, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 10.001266956329346, 'end': 11.001081943511963, 'seconds': 0.9998149871826172, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 23168, 'rtt': 3673278, 'rttvar': 4188233, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 10.001266956329346, 'end': 11.001081943511963, 'seconds': 0.9998149871826172, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 11.001081943511963, 'end': 12.001067876815796, 'seconds': 0.999985933303833, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 24616, 'rtt': 4571359, 'rttvar': 4937337, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 11.001081943511963, 'end': 12.001067876815796, 'seconds': 0.999985933303833, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 12.001067876815796, 'end': 13.001315832138062, 'seconds': 1.0002479553222656, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 24616, 'rtt': 4571359, 'rttvar': 4937337, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 12.001067876815796, 'end': 13.001315832138062, 'seconds': 1.0002479553222656, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 13.001315832138062, 'end': 14.001266956329346, 'seconds': 0.9999511241912842, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 26064, 'rtt': 5552145, 'rttvar': 5664575, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 13.001315832138062, 'end': 14.001266956329346, 'seconds': 0.9999511241912842, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 14.001266956329346, 'end': 15.001137018203735, 'seconds': 0.9998700618743896, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 27512, 'rtt': 6612826, 'rttvar': 6369793, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 14.001266956329346, 'end': 15.001137018203735, 'seconds': 0.9998700618743896, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 15.001137018203735, 'end': 16.00118088722229, 'seconds': 1.0000438690185547, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 27512, 'rtt': 6612826, 'rttvar': 6369793, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 15.001137018203735, 'end': 16.00118088722229, 'seconds': 1.0000438690185547, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 16.00118088722229, 'end': 17.001320838928223, 'seconds': 1.0001399517059326, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 28960, 'rtt': 7735900, 'rttvar': 7023492, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 16.00118088722229, 'end': 17.001320838928223, 'seconds': 1.0001399517059326, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 17.001320838928223, 'end': 18.001075983047485, 'seconds': 0.9997551441192627, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 30408, 'rtt': 8772849, 'rttvar': 7341519, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 17.001320838928223, 'end': 18.001075983047485, 'seconds': 0.9997551441192627, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 18.001075983047485, 'end': 19.001149892807007, 'seconds': 1.0000739097595215, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 30408, 'rtt': 8772849, 'rttvar': 7341519, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 18.001075983047485, 'end': 19.001149892807007, 'seconds': 1.0000739097595215, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 19.001149892807007, 'end': 20.001088857650757, 'seconds': 0.99993896484375, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 31856, 'rtt': 9765650, 'rttvar': 7491741, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 19.001149892807007, 'end': 20.001088857650757, 'seconds': 0.99993896484375, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 20.001088857650757, 'end': 21.00108003616333, 'seconds': 0.9999911785125732, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 31856, 'rtt': 9765650, 'rttvar': 7491741, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 20.001088857650757, 'end': 21.00108003616333, 'seconds': 0.9999911785125732, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 21.00108003616333, 'end': 22.001073837280273, 'seconds': 0.9999938011169434, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 31856, 'rtt': 9765650, 'rttvar': 7491741, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 21.00108003616333, 'end': 22.001073837280273, 'seconds': 0.9999938011169434, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 22.001073837280273, 'end': 23.00111484527588, 'seconds': 1.0000410079956055, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 33304, 'rtt': 10822416, 'rttvar': 7732337, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 22.001073837280273, 'end': 23.00111484527588, 'seconds': 1.0000410079956055, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 23.00111484527588, 'end': 24.00107192993164, 'seconds': 0.9999570846557617, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 34752, 'rtt': 11944476, 'rttvar': 8043372, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 23.00111484527588, 'end': 24.00107192993164, 'seconds': 0.9999570846557617, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 24.00107192993164, 'end': 25.001333951950073, 'seconds': 1.0002620220184326, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 34752, 'rtt': 11944476, 'rttvar': 8043372, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 24.00107192993164, 'end': 25.001333951950073, 'seconds': 1.0002620220184326, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 25.001333951950073, 'end': 26.001075983047485, 'seconds': 0.9997420310974121, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 36200, 'rtt': 12926206, 'rttvar': 7995989, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 25.001333951950073, 'end': 26.001075983047485, 'seconds': 0.9997420310974121, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 26.001075983047485, 'end': 27.001165866851807, 'seconds': 1.0000898838043213, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 37648, 'rtt': 13972716, 'rttvar': 8090012, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 26.001075983047485, 'end': 27.001165866851807, 'seconds': 1.0000898838043213, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 27.001165866851807, 'end': 28.00113582611084, 'seconds': 0.9999699592590332, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 37648, 'rtt': 13972716, 'rttvar': 8090012, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 27.001165866851807, 'end': 28.00113582611084, 'seconds': 0.9999699592590332, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 28.00113582611084, 'end': 29.001221895217896, 'seconds': 1.0000860691070557, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 39096, 'rtt': 14895805, 'rttvar': 7913687, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 28.00113582611084, 'end': 29.001221895217896, 'seconds': 1.0000860691070557, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 29.001221895217896, 'end': 30.00116491317749, 'seconds': 0.9999430179595947, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 40544, 'rtt': 15883488, 'rttvar': 7910632, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 29.001221895217896, 'end': 30.00116491317749, 'seconds': 0.9999430179595947, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 30.00116491317749, 'end': 31.001226902008057, 'seconds': 1.0000619888305664, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 40544, 'rtt': 15883488, 'rttvar': 7910632, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 30.00116491317749, 'end': 31.001226902008057, 'seconds': 1.0000619888305664, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 31.001226902008057, 'end': 32.00116491317749, 'seconds': 0.9999380111694336, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 41992, 'rtt': 16750066, 'rttvar': 7666130, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 31.001226902008057, 'end': 32.00116491317749, 'seconds': 0.9999380111694336, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 32.00116491317749, 'end': 33.00116491317749, 'seconds': 1, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 43440, 'rtt': 17698722, 'rttvar': 7646909, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 32.00116491317749, 'end': 33.00116491317749, 'seconds': 1, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 33.00116491317749, 'end': 34.00114703178406, 'seconds': 0.9999821186065674, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 43440, 'rtt': 17698722, 'rttvar': 7646909, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 33.00116491317749, 'end': 34.00114703178406, 'seconds': 0.9999821186065674, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 34.00114703178406, 'end': 35.00107002258301, 'seconds': 0.9999229907989502, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 44888, 'rtt': 18533417, 'rttvar': 7404573, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 34.00114703178406, 'end': 35.00107002258301, 'seconds': 0.9999229907989502, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 35.00107002258301, 'end': 36.00111699104309, 'seconds': 1.000046968460083, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 44888, 'rtt': 19456510, 'rttvar': 7399615, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 35.00107002258301, 'end': 36.00111699104309, 'seconds': 1.000046968460083, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 36.00111699104309, 'end': 37.00109505653381, 'seconds': 0.9999780654907227, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 44888, 'rtt': 19456510, 'rttvar': 7399615, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 36.00111699104309, 'end': 37.00109505653381, 'seconds': 0.9999780654907227, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 37.00109505653381, 'end': 38.001307010650635, 'seconds': 1.0002119541168213, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 46336, 'rtt': 20271650, 'rttvar': 7179991, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 37.00109505653381, 'end': 38.001307010650635, 'seconds': 1.0002119541168213, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 38.001307010650635, 'end': 39.00039005279541, 'seconds': 0.9990830421447754, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 46336, 'rtt': 21175248, 'rttvar': 7192188, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 38.001307010650635, 'end': 39.00039005279541, 'seconds': 0.9990830421447754, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 39.00039005279541, 'end': 40.001330852508545, 'seconds': 1.0009407997131348, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 46336, 'rtt': 21175248, 'rttvar': 7192188, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 39.00039005279541, 'end': 40.001330852508545, 'seconds': 1.0009407997131348, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 40.001330852508545, 'end': 41.001205921173096, 'seconds': 0.9998750686645508, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 47784, 'rtt': 21958472, 'rttvar': 6960589, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 40.001330852508545, 'end': 41.001205921173096, 'seconds': 0.9998750686645508, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 41.001205921173096, 'end': 42.00130486488342, 'seconds': 1.0000989437103271, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 47784, 'rtt': 21958472, 'rttvar': 6960589, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 41.001205921173096, 'end': 42.00130486488342, 'seconds': 1.0000989437103271, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 42.00130486488342, 'end': 43.00119996070862, 'seconds': 0.9998950958251953, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 47784, 'rtt': 22835853, 'rttvar': 6975206, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 42.00130486488342, 'end': 43.00119996070862, 'seconds': 0.9998950958251953, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 43.00119996070862, 'end': 44.0010769367218, 'seconds': 0.9998769760131836, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 49232, 'rtt': 23593757, 'rttvar': 6747212, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 43.00119996070862, 'end': 44.0010769367218, 'seconds': 0.9998769760131836, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 44.0010769367218, 'end': 45.00126504898071, 'seconds': 1.0001881122589111, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 49232, 'rtt': 23593757, 'rttvar': 6747212, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 44.0010769367218, 'end': 45.00126504898071, 'seconds': 1.0001881122589111, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 45.00126504898071, 'end': 46.00131797790527, 'seconds': 1.0000529289245605, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 49232, 'rtt': 24459371, 'rttvar': 6791636, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 45.00126504898071, 'end': 46.00131797790527, 'seconds': 1.0000529289245605, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 46.00131797790527, 'end': 47.00107192993164, 'seconds': 0.9997539520263672, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 50680, 'rtt': 25216802, 'rttvar': 6608590, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 46.00131797790527, 'end': 47.00107192993164, 'seconds': 0.9997539520263672, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 47.00107192993164, 'end': 48.001163959503174, 'seconds': 1.0000920295715332, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 50680, 'rtt': 25216802, 'rttvar': 6608590, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 47.00107192993164, 'end': 48.001163959503174, 'seconds': 1.0000920295715332, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 48.001163959503174, 'end': 49.00121092796326, 'seconds': 1.000046968460083, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 50680, 'rtt': 26079720, 'rttvar': 6682278, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 48.001163959503174, 'end': 49.00121092796326, 'seconds': 1.000046968460083, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 49.00121092796326, 'end': 50.00107192993164, 'seconds': 0.9998610019683838, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 52128, 'rtt': 26854319, 'rttvar': 6560906, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 49.00121092796326, 'end': 50.00107192993164, 'seconds': 0.9998610019683838, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 50.00107192993164, 'end': 51.001641035079956, 'seconds': 1.0005691051483154, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 52128, 'rtt': 26854319, 'rttvar': 6560906, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 50.00107192993164, 'end': 51.001641035079956, 'seconds': 1.0005691051483154, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 51.001641035079956, 'end': 52.00117802619934, 'seconds': 0.9995369911193848, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 52128, 'rtt': 27749576, 'rttvar': 6711195, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 51.001641035079956, 'end': 52.00117802619934, 'seconds': 0.9995369911193848, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 52.00117802619934, 'end': 53.001163959503174, 'seconds': 0.999985933303833, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 52128, 'rtt': 27749576, 'rttvar': 6711195, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 52.00117802619934, 'end': 53.001163959503174, 'seconds': 0.999985933303833, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 53.001163959503174, 'end': 54.001078844070435, 'seconds': 0.9999148845672607, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 53576, 'rtt': 28528362, 'rttvar': 6590967, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 53.001163959503174, 'end': 54.001078844070435, 'seconds': 0.9999148845672607, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 54.001078844070435, 'end': 55.00051403045654, 'seconds': 0.9994351863861084, 'bytes': 256296, 'bits_per_second': 2051526.7302264944, 'retransmits': 0, 'snd_cwnd': 53576, 'rtt': 29397398, 'rttvar': 6681298, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 54.001078844070435, 'end': 55.00051403045654, 'seconds': 0.9994351863861084, 'bytes': 256296, 'bits_per_second': 2051526.7302264944, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 55.00051403045654, 'end': 56.001057863235474, 'seconds': 1.0005438327789307, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 53576, 'rtt': 29397398, 'rttvar': 6681298, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 55.00051403045654, 'end': 56.001057863235474, 'seconds': 1.0005438327789307, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 56.001057863235474, 'end': 57.001057863235474, 'seconds': 1, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 55024, 'rtt': 29972506, 'rttvar': 6161188, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 56.001057863235474, 'end': 57.001057863235474, 'seconds': 1, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 57.001057863235474, 'end': 58.001060009002686, 'seconds': 1.000002145767212, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 55024, 'rtt': 30665587, 'rttvar': 6007054, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 57.001057863235474, 'end': 58.001060009002686, 'seconds': 1.000002145767212, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}, {'streams': [{'socket': 5, 'start': 58.001060009002686, 'end': 59.00105905532837, 'seconds': 0.9999990463256836, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'snd_cwnd': 55024, 'rtt': 30665587, 'rttvar': 6007054, 'pmtu': 1500, 'omitted': False}], 'sum': {'start': 58.001060009002686, 'end': 59.00105905532837, 'seconds': 0.9999990463256836, 'bytes': 0, 'bits_per_second': 0, 'retransmits': 0, 'omitted': False}}], 'end': {}, 'error': 'error - control socket has closed unexpectedly'}"
17:19:28.279738 tst iperf3m4.py:8: ERR: KeyError: 'sum_sent' [trial-2068↪gprs:sysmo↪iperf3m4.py:8]
17:19:28.287475 tst iperf3m4.py:8: Test FAILED (291.0 sec)
17:19:28.294224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31920): Terminating (SIGTERM)
17:19:28.337717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31922): Terminating (SIGTERM)
17:19:28.380105 run iperf3-srv_10.42.42.10(pid=31923): Terminating (SIGTERM)
17:19:28.421891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31924): Terminating (SIGTERM)
17:19:28.463112 run iperf3-srv_10.42.42.10(pid=31925): Terminating (SIGTERM)
17:19:28.503889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31926): Terminating (SIGTERM)
17:19:28.544956 run iperf3-srv_10.42.42.10(pid=31927): Terminating (SIGTERM)
17:19:28.585807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31930): Terminating (SIGTERM)
17:19:28.627207 run osmo-hlr_10.42.42.2(pid=31931): Terminating (SIGTERM)
17:19:28.668107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31932): Terminating (SIGTERM)
17:19:28.711286 run osmo-stp_10.42.42.5(pid=31933): Terminating (SIGTERM)
17:19:28.763037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31934): Terminating (SIGTERM)
17:19:28.809923 run osmo-ggsn_10.42.42.6(pid=31939): Terminating (SIGTERM)
17:19:28.857632 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31965): Terminating (SIGTERM)
17:19:28.910374 run osmo-sgsn_10.42.42.7(pid=31966): Terminating (SIGTERM)
17:19:28.966109 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31967): Terminating (SIGTERM)
17:19:29.013835 run osmo-msc_10.42.42.8(pid=31970): Terminating (SIGTERM)
17:19:29.093644 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31971): Terminating (SIGTERM)
17:19:29.150316 run osmo-mgw_10.42.42.3(pid=31972): Terminating (SIGTERM)
17:19:29.200188 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31973): Terminating (SIGTERM)
17:19:29.243009 run osmo-mgw_10.42.42.4(pid=31974): Terminating (SIGTERM)
17:19:29.283852 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31979): Terminating (SIGTERM)
17:19:29.325195 run osmo-bsc_10.42.42.9(pid=31980): Terminating (SIGTERM)
17:19:29.368205 run osmo-bts-sysmo(pid=31997): Terminating (SIGTERM)
17:19:29.410600 run osmo-pcu(pid=32005): Terminating (SIGTERM)
17:19:29.452750 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32111): Terminating (SIGTERM)
17:19:29.593383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32111)-killSignals.SIGTERM(pid=32159): Launched
17:19:30.711051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32111)-killSignals.SIGTERM(pid=32159): Terminated: ok {rc=0}
17:19:30.779462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32114): Terminating (SIGTERM)
17:19:30.925531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32114)-killSignals.SIGTERM(pid=32164): Launched
17:19:32.017542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32114)-killSignals.SIGTERM(pid=32164): Terminated: ok {rc=0}
17:19:32.084843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32117): Terminating (SIGTERM)
17:19:32.229975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32117)-killSignals.SIGTERM(pid=32167): Launched
17:19:33.318008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32117)-killSignals.SIGTERM(pid=32167): Terminated: ok {rc=0}
17:19:33.385614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32120): Terminating (SIGTERM)
17:19:33.530588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32120)-killSignals.SIGTERM(pid=32170): Launched
17:19:34.618799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32120)-killSignals.SIGTERM(pid=32170): Terminated: ok {rc=0}
17:19:34.685991 --- ParallelTerminationStrategy: PID 31920 died...
17:19:34.706193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31920): Terminated: ok {rc=0}
17:19:34.753842 --- ParallelTerminationStrategy: PID 31922 died...
17:19:34.773824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31922): Terminated: ok {rc=0}
17:19:34.820889 --- ParallelTerminationStrategy: PID 31923 died...
17:19:34.840753 run iperf3-srv_10.42.42.10(pid=31923): Terminated {rc=256}
17:19:34.887762 --- ParallelTerminationStrategy: PID 31924 died...
17:19:34.907752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31924): Terminated: ok {rc=0}
17:19:34.954829 --- ParallelTerminationStrategy: PID 31925 died...
17:19:34.974802 run iperf3-srv_10.42.42.10(pid=31925): Terminated {rc=256}
17:19:35.021837 --- ParallelTerminationStrategy: PID 31926 died...
17:19:35.041730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31926): Terminated: ok {rc=0}
17:19:35.088641 --- ParallelTerminationStrategy: PID 31927 died...
17:19:35.108456 run iperf3-srv_10.42.42.10(pid=31927): Terminated {rc=256}
17:19:35.155130 --- ParallelTerminationStrategy: PID 31930 died...
17:19:35.175111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31930): Terminated: ok {rc=0}
17:19:35.222319 --- ParallelTerminationStrategy: PID 31931 died...
17:19:35.242235 run osmo-hlr_10.42.42.2(pid=31931): Terminated: ok {rc=0}
17:19:35.288950 --- ParallelTerminationStrategy: PID 31932 died...
17:19:35.308861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31932): Terminated: ok {rc=0}
17:19:35.355669 --- ParallelTerminationStrategy: PID 31933 died...
17:19:35.375475 run osmo-stp_10.42.42.5(pid=31933): Terminated: ok {rc=0}
17:19:35.422389 --- ParallelTerminationStrategy: PID 31934 died...
17:19:35.442203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31934): Terminated: ok {rc=0}
17:19:35.489332 --- ParallelTerminationStrategy: PID 31939 died...
17:19:35.509090 run osmo-ggsn_10.42.42.6(pid=31939): Terminated: ok {rc=0}
17:19:35.555833 --- ParallelTerminationStrategy: PID 31965 died...
17:19:35.575759 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31965): Terminated: ok {rc=0}
17:19:35.622773 --- ParallelTerminationStrategy: PID 31966 died...
17:19:35.642614 run osmo-sgsn_10.42.42.7(pid=31966): Terminated: ok {rc=0}
17:19:35.689777 --- ParallelTerminationStrategy: PID 31967 died...
17:19:35.709563 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31967): Terminated: ok {rc=0}
17:19:35.756368 --- ParallelTerminationStrategy: PID 31970 died...
17:19:35.776229 run osmo-msc_10.42.42.8(pid=31970): Terminated: ok {rc=0}
17:19:35.822931 --- ParallelTerminationStrategy: PID 31971 died...
17:19:35.843041 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31971): Terminated: ok {rc=0}
17:19:35.890263 --- ParallelTerminationStrategy: PID 31972 died...
17:19:35.910332 run osmo-mgw_10.42.42.3(pid=31972): Terminated {rc=15}
17:19:35.957516 --- ParallelTerminationStrategy: PID 31973 died...
17:19:35.977797 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31973): Terminated: ok {rc=0}
17:19:36.024962 --- ParallelTerminationStrategy: PID 31974 died...
17:19:36.044912 run osmo-mgw_10.42.42.4(pid=31974): Terminated {rc=15}
17:19:36.092219 --- ParallelTerminationStrategy: PID 31979 died...
17:19:36.112375 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31979): Terminated: ok {rc=0}
17:19:36.159370 --- ParallelTerminationStrategy: PID 31980 died...
17:19:36.179293 run osmo-bsc_10.42.42.9(pid=31980): Terminated: ok {rc=0}
17:19:36.226312 --- ParallelTerminationStrategy: PID 31997 died...
17:19:36.246619 run osmo-bts-sysmo(pid=31997): Terminated: ok {rc=0}
17:19:36.294178 --- ParallelTerminationStrategy: PID 32005 died...
17:19:36.315077 run osmo-pcu(pid=32005): Terminated: ok {rc=0}
17:19:42.184436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32111): Terminating (SIGINT)
17:19:42.324471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32111)-killSignals.SIGINT(pid=32173): Launched
17:19:43.414633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32111)-killSignals.SIGINT(pid=32173): Terminated: ok {rc=0}
17:19:43.482334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32114): Terminating (SIGINT)
17:19:43.626895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32114)-killSignals.SIGINT(pid=32176): Launched
17:19:44.712726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32114)-killSignals.SIGINT(pid=32176): Terminated: ok {rc=0}
17:19:44.776912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32117): Terminating (SIGINT)
17:19:44.916148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32117)-killSignals.SIGINT(pid=32179): Launched
17:19:45.998343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32117)-killSignals.SIGINT(pid=32179): Terminated: ok {rc=0}
17:19:46.062520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32120): Terminating (SIGINT)
17:19:46.201249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32120)-killSignals.SIGINT(pid=32182): Launched
17:19:47.290076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32120)-killSignals.SIGINT(pid=32182): Terminated: ok {rc=0}
17:19:53.176621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32111): Terminating (SIGKILL)
17:19:53.316523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32111)-killSignals.SIGUSR1(pid=32185): Launched
17:19:54.401935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32111)-killSignals.SIGUSR1(pid=32185): Terminated: ok {rc=0}
17:19:54.466041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32114): Terminating (SIGKILL)
17:19:54.603561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32114)-killSignals.SIGUSR1(pid=32188): Launched
17:19:55.687002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32114)-killSignals.SIGUSR1(pid=32188): Terminated: ok {rc=0}
17:19:55.750875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32117): Terminating (SIGKILL)
17:19:55.888952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32117)-killSignals.SIGUSR1(pid=32191): Launched
17:19:56.976641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32117)-killSignals.SIGUSR1(pid=32191): Terminated: ok {rc=0}
17:19:57.040426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32120): Terminating (SIGKILL)
17:19:57.178514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32120)-killSignals.SIGUSR1(pid=32194): Launched
17:19:58.267570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32120)-killSignals.SIGUSR1(pid=32194): Terminated: ok {rc=0}
17:19:58.526057 bus /gobi_4: Setting Online False
17:19:59.702371 bus /gobi_4: Setting Powered False
17:20:07.936758 bus /gobi_4: Setting Powered False
17:20:09.032825 bus /gobi_4: Setting Powered False
17:20:10.190862 bus /gobi_1: Setting Online False
17:20:11.308312 bus /gobi_1: Setting Powered False
17:20:19.049687 bus /gobi_1: Setting Powered False
17:20:20.150369 bus /gobi_1: Setting Powered False
17:20:21.309540 bus /gobi_0: Setting Online False
17:20:22.441940 bus /gobi_0: Setting Powered False
17:20:30.940034 bus /gobi_0: Setting Powered False
17:20:32.039810 bus /gobi_0: Setting Powered False
17:20:33.198041 bus /gobi_6: Setting Online False
17:20:34.313293 bus /gobi_6: Setting Powered False
17:20:42.116474 bus /gobi_6: Setting Powered False
----------------------------------------------
trial-2068 gprs:sysmo ping.py
----------------------------------------------
17:20:43.278587 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:20:43.290897 tst gprs:sysmo: Using 1 x bts (candidates: 1)
17:20:43.330097 tst ping.py: using LAC 4437
17:20:43.456410 tst ping.py: using RAC 102
17:20:43.581629 tst ping.py: using CellId 4437
17:20:43.704495 tst ping.py: using BVCI 4438
17:20:43.821435 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:20:43.832715 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:20:43.843892 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:20:43.855149 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:20:43.866207 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:20:43.877904 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:20:43.889432 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:20:43.900729 tst gprs:sysmo: Using 1 x modem (candidates: 4)
17:20:44.020035 tst ping.py:19: start network...
17:20:44.238198 run osmo-hlr_10.42.42.2: Starting osmo-hlr
17:20:44.740226 run create_hlr_db(pid=32204): Launched
17:20:44.864455 bus /gobi_6: Setting Powered False
17:20:45.928523 run create_hlr_db(pid=32204): Terminated: ok {rc=0}
17:20:46.380686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32206): Launched
17:20:46.705214 run osmo-hlr_10.42.42.2(pid=32207): Launched
17:20:46.829779 run osmo-stp_10.42.42.5: Starting osmo-stp
17:20:47.382284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32208): Launched
17:20:47.708751 run osmo-stp_10.42.42.5(pid=32209): Launched
17:20:47.831382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn
17:20:48.385200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32210): Launched
17:20:48.508676 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
17:20:48.783862 run patchelf(pid=32211): Launched
17:20:49.967900 run patchelf(pid=32211): Terminated: ok {rc=0}
17:20:50.104454 run osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn
17:20:50.381878 run osmo-gsm-tester_setcap_net_admin.sh(pid=32212): Launched
17:20:51.566885 run osmo-gsm-tester_setcap_net_admin.sh(pid=32212): Terminated: ok {rc=0}
17:20:51.903820 run osmo-ggsn_10.42.42.6(pid=32215): Launched
17:20:52.026278 run osmo-sgsn_10.42.42.7: Starting osmo-sgsn
17:20:52.724180 run pcap-recorder_any(filters='host 10.42.42.7')(pid=32232): Launched
17:20:53.049007 run osmo-sgsn_10.42.42.7(pid=32233): Launched
17:20:53.172648 run osmo-msc_10.42.42.8: Starting osmo-msc
17:20:53.761393 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=32234): Launched
17:20:54.086585 run osmo-msc_10.42.42.8(pid=32235): Launched
17:20:57.267858 run osmo-mgw_10.42.42.3: Starting osmo-mgw
17:20:57.823578 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=32236): Launched
17:20:58.150081 run osmo-mgw_10.42.42.3(pid=32237): Launched
17:20:58.274861 run osmo-mgw_10.42.42.4: Starting osmo-mgw
17:20:58.818897 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=32238): Launched
17:20:59.144831 run osmo-mgw_10.42.42.4(pid=32239): Launched
17:20:59.269198 run osmo-bsc_10.42.42.9: Starting osmo-bsc
17:20:59.941048 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=32240): Launched
17:21:00.265963 run osmo-bsc_10.42.42.9(pid=32241): Launched
17:21:06.552394 run osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.9
17:21:07.117928 run rm-remote-dir(pid=32242): Launched
17:21:09.311510 run rm-remote-dir(pid=32242): Terminated: ok {rc=0}
17:21:09.667388 run mk-remote-dir(pid=32243): Launched
17:21:10.856526 run mk-remote-dir(pid=32243): Terminated: ok {rc=0}
17:21:11.160654 run scp-inst-to-remote(pid=32244): Launched
17:21:23.365815 run scp-inst-to-remote(pid=32244): Terminated: ok {rc=0}
17:21:23.694931 run mk-remote-dir(pid=32246): Launched
17:21:24.869650 run mk-remote-dir(pid=32246): Terminated: ok {rc=0}
17:21:25.153064 run scp-cfg-to-remote(pid=32247): Launched
17:21:26.328214 run scp-cfg-to-remote(pid=32247): Terminated: ok {rc=0}
17:21:26.654072 run reload-dsp-firmware(pid=32249): Launched
17:21:28.829336 run reload-dsp-firmware(pid=32249): Terminated: ok {rc=0}
17:21:29.147369 run osmo-bts-sysmo(pid=32250): Launched
17:21:33.368196 tst ping.py:31: Waiting for bts to be ready...
17:21:35.036129 run rm-remote-dir(pid=32251): Launched
17:21:37.205952 run rm-remote-dir(pid=32251): Terminated: ok {rc=0}
17:21:37.524853 run mk-remote-dir(pid=32252): Launched
17:21:39.695224 run mk-remote-dir(pid=32252): Terminated: ok {rc=0}
17:21:39.980077 run scp-inst-to-bts(pid=32253): Launched
17:21:53.174378 run scp-inst-to-bts(pid=32253): Terminated: ok {rc=0}
17:21:53.496278 run mk-remote-run-dir(pid=32255): Launched
17:21:55.667356 run mk-remote-run-dir(pid=32255): Terminated: ok {rc=0}
17:21:55.941196 run scp-cfg-to-sysmobts(pid=32256): Launched
17:21:58.112075 run scp-cfg-to-sysmobts(pid=32256): Terminated: ok {rc=0}
17:21:58.433206 run osmo-pcu(pid=32258): Launched
17:21:58.557390 tst ping.py: using MSISDN 4035
17:21:58.722678 bus /gobi_6: Setting Powered True
17:22:02.191391 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000010978', msisdn='4035', subscriber_id=1}
17:22:02.470486 bus /gobi_6: Setting Online False
17:22:03.660202 bus /gobi_6: Setting Powered False
17:22:11.106265 bus /gobi_6: Setting Powered True
17:22:12.475428 bus /gobi_6: Setting Online True
17:22:14.924306 tst /gobi_6: Connect to ('901', '70')
17:22:15.192307 tst /gobi_6: Manufacturer: 'Quectel', Model: 'EC20', Revision: 'EC20EQAR02A13E2G 1 [Jul 5 2017 10:49:17]', Serial: '868323024273648'
17:22:15.308345 tst ping.py:42: waiting for modems to attach...
17:22:30.566815 tst /gobi_6: Already registered with network ('901', '70')
17:22:35.054498 tst ping.py:46: waiting for modems to attach to data services...
17:22:40.873474 tst /gobi_6: context activated {apn='inet46', path='/gobi_6/context3', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={}, Name='Internet', Password='', Protocol='ip', Settings={Address='176.16.46.1', DomainNameServers=['192.168.100.1', '8.8.8.8'], Gateway='176.16.46.2', Interface='r433306bbc2604b', Method='static', Netmask='255.255.255.252'}, Type='internet', Username='ogt'}, user='ogt'}
17:22:40.990894 tst ping.py:51: Setting up data plan for "'/gobi_6/context3'"
17:22:41.436616 run move_netns(pid=32268): Launched
17:22:42.633353 run move_netns(pid=32268): Terminated: ok {rc=0}
17:22:42.984616 run ifup(pid=32271): Launched
17:22:44.177827 run ifup(pid=32271): Terminated: ok {rc=0}
17:22:44.527237 run dhcp(pid=32274): Launched
17:22:45.709341 run dhcp(pid=32274): Terminated: ok {rc=0}
17:22:45.838022 tst ping.py:53: Running 10 ping requests for "'/gobi_6/context3'"
17:22:46.235248 run ping(pid=32290): Launched
17:22:56.434022 run ping(pid=32290): Terminated: ok {rc=0}
17:22:58.164560 tst /gobi_6: context deactivated {path='/gobi_6/context3'}
17:23:05.383117 tst /gobi_6: context activated {apn='inet46', path='/gobi_6/context3', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={Interface='r433306bbc2604b'}, Name='Internet', Password='', Protocol='ipv6', Settings={}, Type='internet', Username='ogt'}, user='ogt'}
17:24:01.751571 tst /gobi_6: context deactivated {path='/gobi_6/context3'}
17:24:01.868800 tst ping.py:70: (launched: 2022-12-01_17:22:46.174200)
32291: waiting for 32292
PING 10.42.42.6 (10.42.42.6) 56(84) bytes of data.
64 bytes from 10.42.42.6: icmp_seq=1 ttl=64 time=572 ms
64 bytes from 10.42.42.6: icmp_seq=2 ttl=64 time=489 ms
64 bytes from 10.42.42.6: icmp_seq=3 ttl=64 time=467 ms
64 bytes from 10.42.42.6: icmp_seq=4 ttl=64 time=568 ms
64 bytes from 10.42.42.6: icmp_seq=5 ttl=64 time=588 ms
64 bytes from 10.42.42.6: icmp_seq=6 ttl=64 time=582 ms
64 bytes from 10.42.42.6: icmp_seq=7 ttl=64 time=565 ms
64 bytes from 10.42.42.6: icmp_seq=8 ttl=64 time=560 ms
64 bytes from 10.42.42.6: icmp_seq=9 ttl=64 time=560 ms
64 bytes from 10.42.42.6: icmp_seq=10 ttl=64 time=538 ms
--- 10.42.42.6 ping statistics ---
10 packets transmitted, 10 received, 0% packet loss, time 20ms
rtt min/avg/max/mdev = 466.595/548.899/587.663/38.082 ms
child exited with 0
17:24:02.088488 tst ping.py: Test passed (198.8 sec)
17:24:02.157755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32206): Terminating (SIGTERM)
17:24:02.201504 run osmo-hlr_10.42.42.2(pid=32207): Terminating (SIGTERM)
17:24:02.245249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32208): Terminating (SIGTERM)
17:24:02.290154 run osmo-stp_10.42.42.5(pid=32209): Terminating (SIGTERM)
17:24:02.336454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32210): Terminating (SIGTERM)
17:24:02.394459 run osmo-ggsn_10.42.42.6(pid=32215): Terminating (SIGTERM)
17:24:02.442170 run pcap-recorder_any(filters='host 10.42.42.7')(pid=32232): Terminating (SIGTERM)
17:24:02.538469 run osmo-sgsn_10.42.42.7(pid=32233): Terminating (SIGTERM)
17:24:02.585150 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=32234): Terminating (SIGTERM)
17:24:02.631589 run osmo-msc_10.42.42.8(pid=32235): Terminating (SIGTERM)
17:24:02.675708 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=32236): Terminating (SIGTERM)
17:24:02.721400 run osmo-mgw_10.42.42.3(pid=32237): Terminating (SIGTERM)
17:24:02.764668 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=32238): Terminating (SIGTERM)
17:24:02.807988 run osmo-mgw_10.42.42.4(pid=32239): Terminating (SIGTERM)
17:24:02.850769 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=32240): Terminating (SIGTERM)
17:24:02.894437 run osmo-bsc_10.42.42.9(pid=32241): Terminating (SIGTERM)
17:24:02.937081 run osmo-bts-sysmo(pid=32250): Terminating (SIGTERM)
17:24:02.980228 run osmo-pcu(pid=32258): Terminating (SIGTERM)
17:24:03.023664 --- ParallelTerminationStrategy: PID 32206 died...
17:24:03.043985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32206): Terminated: ok {rc=0}
17:24:03.091371 --- ParallelTerminationStrategy: PID 32207 died...
17:24:03.111345 run osmo-hlr_10.42.42.2(pid=32207): Terminated: ok {rc=0}
17:24:03.158485 --- ParallelTerminationStrategy: PID 32208 died...
17:24:03.178395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32208): Terminated: ok {rc=0}
17:24:03.225587 --- ParallelTerminationStrategy: PID 32209 died...
17:24:03.245401 run osmo-stp_10.42.42.5(pid=32209): Terminated: ok {rc=0}
17:24:03.292800 --- ParallelTerminationStrategy: PID 32210 died...
17:24:03.313043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32210): Terminated: ok {rc=0}
17:24:03.362299 --- ParallelTerminationStrategy: PID 32215 died...
17:24:03.383721 run osmo-ggsn_10.42.42.6(pid=32215): Terminated: ok {rc=0}
17:24:03.434321 --- ParallelTerminationStrategy: PID 32232 died...
17:24:03.455331 run pcap-recorder_any(filters='host 10.42.42.7')(pid=32232): Terminated: ok {rc=0}
17:24:03.505840 --- ParallelTerminationStrategy: PID 32234 died...
17:24:03.527003 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=32234): Terminated: ok {rc=0}
17:24:03.577952 --- ParallelTerminationStrategy: PID 32235 died...
17:24:03.610174 run osmo-msc_10.42.42.8(pid=32235): Terminated: ok {rc=0}
17:24:03.708135 --- ParallelTerminationStrategy: PID 32236 died...
17:24:03.740279 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=32236): Terminated: ok {rc=0}
17:24:03.789914 --- ParallelTerminationStrategy: PID 32237 died...
17:24:03.811055 run osmo-mgw_10.42.42.3(pid=32237): Terminated {rc=15}
17:24:03.862837 --- ParallelTerminationStrategy: PID 32238 died...
17:24:03.884262 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=32238): Terminated: ok {rc=0}
17:24:03.935121 --- ParallelTerminationStrategy: PID 32239 died...
17:24:03.956294 run osmo-mgw_10.42.42.4(pid=32239): Terminated {rc=15}
17:24:04.007092 --- ParallelTerminationStrategy: PID 32240 died...
17:24:04.028207 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=32240): Terminated: ok {rc=0}
17:24:04.079442 --- ParallelTerminationStrategy: PID 32241 died...
17:24:04.100574 run osmo-bsc_10.42.42.9(pid=32241): Terminated: ok {rc=0}
17:24:04.151548 --- ParallelTerminationStrategy: PID 32250 died...
17:24:04.172691 run osmo-bts-sysmo(pid=32250): Terminated: ok {rc=0}
17:24:04.223842 --- ParallelTerminationStrategy: PID 32258 died...
17:24:04.244935 run osmo-pcu(pid=32258): Terminated: ok {rc=0}
17:24:04.464060 --- ParallelTerminationStrategy: PID 32233 died...
17:24:04.485538 run osmo-sgsn_10.42.42.7(pid=32233): Terminated: ok {rc=0}
17:24:04.712264 bus /gobi_6: Setting Online False
17:24:08.841090 bus /gobi_6: Setting Powered False
17:24:25.939579 bus /gobi_6: Setting Powered False
----------------------------------------------
trial-2068 gprs:sysmo ping_idle_ping.py
----------------------------------------------
17:24:27.086788 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:24:27.098827 tst gprs:sysmo: Using 1 x bts (candidates: 1)
17:24:27.133602 tst ping_idle_ping.py: using LAC 4438
17:24:27.260452 tst ping_idle_ping.py: using RAC 103
17:24:27.391804 tst ping_idle_ping.py: using CellId 4438
17:24:27.521383 tst ping_idle_ping.py: using BVCI 4439
17:24:27.641345 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:24:27.652593 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:24:27.663703 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:24:27.675066 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:24:27.686162 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:24:27.697247 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:24:27.708536 tst gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:24:27.719792 tst gprs:sysmo: Using 1 x modem (candidates: 4)
17:24:27.840736 tst ping_idle_ping.py:24: start network...
17:24:28.060363 run osmo-hlr_10.42.42.2: Starting osmo-hlr
17:24:28.565576 run create_hlr_db(pid=32312): Launched
17:24:28.691576 bus /gobi_6: Setting Powered False
17:24:29.756782 run create_hlr_db(pid=32312): Terminated: ok {rc=0}
17:24:30.196437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32314): Launched
17:24:30.506035 run osmo-hlr_10.42.42.2(pid=32315): Launched
17:24:30.623523 run osmo-stp_10.42.42.5: Starting osmo-stp
17:24:31.147009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32316): Launched
17:24:31.453156 run osmo-stp_10.42.42.5(pid=32317): Launched
17:24:31.570372 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn
17:24:32.091975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32318): Launched
17:24:32.208237 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
17:24:32.466249 run patchelf(pid=32319): Launched
17:24:33.641052 run patchelf(pid=32319): Terminated: ok {rc=0}
17:24:33.769331 run osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn
17:24:34.030147 run osmo-gsm-tester_setcap_net_admin.sh(pid=32320): Launched
17:24:35.208251 run osmo-gsm-tester_setcap_net_admin.sh(pid=32320): Terminated: ok {rc=0}
17:24:35.525210 run osmo-ggsn_10.42.42.6(pid=32323): Launched
17:24:35.645398 run osmo-sgsn_10.42.42.7: Starting osmo-sgsn
17:24:36.306463 run pcap-recorder_any(filters='host 10.42.42.7')(pid=32340): Launched
17:24:36.611702 run osmo-sgsn_10.42.42.7(pid=32341): Launched
17:24:36.727763 run osmo-msc_10.42.42.8: Starting osmo-msc
17:24:37.282162 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=32342): Launched
17:24:37.589234 run osmo-msc_10.42.42.8(pid=32343): Launched
17:24:40.761301 run osmo-mgw_10.42.42.3: Starting osmo-mgw
17:24:41.285215 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=32344): Launched
17:24:41.591799 run osmo-mgw_10.42.42.3(pid=32345): Launched
17:24:41.706897 run osmo-mgw_10.42.42.4: Starting osmo-mgw
17:24:42.219541 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=32346): Launched
17:24:42.524919 run osmo-mgw_10.42.42.4(pid=32347): Launched
17:24:42.642774 run osmo-bsc_10.42.42.9: Starting osmo-bsc
17:24:43.271964 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=32348): Launched
17:24:43.576672 run osmo-bsc_10.42.42.9(pid=32349): Launched
17:24:49.847285 run osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.9
17:24:50.380230 run rm-remote-dir(pid=32350): Launched
17:24:52.563918 run rm-remote-dir(pid=32350): Terminated: ok {rc=0}
17:24:52.899565 run mk-remote-dir(pid=32351): Launched
17:24:54.078527 run mk-remote-dir(pid=32351): Terminated: ok {rc=0}
17:24:54.364850 run scp-inst-to-remote(pid=32352): Launched
17:25:06.560834 run scp-inst-to-remote(pid=32352): Terminated: ok {rc=0}
17:25:06.914960 run mk-remote-dir(pid=32357): Launched
17:25:08.105123 run mk-remote-dir(pid=32357): Terminated: ok {rc=0}
17:25:08.408925 run scp-cfg-to-remote(pid=32358): Launched
17:25:09.596403 run scp-cfg-to-remote(pid=32358): Terminated: ok {rc=0}
17:25:09.946328 run reload-dsp-firmware(pid=32360): Launched
17:25:12.134600 run reload-dsp-firmware(pid=32360): Terminated: ok {rc=0}
17:25:12.477275 run osmo-bts-sysmo(pid=32361): Launched
17:25:16.707499 tst ping_idle_ping.py:36: Waiting for bts to be ready...
17:25:18.379631 run rm-remote-dir(pid=32362): Launched
17:25:20.552493 run rm-remote-dir(pid=32362): Terminated: ok {rc=0}
17:25:20.874325 run mk-remote-dir(pid=32363): Launched
17:25:23.049725 run mk-remote-dir(pid=32363): Terminated: ok {rc=0}
17:25:23.326154 run scp-inst-to-bts(pid=32364): Launched
17:25:36.511952 run scp-inst-to-bts(pid=32364): Terminated: ok {rc=0}
17:25:36.833852 run mk-remote-run-dir(pid=32366): Launched
17:25:39.010434 run mk-remote-run-dir(pid=32366): Terminated: ok {rc=0}
17:25:39.286831 run scp-cfg-to-sysmobts(pid=32367): Launched
17:25:41.458645 run scp-cfg-to-sysmobts(pid=32367): Terminated: ok {rc=0}
17:25:41.779916 run osmo-pcu(pid=32369): Launched
17:25:41.905488 tst ping_idle_ping.py: using MSISDN 4036
17:25:42.071988 bus /gobi_6: Setting Powered True
17:25:45.583561 run osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000010978', msisdn='4036', subscriber_id=1}
17:25:45.856409 bus /gobi_6: Setting Online False
17:25:47.042633 bus /gobi_6: Setting Powered False
17:25:54.111738 bus /gobi_6: Setting Powered True
17:25:55.482820 bus /gobi_6: Setting Online True
17:25:57.924563 tst /gobi_6: Connect to ('901', '70')
17:25:58.192822 tst /gobi_6: Manufacturer: 'Quectel', Model: 'EC20', Revision: 'EC20EQAR02A13E2G 1 [Jul 5 2017 10:49:17]', Serial: '868323024273648'
17:25:58.302677 tst ping_idle_ping.py:47: waiting for modems to attach...
17:26:05.158797 tst /gobi_6: Already registered with network ('901', '70')
17:26:16.749955 tst ping_idle_ping.py:51: waiting for modems to attach to data services...
17:26:35.848591 tst /gobi_6: context activated {apn='inet46', path='/gobi_6/context2', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={}, Name='Internet', Password='', Protocol='ip', Settings={Address='176.16.46.1', DomainNameServers=['192.168.100.1', '8.8.8.8'], Gateway='176.16.46.2', Interface='r433306bbc2604b', Method='static', Netmask='255.255.255.252'}, Type='internet', Username='ogt'}, user='ogt'}
17:26:35.957050 tst ping_idle_ping.py:56: Setting up data plane for "'/gobi_6/context2'"
17:26:36.379810 run move_netns(pid=32372): Launched
17:26:37.565554 run move_netns(pid=32372): Terminated: ok {rc=0}
17:26:37.896873 run ifup(pid=32375): Launched
17:26:39.090938 run ifup(pid=32375): Terminated: ok {rc=0}
17:26:39.445328 run dhcp(pid=32378): Launched
17:26:40.636167 run dhcp(pid=32378): Terminated: ok {rc=0}
17:26:40.775479 tst ping_idle_ping.py:60: [1] Running 10 ping requests for "'/gobi_6/context2'"
17:26:41.206866 run ping1(pid=32399): Launched
17:26:51.407450 run ping1(pid=32399): Terminated: ok {rc=0}
17:26:51.544494 tst ping_idle_ping.py:64: (launched: 2022-12-01_17:26:41.141283)
32400: waiting for 32401
PING 10.42.42.6 (10.42.42.6) 56(84) bytes of data.
64 bytes from 10.42.42.6: icmp_seq=1 ttl=64 time=461 ms
64 bytes from 10.42.42.6: icmp_seq=2 ttl=64 time=401 ms
64 bytes from 10.42.42.6: icmp_seq=3 ttl=64 time=360 ms
64 bytes from 10.42.42.6: icmp_seq=4 ttl=64 time=618 ms
64 bytes from 10.42.42.6: icmp_seq=5 ttl=64 time=637 ms
64 bytes from 10.42.42.6: icmp_seq=6 ttl=64 time=633 ms
64 bytes from 10.42.42.6: icmp_seq=7 ttl=64 time=616 ms
64 bytes from 10.42.42.6: icmp_seq=8 ttl=64 time=610 ms
64 bytes from 10.42.42.6: icmp_seq=9 ttl=64 time=532 ms
64 bytes from 10.42.42.6: icmp_seq=10 ttl=64 time=528 ms
--- 10.42.42.6 ping statistics ---
10 packets transmitted, 10 received, 0% packet loss, time 21ms
rtt min/avg/max/mdev = 359.659/539.679/637.444/96.540 ms
child exited with 0
17:26:51.764845 tst ping_idle_ping.py:68: Sleeping for 60 seconds
17:27:51.986659 tst ping_idle_ping.py:73: [2] Running 10 ping requests for "'/gobi_6/context2'"
17:27:52.390962 run ping2(pid=32405): Launched
17:28:02.586149 run ping2(pid=32405): Terminated: ok {rc=0}
17:28:02.713574 tst ping_idle_ping.py:77: (launched: 2022-12-01_17:27:52.328877)
32406: waiting for 32407
PING 10.42.42.6 (10.42.42.6) 56(84) bytes of data.
64 bytes from 10.42.42.6: icmp_seq=1 ttl=64 time=596 ms
64 bytes from 10.42.42.6: icmp_seq=2 ttl=64 time=515 ms
64 bytes from 10.42.42.6: icmp_seq=3 ttl=64 time=492 ms
64 bytes from 10.42.42.6: icmp_seq=4 ttl=64 time=473 ms
64 bytes from 10.42.42.6: icmp_seq=5 ttl=64 time=492 ms
64 bytes from 10.42.42.6: icmp_seq=6 ttl=64 time=488 ms
64 bytes from 10.42.42.6: icmp_seq=7 ttl=64 time=469 ms
64 bytes from 10.42.42.6: icmp_seq=8 ttl=64 time=465 ms
64 bytes from 10.42.42.6: icmp_seq=9 ttl=64 time=465 ms
64 bytes from 10.42.42.6: icmp_seq=10 ttl=64 time=443 ms
--- 10.42.42.6 ping statistics ---
10 packets transmitted, 10 received, 0% packet loss, time 20ms
rtt min/avg/max/mdev = 442.877/489.768/596.054/40.086 ms
child exited with 0
17:28:04.503170 tst /gobi_6: context deactivated {path='/gobi_6/context2'}
17:28:04.619727 tst ping_idle_ping.py: Test passed (217.5 sec)
17:28:04.688391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32314): Terminating (SIGTERM)
17:28:04.732267 run osmo-hlr_10.42.42.2(pid=32315): Terminating (SIGTERM)
17:28:04.775653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32316): Terminating (SIGTERM)
17:28:04.822917 run osmo-stp_10.42.42.5(pid=32317): Terminating (SIGTERM)
17:28:04.869036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32318): Terminating (SIGTERM)
17:28:04.914997 run osmo-ggsn_10.42.42.6(pid=32323): Terminating (SIGTERM)
17:28:04.962417 run pcap-recorder_any(filters='host 10.42.42.7')(pid=32340): Terminating (SIGTERM)
17:28:05.070096 run osmo-sgsn_10.42.42.7(pid=32341): Terminating (SIGTERM)
17:28:05.117389 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=32342): Terminating (SIGTERM)
17:28:05.165655 run osmo-msc_10.42.42.8(pid=32343): Terminating (SIGTERM)
17:28:05.212457 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=32344): Terminating (SIGTERM)
17:28:05.257980 run osmo-mgw_10.42.42.3(pid=32345): Terminating (SIGTERM)
17:28:05.302125 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=32346): Terminating (SIGTERM)
17:28:05.346661 run osmo-mgw_10.42.42.4(pid=32347): Terminating (SIGTERM)
17:28:05.390995 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=32348): Terminating (SIGTERM)
17:28:05.435805 run osmo-bsc_10.42.42.9(pid=32349): Terminating (SIGTERM)
17:28:05.479698 run osmo-bts-sysmo(pid=32361): Terminating (SIGTERM)
17:28:05.523576 run osmo-pcu(pid=32369): Terminating (SIGTERM)
17:28:05.567591 --- ParallelTerminationStrategy: PID 32314 died...
17:28:05.588275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32314): Terminated: ok {rc=0}
17:28:05.637731 --- ParallelTerminationStrategy: PID 32315 died...
17:28:05.658018 run osmo-hlr_10.42.42.2(pid=32315): Terminated: ok {rc=0}
17:28:05.707072 --- ParallelTerminationStrategy: PID 32316 died...
17:28:05.727509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32316): Terminated: ok {rc=0}
17:28:05.776286 --- ParallelTerminationStrategy: PID 32317 died...
17:28:05.796481 run osmo-stp_10.42.42.5(pid=32317): Terminated: ok {rc=0}
17:28:05.847402 --- ParallelTerminationStrategy: PID 32318 died...
17:28:05.868253 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32318): Terminated: ok {rc=0}
17:28:05.938590 --- ParallelTerminationStrategy: PID 32323 died...
17:28:05.976789 run osmo-ggsn_10.42.42.6(pid=32323): Terminated: ok {rc=0}
17:28:06.033966 --- ParallelTerminationStrategy: PID 32340 died...
17:28:06.054925 run pcap-recorder_any(filters='host 10.42.42.7')(pid=32340): Terminated: ok {rc=0}
17:28:06.108829 --- ParallelTerminationStrategy: PID 32342 died...
17:28:06.145754 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=32342): Terminated: ok {rc=0}
17:28:06.208355 --- ParallelTerminationStrategy: PID 32343 died...
17:28:06.229220 run osmo-msc_10.42.42.8(pid=32343): Terminated: ok {rc=0}
17:28:06.279276 --- ParallelTerminationStrategy: PID 32344 died...
17:28:06.300210 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=32344): Terminated: ok {rc=0}
17:28:06.350254 --- ParallelTerminationStrategy: PID 32345 died...
17:28:06.371142 run osmo-mgw_10.42.42.3(pid=32345): Terminated {rc=15}
17:28:06.421166 --- ParallelTerminationStrategy: PID 32346 died...
17:28:06.442087 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=32346): Terminated: ok {rc=0}
17:28:06.492429 --- ParallelTerminationStrategy: PID 32347 died...
17:28:06.513465 run osmo-mgw_10.42.42.4(pid=32347): Terminated {rc=15}
17:28:06.563570 --- ParallelTerminationStrategy: PID 32348 died...
17:28:06.584474 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=32348): Terminated: ok {rc=0}
17:28:06.634968 --- ParallelTerminationStrategy: PID 32349 died...
17:28:06.656141 run osmo-bsc_10.42.42.9(pid=32349): Terminated: ok {rc=0}
17:28:06.707549 --- ParallelTerminationStrategy: PID 32361 died...
17:28:06.728896 run osmo-bts-sysmo(pid=32361): Terminated: ok {rc=0}
17:28:06.779905 --- ParallelTerminationStrategy: PID 32369 died...
17:28:06.801139 run osmo-pcu(pid=32369): Terminated: ok {rc=0}
17:28:07.020438 --- ParallelTerminationStrategy: PID 32341 died...
17:28:07.042833 run osmo-sgsn_10.42.42.7(pid=32341): Terminated: ok {rc=0}
17:28:07.267854 bus /gobi_6: Setting Online False
17:28:10.313568 bus /gobi_6: Setting Powered False
17:28:25.953392 bus /gobi_6: Setting Powered False
---------------------------------------------------------------------
trial-2068 gprs:sysmo FAIL
---------------------------------------------------------------------
17:28:27.299190 tst trial-2068: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_gerrit/trial-2068/run.2022-12-01_17-03-13/trial-2068.xml
--------------------------------------------------------------------------------------------
trial-2068 FAIL
--------------------------------------------------------------------------------------------
17:28:27.519375 tst trial-2068: trial-2068: FAIL, 2 suites failed, 1 suites passed
FAIL: nitb_sms:sysmo (fail: 1)
FAIL: mo_mt_sms.py (5.0 sec) Error: osmo-nitb_10.42.42.2(pid=31563): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31563) [trial-2068↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31563)]
FAIL: gprs:sysmo (fail: 3, pass: 2)
FAIL: cs_paging_gprs_active.py (231.6 sec) KeyError: 'sum_sent'
FAIL: iperf3.py (210.2 sec) KeyError: 'sum_sent'
FAIL: iperf3m4.py (291.0 sec) KeyError: 'sum_sent'
pass: ping.py (198.8 sec)
pass: ping_idle_ping.py (217.5 sec)
PASS: sms:sysmo (pass: 1)
pass: mo_mt_sms.py (117.5 sec)
+ rm -rf trial-2068/inst
+ cd trial-2068
+ command -v journalctl
+ [ ! -z /bin/journalctl ]
+ readlink last_run
+ journalctl -u ofono -o short-precise --since 2022-12-01 17:03:12
+ readlink last_run
+ tar czf /home/jenkins/workspace/osmo-gsm-tester_gerrit/trial-2068-run.tgz run.2022-12-01_17-03-13
+ tar czf /home/jenkins/workspace/osmo-gsm-tester_gerrit/trial-2068-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17598.tgz osmo-bts-oc2g.build-5501.tgz osmo-bts-sysmo.build-8005.tgz osmo-bts.build-7474.tgz osmo-ggsn.build-6649.tgz osmo-hlr.build-8659.tgz osmo-hnbgw.build-2869.tgz osmo-mgw.build-8905.tgz osmo-msc.build-29163.tgz osmo-nitb.build-12915.tgz osmo-pcu-oc2g.build-3890.tgz osmo-pcu-sysmo.build-5172.tgz osmo-pcu.build-5133.tgz osmo-sgsn.build-29927.tgz osmo-stp.build-9200.tgz osmo-trx.build-4645.tgz osmocom-bb.build-4671.tgz srslte.build-19.tgz
+ exit 1
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
[Checks API] No suitable checks publisher found.
ERROR Gerrit response: ConflictFinished: FAILURE
![[Jenkins]](/jenkins/static/342c126a/images/svgs/logo.svg){kind=logo}
