Skip to content

Failed

gprs:sysmo.cs_paging_gprs_active.py (from gprs_sysmo)

Failing for the past 5 builds (Since #2063 )
Took 3 min 45 sec.

Stacktrace

'sum_sent'

Standard Output

----------------------------------------------
trial-2067 gprs:sysmo cs_paging_gprs_active.py
----------------------------------------------
12:02:52.061673 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
12:02:52.073087 tst                       gprs:sysmo: Using 1 x bts (candidates: 1)
12:02:52.203530 tst         cs_paging_gprs_active.py: using LAC 3966
12:02:52.331173 tst         cs_paging_gprs_active.py: using RAC 141
12:02:52.457129 tst         cs_paging_gprs_active.py: using CellId 3966
12:02:52.584021 tst         cs_paging_gprs_active.py: using BVCI 3967
12:02:52.608809 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
12:02:52.619934 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
12:02:52.630995 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
12:02:52.641998 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
12:02:52.653090 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
12:02:52.664212 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
12:02:52.675411 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
12:02:52.686440 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
12:02:52.698060 tst                       gprs:sysmo: Using 1 x modem (candidates: 4)
12:02:52.818004 tst                       gprs:sysmo: Using 1 x modem (candidates: 4)
12:02:53.095823 tst      cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003...
12:02:53.223298 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
12:02:53.540396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20907): Launched
12:02:53.806400 run iperf3-srv_10.42.42.10(pid=20908): Launched
12:02:53.991494 tst      cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004...
12:02:54.117930 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
12:02:54.433595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20909): Launched
12:02:54.698945 run iperf3-srv_10.42.42.10(pid=20910): Launched
12:02:54.884180 tst      cs_paging_gprs_active.py:38: start network...
12:02:55.010248 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
12:02:55.499541 run         create_hlr_db(pid=20911): Launched
12:02:55.674398 bus                        /sierra_2: Setting Powered False
12:02:56.696923 run         create_hlr_db(pid=20911): Terminated: ok {rc=0}
12:02:57.103662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20913): Launched
12:02:57.411124 run   osmo-hlr_10.42.42.2(pid=20914): Launched
12:02:57.521101 run              osmo-stp_10.42.42.5: Starting osmo-stp
12:02:58.050448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20916): Launched
12:02:58.355191 run   osmo-stp_10.42.42.5(pid=20917): Launched
12:02:58.464046 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
12:02:59.994493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20918): Launched
12:03:00.102256 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
12:03:00.370119 run              patchelf(pid=20919): Launched
12:03:01.551331 run              patchelf(pid=20919): Terminated: ok {rc=0}
12:03:01.662853 run             osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn
12:03:01.937143 run osmo-gsm-tester_setcap_net_admin.sh(pid=20920): Launched
12:03:03.118623 run osmo-gsm-tester_setcap_net_admin.sh(pid=20920): Terminated: ok {rc=0}
12:03:03.428863 run  osmo-ggsn_10.42.42.6(pid=20923): Launched
12:03:03.693462 run             osmo-sgsn_10.42.42.7: Starting osmo-sgsn
12:03:08.652675 run pcap-recorder_any(filters='host 10.42.42.7')(pid=20950): Launched
12:03:08.959849 run  osmo-sgsn_10.42.42.7(pid=20951): Launched
12:03:09.073020 run              osmo-msc_10.42.42.8: Starting osmo-msc
12:03:09.652721 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=20952): Launched
12:03:09.960697 run   osmo-msc_10.42.42.8(pid=20953): Launched
12:03:13.123154 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
12:03:13.656455 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=20954): Launched
12:03:13.963680 run   osmo-mgw_10.42.42.3(pid=20955): Launched
12:03:14.082903 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
12:03:14.604781 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=20956): Launched
12:03:14.912603 run   osmo-mgw_10.42.42.4(pid=20957): Launched
12:03:15.033325 run              osmo-bsc_10.42.42.9: Starting osmo-bsc
12:03:15.716980 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=20958): Launched
12:03:16.047395 run   osmo-bsc_10.42.42.9(pid=20959): Launched
12:03:22.325740 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.9
12:03:22.909093 run         rm-remote-dir(pid=20960): Launched
12:03:25.111109 run         rm-remote-dir(pid=20960): Terminated: ok {rc=0}
12:03:25.462103 run         mk-remote-dir(pid=20961): Launched
12:03:26.661468 run         mk-remote-dir(pid=20961): Terminated: ok {rc=0}
12:03:26.957998 run    scp-inst-to-remote(pid=20962): Launched
12:03:39.175332 run    scp-inst-to-remote(pid=20962): Terminated: ok {rc=0}
12:03:39.522269 run         mk-remote-dir(pid=20964): Launched
12:03:40.718859 run         mk-remote-dir(pid=20964): Terminated: ok {rc=0}
12:03:41.012711 run     scp-cfg-to-remote(pid=20965): Launched
12:03:42.199568 run     scp-cfg-to-remote(pid=20965): Terminated: ok {rc=0}
12:03:42.517052 run   reload-dsp-firmware(pid=20967): Launched
12:03:44.701337 run   reload-dsp-firmware(pid=20967): Terminated: ok {rc=0}
12:03:45.014037 run        osmo-bts-sysmo(pid=20968): Launched
12:03:49.328015 tst      cs_paging_gprs_active.py:38: Waiting for bts to be ready...
12:03:51.340332 run         rm-remote-dir(pid=20969): Launched
12:03:53.533282 run         rm-remote-dir(pid=20969): Terminated: ok {rc=0}
12:03:53.869936 run         mk-remote-dir(pid=20970): Launched
12:03:56.063698 run         mk-remote-dir(pid=20970): Terminated: ok {rc=0}
12:03:56.351025 run       scp-inst-to-bts(pid=20971): Launched
12:04:09.547909 run       scp-inst-to-bts(pid=20971): Terminated: ok {rc=0}
12:04:09.863979 run     mk-remote-run-dir(pid=20973): Launched
12:04:12.045074 run     mk-remote-run-dir(pid=20973): Terminated: ok {rc=0}
12:04:12.314282 run   scp-cfg-to-sysmobts(pid=20974): Launched
12:04:14.506603 run   scp-cfg-to-sysmobts(pid=20974): Terminated: ok {rc=0}
12:04:14.843606 run              osmo-pcu(pid=20976): Launched
12:04:14.972854 tst         cs_paging_gprs_active.py: using MSISDN 3982
12:04:15.143584 bus                          /gobi_6: Setting Powered True
12:04:18.670216 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000010978', msisdn='3982', subscriber_id=1}
12:04:18.958148 bus                          /gobi_6: Setting Online False
12:04:20.143603 bus                          /gobi_6: Setting Powered False
12:04:27.228641 bus                          /gobi_6: Setting Powered True
12:04:28.596328 bus                          /gobi_6: Setting Online True
12:04:31.031252 tst                          /gobi_6: Connect to ('901', '70')
12:04:31.302532 tst                          /gobi_6: Manufacturer: 'Quectel', Model: 'EC20', Revision: 'EC20EQAR02A13E2G  1  [Jul  5 2017 10:49:17]', Serial: '868323024273648'
12:04:31.430236 tst         cs_paging_gprs_active.py: using MSISDN 3983
12:04:31.649643 bus                          /gobi_0: Setting Powered True
12:04:35.134137 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000023847', msisdn='3983', subscriber_id=2}
12:04:35.401509 bus                          /gobi_0: Setting Online False
12:04:36.594147 bus                          /gobi_0: Setting Powered False
12:04:43.364599 bus                          /gobi_0: Setting Powered True
12:04:44.768534 bus                          /gobi_0: Setting Online True
12:04:46.469274 tst                          /gobi_6: Already registered with network ('901', '70')
12:04:47.245209 tst                          /gobi_0: Connect to ('901', '70')
12:04:47.522788 tst                          /gobi_0: Manufacturer: 'Quectel', Model: 'EC20', Revision: 'EC20EQAR02A05E2G  1  [Mar 14 2016 19:33:01]', Serial: '868323024271873'
12:04:47.723618 tst      cs_paging_gprs_active.py:38: waiting for modems to attach...
12:05:01.893097 tst                          /gobi_0: Already registered with network ('901', '70')
12:05:07.333732 tst      cs_paging_gprs_active.py:38: waiting for modems to attach to data services...
12:05:10.371232 tst                          /gobi_6: context activated {apn='inet46', path='/gobi_6/context2', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={}, Name='Internet', Password='', Protocol='ip', Settings={Address='176.16.46.1', DomainNameServers=['192.168.100.1', '8.8.8.8'], Gateway='176.16.46.2', Interface='r433306bbc2604b', Method='static', Netmask='255.255.255.252'}, Type='internet', Username='ogt'}, user='ogt'}
12:05:10.571800 tst      cs_paging_gprs_active.py:38: Setting up data plan for "'/gobi_6/context2'"
12:05:10.953341 run            move_netns(pid=20985): Launched
12:05:12.150061 run            move_netns(pid=20985): Terminated: ok {rc=0}
12:05:12.509734 run                  ifup(pid=20988): Launched
12:05:13.705435 run                  ifup(pid=20988): Terminated: ok {rc=0}
12:05:14.056066 run                  dhcp(pid=20991): Launched
12:05:15.238952 run                  dhcp(pid=20991): Terminated: ok {rc=0}
12:05:18.308181 tst                          /gobi_0: context activated {apn='inet46', path='/gobi_0/context3', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={}, Name='Internet', Password='', Protocol='ip', Settings={Address='176.16.46.2', DomainNameServers=['192.168.100.1', '8.8.8.8'], Gateway='176.16.46.1', Interface='r82dcf628584c1c', Method='static', Netmask='255.255.255.252'}, Type='internet', Username='ogt'}, user='ogt'}
12:05:18.507204 tst      cs_paging_gprs_active.py:38: Setting up data plan for "'/gobi_0/context3'"
12:05:18.875369 run            move_netns(pid=21009): Launched
12:05:20.056940 run            move_netns(pid=21009): Terminated: ok {rc=0}
12:05:20.376733 run                  ifup(pid=21012): Launched
12:05:21.559688 run                  ifup(pid=21012): Terminated: ok {rc=0}
12:05:21.882953 run                  dhcp(pid=21015): Launched
12:05:23.065380 run                  dhcp(pid=21015): Terminated: ok {rc=0}
12:05:23.257067 tst      cs_paging_gprs_active.py:38: Running iperf3 client to 10.42.42.10:5003 through "'/gobi_6/context2'"
12:05:23.386024 run           iperf3-cli_10.42.42.10: Preparing iperf3-client connecting to 10.42.42.10:5003 (proto=tcp,time=60s)
12:05:23.771495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21031): Launched
12:05:24.023657 tst      cs_paging_gprs_active.py:38: Running iperf3 client to 10.42.42.10:5004 through "'/gobi_0/context3'"
12:05:24.161703 run           iperf3-cli_10.42.42.10: Preparing iperf3-client connecting to 10.42.42.10:5004 (proto=tcp,time=60s)
12:05:24.561263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21034): Launched
12:05:24.893468 run iperf3-cli_10.42.42.10(pid=21037): Launched
12:05:25.177038 run iperf3-cli_10.42.42.10(pid=21040): Launched
12:05:25.400711 tst      cs_paging_gprs_active.py:13: waiting a few secs to make sure iperf3 test is running
12:05:27.662423 tst      cs_paging_gprs_active.py:16: iperf3 running, let's place a call
12:05:32.542421 tst      cs_paging_gprs_active.py:22: dial success
12:05:35.313151 tst      cs_paging_gprs_active.py:28: answer success, call established and ongoing
12:05:41.896195 tst      cs_paging_gprs_active.py:35: hangup success
12:06:34.180504 run iperf3-cli_10.42.42.10(pid=21037): ERR: Terminated: ERROR {rc=1}  [trial-2067↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪iperf3-srv_10.42.42.10↪iperf3-cli_10.42.42.10↪iperf3-cli_10.42.42.10(pid=21037)]
12:06:34.322600 run iperf3-cli_10.42.42.10(pid=21037): stdout: 
| 				"bits_per_second":	0,
| 				"retransmits":	0,
| 				"omitted":	false
| 			}
| 		}],
| 	"end":	{
| 	},
| 	"error":	"error - control socket has closed unexpectedly"
| }
| child exited with 1 
12:06:34.465134 run iperf3-cli_10.42.42.10(pid=21037): stderr: 
| (launched: 2022-09-08_12:05:24.778295) 
12:06:35.648989 run iperf3-cli_10.42.42.10(pid=21040): ERR: Terminated: ERROR {rc=1}  [trial-2067↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪iperf3-srv_10.42.42.10↪iperf3-cli_10.42.42.10↪iperf3-cli_10.42.42.10(pid=21040)]
12:06:35.778635 run iperf3-cli_10.42.42.10(pid=21040): stdout: 
| 				"bits_per_second":	0,
| 				"retransmits":	0,
| 				"omitted":	false
| 			}
| 		}],
| 	"end":	{
| 	},
| 	"error":	"error - control socket has closed unexpectedly"
| }
| child exited with 1 
12:06:35.906512 run iperf3-cli_10.42.42.10(pid=21040): stderr: 
| (launched: 2022-09-08_12:05:25.061346) 
12:06:36.023652 run iperf3-srv_10.42.42.10(pid=20908): Terminating (SIGINT)
12:06:36.353816 run iperf3-srv_10.42.42.10(pid=20908): Terminated {rc=1}
12:06:36.540271 tst      cs_paging_gprs_active.py:38: Results for 10.42.42.10:5003 through "'/gobi_6/context2'"
12:06:36.590985 tst      cs_paging_gprs_active.py:38: ERR: KeyError: 'sum_sent'  [trial-2067↪gprs:sysmo↪cs_paging_gprs_active.py:38]
12:06:36.597738 tst      cs_paging_gprs_active.py:38: Test FAILED (224.6 sec)
12:06:36.634347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20907): Terminating (SIGTERM)
12:06:36.675359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20909): Terminating (SIGTERM)
12:06:36.716197 run iperf3-srv_10.42.42.10(pid=20910): Terminating (SIGTERM)
12:06:36.757098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20913): Terminating (SIGTERM)
12:06:36.798560 run   osmo-hlr_10.42.42.2(pid=20914): Terminating (SIGTERM)
12:06:36.841623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20916): Terminating (SIGTERM)
12:06:36.886541 run   osmo-stp_10.42.42.5(pid=20917): Terminating (SIGTERM)
12:06:36.940624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20918): Terminating (SIGTERM)
12:06:36.982015 run  osmo-ggsn_10.42.42.6(pid=20923): Terminating (SIGTERM)
12:06:37.030145 run pcap-recorder_any(filters='host 10.42.42.7')(pid=20950): Terminating (SIGTERM)
12:06:37.076043 run  osmo-sgsn_10.42.42.7(pid=20951): Terminating (SIGTERM)
12:06:37.119927 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=20952): Terminating (SIGTERM)
12:06:37.165229 run   osmo-msc_10.42.42.8(pid=20953): Terminating (SIGTERM)
12:06:37.209134 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=20954): Terminating (SIGTERM)
12:06:37.257869 run   osmo-mgw_10.42.42.3(pid=20955): Terminating (SIGTERM)
12:06:37.318790 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=20956): Terminating (SIGTERM)
12:06:37.360197 run   osmo-mgw_10.42.42.4(pid=20957): Terminating (SIGTERM)
12:06:37.401599 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=20958): Terminating (SIGTERM)
12:06:37.442409 run   osmo-bsc_10.42.42.9(pid=20959): Terminating (SIGTERM)
12:06:37.484227 run        osmo-bts-sysmo(pid=20968): Terminating (SIGTERM)
12:06:37.528370 run              osmo-pcu(pid=20976): Terminating (SIGTERM)
12:06:37.572152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21031): Terminating (SIGTERM)
12:06:37.720975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21031)-killSignals.SIGTERM(pid=21060): Launched
12:06:38.820160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21031)-killSignals.SIGTERM(pid=21060): Terminated: ok {rc=0}
12:06:38.872144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21034): Terminating (SIGTERM)
12:06:39.051755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21034)-killSignals.SIGTERM(pid=21065): Launched
12:06:40.146970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21034)-killSignals.SIGTERM(pid=21065): Terminated: ok {rc=0}
12:06:40.160888 ---      ParallelTerminationStrategy: PID 20907 died...
12:06:40.216105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20907): Terminated: ok {rc=0}
12:06:40.225785 ---      ParallelTerminationStrategy: PID 20909 died...
12:06:40.280935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=20909): Terminated: ok {rc=0}
12:06:40.290677 ---      ParallelTerminationStrategy: PID 20910 died...
12:06:40.344363 run iperf3-srv_10.42.42.10(pid=20910): Terminated {rc=256}
12:06:40.354123 ---      ParallelTerminationStrategy: PID 20913 died...
12:06:40.408136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20913): Terminated: ok {rc=0}
12:06:40.417809 ---      ParallelTerminationStrategy: PID 20914 died...
12:06:40.471683 run   osmo-hlr_10.42.42.2(pid=20914): Terminated: ok {rc=0}
12:06:40.481560 ---      ParallelTerminationStrategy: PID 20916 died...
12:06:40.535522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20916): Terminated: ok {rc=0}
12:06:40.545390 ---      ParallelTerminationStrategy: PID 20917 died...
12:06:40.599515 run   osmo-stp_10.42.42.5(pid=20917): Terminated: ok {rc=0}
12:06:40.609324 ---      ParallelTerminationStrategy: PID 20918 died...
12:06:40.664296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=20918): Terminated: ok {rc=0}
12:06:40.674553 ---      ParallelTerminationStrategy: PID 20923 died...
12:06:40.728749 run  osmo-ggsn_10.42.42.6(pid=20923): Terminated: ok {rc=0}
12:06:40.739196 ---      ParallelTerminationStrategy: PID 20950 died...
12:06:40.793370 run pcap-recorder_any(filters='host 10.42.42.7')(pid=20950): Terminated: ok {rc=0}
12:06:40.803676 ---      ParallelTerminationStrategy: PID 20951 died...
12:06:40.857586 run  osmo-sgsn_10.42.42.7(pid=20951): Terminated: ok {rc=0}
12:06:40.867557 ---      ParallelTerminationStrategy: PID 20952 died...
12:06:40.921475 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=20952): Terminated: ok {rc=0}
12:06:40.931543 ---      ParallelTerminationStrategy: PID 20953 died...
12:06:40.985633 run   osmo-msc_10.42.42.8(pid=20953): Terminated: ok {rc=0}
12:06:40.996020 ---      ParallelTerminationStrategy: PID 20954 died...
12:06:41.050348 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=20954): Terminated: ok {rc=0}
12:06:41.060175 ---      ParallelTerminationStrategy: PID 20955 died...
12:06:41.114161 run   osmo-mgw_10.42.42.3(pid=20955): Terminated {rc=15}
12:06:41.124010 ---      ParallelTerminationStrategy: PID 20956 died...
12:06:41.177726 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=20956): Terminated: ok {rc=0}
12:06:41.187679 ---      ParallelTerminationStrategy: PID 20957 died...
12:06:41.241334 run   osmo-mgw_10.42.42.4(pid=20957): Terminated {rc=15}
12:06:41.251390 ---      ParallelTerminationStrategy: PID 20958 died...
12:06:41.305961 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=20958): Terminated: ok {rc=0}
12:06:41.315799 ---      ParallelTerminationStrategy: PID 20959 died...
12:06:41.369862 run   osmo-bsc_10.42.42.9(pid=20959): Terminated: ok {rc=0}
12:06:41.379695 ---      ParallelTerminationStrategy: PID 20968 died...
12:06:41.433519 run        osmo-bts-sysmo(pid=20968): Terminated: ok {rc=0}
12:06:41.443574 ---      ParallelTerminationStrategy: PID 20976 died...
12:06:41.497596 run              osmo-pcu(pid=20976): Terminated: ok {rc=0}
12:06:47.363897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21031): Terminating (SIGINT)
12:06:47.510610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21031)-killSignals.SIGINT(pid=21068): Launched
12:06:48.600612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21031)-killSignals.SIGINT(pid=21068): Terminated: ok {rc=0}
12:06:48.645817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21034): Terminating (SIGINT)
12:06:48.794093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21034)-killSignals.SIGINT(pid=21071): Launched
12:06:49.883966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21034)-killSignals.SIGINT(pid=21071): Terminated: ok {rc=0}
12:06:55.754398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21031): Terminating (SIGKILL)
12:06:55.905656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21031)-killSignals.SIGUSR1(pid=21074): Launched
12:06:56.995263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21031)-killSignals.SIGUSR1(pid=21074): Terminated: ok {rc=0}
12:06:57.040540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21034): Terminating (SIGKILL)
12:06:57.191564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21034)-killSignals.SIGUSR1(pid=21077): Launched
12:06:58.286991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21034)-killSignals.SIGUSR1(pid=21077): Terminated: ok {rc=0}
12:06:58.564248 bus                          /gobi_0: Setting Online False
12:07:01.347829 bus                          /gobi_0: Setting Powered False
12:07:16.027591 bus                          /gobi_0: Setting Powered False
12:07:17.134000 bus                          /gobi_0: Setting Powered False
12:07:18.287179 bus                          /gobi_6: Setting Online False
12:07:19.427941 bus                          /gobi_6: Setting Powered False
12:07:27.974599 bus                          /gobi_6: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/cs_paging_gprs_active.py", line 38, in <module>
    setup_run_iperf3_test_parallel(2, ready_cb=ready_cb_place_voicecall)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 105, in setup_run_iperf3_test_parallel
    print_results(clients[i], servers[i])
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 5, in print_results
    cli.print_results()
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/iperf3.py", line 342, in print_results
    print_result_node_tcp(self.get_results(), 'client')
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/iperf3.py", line 72, in print_result_node_tcp
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/iperf3.py", line 65, in print_result_node_tcp
    sent = result['end']['sum_sent']
KeyError: 'sum_sent'