Skip to content

Failed

gprs:sysmo.cs_paging_gprs_active.py (from gprs_sysmo)

Failing for the past 6 builds (Since #2063 )
Took 3 min 52 sec.

Stacktrace

'sum_sent'

Standard Output

----------------------------------------------
trial-2068 gprs:sysmo cs_paging_gprs_active.py
----------------------------------------------
17:05:51.068066 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:05:51.079315 tst                       gprs:sysmo: Using 1 x bts (candidates: 1)
17:05:51.205111 tst         cs_paging_gprs_active.py: using LAC 4434
17:05:51.327911 tst         cs_paging_gprs_active.py: using RAC 99
17:05:51.444991 tst         cs_paging_gprs_active.py: using CellId 4434
17:05:51.563777 tst         cs_paging_gprs_active.py: using BVCI 4435
17:05:51.587267 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:05:51.597857 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:05:51.608513 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:05:51.619226 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:05:51.629709 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:05:51.640379 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:05:51.651104 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:05:51.661662 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
17:05:51.672523 tst                       gprs:sysmo: Using 1 x modem (candidates: 4)
17:05:51.790909 tst                       gprs:sysmo: Using 1 x modem (candidates: 4)
17:05:52.090644 tst      cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003...
17:05:52.228638 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
17:05:52.570023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31602): Launched
17:05:52.857554 run iperf3-srv_10.42.42.10(pid=31603): Launched
17:05:53.058581 tst      cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004...
17:05:53.195229 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
17:05:53.535704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31604): Launched
17:05:53.819626 run iperf3-srv_10.42.42.10(pid=31605): Launched
17:05:54.020165 tst      cs_paging_gprs_active.py:38: start network...
17:05:54.156849 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
17:05:54.675424 run         create_hlr_db(pid=31606): Launched
17:05:54.864422 bus                        /sierra_2: Setting Powered False
17:05:55.885563 run         create_hlr_db(pid=31606): Terminated: ok {rc=0}
17:05:56.297584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31608): Launched
17:05:56.608583 run   osmo-hlr_10.42.42.2(pid=31609): Launched
17:05:56.718962 run              osmo-stp_10.42.42.5: Starting osmo-stp
17:05:57.249053 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31610): Launched
17:05:57.557997 run   osmo-stp_10.42.42.5(pid=31611): Launched
17:05:57.667351 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
17:05:59.181335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31612): Launched
17:05:59.289581 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
17:05:59.564563 run              patchelf(pid=31613): Launched
17:06:00.747270 run              patchelf(pid=31613): Terminated: ok {rc=0}
17:06:00.859233 run             osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn
17:06:01.142008 run osmo-gsm-tester_setcap_net_admin.sh(pid=31614): Launched
17:06:02.325755 run osmo-gsm-tester_setcap_net_admin.sh(pid=31614): Terminated: ok {rc=0}
17:06:02.638135 run  osmo-ggsn_10.42.42.6(pid=31617): Launched
17:06:02.907985 run             osmo-sgsn_10.42.42.7: Starting osmo-sgsn
17:06:07.887586 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31644): Launched
17:06:08.259602 run  osmo-sgsn_10.42.42.7(pid=31645): Launched
17:06:08.409740 run              osmo-msc_10.42.42.8: Starting osmo-msc
17:06:08.988923 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31646): Launched
17:06:09.297753 run   osmo-msc_10.42.42.8(pid=31647): Launched
17:06:12.461282 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
17:06:13.032048 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31648): Launched
17:06:13.365260 run   osmo-mgw_10.42.42.3(pid=31649): Launched
17:06:13.483656 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
17:06:14.048756 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31650): Launched
17:06:14.383069 run   osmo-mgw_10.42.42.4(pid=31651): Launched
17:06:14.502745 run              osmo-bsc_10.42.42.9: Starting osmo-bsc
17:06:15.201467 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31652): Launched
17:06:15.537449 run   osmo-bsc_10.42.42.9(pid=31653): Launched
17:06:21.809860 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.9
17:06:22.358383 run         rm-remote-dir(pid=31654): Launched
17:06:24.548506 run         rm-remote-dir(pid=31654): Terminated: ok {rc=0}
17:06:24.878874 run         mk-remote-dir(pid=31655): Launched
17:06:26.067266 run         mk-remote-dir(pid=31655): Terminated: ok {rc=0}
17:06:26.345979 run    scp-inst-to-remote(pid=31656): Launched
17:06:38.558217 run    scp-inst-to-remote(pid=31656): Terminated: ok {rc=0}
17:06:38.907661 run         mk-remote-dir(pid=31658): Launched
17:06:40.107465 run         mk-remote-dir(pid=31658): Terminated: ok {rc=0}
17:06:40.407300 run     scp-cfg-to-remote(pid=31659): Launched
17:06:41.606332 run     scp-cfg-to-remote(pid=31659): Terminated: ok {rc=0}
17:06:41.950647 run   reload-dsp-firmware(pid=31661): Launched
17:06:44.150211 run   reload-dsp-firmware(pid=31661): Terminated: ok {rc=0}
17:06:44.486175 run        osmo-bts-sysmo(pid=31662): Launched
17:06:48.805893 tst      cs_paging_gprs_active.py:38: Waiting for bts to be ready...
17:06:50.824470 run         rm-remote-dir(pid=31663): Launched
17:06:53.020731 run         rm-remote-dir(pid=31663): Terminated: ok {rc=0}
17:06:53.360005 run         mk-remote-dir(pid=31664): Launched
17:06:55.556487 run         mk-remote-dir(pid=31664): Terminated: ok {rc=0}
17:06:55.847211 run       scp-inst-to-bts(pid=31666): Launched
17:07:09.063539 run       scp-inst-to-bts(pid=31666): Terminated: ok {rc=0}
17:07:09.403506 run     mk-remote-run-dir(pid=31668): Launched
17:07:11.599689 run     mk-remote-run-dir(pid=31668): Terminated: ok {rc=0}
17:07:11.888685 run   scp-cfg-to-sysmobts(pid=31669): Launched
17:07:14.085698 run   scp-cfg-to-sysmobts(pid=31669): Terminated: ok {rc=0}
17:07:14.426482 run              osmo-pcu(pid=31674): Launched
17:07:14.558983 tst         cs_paging_gprs_active.py: using MSISDN 4028
17:07:14.731463 bus                          /gobi_6: Setting Powered True
17:07:18.230985 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000010978', msisdn='4028', subscriber_id=1}
17:07:18.522416 bus                          /gobi_6: Setting Online False
17:07:19.710062 bus                          /gobi_6: Setting Powered False
17:07:26.448935 bus                          /gobi_6: Setting Powered True
17:07:27.807438 bus                          /gobi_6: Setting Online True
17:07:30.222108 tst                          /gobi_6: Connect to ('901', '70')
17:07:30.517390 tst                          /gobi_6: Manufacturer: 'Quectel', Model: 'EC20', Revision: 'EC20EQAR02A13E2G  1  [Jul  5 2017 10:49:17]', Serial: '868323024273648'
17:07:30.650573 tst         cs_paging_gprs_active.py: using MSISDN 4029
17:07:30.918631 bus                          /gobi_0: Setting Powered True
17:07:34.423806 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000023847', msisdn='4029', subscriber_id=2}
17:07:34.710113 bus                          /gobi_0: Setting Online False
17:07:35.898281 bus                          /gobi_0: Setting Powered False
17:07:43.236543 bus                          /gobi_0: Setting Powered True
17:07:44.618681 bus                          /gobi_0: Setting Online True
17:07:47.071799 tst                          /gobi_0: Connect to ('901', '70')
17:07:47.338992 tst                          /gobi_0: Manufacturer: 'Quectel', Model: 'EC20', Revision: 'EC20EQAR02A05E2G  1  [Mar 14 2016 19:33:01]', Serial: '868323024271873'
17:07:47.523733 tst      cs_paging_gprs_active.py:38: waiting for modems to attach...
17:07:47.709128 tst                          /gobi_6: Already registered with network ('901', '70')
17:08:02.442394 tst                          /gobi_0: Already registered with network ('901', '70')
17:08:08.025201 tst      cs_paging_gprs_active.py:38: waiting for modems to attach to data services...
17:08:16.359256 tst                          /gobi_6: context activated {apn='inet46', path='/gobi_6/context2', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={}, Name='Internet', Password='', Protocol='ip', Settings={Address='176.16.46.1', DomainNameServers=['192.168.100.1', '8.8.8.8'], Gateway='176.16.46.2', Interface='r433306bbc2604b', Method='static', Netmask='255.255.255.252'}, Type='internet', Username='ogt'}, user='ogt'}
17:08:16.545978 tst      cs_paging_gprs_active.py:38: Setting up data plan for "'/gobi_6/context2'"
17:08:16.899495 run            move_netns(pid=31681): Launched
17:08:18.082536 run            move_netns(pid=31681): Terminated: ok {rc=0}
17:08:18.409276 run                  ifup(pid=31684): Launched
17:08:19.593474 run                  ifup(pid=31684): Terminated: ok {rc=0}
17:08:19.917598 run                  dhcp(pid=31687): Launched
17:08:21.099979 run                  dhcp(pid=31687): Terminated: ok {rc=0}
17:08:24.142966 tst                          /gobi_0: context activated {apn='inet46', path='/gobi_0/context3', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={}, Name='Internet', Password='', Protocol='ip', Settings={Address='176.16.46.2', DomainNameServers=['192.168.100.1', '8.8.8.8'], Gateway='176.16.46.1', Interface='r82dcf628584c1c', Method='static', Netmask='255.255.255.252'}, Type='internet', Username='ogt'}, user='ogt'}
17:08:24.345051 tst      cs_paging_gprs_active.py:38: Setting up data plan for "'/gobi_0/context3'"
17:08:24.722757 run            move_netns(pid=31705): Launched
17:08:25.919414 run            move_netns(pid=31705): Terminated: ok {rc=0}
17:08:26.266553 run                  ifup(pid=31708): Launched
17:08:27.463016 run                  ifup(pid=31708): Terminated: ok {rc=0}
17:08:27.807708 run                  dhcp(pid=31711): Launched
17:08:28.990821 run                  dhcp(pid=31711): Terminated: ok {rc=0}
17:08:29.182342 tst      cs_paging_gprs_active.py:38: Running iperf3 client to 10.42.42.10:5003 through "'/gobi_6/context2'"
17:08:29.311373 run           iperf3-cli_10.42.42.10: Preparing iperf3-client connecting to 10.42.42.10:5003 (proto=tcp,time=60s)
17:08:29.710857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727): Launched
17:08:29.969406 tst      cs_paging_gprs_active.py:38: Running iperf3 client to 10.42.42.10:5004 through "'/gobi_0/context3'"
17:08:30.109370 run           iperf3-cli_10.42.42.10: Preparing iperf3-client connecting to 10.42.42.10:5004 (proto=tcp,time=60s)
17:08:30.521033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730): Launched
17:08:30.861336 run iperf3-cli_10.42.42.10(pid=31733): Launched
17:08:31.135750 run iperf3-cli_10.42.42.10(pid=31736): Launched
17:08:31.337727 tst      cs_paging_gprs_active.py:13: waiting a few secs to make sure iperf3 test is running
17:08:33.568759 tst      cs_paging_gprs_active.py:16: iperf3 running, let's place a call
17:08:38.316140 tst      cs_paging_gprs_active.py:22: dial success
17:08:41.149303 tst      cs_paging_gprs_active.py:28: answer success, call established and ongoing
17:08:47.787149 tst      cs_paging_gprs_active.py:35: hangup success
17:09:40.077818 run iperf3-cli_10.42.42.10(pid=31733): ERR: Terminated: ERROR {rc=1}  [trial-2068↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪iperf3-srv_10.42.42.10↪iperf3-cli_10.42.42.10↪iperf3-cli_10.42.42.10(pid=31733)]
17:09:40.222128 run iperf3-cli_10.42.42.10(pid=31733): stdout: 
| 				"bits_per_second":	0,
| 				"retransmits":	0,
| 				"omitted":	false
| 			}
| 		}],
| 	"end":	{
| 	},
| 	"error":	"error - control socket has closed unexpectedly"
| }
| child exited with 1 
17:09:40.363073 run iperf3-cli_10.42.42.10(pid=31733): stderr: 
| (launched: 2022-12-01_17:08:30.745413) 
17:09:41.563768 run iperf3-cli_10.42.42.10(pid=31736): ERR: Terminated: ERROR {rc=1}  [trial-2068↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪iperf3-srv_10.42.42.10↪iperf3-cli_10.42.42.10↪iperf3-cli_10.42.42.10(pid=31736)]
17:09:41.707381 run iperf3-cli_10.42.42.10(pid=31736): stdout: 
| 				"bits_per_second":	0,
| 				"retransmits":	0,
| 				"omitted":	false
| 			}
| 		}],
| 	"end":	{
| 	},
| 	"error":	"error - control socket has closed unexpectedly"
| }
| child exited with 1 
17:09:41.848823 run iperf3-cli_10.42.42.10(pid=31736): stderr: 
| (launched: 2022-12-01_17:08:31.018251) 
17:09:41.980138 run iperf3-srv_10.42.42.10(pid=31603): Terminating (SIGINT)
17:09:42.329386 run iperf3-srv_10.42.42.10(pid=31603): Terminated {rc=1}
17:09:42.536475 tst      cs_paging_gprs_active.py:38: Results for 10.42.42.10:5003 through "'/gobi_6/context2'"
17:09:42.597067 tst      cs_paging_gprs_active.py:38: ERR: KeyError: 'sum_sent'  [trial-2068↪gprs:sysmo↪cs_paging_gprs_active.py:38]
17:09:42.604468 tst      cs_paging_gprs_active.py:38: Test FAILED (231.6 sec)
17:09:42.643096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31602): Terminating (SIGTERM)
17:09:42.687982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31604): Terminating (SIGTERM)
17:09:42.732150 run iperf3-srv_10.42.42.10(pid=31605): Terminating (SIGTERM)
17:09:42.776218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31608): Terminating (SIGTERM)
17:09:42.819859 run   osmo-hlr_10.42.42.2(pid=31609): Terminating (SIGTERM)
17:09:42.864919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31610): Terminating (SIGTERM)
17:09:42.911843 run   osmo-stp_10.42.42.5(pid=31611): Terminating (SIGTERM)
17:09:42.985636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31612): Terminating (SIGTERM)
17:09:43.033281 run  osmo-ggsn_10.42.42.6(pid=31617): Terminating (SIGTERM)
17:09:43.084341 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31644): Terminating (SIGTERM)
17:09:43.147858 run  osmo-sgsn_10.42.42.7(pid=31645): Terminating (SIGTERM)
17:09:43.193839 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31646): Terminating (SIGTERM)
17:09:43.245556 run   osmo-msc_10.42.42.8(pid=31647): Terminating (SIGTERM)
17:09:43.290312 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31648): Terminating (SIGTERM)
17:09:43.333926 run   osmo-mgw_10.42.42.3(pid=31649): Terminating (SIGTERM)
17:09:43.381571 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31650): Terminating (SIGTERM)
17:09:43.425752 run   osmo-mgw_10.42.42.4(pid=31651): Terminating (SIGTERM)
17:09:43.470451 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31652): Terminating (SIGTERM)
17:09:43.520961 run   osmo-bsc_10.42.42.9(pid=31653): Terminating (SIGTERM)
17:09:43.565269 run        osmo-bts-sysmo(pid=31662): Terminating (SIGTERM)
17:09:43.613880 run              osmo-pcu(pid=31674): Terminating (SIGTERM)
17:09:43.657515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727): Terminating (SIGTERM)
17:09:43.834603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727)-killSignals.SIGTERM(pid=31760): Launched
17:09:44.932270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727)-killSignals.SIGTERM(pid=31760): Terminated: ok {rc=0}
17:09:44.980451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730): Terminating (SIGTERM)
17:09:45.139776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730)-killSignals.SIGTERM(pid=31765): Launched
17:09:46.235213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730)-killSignals.SIGTERM(pid=31765): Terminated: ok {rc=0}
17:09:46.249953 ---      ParallelTerminationStrategy: PID 31602 died...
17:09:46.307201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31602): Terminated: ok {rc=0}
17:09:46.317339 ---      ParallelTerminationStrategy: PID 31604 died...
17:09:46.374083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31604): Terminated: ok {rc=0}
17:09:46.384396 ---      ParallelTerminationStrategy: PID 31605 died...
17:09:46.440802 run iperf3-srv_10.42.42.10(pid=31605): Terminated {rc=256}
17:09:46.450973 ---      ParallelTerminationStrategy: PID 31608 died...
17:09:46.507694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31608): Terminated: ok {rc=0}
17:09:46.518232 ---      ParallelTerminationStrategy: PID 31609 died...
17:09:46.574825 run   osmo-hlr_10.42.42.2(pid=31609): Terminated: ok {rc=0}
17:09:46.584865 ---      ParallelTerminationStrategy: PID 31610 died...
17:09:46.641561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31610): Terminated: ok {rc=0}
17:09:46.651791 ---      ParallelTerminationStrategy: PID 31611 died...
17:09:46.708371 run   osmo-stp_10.42.42.5(pid=31611): Terminated: ok {rc=0}
17:09:46.718487 ---      ParallelTerminationStrategy: PID 31612 died...
17:09:46.774956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31612): Terminated: ok {rc=0}
17:09:46.785111 ---      ParallelTerminationStrategy: PID 31617 died...
17:09:46.841723 run  osmo-ggsn_10.42.42.6(pid=31617): Terminated: ok {rc=0}
17:09:46.851928 ---      ParallelTerminationStrategy: PID 31644 died...
17:09:46.908590 run pcap-recorder_any(filters='host 10.42.42.7')(pid=31644): Terminated: ok {rc=0}
17:09:46.918919 ---      ParallelTerminationStrategy: PID 31645 died...
17:09:46.975393 run  osmo-sgsn_10.42.42.7(pid=31645): Terminated: ok {rc=0}
17:09:46.985567 ---      ParallelTerminationStrategy: PID 31646 died...
17:09:47.042125 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=31646): Terminated: ok {rc=0}
17:09:47.052341 ---      ParallelTerminationStrategy: PID 31647 died...
17:09:47.108773 run   osmo-msc_10.42.42.8(pid=31647): Terminated: ok {rc=0}
17:09:47.119093 ---      ParallelTerminationStrategy: PID 31648 died...
17:09:47.175529 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31648): Terminated: ok {rc=0}
17:09:47.185835 ---      ParallelTerminationStrategy: PID 31649 died...
17:09:47.242388 run   osmo-mgw_10.42.42.3(pid=31649): Terminated {rc=15}
17:09:47.252620 ---      ParallelTerminationStrategy: PID 31650 died...
17:09:47.308961 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31650): Terminated: ok {rc=0}
17:09:47.319367 ---      ParallelTerminationStrategy: PID 31651 died...
17:09:47.376220 run   osmo-mgw_10.42.42.4(pid=31651): Terminated {rc=15}
17:09:47.386462 ---      ParallelTerminationStrategy: PID 31652 died...
17:09:47.442882 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=31652): Terminated: ok {rc=0}
17:09:47.453094 ---      ParallelTerminationStrategy: PID 31653 died...
17:09:47.509440 run   osmo-bsc_10.42.42.9(pid=31653): Terminated: ok {rc=0}
17:09:47.519722 ---      ParallelTerminationStrategy: PID 31662 died...
17:09:47.576061 run        osmo-bts-sysmo(pid=31662): Terminated: ok {rc=0}
17:09:47.586317 ---      ParallelTerminationStrategy: PID 31674 died...
17:09:47.642607 run              osmo-pcu(pid=31674): Terminated: ok {rc=0}
17:09:53.510163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727): Terminating (SIGINT)
17:09:53.663850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727)-killSignals.SIGINT(pid=31768): Launched
17:09:54.754640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727)-killSignals.SIGINT(pid=31768): Terminated: ok {rc=0}
17:09:54.800842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730): Terminating (SIGINT)
17:09:54.951445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730)-killSignals.SIGINT(pid=31771): Launched
17:09:56.042332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730)-killSignals.SIGINT(pid=31771): Terminated: ok {rc=0}
17:10:01.912061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727): Terminating (SIGKILL)
17:10:02.063613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727)-killSignals.SIGUSR1(pid=31781): Launched
17:10:03.154896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31727)-killSignals.SIGUSR1(pid=31781): Terminated: ok {rc=0}
17:10:03.200447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730): Terminating (SIGKILL)
17:10:03.350751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730)-killSignals.SIGUSR1(pid=31784): Launched
17:10:04.440713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31730)-killSignals.SIGUSR1(pid=31784): Terminated: ok {rc=0}
17:10:04.724146 bus                          /gobi_0: Setting Online False
17:10:07.698436 bus                          /gobi_0: Setting Powered False
17:10:24.975595 bus                          /gobi_0: Setting Powered False
17:10:26.082793 bus                          /gobi_0: Setting Powered False
17:10:27.240408 bus                          /gobi_6: Setting Online False
17:10:28.382408 bus                          /gobi_6: Setting Powered False
17:10:36.139281 bus                          /gobi_6: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/cs_paging_gprs_active.py", line 38, in <module>
    setup_run_iperf3_test_parallel(2, ready_cb=ready_cb_place_voicecall)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 105, in setup_run_iperf3_test_parallel
    print_results(clients[i], servers[i])
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 5, in print_results
    cli.print_results()
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/iperf3.py", line 342, in print_results
    print_result_node_tcp(self.get_results(), 'client')
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/iperf3.py", line 72, in print_result_node_tcp
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/iperf3.py", line 65, in print_result_node_tcp
    sent = result['end']['sum_sent']
KeyError: 'sum_sent'