Skip to content

Failed

gprs:sysmo.cs_paging_gprs_active.py (from gprs_sysmo)

Failing for the past 2 builds (Since #2063 )
Took 3 min 49 sec.

Stacktrace

'sum_sent'

Standard Output

----------------------------------------------
trial-2064 gprs:sysmo cs_paging_gprs_active.py
----------------------------------------------
18:35:29.053840 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:35:29.064904 tst                       gprs:sysmo: Using 1 x bts (candidates: 1)
18:35:29.196273 tst         cs_paging_gprs_active.py: using LAC 3945
18:35:29.322969 tst         cs_paging_gprs_active.py: using RAC 120
18:35:29.443482 tst         cs_paging_gprs_active.py: using CellId 3945
18:35:29.565706 tst         cs_paging_gprs_active.py: using BVCI 3946
18:35:29.588997 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:35:29.599620 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:35:29.610121 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:35:29.620561 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:35:29.630844 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:35:29.641503 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:35:29.652140 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:35:29.662459 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
18:35:29.673064 tst                       gprs:sysmo: Using 1 x modem (candidates: 4)
18:35:29.792488 tst                       gprs:sysmo: Using 1 x modem (candidates: 4)
18:35:30.089300 tst      cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003...
18:35:30.228243 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
18:35:30.570096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26681): Launched
18:35:30.856997 run iperf3-srv_10.42.42.10(pid=26682): Launched
18:35:31.058611 tst      cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004...
18:35:31.195474 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
18:35:31.535159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26683): Launched
18:35:31.818330 run iperf3-srv_10.42.42.10(pid=26684): Launched
18:35:32.018784 tst      cs_paging_gprs_active.py:38: start network...
18:35:32.155575 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
18:35:32.671949 run         create_hlr_db(pid=26685): Launched
18:35:32.861416 bus                        /sierra_2: Setting Powered False
18:35:33.882362 run         create_hlr_db(pid=26685): Terminated: ok {rc=0}
18:35:34.294688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26687): Launched
18:35:34.601050 run   osmo-hlr_10.42.42.2(pid=26688): Launched
18:35:34.712085 run              osmo-stp_10.42.42.5: Starting osmo-stp
18:35:35.242404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26689): Launched
18:35:35.548257 run   osmo-stp_10.42.42.5(pid=26690): Launched
18:35:35.657195 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
18:35:37.184098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26691): Launched
18:35:37.292104 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
18:35:37.566670 run              patchelf(pid=26692): Launched
18:35:38.748425 run              patchelf(pid=26692): Terminated: ok {rc=0}
18:35:38.860216 run             osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn
18:35:39.141588 run osmo-gsm-tester_setcap_net_admin.sh(pid=26693): Launched
18:35:40.323962 run osmo-gsm-tester_setcap_net_admin.sh(pid=26693): Terminated: ok {rc=0}
18:35:40.635153 run  osmo-ggsn_10.42.42.6(pid=26696): Launched
18:35:40.888695 run             osmo-sgsn_10.42.42.7: Starting osmo-sgsn
18:35:45.644028 run pcap-recorder_any(filters='host 10.42.42.7')(pid=26715): Launched
18:35:45.950999 run  osmo-sgsn_10.42.42.7(pid=26716): Launched
18:35:46.099655 run              osmo-msc_10.42.42.8: Starting osmo-msc
18:35:46.692038 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=26717): Launched
18:35:47.002281 run   osmo-msc_10.42.42.8(pid=26718): Launched
18:35:50.164866 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
18:35:50.761216 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=26719): Launched
18:35:51.093189 run   osmo-mgw_10.42.42.3(pid=26720): Launched
18:35:51.214842 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
18:35:51.781293 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26721): Launched
18:35:52.111654 run   osmo-mgw_10.42.42.4(pid=26722): Launched
18:35:52.229017 run              osmo-bsc_10.42.42.9: Starting osmo-bsc
18:35:52.935470 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=26723): Launched
18:35:53.268818 run   osmo-bsc_10.42.42.9(pid=26724): Launched
18:35:59.550055 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.9
18:36:00.136050 run         rm-remote-dir(pid=26725): Launched
18:36:02.339660 run         rm-remote-dir(pid=26725): Terminated: ok {rc=0}
18:36:02.693757 run         mk-remote-dir(pid=26726): Launched
18:36:03.896352 run         mk-remote-dir(pid=26726): Terminated: ok {rc=0}
18:36:04.195996 run    scp-inst-to-remote(pid=26727): Launched
18:36:16.404348 run    scp-inst-to-remote(pid=26727): Terminated: ok {rc=0}
18:36:16.730104 run         mk-remote-dir(pid=26729): Launched
18:36:17.916607 run         mk-remote-dir(pid=26729): Terminated: ok {rc=0}
18:36:18.196959 run     scp-cfg-to-remote(pid=26730): Launched
18:36:19.382501 run     scp-cfg-to-remote(pid=26730): Terminated: ok {rc=0}
18:36:19.702022 run   reload-dsp-firmware(pid=26732): Launched
18:36:21.888059 run   reload-dsp-firmware(pid=26732): Terminated: ok {rc=0}
18:36:22.201807 run        osmo-bts-sysmo(pid=26733): Launched
18:36:26.499557 tst      cs_paging_gprs_active.py:38: Waiting for bts to be ready...
18:36:28.458059 run         rm-remote-dir(pid=26735): Launched
18:36:30.654022 run         rm-remote-dir(pid=26735): Terminated: ok {rc=0}
18:36:30.993119 run         mk-remote-dir(pid=26736): Launched
18:36:33.187561 run         mk-remote-dir(pid=26736): Terminated: ok {rc=0}
18:36:33.479396 run       scp-inst-to-bts(pid=26737): Launched
18:36:46.696278 run       scp-inst-to-bts(pid=26737): Terminated: ok {rc=0}
18:36:47.034619 run     mk-remote-run-dir(pid=26739): Launched
18:36:49.220023 run     mk-remote-run-dir(pid=26739): Terminated: ok {rc=0}
18:36:49.491971 run   scp-cfg-to-sysmobts(pid=26740): Launched
18:36:51.674832 run   scp-cfg-to-sysmobts(pid=26740): Terminated: ok {rc=0}
18:36:51.992876 run              osmo-pcu(pid=26742): Launched
18:36:52.123171 tst         cs_paging_gprs_active.py: using MSISDN 3949
18:36:52.295704 bus                          /gobi_6: Setting Powered True
18:36:55.793415 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000010978', msisdn='3949', subscriber_id=1}
18:36:56.069346 bus                          /gobi_6: Setting Online False
18:36:57.265513 bus                          /gobi_6: Setting Powered False
18:37:04.206000 bus                          /gobi_6: Setting Powered True
18:37:05.610279 bus                          /gobi_6: Setting Online True
18:37:08.026172 tst                          /gobi_6: Connect to ('901', '70')
18:37:08.312498 tst                          /gobi_6: Manufacturer: 'Quectel', Model: 'EC20', Revision: 'EC20EQAR02A13E2G  1  [Jul  5 2017 10:49:17]', Serial: '868323024273648'
18:37:08.442478 tst         cs_paging_gprs_active.py: using MSISDN 3950
18:37:08.711939 bus                          /gobi_0: Setting Powered True
18:37:12.200370 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000023847', msisdn='3950', subscriber_id=2}
18:37:12.487143 bus                          /gobi_0: Setting Online False
18:37:13.673947 bus                          /gobi_0: Setting Powered False
18:37:20.417277 bus                          /gobi_0: Setting Powered True
18:37:21.790222 bus                          /gobi_0: Setting Online True
18:37:23.504018 tst                          /gobi_6: Already registered with network ('901', '70')
18:37:24.296108 tst                          /gobi_0: Connect to ('901', '70')
18:37:24.573259 tst                          /gobi_0: Manufacturer: 'Quectel', Model: 'EC20', Revision: 'EC20EQAR02A05E2G  1  [Mar 14 2016 19:33:01]', Serial: '868323024271873'
18:37:24.772647 tst      cs_paging_gprs_active.py:38: waiting for modems to attach...
18:37:38.110546 tst                          /gobi_0: Already registered with network ('901', '70')
18:37:43.298432 tst      cs_paging_gprs_active.py:38: waiting for modems to attach to data services...
18:37:46.375121 tst                          /gobi_6: context activated {apn='inet46', path='/gobi_6/context2', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={}, Name='Internet', Password='', Protocol='ip', Settings={Address='176.16.46.1', DomainNameServers=['192.168.100.1', '8.8.8.8'], Gateway='176.16.46.2', Interface='r433306bbc2604b', Method='static', Netmask='255.255.255.252'}, Type='internet', Username='ogt'}, user='ogt'}
18:37:46.574767 tst      cs_paging_gprs_active.py:38: Setting up data plan for "'/gobi_6/context2'"
18:37:46.959778 run            move_netns(pid=26746): Launched
18:37:48.144689 run            move_netns(pid=26746): Terminated: ok {rc=0}
18:37:48.467541 run                  ifup(pid=26749): Launched
18:37:49.652431 run                  ifup(pid=26749): Terminated: ok {rc=0}
18:37:49.975215 run                  dhcp(pid=26752): Launched
18:37:51.159359 run                  dhcp(pid=26752): Terminated: ok {rc=0}
18:37:59.530165 tst                          /gobi_0: context activated {apn='inet46', path='/gobi_0/context3', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={}, Name='Internet', Password='', Protocol='ip', Settings={Address='176.16.46.2', DomainNameServers=['192.168.100.1', '8.8.8.8'], Gateway='176.16.46.1', Interface='r82dcf628584c1c', Method='static', Netmask='255.255.255.252'}, Type='internet', Username='ogt'}, user='ogt'}
18:37:59.730830 tst      cs_paging_gprs_active.py:38: Setting up data plan for "'/gobi_0/context3'"
18:38:00.100775 run            move_netns(pid=26770): Launched
18:38:01.295046 run            move_netns(pid=26770): Terminated: ok {rc=0}
18:38:01.637521 run                  ifup(pid=26773): Launched
18:38:02.833510 run                  ifup(pid=26773): Terminated: ok {rc=0}
18:38:03.176824 run                  dhcp(pid=26776): Launched
18:38:04.361296 run                  dhcp(pid=26776): Terminated: ok {rc=0}
18:38:04.560417 tst      cs_paging_gprs_active.py:38: Running iperf3 client to 10.42.42.10:5003 through "'/gobi_6/context2'"
18:38:04.691994 run           iperf3-cli_10.42.42.10: Preparing iperf3-client connecting to 10.42.42.10:5003 (proto=tcp,time=60s)
18:38:05.093725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26792): Launched
18:38:05.348119 tst      cs_paging_gprs_active.py:38: Running iperf3 client to 10.42.42.10:5004 through "'/gobi_0/context3'"
18:38:05.487141 run           iperf3-cli_10.42.42.10: Preparing iperf3-client connecting to 10.42.42.10:5004 (proto=tcp,time=60s)
18:38:05.892704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26795): Launched
18:38:06.223353 run iperf3-cli_10.42.42.10(pid=26798): Launched
18:38:06.510631 run iperf3-cli_10.42.42.10(pid=26801): Launched
18:38:06.725167 tst      cs_paging_gprs_active.py:13: waiting a few secs to make sure iperf3 test is running
18:38:08.968699 tst      cs_paging_gprs_active.py:16: iperf3 running, let's place a call
18:38:13.708478 tst      cs_paging_gprs_active.py:22: dial success
18:38:16.547763 tst      cs_paging_gprs_active.py:28: answer success, call established and ongoing
18:38:23.161053 tst      cs_paging_gprs_active.py:35: hangup success
18:39:15.432040 run iperf3-cli_10.42.42.10(pid=26798): ERR: Terminated: ERROR {rc=1}  [trial-2064↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪iperf3-srv_10.42.42.10↪iperf3-cli_10.42.42.10↪iperf3-cli_10.42.42.10(pid=26798)]
18:39:15.565770 run iperf3-cli_10.42.42.10(pid=26798): stdout: 
| 				"bits_per_second":	0,
| 				"retransmits":	0,
| 				"omitted":	false
| 			}
| 		}],
| 	"end":	{
| 	},
| 	"error":	"error - control socket has closed unexpectedly"
| }
| child exited with 1 
18:39:15.698620 run iperf3-cli_10.42.42.10(pid=26798): stderr: 
| (launched: 2022-03-29_18:38:06.104023) 
18:39:16.889028 run iperf3-cli_10.42.42.10(pid=26801): ERR: Terminated: ERROR {rc=1}  [trial-2064↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪iperf3-srv_10.42.42.10↪iperf3-cli_10.42.42.10↪iperf3-cli_10.42.42.10(pid=26801)]
18:39:17.021536 run iperf3-cli_10.42.42.10(pid=26801): stdout: 
| 				"bits_per_second":	0,
| 				"retransmits":	0,
| 				"omitted":	false
| 			}
| 		}],
| 	"end":	{
| 	},
| 	"error":	"error - control socket has closed unexpectedly"
| }
| child exited with 1 
18:39:17.153253 run iperf3-cli_10.42.42.10(pid=26801): stderr: 
| (launched: 2022-03-29_18:38:06.389480) 
18:39:17.275038 run iperf3-srv_10.42.42.10(pid=26682): Terminating (SIGINT)
18:39:17.614568 run iperf3-srv_10.42.42.10(pid=26682): Terminated {rc=1}
18:39:17.810530 tst      cs_paging_gprs_active.py:38: Results for 10.42.42.10:5003 through "'/gobi_6/context2'"
18:39:17.870385 tst      cs_paging_gprs_active.py:38: ERR: KeyError: 'sum_sent'  [trial-2064↪gprs:sysmo↪cs_paging_gprs_active.py:38]
18:39:17.880207 tst      cs_paging_gprs_active.py:38: Test FAILED (228.9 sec)
18:39:17.920172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26681): Terminating (SIGTERM)
18:39:17.963004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26683): Terminating (SIGTERM)
18:39:18.006669 run iperf3-srv_10.42.42.10(pid=26684): Terminating (SIGTERM)
18:39:18.049919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26687): Terminating (SIGTERM)
18:39:18.093399 run   osmo-hlr_10.42.42.2(pid=26688): Terminating (SIGTERM)
18:39:18.137560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26689): Terminating (SIGTERM)
18:39:18.184867 run   osmo-stp_10.42.42.5(pid=26690): Terminating (SIGTERM)
18:39:18.237588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26691): Terminating (SIGTERM)
18:39:18.286167 run  osmo-ggsn_10.42.42.6(pid=26696): Terminating (SIGTERM)
18:39:18.336809 run pcap-recorder_any(filters='host 10.42.42.7')(pid=26715): Terminating (SIGTERM)
18:39:18.389794 run  osmo-sgsn_10.42.42.7(pid=26716): Terminating (SIGTERM)
18:39:18.441204 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=26717): Terminating (SIGTERM)
18:39:18.532137 run   osmo-msc_10.42.42.8(pid=26718): Terminating (SIGTERM)
18:39:18.577141 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=26719): Terminating (SIGTERM)
18:39:18.625036 run   osmo-mgw_10.42.42.3(pid=26720): Terminating (SIGTERM)
18:39:18.669452 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26721): Terminating (SIGTERM)
18:39:18.713327 run   osmo-mgw_10.42.42.4(pid=26722): Terminating (SIGTERM)
18:39:18.756331 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=26723): Terminating (SIGTERM)
18:39:18.799489 run   osmo-bsc_10.42.42.9(pid=26724): Terminating (SIGTERM)
18:39:18.842778 run        osmo-bts-sysmo(pid=26733): Terminating (SIGTERM)
18:39:18.887051 run              osmo-pcu(pid=26742): Terminating (SIGTERM)
18:39:18.932086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26792): Terminating (SIGTERM)
18:39:19.106424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26792)-killSignals.SIGTERM(pid=26820): Launched
18:39:20.199973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26792)-killSignals.SIGTERM(pid=26820): Terminated: ok {rc=0}
18:39:20.248076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26795): Terminating (SIGTERM)
18:39:20.406464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26795)-killSignals.SIGTERM(pid=26825): Launched
18:39:21.502601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26795)-killSignals.SIGTERM(pid=26825): Terminated: ok {rc=0}
18:39:21.517010 ---      ParallelTerminationStrategy: PID 26681 died...
18:39:21.573762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26681): Terminated: ok {rc=0}
18:39:21.584086 ---      ParallelTerminationStrategy: PID 26683 died...
18:39:21.645980 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26683): Terminated: ok {rc=0}
18:39:21.656294 ---      ParallelTerminationStrategy: PID 26684 died...
18:39:21.713215 run iperf3-srv_10.42.42.10(pid=26684): Terminated {rc=256}
18:39:21.723669 ---      ParallelTerminationStrategy: PID 26687 died...
18:39:21.780419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26687): Terminated: ok {rc=0}
18:39:21.790521 ---      ParallelTerminationStrategy: PID 26688 died...
18:39:21.847350 run   osmo-hlr_10.42.42.2(pid=26688): Terminated: ok {rc=0}
18:39:21.857541 ---      ParallelTerminationStrategy: PID 26689 died...
18:39:21.914362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26689): Terminated: ok {rc=0}
18:39:21.924932 ---      ParallelTerminationStrategy: PID 26690 died...
18:39:21.981267 run   osmo-stp_10.42.42.5(pid=26690): Terminated: ok {rc=0}
18:39:21.991393 ---      ParallelTerminationStrategy: PID 26691 died...
18:39:22.047423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26691): Terminated: ok {rc=0}
18:39:22.057540 ---      ParallelTerminationStrategy: PID 26696 died...
18:39:22.114483 run  osmo-ggsn_10.42.42.6(pid=26696): Terminated: ok {rc=0}
18:39:22.124626 ---      ParallelTerminationStrategy: PID 26715 died...
18:39:22.180852 run pcap-recorder_any(filters='host 10.42.42.7')(pid=26715): Terminated: ok {rc=0}
18:39:22.191050 ---      ParallelTerminationStrategy: PID 26716 died...
18:39:22.246979 run  osmo-sgsn_10.42.42.7(pid=26716): Terminated: ok {rc=0}
18:39:22.257074 ---      ParallelTerminationStrategy: PID 26717 died...
18:39:22.313219 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=26717): Terminated: ok {rc=0}
18:39:22.323437 ---      ParallelTerminationStrategy: PID 26718 died...
18:39:22.380080 run   osmo-msc_10.42.42.8(pid=26718): Terminated: ok {rc=0}
18:39:22.390200 ---      ParallelTerminationStrategy: PID 26719 died...
18:39:22.446902 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=26719): Terminated: ok {rc=0}
18:39:22.457199 ---      ParallelTerminationStrategy: PID 26720 died...
18:39:22.513760 run   osmo-mgw_10.42.42.3(pid=26720): Terminated {rc=15}
18:39:22.524028 ---      ParallelTerminationStrategy: PID 26721 died...
18:39:22.580870 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26721): Terminated: ok {rc=0}
18:39:22.591618 ---      ParallelTerminationStrategy: PID 26722 died...
18:39:22.648189 run   osmo-mgw_10.42.42.4(pid=26722): Terminated {rc=15}
18:39:22.658380 ---      ParallelTerminationStrategy: PID 26723 died...
18:39:22.714606 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=26723): Terminated: ok {rc=0}
18:39:22.724749 ---      ParallelTerminationStrategy: PID 26724 died...
18:39:22.781188 run   osmo-bsc_10.42.42.9(pid=26724): Terminated: ok {rc=0}
18:39:22.791497 ---      ParallelTerminationStrategy: PID 26733 died...
18:39:22.848219 run        osmo-bts-sysmo(pid=26733): Terminated: ok {rc=0}
18:39:22.858532 ---      ParallelTerminationStrategy: PID 26742 died...
18:39:22.915654 run              osmo-pcu(pid=26742): Terminated: ok {rc=0}
18:39:28.782806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26792): Terminating (SIGINT)
18:39:28.940224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26792)-killSignals.SIGINT(pid=26828): Launched
18:39:30.034464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26792)-killSignals.SIGINT(pid=26828): Terminated: ok {rc=0}
18:39:30.082192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26795): Terminating (SIGINT)
18:39:30.238933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26795)-killSignals.SIGINT(pid=26831): Launched
18:39:31.333096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26795)-killSignals.SIGINT(pid=26831): Terminated: ok {rc=0}
18:39:37.207268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26792): Terminating (SIGKILL)
18:39:37.362168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26792)-killSignals.SIGUSR1(pid=26834): Launched
18:39:38.455308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26792)-killSignals.SIGUSR1(pid=26834): Terminated: ok {rc=0}
18:39:38.503227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26795): Terminating (SIGKILL)
18:39:38.659413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26795)-killSignals.SIGUSR1(pid=26837): Launched
18:39:39.752234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26795)-killSignals.SIGUSR1(pid=26837): Terminated: ok {rc=0}
18:39:39.990856 bus                          /gobi_0: Setting Online False
18:39:41.148067 bus                          /gobi_0: Setting Powered False
18:39:57.968462 bus                          /gobi_0: Setting Powered False
18:39:59.074399 bus                          /gobi_0: Setting Powered False
18:40:00.224511 bus                          /gobi_6: Setting Online False
18:40:01.369130 bus                          /gobi_6: Setting Powered False
18:40:09.972198 bus                          /gobi_6: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/cs_paging_gprs_active.py", line 38, in <module>
    setup_run_iperf3_test_parallel(2, ready_cb=ready_cb_place_voicecall)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 105, in setup_run_iperf3_test_parallel
    print_results(clients[i], servers[i])
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 5, in print_results
    cli.print_results()
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/iperf3.py", line 342, in print_results
    print_result_node_tcp(self.get_results(), 'client')
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/iperf3.py", line 72, in print_result_node_tcp
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/iperf3.py", line 65, in print_result_node_tcp
    sent = result['end']['sum_sent']
KeyError: 'sum_sent'