Skip to content

Failed

gprs:sysmo.cs_paging_gprs_active.py (from gprs_sysmo)

Failing for the past 4 builds (Since #2063 )
Took 4 min 8 sec.

Stacktrace

'sum_sent'

Standard Output

----------------------------------------------
trial-2066 gprs:sysmo cs_paging_gprs_active.py
----------------------------------------------
11:04:38.052662 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
11:04:38.063518 tst                       gprs:sysmo: Using 1 x bts (candidates: 1)
11:04:38.189459 tst         cs_paging_gprs_active.py: using LAC 3959
11:04:38.310501 tst         cs_paging_gprs_active.py: using RAC 134
11:04:38.444567 tst         cs_paging_gprs_active.py: using CellId 3959
11:04:38.579503 tst         cs_paging_gprs_active.py: using BVCI 3960
11:04:38.604691 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
11:04:38.615783 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
11:04:38.626654 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
11:04:38.637659 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
11:04:38.648495 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
11:04:38.659709 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
11:04:38.670660 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
11:04:38.681548 tst                       gprs:sysmo: Using 1 x ip_address (candidates: 9)
11:04:38.692571 tst                       gprs:sysmo: Using 1 x modem (candidates: 4)
11:04:38.809885 tst                       gprs:sysmo: Using 1 x modem (candidates: 4)
11:04:39.093815 tst      cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003...
11:04:39.223953 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
11:04:39.543041 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17999): Launched
11:04:39.812433 run iperf3-srv_10.42.42.10(pid=18000): Launched
11:04:39.999738 tst      cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004...
11:04:40.127874 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
11:04:40.446898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18001): Launched
11:04:40.711767 run iperf3-srv_10.42.42.10(pid=18002): Launched
11:04:40.898484 tst      cs_paging_gprs_active.py:38: start network...
11:04:41.026063 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
11:04:41.522242 run         create_hlr_db(pid=18003): Launched
11:04:41.699670 bus                        /sierra_2: Setting Powered False
11:04:42.722081 run         create_hlr_db(pid=18003): Terminated: ok {rc=0}
11:04:43.160997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18005): Launched
11:04:43.491523 run   osmo-hlr_10.42.42.2(pid=18006): Launched
11:04:43.610161 run              osmo-stp_10.42.42.5: Starting osmo-stp
11:04:44.181290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18007): Launched
11:04:44.511799 run   osmo-stp_10.42.42.5(pid=18008): Launched
11:04:44.629936 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
11:04:46.172791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18009): Launched
11:04:46.281707 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
11:04:46.555843 run              patchelf(pid=18010): Launched
11:04:47.739513 run              patchelf(pid=18010): Terminated: ok {rc=0}
11:04:47.852692 run             osmo-ggsn_10.42.42.6: Applying CAP_NET_ADMIN capability to osmo-ggsn
11:04:48.132922 run osmo-gsm-tester_setcap_net_admin.sh(pid=18011): Launched
11:04:49.316562 run osmo-gsm-tester_setcap_net_admin.sh(pid=18011): Terminated: ok {rc=0}
11:04:49.628655 run  osmo-ggsn_10.42.42.6(pid=18014): Launched
11:04:49.814893 run             osmo-sgsn_10.42.42.7: Starting osmo-sgsn
11:04:54.637195 run pcap-recorder_any(filters='host 10.42.42.7')(pid=18035): Launched
11:04:54.948682 run  osmo-sgsn_10.42.42.7(pid=18036): Launched
11:04:55.061926 run              osmo-msc_10.42.42.8: Starting osmo-msc
11:04:55.645774 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=18037): Launched
11:04:55.957202 run   osmo-msc_10.42.42.8(pid=18038): Launched
11:04:59.123285 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
11:04:59.659431 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=18039): Launched
11:04:59.968655 run   osmo-mgw_10.42.42.3(pid=18040): Launched
11:05:00.078274 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
11:05:00.608047 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18041): Launched
11:05:00.918922 run   osmo-mgw_10.42.42.4(pid=18042): Launched
11:05:01.028158 run              osmo-bsc_10.42.42.9: Starting osmo-bsc
11:05:01.677392 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=18043): Launched
11:05:02.006048 run   osmo-bsc_10.42.42.9(pid=18047): Launched
11:05:08.271729 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.9
11:05:08.823790 run         rm-remote-dir(pid=18048): Launched
11:05:11.017568 run         rm-remote-dir(pid=18048): Terminated: ok {rc=0}
11:05:11.352419 run         mk-remote-dir(pid=18049): Launched
11:05:12.542823 run         mk-remote-dir(pid=18049): Terminated: ok {rc=0}
11:05:12.823305 run    scp-inst-to-remote(pid=18050): Launched
11:05:25.041824 run    scp-inst-to-remote(pid=18050): Terminated: ok {rc=0}
11:05:25.390758 run         mk-remote-dir(pid=18052): Launched
11:05:26.590223 run         mk-remote-dir(pid=18052): Terminated: ok {rc=0}
11:05:26.888166 run     scp-cfg-to-remote(pid=18053): Launched
11:05:28.087958 run     scp-cfg-to-remote(pid=18053): Terminated: ok {rc=0}
11:05:28.432547 run   reload-dsp-firmware(pid=18055): Launched
11:05:30.630169 run   reload-dsp-firmware(pid=18055): Terminated: ok {rc=0}
11:05:30.965528 run        osmo-bts-sysmo(pid=18056): Launched
11:05:35.269063 tst      cs_paging_gprs_active.py:38: Waiting for bts to be ready...
11:05:37.234392 run         rm-remote-dir(pid=18057): Launched
11:05:39.418949 run         rm-remote-dir(pid=18057): Terminated: ok {rc=0}
11:05:39.736079 run         mk-remote-dir(pid=18059): Launched
11:05:41.919460 run         mk-remote-dir(pid=18059): Terminated: ok {rc=0}
11:05:42.192459 run       scp-inst-to-bts(pid=18060): Launched
11:05:55.400483 run       scp-inst-to-bts(pid=18060): Terminated: ok {rc=0}
11:05:55.738927 run     mk-remote-run-dir(pid=18062): Launched
11:05:57.935832 run     mk-remote-run-dir(pid=18062): Terminated: ok {rc=0}
11:05:58.225168 run   scp-cfg-to-sysmobts(pid=18063): Launched
11:06:00.420374 run   scp-cfg-to-sysmobts(pid=18063): Terminated: ok {rc=0}
11:06:00.760494 run              osmo-pcu(pid=18065): Launched
11:06:00.891926 tst         cs_paging_gprs_active.py: using MSISDN 3971
11:06:01.064828 bus                          /gobi_6: Setting Powered True
11:06:04.561907 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000010978', msisdn='3971', subscriber_id=1}
11:06:04.837143 bus                          /gobi_6: Setting Online False
11:06:06.022031 bus                          /gobi_6: Setting Powered False
11:06:13.215438 bus                          /gobi_6: Setting Powered True
11:06:14.586216 bus                          /gobi_6: Setting Online True
11:06:17.047568 tst                          /gobi_6: Connect to ('901', '70')
11:06:17.324293 tst                          /gobi_6: Manufacturer: 'Quectel', Model: 'EC20', Revision: 'EC20EQAR02A13E2G  1  [Jul  5 2017 10:49:17]', Serial: '868323024273648'
11:06:17.449279 tst         cs_paging_gprs_active.py: using MSISDN 3972
11:06:17.683860 bus                          /gobi_0: Setting Powered True
11:06:21.193571 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000023847', msisdn='3972', subscriber_id=2}
11:06:21.462618 bus                          /gobi_0: Setting Online False
11:06:22.658387 bus                          /gobi_0: Setting Powered False
11:06:29.390399 bus                          /gobi_0: Setting Powered True
11:06:30.791745 bus                          /gobi_0: Setting Online True
11:06:32.429424 tst                          /gobi_6: Already registered with network ('901', '70')
11:06:33.239860 tst                          /gobi_0: Connect to ('901', '70')
11:06:33.516756 tst                          /gobi_0: Manufacturer: 'Quectel', Model: 'EC20', Revision: 'EC20EQAR02A05E2G  1  [Mar 14 2016 19:33:01]', Serial: '868323024271873'
11:06:33.716034 tst      cs_paging_gprs_active.py:38: waiting for modems to attach...
11:06:48.804081 tst                          /gobi_0: Already registered with network ('901', '70')
11:06:54.234517 tst      cs_paging_gprs_active.py:38: waiting for modems to attach to data services...
11:07:02.628202 tst                          /gobi_6: context activated {apn='inet46', path='/gobi_6/context2', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={}, Name='Internet', Password='', Protocol='ip', Settings={Address='176.16.46.1', DomainNameServers=['192.168.100.1', '8.8.8.8'], Gateway='176.16.46.2', Interface='r433306bbc2604b', Method='static', Netmask='255.255.255.252'}, Type='internet', Username='ogt'}, user='ogt'}
11:07:02.827937 tst      cs_paging_gprs_active.py:38: Setting up data plan for "'/gobi_6/context2'"
11:07:03.208536 run            move_netns(pid=18070): Launched
11:07:04.402904 run            move_netns(pid=18070): Terminated: ok {rc=0}
11:07:04.747099 run                  ifup(pid=18073): Launched
11:07:05.942493 run                  ifup(pid=18073): Terminated: ok {rc=0}
11:07:06.287154 run                  dhcp(pid=18076): Launched
11:07:07.482138 run                  dhcp(pid=18076): Terminated: ok {rc=0}
11:07:10.597196 tst                          /gobi_0: context activated {apn='inet46', path='/gobi_0/context3', properties={AccessPointName='inet46', Active=True, AuthenticationMethod='chap', IPv6.Settings={}, Name='Internet', Password='', Protocol='ip', Settings={Address='176.16.46.2', DomainNameServers=['192.168.100.1', '8.8.8.8'], Gateway='176.16.46.1', Interface='r82dcf628584c1c', Method='static', Netmask='255.255.255.252'}, Type='internet', Username='ogt'}, user='ogt'}
11:07:10.784200 tst      cs_paging_gprs_active.py:38: Setting up data plan for "'/gobi_0/context3'"
11:07:11.147952 run            move_netns(pid=18094): Launched
11:07:12.331999 run            move_netns(pid=18094): Terminated: ok {rc=0}
11:07:12.664024 run                  ifup(pid=18097): Launched
11:07:13.846635 run                  ifup(pid=18097): Terminated: ok {rc=0}
11:07:14.178050 run                  dhcp(pid=18100): Launched
11:07:15.371428 run                  dhcp(pid=18100): Terminated: ok {rc=0}
11:07:15.577070 tst      cs_paging_gprs_active.py:38: Running iperf3 client to 10.42.42.10:5003 through "'/gobi_6/context2'"
11:07:15.715924 run           iperf3-cli_10.42.42.10: Preparing iperf3-client connecting to 10.42.42.10:5003 (proto=tcp,time=60s)
11:07:16.109297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18116): Launched
11:07:16.345136 tst      cs_paging_gprs_active.py:38: Running iperf3 client to 10.42.42.10:5004 through "'/gobi_0/context3'"
11:07:16.473884 run           iperf3-cli_10.42.42.10: Preparing iperf3-client connecting to 10.42.42.10:5004 (proto=tcp,time=60s)
11:07:16.848309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18119): Launched
11:07:17.160409 run iperf3-cli_10.42.42.10(pid=18122): Launched
11:07:17.428185 run iperf3-cli_10.42.42.10(pid=18125): Launched
11:07:17.634877 tst      cs_paging_gprs_active.py:13: waiting a few secs to make sure iperf3 test is running
11:07:19.862956 tst      cs_paging_gprs_active.py:16: iperf3 running, let's place a call
11:07:24.454308 tst      cs_paging_gprs_active.py:22: dial success
11:07:27.167315 tst      cs_paging_gprs_active.py:28: answer success, call established and ongoing
11:07:33.772380 tst      cs_paging_gprs_active.py:35: hangup success
11:08:43.058532 run iperf3-cli_10.42.42.10(pid=18122): ERR: Terminated: ERROR {rc=1}  [trial-2066↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪iperf3-srv_10.42.42.10↪iperf3-cli_10.42.42.10↪iperf3-cli_10.42.42.10(pid=18122)]
11:08:43.192191 run iperf3-cli_10.42.42.10(pid=18122): stdout: 
| 				"bits_per_second":	0,
| 				"retransmits":	0,
| 				"omitted":	false
| 			}
| 		}],
| 	"end":	{
| 	},
| 	"error":	"error - control socket has closed unexpectedly"
| }
| child exited with 1 
11:08:43.323803 run iperf3-cli_10.42.42.10(pid=18122): stderr: 
| (launched: 2022-09-07_11:07:17.052275) 
11:08:44.509324 run iperf3-cli_10.42.42.10(pid=18125): ERR: Terminated: ERROR {rc=1}  [trial-2066↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪iperf3-srv_10.42.42.10↪iperf3-cli_10.42.42.10↪iperf3-cli_10.42.42.10(pid=18125)]
11:08:44.642853 run iperf3-cli_10.42.42.10(pid=18125): stdout: 
| 				"bits_per_second":	0,
| 				"retransmits":	0,
| 				"omitted":	false
| 			}
| 		}],
| 	"end":	{
| 	},
| 	"error":	"error - control socket has closed unexpectedly"
| }
| child exited with 1 
11:08:44.773325 run iperf3-cli_10.42.42.10(pid=18125): stderr: 
| (launched: 2022-09-07_11:07:17.318037) 
11:08:44.897231 run iperf3-srv_10.42.42.10(pid=18000): Terminating (SIGINT)
11:08:45.234428 run iperf3-srv_10.42.42.10(pid=18000): Terminated {rc=1}
11:08:45.430514 tst      cs_paging_gprs_active.py:38: Results for 10.42.42.10:5003 through "'/gobi_6/context2'"
11:08:45.490636 tst      cs_paging_gprs_active.py:38: ERR: KeyError: 'sum_sent'  [trial-2066↪gprs:sysmo↪cs_paging_gprs_active.py:38]
11:08:45.498105 tst      cs_paging_gprs_active.py:38: Test FAILED (247.5 sec)
11:08:45.534751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17999): Terminating (SIGTERM)
11:08:45.576865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18001): Terminating (SIGTERM)
11:08:45.619168 run iperf3-srv_10.42.42.10(pid=18002): Terminating (SIGTERM)
11:08:45.661057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18005): Terminating (SIGTERM)
11:08:45.702542 run   osmo-hlr_10.42.42.2(pid=18006): Terminating (SIGTERM)
11:08:45.745327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18007): Terminating (SIGTERM)
11:08:45.788298 run   osmo-stp_10.42.42.5(pid=18008): Terminating (SIGTERM)
11:08:45.832615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18009): Terminating (SIGTERM)
11:08:45.877357 run  osmo-ggsn_10.42.42.6(pid=18014): Terminating (SIGTERM)
11:08:45.930204 run pcap-recorder_any(filters='host 10.42.42.7')(pid=18035): Terminating (SIGTERM)
11:08:46.002214 run  osmo-sgsn_10.42.42.7(pid=18036): Terminating (SIGTERM)
11:08:46.047095 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=18037): Terminating (SIGTERM)
11:08:46.109451 run   osmo-msc_10.42.42.8(pid=18038): Terminating (SIGTERM)
11:08:46.187062 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=18039): Terminating (SIGTERM)
11:08:46.231633 run   osmo-mgw_10.42.42.3(pid=18040): Terminating (SIGTERM)
11:08:46.292648 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18041): Terminating (SIGTERM)
11:08:46.339433 run   osmo-mgw_10.42.42.4(pid=18042): Terminating (SIGTERM)
11:08:46.383142 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=18043): Terminating (SIGTERM)
11:08:46.425118 run   osmo-bsc_10.42.42.9(pid=18047): Terminating (SIGTERM)
11:08:46.467094 run        osmo-bts-sysmo(pid=18056): Terminating (SIGTERM)
11:08:46.509012 run              osmo-pcu(pid=18065): Terminating (SIGTERM)
11:08:46.550663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18116): Terminating (SIGTERM)
11:08:46.721448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18116)-killSignals.SIGTERM(pid=18146): Launched
11:08:47.813238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18116)-killSignals.SIGTERM(pid=18146): Terminated: ok {rc=0}
11:08:47.858862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18119): Terminating (SIGTERM)
11:08:48.005401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18119)-killSignals.SIGTERM(pid=18150): Launched
11:08:49.095680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18119)-killSignals.SIGTERM(pid=18150): Terminated: ok {rc=0}
11:08:49.109587 ---      ParallelTerminationStrategy: PID 17999 died...
11:08:49.164210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=17999): Terminated: ok {rc=0}
11:08:49.174397 ---      ParallelTerminationStrategy: PID 18001 died...
11:08:49.228702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18001): Terminated: ok {rc=0}
11:08:49.238365 ---      ParallelTerminationStrategy: PID 18002 died...
11:08:49.292263 run iperf3-srv_10.42.42.10(pid=18002): Terminated {rc=256}
11:08:49.301939 ---      ParallelTerminationStrategy: PID 18005 died...
11:08:49.356027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=18005): Terminated: ok {rc=0}
11:08:49.365729 ---      ParallelTerminationStrategy: PID 18006 died...
11:08:49.420075 run   osmo-hlr_10.42.42.2(pid=18006): Terminated: ok {rc=0}
11:08:49.429768 ---      ParallelTerminationStrategy: PID 18007 died...
11:08:49.483920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=18007): Terminated: ok {rc=0}
11:08:49.493676 ---      ParallelTerminationStrategy: PID 18008 died...
11:08:49.548178 run   osmo-stp_10.42.42.5(pid=18008): Terminated: ok {rc=0}
11:08:49.557865 ---      ParallelTerminationStrategy: PID 18009 died...
11:08:49.612024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=18009): Terminated: ok {rc=0}
11:08:49.621702 ---      ParallelTerminationStrategy: PID 18014 died...
11:08:49.675962 run  osmo-ggsn_10.42.42.6(pid=18014): Terminated: ok {rc=0}
11:08:49.685644 ---      ParallelTerminationStrategy: PID 18035 died...
11:08:49.739826 run pcap-recorder_any(filters='host 10.42.42.7')(pid=18035): Terminated: ok {rc=0}
11:08:49.749553 ---      ParallelTerminationStrategy: PID 18036 died...
11:08:49.804061 run  osmo-sgsn_10.42.42.7(pid=18036): Terminated: ok {rc=0}
11:08:49.813825 ---      ParallelTerminationStrategy: PID 18037 died...
11:08:49.868607 run pcap-recorder_any(filters='host 10.42.42.8 and port not 22')(pid=18037): Terminated: ok {rc=0}
11:08:49.878323 ---      ParallelTerminationStrategy: PID 18038 died...
11:08:49.934159 run   osmo-msc_10.42.42.8(pid=18038): Terminated: ok {rc=0}
11:08:49.943958 ---      ParallelTerminationStrategy: PID 18039 died...
11:08:49.997851 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=18039): Terminated: ok {rc=0}
11:08:50.007746 ---      ParallelTerminationStrategy: PID 18040 died...
11:08:50.061657 run   osmo-mgw_10.42.42.3(pid=18040): Terminated {rc=15}
11:08:50.071495 ---      ParallelTerminationStrategy: PID 18041 died...
11:08:50.125698 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=18041): Terminated: ok {rc=0}
11:08:50.135731 ---      ParallelTerminationStrategy: PID 18042 died...
11:08:50.189934 run   osmo-mgw_10.42.42.4(pid=18042): Terminated {rc=15}
11:08:50.199858 ---      ParallelTerminationStrategy: PID 18043 died...
11:08:50.253944 run pcap-recorder_any(filters='host 10.42.42.9 and port not 22')(pid=18043): Terminated: ok {rc=0}
11:08:50.263942 ---      ParallelTerminationStrategy: PID 18047 died...
11:08:50.318195 run   osmo-bsc_10.42.42.9(pid=18047): Terminated: ok {rc=0}
11:08:50.328071 ---      ParallelTerminationStrategy: PID 18056 died...
11:08:50.382029 run        osmo-bts-sysmo(pid=18056): Terminated: ok {rc=0}
11:08:50.391854 ---      ParallelTerminationStrategy: PID 18065 died...
11:08:50.445731 run              osmo-pcu(pid=18065): Terminated: ok {rc=0}
11:08:56.311527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18116): Terminating (SIGINT)
11:08:56.458765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18116)-killSignals.SIGINT(pid=18153): Launched
11:08:57.548884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18116)-killSignals.SIGINT(pid=18153): Terminated: ok {rc=0}
11:08:57.594479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18119): Terminating (SIGINT)
11:08:57.744577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18119)-killSignals.SIGINT(pid=18156): Launched
11:08:58.835355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18119)-killSignals.SIGINT(pid=18156): Terminated: ok {rc=0}
11:09:04.705494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18116): Terminating (SIGKILL)
11:09:04.862042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18116)-killSignals.SIGUSR1(pid=18159): Launched
11:09:05.958773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18116)-killSignals.SIGUSR1(pid=18159): Terminated: ok {rc=0}
11:09:06.006177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18119): Terminating (SIGKILL)
11:09:06.161634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18119)-killSignals.SIGUSR1(pid=18162): Launched
11:09:07.256458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=18119)-killSignals.SIGUSR1(pid=18162): Terminated: ok {rc=0}
11:09:07.498299 bus                          /gobi_0: Setting Online False
11:09:09.676083 bus                          /gobi_0: Setting Powered False
11:09:26.977263 bus                          /gobi_0: Setting Powered False
11:09:28.083138 bus                          /gobi_0: Setting Powered False
11:09:29.234584 bus                          /gobi_6: Setting Online False
11:09:30.344239 bus                          /gobi_6: Setting Powered False
11:09:38.974889 bus                          /gobi_6: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/cs_paging_gprs_active.py", line 38, in <module>
    setup_run_iperf3_test_parallel(2, ready_cb=ready_cb_place_voicecall)
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 105, in setup_run_iperf3_test_parallel
    print_results(clients[i], servers[i])
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 5, in print_results
    cli.print_results()
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/iperf3.py", line 342, in print_results
    print_result_node_tcp(self.get_results(), 'client')
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/iperf3.py", line 72, in print_result_node_tcp
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_gerrit/osmo-gsm-tester/src/osmo_gsm_tester/obj/iperf3.py", line 65, in print_result_node_tcp
    sent = result['end']['sum_sent']
KeyError: 'sum_sent'