
----------------------------------------------
trial-2373 gprs:oc2g iperf3.py
----------------------------------------------
10:02:05.074047 tst                        iperf3.py: DBG: registering module <module 'testlib' from '/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py'> for cleanup  [trial-2373↪gprs:oc2g↪iperf3.py:5↪iperf3.py]  [testenv.py:115]
10:02:05.095555 ---                ReservedResources: DBG: requesting use of ip_address {specifics={}}  [resource.py:503]
10:02:05.096241 tst                        gprs:oc2g: Using 1 x ip_address (candidates: 9)  [trial-2373↪gprs:oc2g]  [resource.py:316]
10:02:05.105196 tst                        gprs:oc2g: DBG: Picked - _hash: fd103b22c7cf2480d609150e06f4bbd92ac78d8c
  _reserved_by: gprs:oc2g-25516-1670662216
  addr: 10.42.42.2
  [trial-2373↪gprs:oc2g]  [resource.py:360]
10:02:05.105627 ---                ReservedResources: DBG: {available=1}  [resource.py:509]
10:02:05.105981 ---                ReservedResources: DBG: {using={_hash='fd103b22c7cf2480d609150e06f4bbd92ac78d8c', _reserved_by='gprs:oc2g-25516-1670662216', addr='10.42.42.2'}}  [resource.py:527]
10:02:05.106630 ---                ReservedResources: DBG: requesting use of bts {specifics={}}  [resource.py:503]
10:02:05.107271 tst                        gprs:oc2g: Using 1 x bts (candidates: 1)  [trial-2373↪gprs:oc2g]  [resource.py:316]
10:02:05.129092 tst                        gprs:oc2g: DBG: Picked - _hash: 41340d7de4877bbd59a881ae568e0c8256c8228f
  _reserved_by: gprs:oc2g-25516-1670662216
  addr: 10.42.42.100
  band: GSM-900
  ciphers:
  - a5_0
  - a5_1
  - a5_3
  direct_pcu: 'True'
  ipa_unit_id: '14'
  label: OC-2G
  trx_list:
  - arfcn: '50'
  type: osmo-bts-oc2g
  [trial-2373↪gprs:oc2g]  [resource.py:360]
10:02:05.129524 ---                ReservedResources: DBG: {available=1}  [resource.py:509]
10:02:05.129942 ---                ReservedResources: DBG: {using={_hash='41340d7de4877bbd59a881ae568e0c8256c8228f', _reserved_by='gprs:oc2g-25516-1670662216', addr='10.42.42.100', band='GSM-900', ciphers=['a5_0', 'a5_1', 'a5_3'], direct_pcu='True', ipa_unit_id='14', label='OC-2G', trx_list=[{'arfcn': '50'}], type='osmo-bts-oc2g'}}  [resource.py:527]
10:02:05.207926 tst                        iperf3.py: using LAC 27620  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py]  [testenv.py:342]
10:02:05.337524 tst                        iperf3.py: using RAC 80  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py]  [testenv.py:347]
10:02:05.464772 tst                        iperf3.py: using CellId 27620  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py]  [testenv.py:352]
10:02:05.595475 tst                        iperf3.py: using BVCI 27621  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py]  [testenv.py:357]
10:02:05.642912 ---                ReservedResources: DBG: requesting use of ip_address {specifics={}}  [resource.py:503]
10:02:05.643643 tst                        gprs:oc2g: Using 1 x ip_address (candidates: 9)  [trial-2373↪gprs:oc2g]  [resource.py:316]
10:02:05.652432 tst                        gprs:oc2g: DBG: Picked - _hash: 1c614d6210c551d142aadca8f25e1534ebb2a70f
  _reserved_by: gprs:oc2g-25516-1670662216
  addr: 10.42.42.3
  [trial-2373↪gprs:oc2g]  [resource.py:360]
10:02:05.652868 ---                ReservedResources: DBG: {available=1}  [resource.py:509]
10:02:05.653403 ---                ReservedResources: DBG: {using={_hash='1c614d6210c551d142aadca8f25e1534ebb2a70f', _reserved_by='gprs:oc2g-25516-1670662216', addr='10.42.42.3'}}  [resource.py:527]
10:02:05.654096 ---                ReservedResources: DBG: requesting use of ip_address {specifics={}}  [resource.py:503]
10:02:05.654790 tst                        gprs:oc2g: Using 1 x ip_address (candidates: 9)  [trial-2373↪gprs:oc2g]  [resource.py:316]
10:02:05.663532 tst                        gprs:oc2g: DBG: Picked - _hash: 862b529c701adf302477bc126a8032cfc2ec4753
  _reserved_by: gprs:oc2g-25516-1670662216
  addr: 10.42.42.4
  [trial-2373↪gprs:oc2g]  [resource.py:360]
10:02:05.663968 ---                ReservedResources: DBG: {available=1}  [resource.py:509]
10:02:05.664449 ---                ReservedResources: DBG: {using={_hash='862b529c701adf302477bc126a8032cfc2ec4753', _reserved_by='gprs:oc2g-25516-1670662216', addr='10.42.42.4'}}  [resource.py:527]
10:02:05.665270 ---                ReservedResources: DBG: requesting use of ip_address {specifics={}}  [resource.py:503]
10:02:05.665966 tst                        gprs:oc2g: Using 1 x ip_address (candidates: 9)  [trial-2373↪gprs:oc2g]  [resource.py:316]
10:02:05.674980 tst                        gprs:oc2g: DBG: Picked - _hash: 05feb6e1e24ca4235889eb28d0a8d5cedac6e5d1
  _reserved_by: gprs:oc2g-25516-1670662216
  addr: 10.42.42.5
  [trial-2373↪gprs:oc2g]  [resource.py:360]
10:02:05.675413 ---                ReservedResources: DBG: {available=1}  [resource.py:509]
10:02:05.675788 ---                ReservedResources: DBG: {using={_hash='05feb6e1e24ca4235889eb28d0a8d5cedac6e5d1', _reserved_by='gprs:oc2g-25516-1670662216', addr='10.42.42.5'}}  [resource.py:527]
10:02:05.676479 ---                ReservedResources: DBG: requesting use of ip_address {specifics={}}  [resource.py:503]
10:02:05.677233 tst                        gprs:oc2g: Using 1 x ip_address (candidates: 9)  [trial-2373↪gprs:oc2g]  [resource.py:316]
10:02:05.685947 tst                        gprs:oc2g: DBG: Picked - _hash: e780ac7581ad29f8f46e637b61d0c38898c4c52c
  _reserved_by: gprs:oc2g-25516-1670662216
  addr: 10.42.42.6
  [trial-2373↪gprs:oc2g]  [resource.py:360]
10:02:05.686381 ---                ReservedResources: DBG: {available=1}  [resource.py:509]
10:02:05.686756 ---                ReservedResources: DBG: {using={_hash='e780ac7581ad29f8f46e637b61d0c38898c4c52c', _reserved_by='gprs:oc2g-25516-1670662216', addr='10.42.42.6'}}  [resource.py:527]
10:02:05.687430 ---                ReservedResources: DBG: requesting use of ip_address {specifics={}}  [resource.py:503]
10:02:05.688117 tst                        gprs:oc2g: Using 1 x ip_address (candidates: 9)  [trial-2373↪gprs:oc2g]  [resource.py:316]
10:02:05.696930 tst                        gprs:oc2g: DBG: Picked - _hash: b2212df768d69556d7af0478db6e7da51aac0a5c
  _reserved_by: gprs:oc2g-25516-1670662216
  addr: 10.42.42.7
  [trial-2373↪gprs:oc2g]  [resource.py:360]
10:02:05.697443 ---                ReservedResources: DBG: {available=1}  [resource.py:509]
10:02:05.697810 ---                ReservedResources: DBG: {using={_hash='b2212df768d69556d7af0478db6e7da51aac0a5c', _reserved_by='gprs:oc2g-25516-1670662216', addr='10.42.42.7'}}  [resource.py:527]
10:02:05.698511 ---                ReservedResources: DBG: requesting use of ip_address {specifics={}}  [resource.py:503]
10:02:05.699197 tst                        gprs:oc2g: Using 1 x ip_address (candidates: 9)  [trial-2373↪gprs:oc2g]  [resource.py:316]
10:02:05.708035 tst                        gprs:oc2g: DBG: Picked - _hash: 74212ce0f9a1134dba3a0b560bc3edbc008efa69
  _reserved_by: gprs:oc2g-25516-1670662216
  addr: 10.42.42.8
  [trial-2373↪gprs:oc2g]  [resource.py:360]
10:02:05.708465 ---                ReservedResources: DBG: {available=1}  [resource.py:509]
10:02:05.708840 ---                ReservedResources: DBG: {using={_hash='74212ce0f9a1134dba3a0b560bc3edbc008efa69', _reserved_by='gprs:oc2g-25516-1670662216', addr='10.42.42.8'}}  [resource.py:527]
10:02:05.709703 ---                ReservedResources: DBG: requesting use of ip_address {specifics={}}  [resource.py:503]
10:02:05.710394 tst                        gprs:oc2g: Using 1 x ip_address (candidates: 9)  [trial-2373↪gprs:oc2g]  [resource.py:316]
10:02:05.719092 tst                        gprs:oc2g: DBG: Picked - _hash: d1aa7fb97160ac70999fba6bc9ed088d6e6583aa
  _reserved_by: gprs:oc2g-25516-1670662216
  addr: 10.42.42.9
  [trial-2373↪gprs:oc2g]  [resource.py:360]
10:02:05.719522 ---                ReservedResources: DBG: {available=1}  [resource.py:509]
10:02:05.719890 ---                ReservedResources: DBG: {using={_hash='d1aa7fb97160ac70999fba6bc9ed088d6e6583aa', _reserved_by='gprs:oc2g-25516-1670662216', addr='10.42.42.9'}}  [resource.py:527]
10:02:05.720604 ---                ReservedResources: DBG: requesting use of ip_address {specifics={}}  [resource.py:503]
10:02:05.721407 tst                        gprs:oc2g: Using 1 x ip_address (candidates: 9)  [trial-2373↪gprs:oc2g]  [resource.py:316]
10:02:05.730171 tst                        gprs:oc2g: DBG: Picked - _hash: fa0de0a0555be2f2b4e9de4e4ca583c4ab8a3a77
  _reserved_by: gprs:oc2g-25516-1670662216
  addr: 10.42.42.10
  [trial-2373↪gprs:oc2g]  [resource.py:360]
10:02:05.730611 ---                ReservedResources: DBG: {available=1}  [resource.py:509]
10:02:05.730983 ---                ReservedResources: DBG: {using={_hash='fa0de0a0555be2f2b4e9de4e4ca583c4ab8a3a77', _reserved_by='gprs:oc2g-25516-1670662216', addr='10.42.42.10'}}  [resource.py:527]
10:02:05.731826 ---                ReservedResources: DBG: requesting use of modem {specifics={}}  [resource.py:503]
10:02:05.732522 tst                        gprs:oc2g: Using 1 x modem (candidates: 4)  [trial-2373↪gprs:oc2g]  [resource.py:316]
10:02:05.757584 tst                        gprs:oc2g: DBG: Picked - _hash: c8b3ff195834cf3b6dba1d7772ef833921aac339
  _reserved_by: gprs:oc2g-25516-1670662216
  auth_algo: comp128v1
  ciphers:
  - a5_0
  - a5_1
  features:
  - 2g
  - sms
  - voice
  - ussd
  - gprs
  - sim
  ki: 07F35D0A9476646169669401215580E0
  label: ec20_1
  path: /sys/devices/pci0000:00/0000:00:12.2/usb1/1-5/1-5.2/1-5.2.6
  [trial-2373↪gprs:oc2g]  [resource.py:360]
10:02:05.758050 ---                ReservedResources: DBG: {available=1}  [resource.py:509]
10:02:05.758496 ---                ReservedResources: DBG: {using={_hash='c8b3ff195834cf3b6dba1d7772ef833921aac339', _reserved_by='gprs:oc2g-25516-1670662216', auth_algo='comp128v1', ciphers=['a5_0', 'a5_1'], features=['2g', 'sms', 'voice', 'ussd', 'gprs', 'sim'], ki='07F35D0A9476646169669401215580E0', label='ec20_1', path='/sys/devices/pci0000:00/0000:00:12.2/usb1/1-5/1-5.2/1-5.2.6'}}  [resource.py:527]
10:02:05.812474 tst                          /gobi_6: DBG: creating from syspath /sys/devices/pci0000:00/0000:00:12.2/usb1/1-5/1-5.2/1-5.2.6  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪/gobi_6]  [ms_ofono.py:381]
10:02:05.986335 tst                      iperf3.py:8: start iperfv3 server 10.42.42.10:5003...  [trial-2373↪gprs:oc2g↪iperf3.py:8]  [testlib.py:61]
10:02:06.143451 run           iperf3-srv_10.42.42.10: Starting iperf3-srv  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪iperf3-srv_10.42.42.10]  [iperf3.py:119]
10:02:06.215091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22'): DBG: Recording pcap /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/iperf3-srv_10.42.42.10/pcap host 10.42.42.10 and port not 22  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪iperf3-srv_10.42.42.10↪pcap-recorder_any(filters='host 10.42.42.10 and port not 22')]  [pcap_recorder.py:38]
10:02:06.263861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22'): DBG: cd '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/iperf3-srv_10.42.42.10/pcap';  tcpdump -n -i any -w /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/iperf3-srv_10.42.42.10/pcap/pcap-recorder_any(filters='host 10.42.42.10 and port not 22').pcap host 10.42.42.10 and port not 22  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪iperf3-srv_10.42.42.10↪pcap-recorder_any(filters='host 10.42.42.10 and port not 22')↪pcap-recorder_any(filters='host 10.42.42.10 and port not 22')]  [process.py:181]
10:02:06.314014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22'): DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/iperf3-srv_10.42.42.10/pcap/stdout  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪iperf3-srv_10.42.42.10↪pcap-recorder_any(filters='host 10.42.42.10 and port not 22')↪pcap-recorder_any(filters='host 10.42.42.10 and port not 22')]  [process.py:161]
10:02:06.364677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22'): DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/iperf3-srv_10.42.42.10/pcap/stderr  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪iperf3-srv_10.42.42.10↪pcap-recorder_any(filters='host 10.42.42.10 and port not 22')↪pcap-recorder_any(filters='host 10.42.42.10 and port not 22')]  [process.py:161]
10:02:06.478330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26623): Launched  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪iperf3-srv_10.42.42.10↪pcap-recorder_any(filters='host 10.42.42.10 and port not 22')↪pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26623)]  [process.py:202]
10:02:06.551767 run           iperf3-srv_10.42.42.10: DBG: cd '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/iperf3-srv_10.42.42.10';  iperf3 -s -B 10.42.42.10 -p 5003 -J  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪iperf3-srv_10.42.42.10↪iperf3-srv_10.42.42.10]  [process.py:181]
10:02:06.600240 run           iperf3-srv_10.42.42.10: DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/iperf3-srv_10.42.42.10/stdout  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪iperf3-srv_10.42.42.10↪iperf3-srv_10.42.42.10]  [process.py:161]
10:02:06.649784 run           iperf3-srv_10.42.42.10: DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/iperf3-srv_10.42.42.10/stderr  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪iperf3-srv_10.42.42.10↪iperf3-srv_10.42.42.10]  [process.py:161]
10:02:06.758908 run iperf3-srv_10.42.42.10(pid=26624): Launched  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪iperf3-srv_10.42.42.10↪iperf3-srv_10.42.42.10(pid=26624)]  [process.py:202]
10:02:06.938979 tst                      iperf3.py:8: start network...  [trial-2373↪gprs:oc2g↪iperf3.py:8]  [testlib.py:64]
10:02:07.096402 run              osmo-hlr_10.42.42.2: Starting osmo-hlr  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2]  [hlr_osmo.py:43]
10:02:07.167016 run              osmo-hlr_10.42.42.2: DBG: {config_file='/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/osmo-hlr.cfg'}  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2]  [hlr_osmo.py:79]
10:02:07.215265 run              osmo-hlr_10.42.42.2: DBG: HLR CONFIG:
{'hlr': {'ip_address': {'_hash': 'fd103b22c7cf2480d609150e06f4bbd92ac78d8c',
                        '_reserved_by': 'gprs:oc2g-25516-1670662216',
                        '_used': True,
                        'addr': '10.42.42.2'}}}  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2]  [hlr_osmo.py:85]
10:02:07.287206 cnf                        Templates: DBG: rendering osmo-hlr.cfg.tmpl  [trial-2373↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪Templates]  [template.py:56]
10:02:07.349355 run              osmo-hlr_10.42.42.2: DBG: ! Configuration rendered by osmo-gsm-tester
log stderr
 logging filter all 1
 logging color 1
 logging print category 1
 logging print category-hex 0
 logging print level 1
 logging print file basename last
 logging print extended-timestamp 1
 logging level set-all debug
line vty
 no login
 bind 10.42.42.2
ctrl
 bind 10.42.42.2
hlr
 gsup
  bind ip 10.42.42.2
 ussd route prefix *#100# internal own-msisdn
  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2]  [hlr_osmo.py:89]
10:02:07.373833 tst                       trial-2373: DBG: has bin_tar {bin_name='osmo-hlr', matches=['osmo-hlr.build-8701.tgz'], run_label=''}  [trial.py:148]
10:02:07.399435 run                    create_hlr_db: DBG: cd '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/create_hlr_db';  /bin/sh -c sqlite3 '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' < '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/inst/osmo-hlr/share/doc/osmo-hlr/sql/hlr.sql'  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2↪create_hlr_db]  [process.py:181]
10:02:07.448434 run                    create_hlr_db: DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/create_hlr_db/stdout  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2↪create_hlr_db]  [process.py:161]
10:02:07.498552 run                    create_hlr_db: DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/create_hlr_db/stderr  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2↪create_hlr_db]  [process.py:161]
10:02:07.608791 run         create_hlr_db(pid=26625): Launched  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2↪create_hlr_db(pid=26625)]  [process.py:202]
10:02:07.782460 bus                          /gobi_6: Setting Powered False  [trial-2373↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪/gobi_6↪/gobi_6]  [ms_ofono.py:317]
10:02:08.691714 run         create_hlr_db(pid=26625): DBG: Cleanup  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2↪create_hlr_db(pid=26625)]  [process.py:288]
10:02:08.813032 run         create_hlr_db(pid=26625): Terminated: ok {rc=0}  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2↪create_hlr_db(pid=26625)]  [process.py:291]
10:02:08.921118 bus                          /gobi_6: DBG: Powered == False  [trial-2373↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪/gobi_6↪/gobi_6]  [ms_ofono.py:309]
10:02:08.985689 run pcap-recorder_any(filters='host 10.42.42.2'): DBG: Recording pcap /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/pcap host 10.42.42.2  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2↪pcap-recorder_any(filters='host 10.42.42.2')]  [pcap_recorder.py:38]
10:02:09.030712 run pcap-recorder_any(filters='host 10.42.42.2'): DBG: cd '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/pcap';  tcpdump -n -i any -w /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/pcap/pcap-recorder_any(filters='host 10.42.42.2').pcap host 10.42.42.2  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2↪pcap-recorder_any(filters='host 10.42.42.2')↪pcap-recorder_any(filters='host 10.42.42.2')]  [process.py:181]
10:02:09.076719 run pcap-recorder_any(filters='host 10.42.42.2'): DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/pcap/stdout  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2↪pcap-recorder_any(filters='host 10.42.42.2')↪pcap-recorder_any(filters='host 10.42.42.2')]  [process.py:161]
10:02:09.123603 run pcap-recorder_any(filters='host 10.42.42.2'): DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/pcap/stderr  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2↪pcap-recorder_any(filters='host 10.42.42.2')↪pcap-recorder_any(filters='host 10.42.42.2')]  [process.py:161]
10:02:09.229077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26627): Launched  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2↪pcap-recorder_any(filters='host 10.42.42.2')↪pcap-recorder_any(filters='host 10.42.42.2')(pid=26627)]  [process.py:202]
10:02:09.296024 run              osmo-hlr_10.42.42.2: DBG: {binary='/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/inst/osmo-hlr/bin/osmo-hlr', env={LD_LIBRARY_PATH='/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/inst/osmo-hlr/lib'}, run_dir=/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2}  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2]  [hlr_osmo.py:68]
10:02:09.339721 run              osmo-hlr_10.42.42.2: DBG: cd '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2'; LD_LIBRARY_PATH='/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/inst/osmo-hlr/lib' /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/inst/osmo-hlr/bin/osmo-hlr -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/osmo-hlr.cfg --database /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2]  [process.py:181]
10:02:09.384299 run              osmo-hlr_10.42.42.2: DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/stdout  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2]  [process.py:161]
10:02:09.429633 run              osmo-hlr_10.42.42.2: DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/stderr  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2]  [process.py:161]
10:02:09.533938 run   osmo-hlr_10.42.42.2(pid=26628): Launched  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26628)]  [process.py:202]
10:02:09.651499 run              osmo-stp_10.42.42.5: Starting osmo-stp  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5]  [stp_osmo.py:37]
10:02:09.718250 run              osmo-stp_10.42.42.5: DBG: {config_file='/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-stp_10.42.42.5/osmo-stp.cfg'}  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5]  [stp_osmo.py:65]
10:02:09.763222 run              osmo-stp_10.42.42.5: DBG: STP CONFIG:
{'stp': {'ip_address': {'_hash': '05feb6e1e24ca4235889eb28d0a8d5cedac6e5d1',
                        '_reserved_by': 'gprs:oc2g-25516-1670662216',
                        '_used': True,
                        'addr': '10.42.42.5'}}}  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5]  [stp_osmo.py:71]
10:02:09.830369 cnf                        Templates: DBG: rendering osmo-stp.cfg.tmpl  [trial-2373↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪Templates]  [template.py:56]
10:02:09.888176 run              osmo-stp_10.42.42.5: DBG: ! Configuration rendered by osmo-gsm-tester
log stderr
 logging filter all 1
 logging color 1
 logging print category 1
 logging print category-hex 0
 logging print level 1
 logging print file basename last
 logging print extended-timestamp 1
 logging level set-all debug
line vty
 no login
 bind 10.42.42.5
!ctrl
! bind 10.42.42.5
cs7 instance 0
 xua rkm routing-key-allocation dynamic-permitted
 listen m3ua 2905
  accept-asp-connections dynamic-permitted
  local-ip 10.42.42.5
  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5]  [stp_osmo.py:75]
10:02:09.910800 tst                       trial-2373: DBG: has bin_tar {bin_name='osmo-stp', matches=['osmo-stp.build-9242.tgz'], run_label=''}  [trial.py:148]
10:02:09.934449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22'): DBG: Recording pcap /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-stp_10.42.42.5/pcap host 10.42.42.5 and port not 22  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪pcap-recorder_any(filters='host 10.42.42.5 and port not 22')]  [pcap_recorder.py:38]
10:02:09.979631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22'): DBG: cd '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-stp_10.42.42.5/pcap';  tcpdump -n -i any -w /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-stp_10.42.42.5/pcap/pcap-recorder_any(filters='host 10.42.42.5 and port not 22').pcap host 10.42.42.5 and port not 22  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪pcap-recorder_any(filters='host 10.42.42.5 and port not 22')↪pcap-recorder_any(filters='host 10.42.42.5 and port not 22')]  [process.py:181]
10:02:10.025544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22'): DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-stp_10.42.42.5/pcap/stdout  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪pcap-recorder_any(filters='host 10.42.42.5 and port not 22')↪pcap-recorder_any(filters='host 10.42.42.5 and port not 22')]  [process.py:161]
10:02:10.072371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22'): DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-stp_10.42.42.5/pcap/stderr  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪pcap-recorder_any(filters='host 10.42.42.5 and port not 22')↪pcap-recorder_any(filters='host 10.42.42.5 and port not 22')]  [process.py:161]
10:02:10.176833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26630): Launched  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪pcap-recorder_any(filters='host 10.42.42.5 and port not 22')↪pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26630)]  [process.py:202]
10:02:10.243989 run              osmo-stp_10.42.42.5: DBG: {binary='/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/inst/osmo-stp/bin/osmo-stp', env={LD_LIBRARY_PATH='/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/inst/osmo-stp/lib'}, run_dir=/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-stp_10.42.42.5}  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5]  [stp_osmo.py:54]
10:02:10.287485 run              osmo-stp_10.42.42.5: DBG: cd '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-stp_10.42.42.5'; LD_LIBRARY_PATH='/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/inst/osmo-stp/lib' /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/inst/osmo-stp/bin/osmo-stp -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-stp_10.42.42.5/osmo-stp.cfg  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5]  [process.py:181]
10:02:10.331974 run              osmo-stp_10.42.42.5: DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-stp_10.42.42.5/stdout  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5]  [process.py:161]
10:02:10.377294 run              osmo-stp_10.42.42.5: DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-stp_10.42.42.5/stderr  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5]  [process.py:161]
10:02:10.480377 run   osmo-stp_10.42.42.5(pid=26631): Launched  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26631)]  [process.py:202]
10:02:10.593178 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6]  [ggsn_osmo.py:37]
10:02:10.659941 run             osmo-ggsn_10.42.42.6: DBG: {config_file='/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-ggsn_10.42.42.6/osmo-ggsn.cfg'}  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6]  [ggsn_osmo.py:72]
10:02:10.705897 run             osmo-ggsn_10.42.42.6: DBG: GGSN CONFIG:
{'ggsn': {'ip_address': {'_hash': 'e780ac7581ad29f8f46e637b61d0c38898c4c52c',
                         '_reserved_by': 'gprs:oc2g-25516-1670662216',
                         '_used': True,
                         'addr': '10.42.42.6'},
          'statedir': '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-ggsn_10.42.42.6/statedir'}}  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6]  [ggsn_osmo.py:79]
10:02:10.776443 cnf                        Templates: DBG: rendering osmo-ggsn.cfg.tmpl  [trial-2373↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪Templates]  [template.py:56]
10:02:10.833989 run             osmo-ggsn_10.42.42.6: DBG: !
! OpenGGSN (0.94.1-adac) configuration saved from vty
!!
!
log stderr
  logging filter all 1
  logging color 1
  logging print category 1
  logging print category-hex 0
  logging print level 1
  logging print file basename last
  logging print extended-timestamp 1
  logging level ip info
  logging level tun info
  logging level ggsn info
  logging level sgsn notice
  logging level icmp6 notice
  logging level lglobal notice
  logging level llapd notice
  logging level linp notice
  logging level lmux notice
  logging level lmi notice
  logging level lmib notice
  logging level lsms notice
  logging level lctrl notice
  logging level lgtp info
  logging level lstats notice
  logging level lgsup notice
  logging level loap notice
  logging level lss7 notice
  logging level lsccp notice
  logging level lsua notice
  logging level lm3ua notice
  logging level lmgcp notice
  logging level set-all debug
!
stats interval 5
!
line vty
 bind 10.42.42.6
ctrl
 bind 10.42.42.6
!
ggsn ggsn0
 gtp state-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-ggsn_10.42.42.6/statedir
 gtp bind-ip 10.42.42.6
 apn internet
  gtpu-mode tun
  tun-device tun4
  type-support v4
  ip prefix dynamic 176.16.222.0/24
  ip dns 0 8.8.8.8
  ip dns 1 8.8.8.4
  ip ifconfig 176.16.222.1/24
  no shutdown
 apn inet6
  gtpu-mode tun
  tun-device tun6
  type-support v6
  ipv6 prefix dynamic fde4:8dba:82e1:2000:0:0:0:0/56
  ipv6 dns 0 2001:4860:4860::8888
  ipv6 dns 1 2001:4860:4860::8844
  ipv6 ifconfig fde4:8dba:82e1:2000:0:0:0:0/56
  ipv6 link-local fe80::1111:1111:1111:1111/64
  no shutdown
 apn inet46
  gtpu-mode tun
  tun-device tun46
  type-support v4v6
  ip prefix dynamic 176.16.46.0/24
  ip dns 0 192.168.100.1
  ip dns 1 8.8.8.8
  ip ifconfig 176.16.46.0/24
  ipv6 prefix dynamic fde4:8dba:82e1:2000:0:0:0:0/56
  ipv6 dns 0 2001:4860:4860::8888
  ipv6 dns 1 2001:4860:4860::8844
  ipv6 ifconfig fde4:8dba:82e1:2000:0:0:0:0/56
  ipv6 link-local fe80::1111:1111:1111:1112/64
  no shutdown
 default-apn internet
 no shutdown ggsn
  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6]  [ggsn_osmo.py:83]
10:02:10.856816 tst                       trial-2373: DBG: has bin_tar {bin_name='osmo-ggsn', matches=['osmo-ggsn.build-6681.tgz'], run_label=''}  [trial.py:148]
10:02:10.881009 run pcap-recorder_any(filters='host 10.42.42.6'): DBG: Recording pcap /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-ggsn_10.42.42.6/pcap host 10.42.42.6  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6↪pcap-recorder_any(filters='host 10.42.42.6')]  [pcap_recorder.py:38]
10:02:10.926127 run pcap-recorder_any(filters='host 10.42.42.6'): DBG: cd '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-ggsn_10.42.42.6/pcap';  tcpdump -n -i any -w /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-ggsn_10.42.42.6/pcap/pcap-recorder_any(filters='host 10.42.42.6').pcap host 10.42.42.6  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6↪pcap-recorder_any(filters='host 10.42.42.6')↪pcap-recorder_any(filters='host 10.42.42.6')]  [process.py:181]
10:02:10.972230 run pcap-recorder_any(filters='host 10.42.42.6'): DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-ggsn_10.42.42.6/pcap/stdout  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6↪pcap-recorder_any(filters='host 10.42.42.6')↪pcap-recorder_any(filters='host 10.42.42.6')]  [process.py:161]
10:02:11.019263 run pcap-recorder_any(filters='host 10.42.42.6'): DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-ggsn_10.42.42.6/pcap/stderr  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6↪pcap-recorder_any(filters='host 10.42.42.6')↪pcap-recorder_any(filters='host 10.42.42.6')]  [process.py:161]
10:02:11.124668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26633): Launched  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6↪pcap-recorder_any(filters='host 10.42.42.6')↪pcap-recorder_any(filters='host 10.42.42.6')(pid=26633)]  [process.py:202]
10:02:11.234419 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6]  [ggsn_osmo.py:56]
10:02:11.300748 run                         patchelf: DBG: cd '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-ggsn_10.42.42.6/patchelf';  patchelf --set-rpath /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/inst/osmo-ggsn/lib /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/inst/osmo-ggsn/bin/osmo-ggsn  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6↪patchelf]  [process.py:181]
10:02:11.346593 run                         patchelf: DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-ggsn_10.42.42.6/patchelf/stdout  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6↪patchelf]  [process.py:161]
10:02:11.393400 run                         patchelf: DBG: /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-ggsn_10.42.42.6/patchelf/stderr  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6↪patchelf]  [process.py:161]
10:02:11.498147 run              patchelf(pid=26634): Launched  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6↪patchelf(pid=26634)]  [process.py:202]
10:02:11.571256 run   osmo-stp_10.42.42.5(pid=26631): DBG: Cleanup  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26631)]  [process.py:288]
10:02:11.674118 run   osmo-stp_10.42.42.5(pid=26631): ERR: Terminated: ERROR {rc=1}  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26631)]  [process.py:295]
10:02:11.803568 run   osmo-stp_10.42.42.5(pid=26631): stdout: 
| (launched: 2022-12-10_10:02:10.354243)
| Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org>
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html>
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26631)]  [process.py:303]
10:02:11.934504 run   osmo-stp_10.42.42.5(pid=26631): stderr: 
| [0;m[38;5;43m20221210100210526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| [0;m[38;5;43m20221210100210526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| [0;m[38;5;43m20221210100210526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| [0;m20221210100210527 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221210100210527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221210100210527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221210100210527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26631)]  [process.py:309]
10:02:12.061344 run   osmo-stp_10.42.42.5(pid=26631): stdout: 
| (launched: 2022-12-10_10:02:10.354243)
| Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org>
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html>
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26631)]  [process.py:303]
10:02:12.185782 run   osmo-stp_10.42.42.5(pid=26631): stderr: 
| [0;m[38;5;43m20221210100210526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| [0;m[38;5;43m20221210100210526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| [0;m[38;5;43m20221210100210526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| [0;m20221210100210527 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221210100210527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221210100210527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221210100210527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26631)]  [process.py:309]
10:02:12.331717 run              patchelf(pid=26634): Terminating (SIGINT)  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6↪patchelf(pid=26634)]  [process.py:259]
10:02:12.405425 run              patchelf(pid=26634): DBG: Cleanup  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6↪patchelf(pid=26634)]  [process.py:288]
10:02:12.503152 run              patchelf(pid=26634): Terminated: ok {rc=0}  [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-ggsn_10.42.42.6↪patchelf(pid=26634)]  [process.py:291]
10:02:12.557525 tst                      iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26631): Process ended prematurely: osmo-stp_10.42.42.5(pid=26631) [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26631)]  [trial-2373↪gprs:oc2g↪iperf3.py:8]  [testenv.py:142: raise log_module.Error('Process ended prematurely: %s' % proc.name())]
10:02:12.561443 tst                      iperf3.py:8: TRACEBACK: Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/iperf3.py", line 8, in <module>
    setup_run_iperf3_test_parallel(1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 67, in setup_run_iperf3_test_parallel
    ggsn.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ggsn_osmo.py", line 57, in start
    util.change_elf_rpath(binary, util.prepend_library_path(lib), self.run_dir.new_dir('patchelf'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 57, in change_elf_rpath
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 214, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 211, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 421, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=26631): Process ended prematurely: osmo-stp_10.42.42.5(pid=26631) [trial-2373↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26631)]
  [trial-2373↪gprs:oc2g↪iperf3.py:8]  [test.py:128]
10:02:12.566647 tst                      iperf3.py:8: Test FAILED (7.5 sec)  [trial-2373↪gprs:oc2g↪iperf3.py:8]  [test.py:129]
10:02:12.569706 ---      ParallelTerminationStrategy: DBG: Scheduled to terminate 7 processes.  [process.py:109]
10:02:12.580114 run   osmo-hlr_10.42.42.2(pid=26628): DBG: Cleanup  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26628)]  [process.py:288]
10:02:12.618244 run   osmo-hlr_10.42.42.2(pid=26628): ERR: Terminated: ERROR {rc=237}  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26628)]  [process.py:295]
10:02:12.666797 run   osmo-hlr_10.42.42.2(pid=26628): stdout: 
| (launched: 2022-12-10_10:02:09.406549) 
  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26628)]  [process.py:303]
10:02:12.716249 run   osmo-hlr_10.42.42.2(pid=26628): stderr: 
| [0;m[1;31m20221210100209583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| [0;m[1;31m20221210100209583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| [0;m[1;31m20221210100209583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| [0;m[1;31m20221210100209583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| [0;m[1;31m20221210100209583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| [0;m[1;31m20221210100209583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| [0;m[1;31m20221210100209595 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2373/run.2022-12-10_09-48-07/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| [0;m20221210100209604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221210100209604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221210100209604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 
  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26628)]  [process.py:309]
10:02:12.736261 ---      ParallelTerminationStrategy: DBG: Starting to kill with SIGTERM  [process.py:117]
10:02:12.760175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26623): Terminating (SIGTERM)  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪iperf3-srv_10.42.42.10↪pcap-recorder_any(filters='host 10.42.42.10 and port not 22')↪pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26623)]  [process.py:259]
10:02:12.799830 run iperf3-srv_10.42.42.10(pid=26624): Terminating (SIGTERM)  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪iperf3-srv_10.42.42.10↪iperf3-srv_10.42.42.10(pid=26624)]  [process.py:259]
10:02:12.839495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26627): Terminating (SIGTERM)  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪pcap-recorder_any(filters='host 10.42.42.2')↪pcap-recorder_any(filters='host 10.42.42.2')(pid=26627)]  [process.py:259]
10:02:12.878943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26630): Terminating (SIGTERM)  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-stp_10.42.42.5↪pcap-recorder_any(filters='host 10.42.42.5 and port not 22')↪pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26630)]  [process.py:259]
10:02:12.918390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26633): Terminating (SIGTERM)  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-ggsn_10.42.42.6↪pcap-recorder_any(filters='host 10.42.42.6')↪pcap-recorder_any(filters='host 10.42.42.6')(pid=26633)]  [process.py:259]
10:02:12.935357 ---      ParallelTerminationStrategy: PID 26623 died...  [process.py:76]
10:02:12.944561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26623): DBG: Cleanup  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪iperf3-srv_10.42.42.10↪pcap-recorder_any(filters='host 10.42.42.10 and port not 22')↪pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26623)]  [process.py:288]
10:02:12.979996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26623): Terminated: ok {rc=0}  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪iperf3-srv_10.42.42.10↪pcap-recorder_any(filters='host 10.42.42.10 and port not 22')↪pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26623)]  [process.py:291]
10:02:12.998255 ---      ParallelTerminationStrategy: PID 26624 died...  [process.py:76]
10:02:13.007381 run iperf3-srv_10.42.42.10(pid=26624): DBG: Cleanup  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪iperf3-srv_10.42.42.10↪iperf3-srv_10.42.42.10(pid=26624)]  [process.py:288]
10:02:13.042536 run iperf3-srv_10.42.42.10(pid=26624): Terminated {rc=256}  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪iperf3-srv_10.42.42.10↪iperf3-srv_10.42.42.10(pid=26624)]  [process.py:293]
10:02:13.060710 ---      ParallelTerminationStrategy: PID 26627 died...  [process.py:76]
10:02:13.069934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26627): DBG: Cleanup  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪pcap-recorder_any(filters='host 10.42.42.2')↪pcap-recorder_any(filters='host 10.42.42.2')(pid=26627)]  [process.py:288]
10:02:13.105296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26627): Terminated: ok {rc=0}  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪pcap-recorder_any(filters='host 10.42.42.2')↪pcap-recorder_any(filters='host 10.42.42.2')(pid=26627)]  [process.py:291]
10:02:13.123421 ---      ParallelTerminationStrategy: PID 26630 died...  [process.py:76]
10:02:13.132524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26630): DBG: Cleanup  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-stp_10.42.42.5↪pcap-recorder_any(filters='host 10.42.42.5 and port not 22')↪pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26630)]  [process.py:288]
10:02:13.167858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26630): Terminated: ok {rc=0}  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-stp_10.42.42.5↪pcap-recorder_any(filters='host 10.42.42.5 and port not 22')↪pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26630)]  [process.py:291]
10:02:13.186112 ---      ParallelTerminationStrategy: PID 26633 died...  [process.py:76]
10:02:13.195232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26633): DBG: Cleanup  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-ggsn_10.42.42.6↪pcap-recorder_any(filters='host 10.42.42.6')↪pcap-recorder_any(filters='host 10.42.42.6')(pid=26633)]  [process.py:288]
10:02:13.231075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26633): Terminated: ok {rc=0}  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-ggsn_10.42.42.6↪pcap-recorder_any(filters='host 10.42.42.6')↪pcap-recorder_any(filters='host 10.42.42.6')(pid=26633)]  [process.py:291]
10:02:13.256301 tst                          /gobi_6: DBG: cleanup  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪/gobi_6]  [ms_ofono.py:403]
10:02:13.278541 bus                          /gobi_6: DBG: Powered == False  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪/gobi_6↪/gobi_6]  [ms_ofono.py:309]
10:02:13.313777 bus                          /gobi_6: Setting Powered False  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪/gobi_6↪/gobi_6]  [ms_ofono.py:317]
10:02:14.355805 bus                          /gobi_6: DBG: Powered == False  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py↪/gobi_6↪/gobi_6]  [ms_ofono.py:309]
10:02:14.377362 tst                        iperf3.py: DBG: Cleaning up module <module 'testlib' from '/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py'>  [trial-2373↪gprs:oc2g↪iperf3.py↪iperf3.py]  [testenv.py:122]
