<classResult _class='hudson.tasks.junit.ClassResult'><child><age>62</age><className>gprs:trx-umtrx</className><duration>9.0</duration><errorStackTrace>osmo-stp_10.42.42.5(pid=29787): Process ended prematurely: osmo-stp_10.42.42.5(pid=29787) [trial-2379↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29787)]</errorStackTrace><failedSince>2318</failedSince><name>cs_paging_gprs_active.py</name><properties></properties><skipped>false</skipped><status>FAILED</status><stderr>Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "&lt;frozen importlib._bootstrap_external&gt;", line 728, in exec_module
  File "&lt;frozen importlib._bootstrap&gt;", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/cs_paging_gprs_active.py", line 38, in &lt;module&gt;
    setup_run_iperf3_test_parallel(2, ready_cb=ready_cb_place_voicecall)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 67, in setup_run_iperf3_test_parallel
    ggsn.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ggsn_osmo.py", line 57, in start
    util.change_elf_rpath(binary, util.prepend_library_path(lib), self.run_dir.new_dir('patchelf'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 57, in change_elf_rpath
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 214, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 211, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 421, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=29787): Process ended prematurely: osmo-stp_10.42.42.5(pid=29787) [trial-2379↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29787)]
</stderr><stdout>
----------------------------------------------
trial-2379 gprs:trx-umtrx cs_paging_gprs_active.py
----------------------------------------------
16:46:07.825637 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:07.836845 tst                   gprs:trx-umtrx: Using 1 x bts (candidates: 1)
16:46:07.983450 tst         cs_paging_gprs_active.py: using LAC 30175
16:46:08.114634 tst         cs_paging_gprs_active.py: using RAC 85
16:46:08.244389 tst         cs_paging_gprs_active.py: using CellId 30175
16:46:08.378694 tst         cs_paging_gprs_active.py: using BVCI 30176
16:46:08.404613 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:08.415801 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:08.426746 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:08.437731 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:08.449207 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:08.460224 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:08.471608 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:08.482759 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:08.494227 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:46:08.612000 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:46:08.914957 tst      cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003...
16:46:09.055471 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
16:46:09.404786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29777): Launched
16:46:09.696217 run iperf3-srv_10.42.42.10(pid=29778): Launched
16:46:09.902386 tst      cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004...
16:46:10.043010 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
16:46:10.392301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29779): Launched
16:46:10.682961 run iperf3-srv_10.42.42.10(pid=29780): Launched
16:46:10.888662 tst      cs_paging_gprs_active.py:38: start network...
16:46:11.029742 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
16:46:11.559361 run         create_hlr_db(pid=29781): Launched
16:46:11.753128 bus                        /sierra_2: Setting Powered False
16:46:12.775055 run         create_hlr_db(pid=29781): Terminated: ok {rc=0}
16:46:13.195229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29783): Launched
16:46:13.510463 run   osmo-hlr_10.42.42.2(pid=29784): Launched
16:46:13.635823 run              osmo-stp_10.42.42.5: Starting osmo-stp
16:46:14.181759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29786): Launched
16:46:14.496929 run   osmo-stp_10.42.42.5(pid=29787): Launched
16:46:14.610204 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
16:46:15.153356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29789): Launched
16:46:15.264138 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
16:46:15.537647 run              patchelf(pid=29790): Launched
16:46:15.719467 run   osmo-stp_10.42.42.5(pid=29787): ERR: Terminated: ERROR {rc=1}  [trial-2379↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29787)]
16:46:15.870061 run   osmo-stp_10.42.42.5(pid=29787): stdout: 
| (launched: 2022-12-12_16:46:14.340435)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:46:16.019408 run   osmo-stp_10.42.42.5(pid=29787): stderr: 
| �[0;m�[38;5;43m20221212164614511 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221212164614511 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221212164614511 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221212164614512 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221212164614512 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221212164614512 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221212164614513 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:46:16.161649 run   osmo-stp_10.42.42.5(pid=29787): stdout: 
| (launched: 2022-12-12_16:46:14.340435)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:46:16.304270 run   osmo-stp_10.42.42.5(pid=29787): stderr: 
| �[0;m�[38;5;43m20221212164614511 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221212164614511 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221212164614511 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221212164614512 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221212164614512 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221212164614512 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221212164614513 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:46:16.471081 run              patchelf(pid=29790): Terminating (SIGINT)
16:46:16.648923 run              patchelf(pid=29790): Terminated: ok {rc=0}
16:46:16.682268 tst      cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29787): Process ended prematurely: osmo-stp_10.42.42.5(pid=29787) [trial-2379↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29787)]  [trial-2379↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38]
16:46:16.692143 tst      cs_paging_gprs_active.py:38: Test FAILED (8.9 sec)
16:46:16.753363 run   osmo-hlr_10.42.42.2(pid=29784): ERR: Terminated: ERROR {rc=237}  [trial-2379↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29784)]
16:46:16.803706 run   osmo-hlr_10.42.42.2(pid=29784): stdout: 
| (launched: 2022-12-12_16:46:13.354032) 
16:46:16.854363 run   osmo-hlr_10.42.42.2(pid=29784): stderr: 
| �[0;m�[1;31m20221212164613529 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221212164613529 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221212164613529 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221212164613529 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221212164613529 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221212164613529 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221212164613541 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221212164613549 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221212164613550 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221212164613550 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 
16:46:16.897492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29777): Terminating (SIGTERM)
16:46:16.940496 run iperf3-srv_10.42.42.10(pid=29778): Terminating (SIGTERM)
16:46:16.983327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29779): Terminating (SIGTERM)
16:46:17.026350 run iperf3-srv_10.42.42.10(pid=29780): Terminating (SIGTERM)
16:46:17.069236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29783): Terminating (SIGTERM)
16:46:17.109726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29786): Terminating (SIGTERM)
16:46:17.150461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29789): Terminating (SIGTERM)
16:46:17.159903 ---      ParallelTerminationStrategy: PID 29777 died...
16:46:17.213391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29777): Terminated: ok {rc=0}
16:46:17.223003 ---      ParallelTerminationStrategy: PID 29778 died...
16:46:17.275530 run iperf3-srv_10.42.42.10(pid=29778): Terminated {rc=256}
16:46:17.285048 ---      ParallelTerminationStrategy: PID 29779 died...
16:46:17.337714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29779): Terminated: ok {rc=0}
16:46:17.347276 ---      ParallelTerminationStrategy: PID 29780 died...
16:46:17.400275 run iperf3-srv_10.42.42.10(pid=29780): Terminated {rc=256}
16:46:17.409925 ---      ParallelTerminationStrategy: PID 29783 died...
16:46:17.462741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29783): Terminated: ok {rc=0}
16:46:17.472351 ---      ParallelTerminationStrategy: PID 29786 died...
16:46:17.525228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29786): Terminated: ok {rc=0}
16:46:17.534766 ---      ParallelTerminationStrategy: PID 29789 died...
16:46:17.587592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29789): Terminated: ok {rc=0}
16:46:17.671285 bus                          /gobi_0: Setting Powered False
16:46:18.779640 bus                          /gobi_0: Setting Powered False
16:46:19.892114 bus                          /gobi_6: Setting Powered False
</stdout></child><child><age>62</age><className>gprs:trx-umtrx</className><duration>8.0</duration><errorStackTrace>osmo-stp_10.42.42.5(pid=29799): Process ended prematurely: osmo-stp_10.42.42.5(pid=29799) [trial-2379↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29799)]</errorStackTrace><failedSince>2318</failedSince><name>iperf3.py</name><properties></properties><skipped>false</skipped><status>FAILED</status><stderr>Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "&lt;frozen importlib._bootstrap_external&gt;", line 728, in exec_module
  File "&lt;frozen importlib._bootstrap&gt;", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/iperf3.py", line 8, in &lt;module&gt;
    setup_run_iperf3_test_parallel(1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 67, in setup_run_iperf3_test_parallel
    ggsn.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ggsn_osmo.py", line 57, in start
    util.change_elf_rpath(binary, util.prepend_library_path(lib), self.run_dir.new_dir('patchelf'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 57, in change_elf_rpath
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 214, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 211, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 421, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=29799): Process ended prematurely: osmo-stp_10.42.42.5(pid=29799) [trial-2379↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29799)]
</stderr><stdout>
----------------------------------------------
trial-2379 gprs:trx-umtrx iperf3.py
----------------------------------------------
16:46:21.003491 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:21.014768 tst                   gprs:trx-umtrx: Using 1 x bts (candidates: 1)
16:46:21.154623 tst                        iperf3.py: using LAC 30176
16:46:21.278984 tst                        iperf3.py: using RAC 86
16:46:21.404124 tst                        iperf3.py: using CellId 30176
16:46:21.530177 tst                        iperf3.py: using BVCI 30177
16:46:21.554211 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:21.564910 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:21.575549 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:21.586160 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:21.596521 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:21.606991 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:21.617591 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:21.627992 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:21.638972 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:46:21.937832 tst                      iperf3.py:8: start iperfv3 server 10.42.42.10:5003...
16:46:22.078790 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
16:46:22.424349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29791): Launched
16:46:22.714902 run iperf3-srv_10.42.42.10(pid=29792): Launched
16:46:22.919836 tst                      iperf3.py:8: start network...
16:46:23.060720 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
16:46:23.588708 run         create_hlr_db(pid=29793): Launched
16:46:23.781498 bus                          /gobi_6: Setting Powered False
16:46:24.802540 run         create_hlr_db(pid=29793): Terminated: ok {rc=0}
16:46:25.221960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29795): Launched
16:46:25.538428 run   osmo-hlr_10.42.42.2(pid=29796): Launched
16:46:25.664624 run              osmo-stp_10.42.42.5: Starting osmo-stp
16:46:26.211428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29798): Launched
16:46:26.523915 run   osmo-stp_10.42.42.5(pid=29799): Launched
16:46:26.636239 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
16:46:27.180580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29801): Launched
16:46:27.291231 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
16:46:27.565940 run              patchelf(pid=29802): Launched
16:46:27.748122 run   osmo-stp_10.42.42.5(pid=29799): ERR: Terminated: ERROR {rc=1}  [trial-2379↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29799)]
16:46:27.881248 run   osmo-stp_10.42.42.5(pid=29799): stdout: 
| (launched: 2022-12-12_16:46:26.369229)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:46:28.014625 run   osmo-stp_10.42.42.5(pid=29799): stderr: 
| �[0;m�[38;5;43m20221212164626537 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221212164626537 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221212164626537 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221212164626538 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221212164626538 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221212164626538 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221212164626538 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:46:28.143539 run   osmo-stp_10.42.42.5(pid=29799): stdout: 
| (launched: 2022-12-12_16:46:26.369229)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:46:28.271223 run   osmo-stp_10.42.42.5(pid=29799): stderr: 
| �[0;m�[38;5;43m20221212164626537 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221212164626537 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221212164626537 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221212164626538 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221212164626538 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221212164626538 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221212164626538 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:46:28.419184 run              patchelf(pid=29802): Terminating (SIGINT)
16:46:28.592683 run              patchelf(pid=29802): Terminated: ok {rc=0}
16:46:28.624583 tst                      iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29799): Process ended prematurely: osmo-stp_10.42.42.5(pid=29799) [trial-2379↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29799)]  [trial-2379↪gprs:trx-umtrx↪iperf3.py:8]
16:46:28.633907 tst                      iperf3.py:8: Test FAILED (7.7 sec)
16:46:28.693744 run   osmo-hlr_10.42.42.2(pid=29796): ERR: Terminated: ERROR {rc=237}  [trial-2379↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29796)]
16:46:28.742304 run   osmo-hlr_10.42.42.2(pid=29796): stdout: 
| (launched: 2022-12-12_16:46:25.381162) 
16:46:28.791518 run   osmo-hlr_10.42.42.2(pid=29796): stderr: 
| �[0;m�[1;31m20221212164625556 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221212164625556 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221212164625556 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221212164625556 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221212164625556 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221212164625556 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221212164625568 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221212164625576 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221212164625577 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221212164625577 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 
16:46:28.833771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29791): Terminating (SIGTERM)
16:46:28.873416 run iperf3-srv_10.42.42.10(pid=29792): Terminating (SIGTERM)
16:46:28.913037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29795): Terminating (SIGTERM)
16:46:28.952801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29798): Terminating (SIGTERM)
16:46:28.992613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29801): Terminating (SIGTERM)
16:46:29.002021 ---      ParallelTerminationStrategy: PID 29791 died...
16:46:29.055178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29791): Terminated: ok {rc=0}
16:46:29.064737 ---      ParallelTerminationStrategy: PID 29792 died...
16:46:29.117629 run iperf3-srv_10.42.42.10(pid=29792): Terminated {rc=256}
16:46:29.127137 ---      ParallelTerminationStrategy: PID 29795 died...
16:46:29.179908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29795): Terminated: ok {rc=0}
16:46:29.189924 ---      ParallelTerminationStrategy: PID 29798 died...
16:46:29.243567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29798): Terminated: ok {rc=0}
16:46:29.253263 ---      ParallelTerminationStrategy: PID 29801 died...
16:46:29.306238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29801): Terminated: ok {rc=0}
16:46:29.390228 bus                          /gobi_6: Setting Powered False
</stdout></child><child><age>205</age><className>gprs:trx-umtrx</className><duration>12.0</duration><errorStackTrace>osmo-stp_10.42.42.5(pid=29817): Process ended prematurely: osmo-stp_10.42.42.5(pid=29817) [trial-2379↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29817)]</errorStackTrace><failedSince>2175</failedSince><name>iperf3m4.py</name><properties></properties><skipped>false</skipped><status>FAILED</status><stderr>Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "&lt;frozen importlib._bootstrap_external&gt;", line 728, in exec_module
  File "&lt;frozen importlib._bootstrap&gt;", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/iperf3m4.py", line 8, in &lt;module&gt;
    setup_run_iperf3_test_parallel(4)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 67, in setup_run_iperf3_test_parallel
    ggsn.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ggsn_osmo.py", line 57, in start
    util.change_elf_rpath(binary, util.prepend_library_path(lib), self.run_dir.new_dir('patchelf'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 57, in change_elf_rpath
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 214, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 211, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 421, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=29817): Process ended prematurely: osmo-stp_10.42.42.5(pid=29817) [trial-2379↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29817)]
</stderr><stdout>
----------------------------------------------
trial-2379 gprs:trx-umtrx iperf3m4.py
----------------------------------------------
16:46:30.507279 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:30.519358 tst                   gprs:trx-umtrx: Using 1 x bts (candidates: 1)
16:46:30.668866 tst                      iperf3m4.py: using LAC 30177
16:46:30.809870 tst                      iperf3m4.py: using RAC 87
16:46:30.959016 tst                      iperf3m4.py: using CellId 30177
16:46:31.125716 tst                      iperf3m4.py: using BVCI 30178
16:46:31.162152 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:31.179434 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:31.196716 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:31.212271 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:31.227751 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:31.243287 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:31.261530 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:31.278990 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:31.296811 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:46:31.434901 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:46:31.568712 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:46:31.723213 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:46:32.059683 tst                    iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003...
16:46:32.193760 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
16:46:32.522464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29803): Launched
16:46:32.794340 run iperf3-srv_10.42.42.10(pid=29804): Launched
16:46:32.984273 tst                    iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004...
16:46:33.113964 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
16:46:33.438836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29805): Launched
16:46:33.708835 run iperf3-srv_10.42.42.10(pid=29806): Launched
16:46:33.898918 tst                    iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005...
16:46:34.028396 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
16:46:34.353343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29807): Launched
16:46:34.624419 run iperf3-srv_10.42.42.10(pid=29808): Launched
16:46:34.814554 tst                    iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006...
16:46:34.944081 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
16:46:35.268871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29809): Launched
16:46:35.538909 run iperf3-srv_10.42.42.10(pid=29810): Launched
16:46:35.728402 tst                    iperf3m4.py:8: start network...
16:46:35.857749 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
16:46:36.356645 run         create_hlr_db(pid=29811): Launched
16:46:36.534454 bus                          /gobi_6: Setting Powered False
16:46:37.557498 run         create_hlr_db(pid=29811): Terminated: ok {rc=0}
16:46:38.001819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29813): Launched
16:46:38.338645 run   osmo-hlr_10.42.42.2(pid=29814): Launched
16:46:38.459496 run              osmo-stp_10.42.42.5: Starting osmo-stp
16:46:39.044869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29816): Launched
16:46:39.382026 run   osmo-stp_10.42.42.5(pid=29817): Launched
16:46:39.504532 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
16:46:40.090440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29819): Launched
16:46:40.210624 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
16:46:40.505159 run              patchelf(pid=29820): Launched
16:46:40.700134 run   osmo-stp_10.42.42.5(pid=29817): ERR: Terminated: ERROR {rc=1}  [trial-2379↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29817)]
16:46:40.843195 run   osmo-stp_10.42.42.5(pid=29817): stdout: 
| (launched: 2022-12-12_16:46:39.214989)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:46:40.987002 run   osmo-stp_10.42.42.5(pid=29817): stderr: 
| �[0;m�[38;5;43m20221212164639405 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221212164639405 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221212164639405 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221212164639406 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221212164639406 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221212164639406 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221212164639406 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:46:41.125449 run   osmo-stp_10.42.42.5(pid=29817): stdout: 
| (launched: 2022-12-12_16:46:39.214989)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:46:41.262493 run   osmo-stp_10.42.42.5(pid=29817): stderr: 
| �[0;m�[38;5;43m20221212164639405 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221212164639405 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221212164639405 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221212164639406 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221212164639406 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221212164639406 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221212164639406 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:46:41.421518 run              patchelf(pid=29820): Terminating (SIGINT)
16:46:41.608130 run              patchelf(pid=29820): Terminated: ok {rc=0}
16:46:41.642469 tst                    iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29817): Process ended prematurely: osmo-stp_10.42.42.5(pid=29817) [trial-2379↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29817)]  [trial-2379↪gprs:trx-umtrx↪iperf3m4.py:8]
16:46:41.652587 tst                    iperf3m4.py:8: Test FAILED (11.2 sec)
16:46:41.717225 run   osmo-hlr_10.42.42.2(pid=29814): ERR: Terminated: ERROR {rc=237}  [trial-2379↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29814)]
16:46:41.769419 run   osmo-hlr_10.42.42.2(pid=29814): stdout: 
| (launched: 2022-12-12_16:46:38.171624) 
16:46:41.822158 run   osmo-hlr_10.42.42.2(pid=29814): stderr: 
| �[0;m�[1;31m20221212164638367 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221212164638367 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221212164638367 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221212164638367 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221212164638367 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221212164638367 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221212164638380 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221212164638390 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221212164638390 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221212164638390 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 
16:46:41.866653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29803): Terminating (SIGTERM)
16:46:41.909054 run iperf3-srv_10.42.42.10(pid=29804): Terminating (SIGTERM)
16:46:41.951882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29805): Terminating (SIGTERM)
16:46:41.996101 run iperf3-srv_10.42.42.10(pid=29806): Terminating (SIGTERM)
16:46:42.040131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29807): Terminating (SIGTERM)
16:46:42.082341 run iperf3-srv_10.42.42.10(pid=29808): Terminating (SIGTERM)
16:46:42.124401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29809): Terminating (SIGTERM)
16:46:42.166403 run iperf3-srv_10.42.42.10(pid=29810): Terminating (SIGTERM)
16:46:42.208769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29813): Terminating (SIGTERM)
16:46:42.250992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29816): Terminating (SIGTERM)
16:46:42.293352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29819): Terminating (SIGTERM)
16:46:42.303492 ---      ParallelTerminationStrategy: PID 29803 died...
16:46:42.359948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29803): Terminated: ok {rc=0}
16:46:42.370521 ---      ParallelTerminationStrategy: PID 29804 died...
16:46:42.426383 run iperf3-srv_10.42.42.10(pid=29804): Terminated {rc=256}
16:46:42.436768 ---      ParallelTerminationStrategy: PID 29805 died...
16:46:42.492885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29805): Terminated: ok {rc=0}
16:46:42.503387 ---      ParallelTerminationStrategy: PID 29806 died...
16:46:42.560072 run iperf3-srv_10.42.42.10(pid=29806): Terminated {rc=256}
16:46:42.570270 ---      ParallelTerminationStrategy: PID 29807 died...
16:46:42.626986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29807): Terminated: ok {rc=0}
16:46:42.637272 ---      ParallelTerminationStrategy: PID 29808 died...
16:46:42.693455 run iperf3-srv_10.42.42.10(pid=29808): Terminated {rc=256}
16:46:42.703616 ---      ParallelTerminationStrategy: PID 29809 died...
16:46:42.759944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29809): Terminated: ok {rc=0}
16:46:42.770082 ---      ParallelTerminationStrategy: PID 29810 died...
16:46:42.826033 run iperf3-srv_10.42.42.10(pid=29810): Terminated {rc=256}
16:46:42.836536 ---      ParallelTerminationStrategy: PID 29813 died...
16:46:42.893038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29813): Terminated: ok {rc=0}
16:46:42.903394 ---      ParallelTerminationStrategy: PID 29816 died...
16:46:42.960353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29816): Terminated: ok {rc=0}
16:46:42.970491 ---      ParallelTerminationStrategy: PID 29819 died...
16:46:43.026822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29819): Terminated: ok {rc=0}
16:46:43.113851 bus                          /gobi_4: Setting Powered False
16:46:44.221840 bus                          /gobi_4: Setting Powered False
16:46:45.329238 bus                          /gobi_1: Setting Powered False
16:46:46.462238 bus                          /gobi_1: Setting Powered False
16:46:47.578820 bus                          /gobi_0: Setting Powered False
16:46:48.681184 bus                          /gobi_0: Setting Powered False
16:46:49.794089 bus                          /gobi_6: Setting Powered False
</stdout></child><child><age>180</age><className>gprs:trx-umtrx</className><duration>7.0</duration><errorStackTrace>osmo-stp_10.42.42.5(pid=29827): Process ended prematurely: osmo-stp_10.42.42.5(pid=29827) [trial-2379↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29827)]</errorStackTrace><failedSince>2200</failedSince><name>ping.py</name><properties></properties><skipped>false</skipped><status>FAILED</status><stderr>Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "&lt;frozen importlib._bootstrap_external&gt;", line 728, in exec_module
  File "&lt;frozen importlib._bootstrap&gt;", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/ping.py", line 22, in &lt;module&gt;
    ggsn.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ggsn_osmo.py", line 57, in start
    util.change_elf_rpath(binary, util.prepend_library_path(lib), self.run_dir.new_dir('patchelf'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 57, in change_elf_rpath
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 214, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 211, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 421, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=29827): Process ended prematurely: osmo-stp_10.42.42.5(pid=29827) [trial-2379↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29827)]
</stderr><stdout>
----------------------------------------------
trial-2379 gprs:trx-umtrx ping.py
----------------------------------------------
16:46:50.861460 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:50.872749 tst                   gprs:trx-umtrx: Using 1 x bts (candidates: 1)
16:46:51.016247 tst                          ping.py: using LAC 30178
16:46:51.135183 tst                          ping.py: using RAC 88
16:46:51.254454 tst                          ping.py: using CellId 30178
16:46:51.373716 tst                          ping.py: using BVCI 30179
16:46:51.396904 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:51.407565 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:51.418112 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:51.429206 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:51.440232 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:51.451353 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:51.462521 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:51.473677 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:46:51.753116 tst                       ping.py:19: start network...
16:46:51.880024 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
16:46:52.371751 run         create_hlr_db(pid=29821): Launched
16:46:52.547714 bus                          /gobi_6: Setting Powered False
16:46:53.567960 run         create_hlr_db(pid=29821): Terminated: ok {rc=0}
16:46:54.004695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29823): Launched
16:46:54.334347 run   osmo-hlr_10.42.42.2(pid=29824): Launched
16:46:54.453713 run              osmo-stp_10.42.42.5: Starting osmo-stp
16:46:55.028843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29826): Launched
16:46:55.359389 run   osmo-stp_10.42.42.5(pid=29827): Launched
16:46:55.478585 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
16:46:56.052448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29829): Launched
16:46:56.170190 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
16:46:56.459176 run              patchelf(pid=29830): Launched
16:46:56.650909 run   osmo-stp_10.42.42.5(pid=29827): ERR: Terminated: ERROR {rc=1}  [trial-2379↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29827)]
16:46:56.791361 run   osmo-stp_10.42.42.5(pid=29827): stdout: 
| (launched: 2022-12-12_16:46:55.195707)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:46:56.931900 run   osmo-stp_10.42.42.5(pid=29827): stderr: 
| �[0;m�[38;5;43m20221212164655384 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221212164655384 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221212164655384 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221212164655385 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221212164655385 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221212164655385 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221212164655385 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:46:57.068260 run   osmo-stp_10.42.42.5(pid=29827): stdout: 
| (launched: 2022-12-12_16:46:55.195707)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:46:57.203106 run   osmo-stp_10.42.42.5(pid=29827): stderr: 
| �[0;m�[38;5;43m20221212164655384 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221212164655384 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221212164655384 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221212164655385 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221212164655385 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221212164655385 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221212164655385 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:46:57.359614 run              patchelf(pid=29830): Terminating (SIGINT)
16:46:57.543323 run              patchelf(pid=29830): Terminated: ok {rc=0}
16:46:57.576602 tst                       ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29827): Process ended prematurely: osmo-stp_10.42.42.5(pid=29827) [trial-2379↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29827)]  [trial-2379↪gprs:trx-umtrx↪ping.py:22]
16:46:57.586092 tst                       ping.py:22: Test FAILED (6.7 sec)
16:46:57.650255 run   osmo-hlr_10.42.42.2(pid=29824): ERR: Terminated: ERROR {rc=237}  [trial-2379↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29824)]
16:46:57.702169 run   osmo-hlr_10.42.42.2(pid=29824): stdout: 
| (launched: 2022-12-12_16:46:54.171304) 
16:46:57.754787 run   osmo-hlr_10.42.42.2(pid=29824): stderr: 
| �[0;m�[1;31m20221212164654367 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221212164654367 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221212164654367 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221212164654367 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221212164654367 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221212164654367 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221212164654409 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221212164654418 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221212164654419 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221212164654419 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 
16:46:57.799032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29823): Terminating (SIGTERM)
16:46:57.841533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29826): Terminating (SIGTERM)
16:46:57.883780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29829): Terminating (SIGTERM)
16:46:57.894016 ---      ParallelTerminationStrategy: PID 29823 died...
16:46:57.950980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29823): Terminated: ok {rc=0}
16:46:57.961613 ---      ParallelTerminationStrategy: PID 29826 died...
16:46:58.018491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29826): Terminated: ok {rc=0}
16:46:58.028556 ---      ParallelTerminationStrategy: PID 29829 died...
16:46:58.085032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29829): Terminated: ok {rc=0}
16:46:58.173179 bus                          /gobi_6: Setting Powered False
</stdout></child><child><age>241</age><className>gprs:trx-umtrx</className><duration>7.0</duration><errorStackTrace>osmo-stp_10.42.42.5(pid=29837): Process ended prematurely: osmo-stp_10.42.42.5(pid=29837) [trial-2379↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29837)]</errorStackTrace><failedSince>2139</failedSince><name>ping_idle_ping.py</name><properties></properties><skipped>false</skipped><status>FAILED</status><stderr>Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "&lt;frozen importlib._bootstrap_external&gt;", line 728, in exec_module
  File "&lt;frozen importlib._bootstrap&gt;", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/ping_idle_ping.py", line 27, in &lt;module&gt;
    ggsn.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ggsn_osmo.py", line 57, in start
    util.change_elf_rpath(binary, util.prepend_library_path(lib), self.run_dir.new_dir('patchelf'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 57, in change_elf_rpath
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 214, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 211, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 421, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=29837): Process ended prematurely: osmo-stp_10.42.42.5(pid=29837) [trial-2379↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29837)]
</stderr><stdout>
----------------------------------------------
trial-2379 gprs:trx-umtrx ping_idle_ping.py
----------------------------------------------
16:46:59.225398 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:59.237251 tst                   gprs:trx-umtrx: Using 1 x bts (candidates: 1)
16:46:59.381466 tst                ping_idle_ping.py: using LAC 30179
16:46:59.501245 tst                ping_idle_ping.py: using RAC 89
16:46:59.621525 tst                ping_idle_ping.py: using CellId 30179
16:46:59.741642 tst                ping_idle_ping.py: using BVCI 30180
16:46:59.765382 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:59.776178 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:59.786788 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:59.797860 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:59.808915 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:59.819990 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:59.831274 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:46:59.842535 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:47:00.124747 tst             ping_idle_ping.py:24: start network...
16:47:00.252839 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
16:47:00.749161 run         create_hlr_db(pid=29831): Launched
16:47:00.948743 bus                          /gobi_6: Setting Powered False
16:47:01.962337 run         create_hlr_db(pid=29831): Terminated: ok {rc=0}
16:47:02.409011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29833): Launched
16:47:02.741201 run   osmo-hlr_10.42.42.2(pid=29834): Launched
16:47:02.863054 run              osmo-stp_10.42.42.5: Starting osmo-stp
16:47:03.437751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29836): Launched
16:47:03.769530 run   osmo-stp_10.42.42.5(pid=29837): Launched
16:47:03.889162 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
16:47:04.466470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29839): Launched
16:47:04.583960 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
16:47:04.873426 run              patchelf(pid=29840): Launched
16:47:05.066022 run   osmo-stp_10.42.42.5(pid=29837): ERR: Terminated: ERROR {rc=1}  [trial-2379↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29837)]
16:47:05.205968 run   osmo-stp_10.42.42.5(pid=29837): stdout: 
| (launched: 2022-12-12_16:47:03.605401)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:47:05.346914 run   osmo-stp_10.42.42.5(pid=29837): stderr: 
| �[0;m�[38;5;43m20221212164703794 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221212164703795 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221212164703795 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221212164703795 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221212164703796 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221212164703796 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221212164703796 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:47:05.482968 run   osmo-stp_10.42.42.5(pid=29837): stdout: 
| (launched: 2022-12-12_16:47:03.605401)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:47:05.617765 run   osmo-stp_10.42.42.5(pid=29837): stderr: 
| �[0;m�[38;5;43m20221212164703794 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221212164703795 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221212164703795 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221212164703795 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221212164703796 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221212164703796 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221212164703796 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:47:05.773875 run              patchelf(pid=29840): Terminating (SIGINT)
16:47:05.957467 run              patchelf(pid=29840): Terminated: ok {rc=0}
16:47:05.990598 tst             ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29837): Process ended prematurely: osmo-stp_10.42.42.5(pid=29837) [trial-2379↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29837)]  [trial-2379↪gprs:trx-umtrx↪ping_idle_ping.py:27]
16:47:06.000219 tst             ping_idle_ping.py:27: Test FAILED (6.8 sec)
16:47:06.064185 run   osmo-hlr_10.42.42.2(pid=29834): ERR: Terminated: ERROR {rc=237}  [trial-2379↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29834)]
16:47:06.116172 run   osmo-hlr_10.42.42.2(pid=29834): stdout: 
| (launched: 2022-12-12_16:47:02.577174) 
16:47:06.168677 run   osmo-hlr_10.42.42.2(pid=29834): stderr: 
| �[0;m�[1;31m20221212164702774 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221212164702774 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221212164702774 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221212164702774 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221212164702774 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221212164702774 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221212164702788 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2379/run.2022-12-12_16-06-15/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221212164702796 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221212164702797 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221212164702797 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 
16:47:06.213055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29833): Terminating (SIGTERM)
16:47:06.255436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29836): Terminating (SIGTERM)
16:47:06.297922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29839): Terminating (SIGTERM)
16:47:06.308114 ---      ParallelTerminationStrategy: PID 29833 died...
16:47:06.364553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29833): Terminated: ok {rc=0}
16:47:06.374997 ---      ParallelTerminationStrategy: PID 29836 died...
16:47:06.431020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29836): Terminated: ok {rc=0}
16:47:06.441598 ---      ParallelTerminationStrategy: PID 29839 died...
16:47:06.497852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29839): Terminated: ok {rc=0}
16:47:06.584394 bus                          /gobi_6: Setting Powered False
</stdout></child><failCount>5</failCount><name>gprs:trx-umtrx</name><passCount>0</passCount><skipCount>0</skipCount></classResult>