<classResult _class='hudson.tasks.junit.ClassResult'><child><age>44</age><className>gprs:trx-umtrx</className><duration>9.0</duration><errorStackTrace>osmo-stp_10.42.42.5(pid=21445): Process ended prematurely: osmo-stp_10.42.42.5(pid=21445) [trial-2361↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21445)]</errorStackTrace><failedSince>2318</failedSince><name>cs_paging_gprs_active.py</name><properties></properties><skipped>false</skipped><status>FAILED</status><stderr>Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "&lt;frozen importlib._bootstrap_external&gt;", line 728, in exec_module
  File "&lt;frozen importlib._bootstrap&gt;", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/cs_paging_gprs_active.py", line 38, in &lt;module&gt;
    setup_run_iperf3_test_parallel(2, ready_cb=ready_cb_place_voicecall)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 67, in setup_run_iperf3_test_parallel
    ggsn.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ggsn_osmo.py", line 57, in start
    util.change_elf_rpath(binary, util.prepend_library_path(lib), self.run_dir.new_dir('patchelf'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 57, in change_elf_rpath
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 214, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 211, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 421, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=21445): Process ended prematurely: osmo-stp_10.42.42.5(pid=21445) [trial-2361↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21445)]
</stderr><stdout>
----------------------------------------------
trial-2361 gprs:trx-umtrx cs_paging_gprs_active.py
----------------------------------------------
16:16:25.152772 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:25.163455 tst                   gprs:trx-umtrx: Using 1 x bts (candidates: 1)
16:16:25.302398 tst         cs_paging_gprs_active.py: using LAC 22224
16:16:25.426058 tst         cs_paging_gprs_active.py: using RAC 39
16:16:25.548842 tst         cs_paging_gprs_active.py: using CellId 22224
16:16:25.671370 tst         cs_paging_gprs_active.py: using BVCI 22225
16:16:25.695018 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:25.705823 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:25.716192 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:25.726708 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:25.737040 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:25.747341 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:25.757897 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:25.768181 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:25.778751 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:16:25.901017 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:16:26.188462 tst      cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003...
16:16:26.317636 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
16:16:26.641358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21435): Launched
16:16:26.910123 run iperf3-srv_10.42.42.10(pid=21436): Launched
16:16:27.099600 tst      cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004...
16:16:27.228609 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
16:16:27.561674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21437): Launched
16:16:27.828669 run iperf3-srv_10.42.42.10(pid=21438): Launched
16:16:28.017860 tst      cs_paging_gprs_active.py:38: start network...
16:16:28.147105 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
16:16:28.646256 run         create_hlr_db(pid=21439): Launched
16:16:28.825589 bus                        /sierra_2: Setting Powered False
16:16:29.846723 run         create_hlr_db(pid=21439): Terminated: ok {rc=0}
16:16:30.291095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21441): Launched
16:16:30.626897 run   osmo-hlr_10.42.42.2(pid=21442): Launched
16:16:30.748577 run              osmo-stp_10.42.42.5: Starting osmo-stp
16:16:31.365453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21444): Launched
16:16:31.707276 run   osmo-stp_10.42.42.5(pid=21445): Launched
16:16:31.827759 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
16:16:32.479444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21447): Launched
16:16:32.598756 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
16:16:32.889828 run              patchelf(pid=21448): Launched
16:16:33.084584 run   osmo-stp_10.42.42.5(pid=21445): ERR: Terminated: ERROR {rc=1}  [trial-2361↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21445)]
16:16:33.227089 run   osmo-stp_10.42.42.5(pid=21445): stdout: 
| (launched: 2022-12-09_16:16:31.529259)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:16:33.370580 run   osmo-stp_10.42.42.5(pid=21445): stderr: 
| �[0;m�[38;5;43m20221209161631915 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221209161631915 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221209161631915 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221209161631916 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221209161631923 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221209161631923 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221209161631923 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:16:33.508141 run   osmo-stp_10.42.42.5(pid=21445): stdout: 
| (launched: 2022-12-09_16:16:31.529259)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:16:33.644805 run   osmo-stp_10.42.42.5(pid=21445): stderr: 
| �[0;m�[38;5;43m20221209161631915 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221209161631915 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221209161631915 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221209161631916 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221209161631923 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221209161631923 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221209161631923 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:16:33.804023 run              patchelf(pid=21448): Terminating (SIGINT)
16:16:33.991390 run              patchelf(pid=21448): Terminated: ok {rc=0}
16:16:34.025916 tst      cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=21445): Process ended prematurely: osmo-stp_10.42.42.5(pid=21445) [trial-2361↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21445)]  [trial-2361↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38]
16:16:34.035791 tst      cs_paging_gprs_active.py:38: Test FAILED (8.9 sec)
16:16:34.100591 run   osmo-hlr_10.42.42.2(pid=21442): ERR: Terminated: ERROR {rc=237}  [trial-2361↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21442)]
16:16:34.152505 run   osmo-hlr_10.42.42.2(pid=21442): stdout: 
| (launched: 2022-12-09_16:16:30.460882) 
16:16:34.205558 run   osmo-hlr_10.42.42.2(pid=21442): stderr: 
| �[0;m�[1;31m20221209161630663 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221209161630663 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221209161630663 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221209161630663 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221209161630663 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221209161630664 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221209161630675 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221209161630684 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221209161630684 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221209161630684 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 
16:16:34.250216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21435): Terminating (SIGTERM)
16:16:34.292260 run iperf3-srv_10.42.42.10(pid=21436): Terminating (SIGTERM)
16:16:34.336449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21437): Terminating (SIGTERM)
16:16:34.378903 run iperf3-srv_10.42.42.10(pid=21438): Terminating (SIGTERM)
16:16:34.420806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21441): Terminating (SIGTERM)
16:16:34.463527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21444): Terminating (SIGTERM)
16:16:34.505986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21447): Terminating (SIGTERM)
16:16:34.515980 ---      ParallelTerminationStrategy: PID 21435 died...
16:16:34.573099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21435): Terminated: ok {rc=0}
16:16:34.583460 ---      ParallelTerminationStrategy: PID 21436 died...
16:16:34.640000 run iperf3-srv_10.42.42.10(pid=21436): Terminated {rc=256}
16:16:34.650045 ---      ParallelTerminationStrategy: PID 21437 died...
16:16:34.707040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21437): Terminated: ok {rc=0}
16:16:34.717562 ---      ParallelTerminationStrategy: PID 21438 died...
16:16:34.774406 run iperf3-srv_10.42.42.10(pid=21438): Terminated {rc=256}
16:16:34.784658 ---      ParallelTerminationStrategy: PID 21441 died...
16:16:34.840804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21441): Terminated: ok {rc=0}
16:16:34.851291 ---      ParallelTerminationStrategy: PID 21444 died...
16:16:34.907843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21444): Terminated: ok {rc=0}
16:16:34.918145 ---      ParallelTerminationStrategy: PID 21447 died...
16:16:34.974893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21447): Terminated: ok {rc=0}
16:16:35.063343 bus                          /gobi_0: Setting Powered False
16:16:36.171884 bus                          /gobi_0: Setting Powered False
16:16:37.280756 bus                          /gobi_6: Setting Powered False
</stdout></child><child><age>44</age><className>gprs:trx-umtrx</className><duration>8.0</duration><errorStackTrace>osmo-stp_10.42.42.5(pid=21457): Process ended prematurely: osmo-stp_10.42.42.5(pid=21457) [trial-2361↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21457)]</errorStackTrace><failedSince>2318</failedSince><name>iperf3.py</name><properties></properties><skipped>false</skipped><status>FAILED</status><stderr>Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "&lt;frozen importlib._bootstrap_external&gt;", line 728, in exec_module
  File "&lt;frozen importlib._bootstrap&gt;", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/iperf3.py", line 8, in &lt;module&gt;
    setup_run_iperf3_test_parallel(1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 67, in setup_run_iperf3_test_parallel
    ggsn.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ggsn_osmo.py", line 57, in start
    util.change_elf_rpath(binary, util.prepend_library_path(lib), self.run_dir.new_dir('patchelf'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 57, in change_elf_rpath
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 214, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 211, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 421, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=21457): Process ended prematurely: osmo-stp_10.42.42.5(pid=21457) [trial-2361↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21457)]
</stderr><stdout>
----------------------------------------------
trial-2361 gprs:trx-umtrx iperf3.py
----------------------------------------------
16:16:38.391937 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:38.403387 tst                   gprs:trx-umtrx: Using 1 x bts (candidates: 1)
16:16:38.545912 tst                        iperf3.py: using LAC 22225
16:16:38.669841 tst                        iperf3.py: using RAC 40
16:16:38.791373 tst                        iperf3.py: using CellId 22225
16:16:38.923031 tst                        iperf3.py: using BVCI 22226
16:16:38.948504 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:38.959791 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:38.971012 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:38.982898 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:38.995506 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:39.007485 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:39.018822 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:39.030659 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:39.042650 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:16:39.331948 tst                      iperf3.py:8: start iperfv3 server 10.42.42.10:5003...
16:16:39.461610 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
16:16:39.786758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21449): Launched
16:16:40.055083 run iperf3-srv_10.42.42.10(pid=21450): Launched
16:16:40.246724 tst                      iperf3.py:8: start network...
16:16:40.376375 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
16:16:40.874289 run         create_hlr_db(pid=21451): Launched
16:16:41.053406 bus                          /gobi_6: Setting Powered False
16:16:42.074878 run         create_hlr_db(pid=21451): Terminated: ok {rc=0}
16:16:42.491843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21453): Launched
16:16:42.807013 run   osmo-hlr_10.42.42.2(pid=21454): Launched
16:16:42.925966 run              osmo-stp_10.42.42.5: Starting osmo-stp
16:16:43.467392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21456): Launched
16:16:43.777944 run   osmo-stp_10.42.42.5(pid=21457): Launched
16:16:43.894490 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
16:16:44.436783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21459): Launched
16:16:44.547304 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
16:16:44.818669 run              patchelf(pid=21460): Launched
16:16:45.000934 run   osmo-stp_10.42.42.5(pid=21457): ERR: Terminated: ERROR {rc=1}  [trial-2361↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21457)]
16:16:45.134648 run   osmo-stp_10.42.42.5(pid=21457): stdout: 
| (launched: 2022-12-09_16:16:43.624826)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:16:45.268389 run   osmo-stp_10.42.42.5(pid=21457): stderr: 
| �[0;m�[38;5;43m20221209161643797 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221209161643797 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221209161643798 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221209161643798 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221209161643798 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221209161643798 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221209161643799 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:16:45.397089 run   osmo-stp_10.42.42.5(pid=21457): stdout: 
| (launched: 2022-12-09_16:16:43.624826)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:16:45.524245 run   osmo-stp_10.42.42.5(pid=21457): stderr: 
| �[0;m�[38;5;43m20221209161643797 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221209161643797 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221209161643798 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221209161643798 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221209161643798 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221209161643798 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221209161643799 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:16:45.672777 run              patchelf(pid=21460): Terminating (SIGINT)
16:16:45.851221 run              patchelf(pid=21460): Terminated: ok {rc=0}
16:16:45.884556 tst                      iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21457): Process ended prematurely: osmo-stp_10.42.42.5(pid=21457) [trial-2361↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21457)]  [trial-2361↪gprs:trx-umtrx↪iperf3.py:8]
16:16:45.898052 tst                      iperf3.py:8: Test FAILED (7.5 sec)
16:16:45.967830 run   osmo-hlr_10.42.42.2(pid=21454): ERR: Terminated: ERROR {rc=237}  [trial-2361↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21454)]
16:16:46.022405 run   osmo-hlr_10.42.42.2(pid=21454): stdout: 
| (launched: 2022-12-09_16:16:42.650670) 
16:16:46.073850 run   osmo-hlr_10.42.42.2(pid=21454): stderr: 
| �[0;m�[1;31m20221209161642830 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221209161642830 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221209161642830 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221209161642830 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221209161642830 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221209161642830 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221209161642841 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221209161642849 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221209161642849 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221209161642849 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 
16:16:46.117334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21449): Terminating (SIGTERM)
16:16:46.159416 run iperf3-srv_10.42.42.10(pid=21450): Terminating (SIGTERM)
16:16:46.204391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21453): Terminating (SIGTERM)
16:16:46.245625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21456): Terminating (SIGTERM)
16:16:46.286870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21459): Terminating (SIGTERM)
16:16:46.296460 ---      ParallelTerminationStrategy: PID 21449 died...
16:16:46.351290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21449): Terminated: ok {rc=0}
16:16:46.361703 ---      ParallelTerminationStrategy: PID 21450 died...
16:16:46.416363 run iperf3-srv_10.42.42.10(pid=21450): Terminated {rc=256}
16:16:46.426609 ---      ParallelTerminationStrategy: PID 21453 died...
16:16:46.481279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21453): Terminated: ok {rc=0}
16:16:46.491633 ---      ParallelTerminationStrategy: PID 21456 died...
16:16:46.546383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21456): Terminated: ok {rc=0}
16:16:46.556664 ---      ParallelTerminationStrategy: PID 21459 died...
16:16:46.616518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21459): Terminated: ok {rc=0}
16:16:46.729262 bus                          /gobi_6: Setting Powered False
</stdout></child><child><age>187</age><className>gprs:trx-umtrx</className><duration>12.0</duration><errorStackTrace>osmo-stp_10.42.42.5(pid=21475): Process ended prematurely: osmo-stp_10.42.42.5(pid=21475) [trial-2361↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21475)]</errorStackTrace><failedSince>2175</failedSince><name>iperf3m4.py</name><properties></properties><skipped>false</skipped><status>FAILED</status><stderr>Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "&lt;frozen importlib._bootstrap_external&gt;", line 728, in exec_module
  File "&lt;frozen importlib._bootstrap&gt;", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/iperf3m4.py", line 8, in &lt;module&gt;
    setup_run_iperf3_test_parallel(4)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 67, in setup_run_iperf3_test_parallel
    ggsn.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ggsn_osmo.py", line 57, in start
    util.change_elf_rpath(binary, util.prepend_library_path(lib), self.run_dir.new_dir('patchelf'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 57, in change_elf_rpath
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 214, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 211, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 421, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=21475): Process ended prematurely: osmo-stp_10.42.42.5(pid=21475) [trial-2361↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21475)]
</stderr><stdout>
----------------------------------------------
trial-2361 gprs:trx-umtrx iperf3m4.py
----------------------------------------------
16:16:47.853475 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:47.865466 tst                   gprs:trx-umtrx: Using 1 x bts (candidates: 1)
16:16:48.008861 tst                      iperf3m4.py: using LAC 22226
16:16:48.130883 tst                      iperf3m4.py: using RAC 41
16:16:48.252346 tst                      iperf3m4.py: using CellId 22226
16:16:48.377326 tst                      iperf3m4.py: using BVCI 22227
16:16:48.401036 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:48.411944 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:48.422453 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:48.433188 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:48.443670 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:48.454317 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:48.465081 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:48.475784 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:16:48.486778 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:16:48.606140 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:16:48.734324 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:16:48.853100 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:16:49.157402 tst                    iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003...
16:16:49.297262 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
16:16:49.643513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21461): Launched
16:16:49.931103 run iperf3-srv_10.42.42.10(pid=21462): Launched
16:16:50.136080 tst                    iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004...
16:16:50.275564 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
16:16:50.622716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21463): Launched
16:16:50.908307 run iperf3-srv_10.42.42.10(pid=21464): Launched
16:16:51.114509 tst                    iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005...
16:16:51.254273 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
16:16:51.602796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21465): Launched
16:16:51.890780 run iperf3-srv_10.42.42.10(pid=21466): Launched
16:16:52.096418 tst                    iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006...
16:16:52.235473 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
16:16:52.583869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21467): Launched
16:16:52.871207 run iperf3-srv_10.42.42.10(pid=21468): Launched
16:16:53.075360 tst                    iperf3m4.py:8: start network...
16:16:53.214014 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
16:16:53.736881 run         create_hlr_db(pid=21469): Launched
16:16:53.930203 bus                          /gobi_6: Setting Powered False
16:16:54.949381 run         create_hlr_db(pid=21469): Terminated: ok {rc=0}
16:16:55.393910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21471): Launched
16:16:55.730040 run   osmo-hlr_10.42.42.2(pid=21472): Launched
16:16:55.851445 run              osmo-stp_10.42.42.5: Starting osmo-stp
16:16:56.435574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21474): Launched
16:16:56.772597 run   osmo-stp_10.42.42.5(pid=21475): Launched
16:16:56.895290 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
16:16:57.480857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21477): Launched
16:16:57.601578 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
16:16:57.895212 run              patchelf(pid=21478): Launched
16:16:58.090664 run   osmo-stp_10.42.42.5(pid=21475): ERR: Terminated: ERROR {rc=1}  [trial-2361↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21475)]
16:16:58.233624 run   osmo-stp_10.42.42.5(pid=21475): stdout: 
| (launched: 2022-12-09_16:16:56.605874)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:16:58.377758 run   osmo-stp_10.42.42.5(pid=21475): stderr: 
| �[0;m�[38;5;43m20221209161656799 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221209161656799 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221209161656800 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221209161656800 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221209161656800 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221209161656800 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221209161656801 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:16:58.515462 run   osmo-stp_10.42.42.5(pid=21475): stdout: 
| (launched: 2022-12-09_16:16:56.605874)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:16:58.651992 run   osmo-stp_10.42.42.5(pid=21475): stderr: 
| �[0;m�[38;5;43m20221209161656799 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221209161656799 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221209161656800 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221209161656800 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221209161656800 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221209161656800 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221209161656801 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:16:58.810680 run              patchelf(pid=21478): Terminating (SIGINT)
16:16:58.996765 run              patchelf(pid=21478): Terminated: ok {rc=0}
16:16:59.030884 tst                    iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=21475): Process ended prematurely: osmo-stp_10.42.42.5(pid=21475) [trial-2361↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21475)]  [trial-2361↪gprs:trx-umtrx↪iperf3m4.py:8]
16:16:59.040767 tst                    iperf3m4.py:8: Test FAILED (11.2 sec)
16:16:59.105140 run   osmo-hlr_10.42.42.2(pid=21472): ERR: Terminated: ERROR {rc=237}  [trial-2361↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21472)]
16:16:59.156897 run   osmo-hlr_10.42.42.2(pid=21472): stdout: 
| (launched: 2022-12-09_16:16:55.563775) 
16:16:59.209567 run   osmo-hlr_10.42.42.2(pid=21472): stderr: 
| �[0;m�[1;31m20221209161655763 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221209161655763 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221209161655763 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221209161655763 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221209161655763 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221209161655763 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221209161655775 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221209161655784 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221209161655784 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221209161655784 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 
16:16:59.254133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21461): Terminating (SIGTERM)
16:16:59.296855 run iperf3-srv_10.42.42.10(pid=21462): Terminating (SIGTERM)
16:16:59.339172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21463): Terminating (SIGTERM)
16:16:59.381930 run iperf3-srv_10.42.42.10(pid=21464): Terminating (SIGTERM)
16:16:59.424641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21465): Terminating (SIGTERM)
16:16:59.466833 run iperf3-srv_10.42.42.10(pid=21466): Terminating (SIGTERM)
16:16:59.508924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21467): Terminating (SIGTERM)
16:16:59.551280 run iperf3-srv_10.42.42.10(pid=21468): Terminating (SIGTERM)
16:16:59.594027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21471): Terminating (SIGTERM)
16:16:59.635822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21474): Terminating (SIGTERM)
16:16:59.678223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21477): Terminating (SIGTERM)
16:16:59.688253 ---      ParallelTerminationStrategy: PID 21461 died...
16:16:59.744621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21461): Terminated: ok {rc=0}
16:16:59.755143 ---      ParallelTerminationStrategy: PID 21462 died...
16:16:59.811496 run iperf3-srv_10.42.42.10(pid=21462): Terminated {rc=256}
16:16:59.821802 ---      ParallelTerminationStrategy: PID 21463 died...
16:16:59.878182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21463): Terminated: ok {rc=0}
16:16:59.888404 ---      ParallelTerminationStrategy: PID 21464 died...
16:16:59.944553 run iperf3-srv_10.42.42.10(pid=21464): Terminated {rc=256}
16:16:59.954759 ---      ParallelTerminationStrategy: PID 21465 died...
16:17:00.010982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21465): Terminated: ok {rc=0}
16:17:00.021577 ---      ParallelTerminationStrategy: PID 21466 died...
16:17:00.077724 run iperf3-srv_10.42.42.10(pid=21466): Terminated {rc=256}
16:17:00.087999 ---      ParallelTerminationStrategy: PID 21467 died...
16:17:00.144377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=21467): Terminated: ok {rc=0}
16:17:00.154477 ---      ParallelTerminationStrategy: PID 21468 died...
16:17:00.210624 run iperf3-srv_10.42.42.10(pid=21468): Terminated {rc=256}
16:17:00.221123 ---      ParallelTerminationStrategy: PID 21471 died...
16:17:00.277109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21471): Terminated: ok {rc=0}
16:17:00.287563 ---      ParallelTerminationStrategy: PID 21474 died...
16:17:00.345267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21474): Terminated: ok {rc=0}
16:17:00.355734 ---      ParallelTerminationStrategy: PID 21477 died...
16:17:00.409711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21477): Terminated: ok {rc=0}
16:17:00.499396 bus                          /gobi_4: Setting Powered False
16:17:01.611903 bus                          /gobi_4: Setting Powered False
16:17:02.720112 bus                          /gobi_1: Setting Powered False
16:17:03.826751 bus                          /gobi_1: Setting Powered False
16:17:04.934378 bus                          /gobi_0: Setting Powered False
16:17:06.040574 bus                          /gobi_0: Setting Powered False
16:17:07.149821 bus                          /gobi_6: Setting Powered False
</stdout></child><child><age>162</age><className>gprs:trx-umtrx</className><duration>7.0</duration><errorStackTrace>osmo-stp_10.42.42.5(pid=21488): Process ended prematurely: osmo-stp_10.42.42.5(pid=21488) [trial-2361↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21488)]</errorStackTrace><failedSince>2200</failedSince><name>ping.py</name><properties></properties><skipped>false</skipped><status>FAILED</status><stderr>Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "&lt;frozen importlib._bootstrap_external&gt;", line 728, in exec_module
  File "&lt;frozen importlib._bootstrap&gt;", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/ping.py", line 22, in &lt;module&gt;
    ggsn.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ggsn_osmo.py", line 57, in start
    util.change_elf_rpath(binary, util.prepend_library_path(lib), self.run_dir.new_dir('patchelf'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 57, in change_elf_rpath
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 214, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 211, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 421, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=21488): Process ended prematurely: osmo-stp_10.42.42.5(pid=21488) [trial-2361↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21488)]
</stderr><stdout>
----------------------------------------------
trial-2361 gprs:trx-umtrx ping.py
----------------------------------------------
16:17:08.219613 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:17:08.231392 tst                   gprs:trx-umtrx: Using 1 x bts (candidates: 1)
16:17:08.377911 tst                          ping.py: using LAC 22227
16:17:08.504158 tst                          ping.py: using RAC 42
16:17:08.633589 tst                          ping.py: using CellId 22227
16:17:08.760539 tst                          ping.py: using BVCI 22228
16:17:08.785416 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:17:08.796543 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:17:08.807591 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:17:08.818848 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:17:08.829990 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:17:08.841203 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:17:08.852426 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:17:08.863692 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:17:09.162904 tst                       ping.py:19: start network...
16:17:09.299801 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
16:17:09.813781 run         create_hlr_db(pid=21482): Launched
16:17:10.003628 bus                          /gobi_6: Setting Powered False
16:17:11.022873 run         create_hlr_db(pid=21482): Terminated: ok {rc=0}
16:17:11.457666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21484): Launched
16:17:11.785885 run   osmo-hlr_10.42.42.2(pid=21485): Launched
16:17:11.906090 run              osmo-stp_10.42.42.5: Starting osmo-stp
16:17:12.478572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21487): Launched
16:17:12.806612 run   osmo-stp_10.42.42.5(pid=21488): Launched
16:17:12.925270 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
16:17:13.495249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21490): Launched
16:17:13.612167 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
16:17:13.898861 run              patchelf(pid=21491): Launched
16:17:14.090761 run   osmo-stp_10.42.42.5(pid=21488): ERR: Terminated: ERROR {rc=1}  [trial-2361↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21488)]
16:17:14.231619 run   osmo-stp_10.42.42.5(pid=21488): stdout: 
| (launched: 2022-12-09_16:17:12.643926)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:17:14.372362 run   osmo-stp_10.42.42.5(pid=21488): stderr: 
| �[0;m�[38;5;43m20221209161712839 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221209161712840 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221209161712840 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221209161712840 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221209161712841 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221209161712841 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221209161712841 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:17:14.508198 run   osmo-stp_10.42.42.5(pid=21488): stdout: 
| (launched: 2022-12-09_16:17:12.643926)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:17:14.642695 run   osmo-stp_10.42.42.5(pid=21488): stderr: 
| �[0;m�[38;5;43m20221209161712839 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221209161712840 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221209161712840 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221209161712840 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221209161712841 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221209161712841 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221209161712841 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:17:14.798247 run              patchelf(pid=21491): Terminating (SIGINT)
16:17:14.980872 run              patchelf(pid=21491): Terminated: ok {rc=0}
16:17:15.014108 tst                       ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=21488): Process ended prematurely: osmo-stp_10.42.42.5(pid=21488) [trial-2361↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21488)]  [trial-2361↪gprs:trx-umtrx↪ping.py:22]
16:17:15.023615 tst                       ping.py:22: Test FAILED (6.8 sec)
16:17:15.087550 run   osmo-hlr_10.42.42.2(pid=21485): ERR: Terminated: ERROR {rc=237}  [trial-2361↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21485)]
16:17:15.139373 run   osmo-hlr_10.42.42.2(pid=21485): stdout: 
| (launched: 2022-12-09_16:17:11.623473) 
16:17:15.191754 run   osmo-hlr_10.42.42.2(pid=21485): stderr: 
| �[0;m�[1;31m20221209161711823 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221209161711823 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221209161711823 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221209161711823 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221209161711823 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221209161711823 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221209161711836 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221209161711844 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221209161711844 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221209161711844 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 
16:17:15.235835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21484): Terminating (SIGTERM)
16:17:15.278049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21487): Terminating (SIGTERM)
16:17:15.319969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21490): Terminating (SIGTERM)
16:17:15.330086 ---      ParallelTerminationStrategy: PID 21484 died...
16:17:15.386850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21484): Terminated: ok {rc=0}
16:17:15.397666 ---      ParallelTerminationStrategy: PID 21487 died...
16:17:15.453762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21487): Terminated: ok {rc=0}
16:17:15.464196 ---      ParallelTerminationStrategy: PID 21490 died...
16:17:15.520400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21490): Terminated: ok {rc=0}
16:17:15.606520 bus                          /gobi_6: Setting Powered False
</stdout></child><child><age>223</age><className>gprs:trx-umtrx</className><duration>7.0</duration><errorStackTrace>osmo-stp_10.42.42.5(pid=21498): Process ended prematurely: osmo-stp_10.42.42.5(pid=21498) [trial-2361↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21498)]</errorStackTrace><failedSince>2139</failedSince><name>ping_idle_ping.py</name><properties></properties><skipped>false</skipped><status>FAILED</status><stderr>Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "&lt;frozen importlib._bootstrap_external&gt;", line 728, in exec_module
  File "&lt;frozen importlib._bootstrap&gt;", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/ping_idle_ping.py", line 27, in &lt;module&gt;
    ggsn.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ggsn_osmo.py", line 57, in start
    util.change_elf_rpath(binary, util.prepend_library_path(lib), self.run_dir.new_dir('patchelf'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 57, in change_elf_rpath
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 214, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 211, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 421, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=21498): Process ended prematurely: osmo-stp_10.42.42.5(pid=21498) [trial-2361↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21498)]
</stderr><stdout>
----------------------------------------------
trial-2361 gprs:trx-umtrx ping_idle_ping.py
----------------------------------------------
16:17:16.664807 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:17:16.683042 tst                   gprs:trx-umtrx: Using 1 x bts (candidates: 1)
16:17:16.841554 tst                ping_idle_ping.py: using LAC 22228
16:17:16.996863 tst                ping_idle_ping.py: using RAC 43
16:17:17.123675 tst                ping_idle_ping.py: using CellId 22228
16:17:17.252697 tst                ping_idle_ping.py: using BVCI 22229
16:17:17.278664 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:17:17.290554 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:17:17.302470 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:17:17.316373 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:17:17.328014 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:17:17.339589 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:17:17.352695 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
16:17:17.365397 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
16:17:17.651199 tst             ping_idle_ping.py:24: start network...
16:17:17.778996 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
16:17:18.270229 run         create_hlr_db(pid=21492): Launched
16:17:18.446944 bus                          /gobi_6: Setting Powered False
16:17:19.467719 run         create_hlr_db(pid=21492): Terminated: ok {rc=0}
16:17:19.875741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21494): Launched
16:17:20.182557 run   osmo-hlr_10.42.42.2(pid=21495): Launched
16:17:20.294251 run              osmo-stp_10.42.42.5: Starting osmo-stp
16:17:20.825271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21497): Launched
16:17:21.131770 run   osmo-stp_10.42.42.5(pid=21498): Launched
16:17:21.242811 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
16:17:21.774954 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21500): Launched
16:17:21.883894 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
16:17:22.151220 run              patchelf(pid=21501): Launched
16:17:22.329868 run   osmo-stp_10.42.42.5(pid=21498): ERR: Terminated: ERROR {rc=1}  [trial-2361↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21498)]
16:17:22.460570 run   osmo-stp_10.42.42.5(pid=21498): stdout: 
| (launched: 2022-12-09_16:17:20.980681)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:17:22.592646 run   osmo-stp_10.42.42.5(pid=21498): stderr: 
| �[0;m�[38;5;43m20221209161721152 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221209161721153 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221209161721153 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221209161721153 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221209161721155 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221209161721156 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221209161721156 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:17:22.718984 run   osmo-stp_10.42.42.5(pid=21498): stdout: 
| (launched: 2022-12-09_16:17:20.980681)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
16:17:22.844023 run   osmo-stp_10.42.42.5(pid=21498): stderr: 
| �[0;m�[38;5;43m20221209161721152 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221209161721153 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221209161721153 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221209161721153 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221209161721155 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221209161721156 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221209161721156 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
16:17:22.989339 run              patchelf(pid=21501): Terminating (SIGINT)
16:17:23.159871 run              patchelf(pid=21501): Terminated: ok {rc=0}
16:17:23.190840 tst             ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=21498): Process ended prematurely: osmo-stp_10.42.42.5(pid=21498) [trial-2361↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=21498)]  [trial-2361↪gprs:trx-umtrx↪ping_idle_ping.py:27]
16:17:23.199451 tst             ping_idle_ping.py:27: Test FAILED (6.5 sec)
16:17:23.259806 run   osmo-hlr_10.42.42.2(pid=21495): ERR: Terminated: ERROR {rc=237}  [trial-2361↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=21495)]
16:17:23.309207 run   osmo-hlr_10.42.42.2(pid=21495): stdout: 
| (launched: 2022-12-09_16:17:20.031393) 
16:17:23.359176 run   osmo-hlr_10.42.42.2(pid=21495): stderr: 
| �[0;m�[1;31m20221209161720213 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221209161720213 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221209161720213 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221209161720213 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221209161720213 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221209161720213 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221209161720226 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2361/run.2022-12-09_15-36-58/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221209161720236 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221209161720237 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221209161720237 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 
16:17:23.401781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21494): Terminating (SIGTERM)
16:17:23.441792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21497): Terminating (SIGTERM)
16:17:23.481993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21500): Terminating (SIGTERM)
16:17:23.491333 ---      ParallelTerminationStrategy: PID 21494 died...
16:17:23.545130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=21494): Terminated: ok {rc=0}
16:17:23.554881 ---      ParallelTerminationStrategy: PID 21497 died...
16:17:23.608056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=21497): Terminated: ok {rc=0}
16:17:23.617825 ---      ParallelTerminationStrategy: PID 21500 died...
16:17:23.671319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=21500): Terminated: ok {rc=0}
16:17:23.755916 bus                          /gobi_6: Setting Powered False
</stdout></child><failCount>5</failCount><name>gprs:trx-umtrx</name><passCount>0</passCount><skipCount>0</skipCount></classResult>