<classResult _class='hudson.tasks.junit.ClassResult'><child><age>57</age><className>gprs:trx-umtrx</className><duration>9.0</duration><errorStackTrace>osmo-stp_10.42.42.5(pid=4594): Process ended prematurely: osmo-stp_10.42.42.5(pid=4594) [trial-2374↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4594)]</errorStackTrace><failedSince>2318</failedSince><name>cs_paging_gprs_active.py</name><properties></properties><skipped>false</skipped><status>FAILED</status><stderr>Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "&lt;frozen importlib._bootstrap_external&gt;", line 728, in exec_module
  File "&lt;frozen importlib._bootstrap&gt;", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/cs_paging_gprs_active.py", line 38, in &lt;module&gt;
    setup_run_iperf3_test_parallel(2, ready_cb=ready_cb_place_voicecall)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 67, in setup_run_iperf3_test_parallel
    ggsn.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ggsn_osmo.py", line 57, in start
    util.change_elf_rpath(binary, util.prepend_library_path(lib), self.run_dir.new_dir('patchelf'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 57, in change_elf_rpath
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 214, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 211, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 421, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=4594): Process ended prematurely: osmo-stp_10.42.42.5(pid=4594) [trial-2374↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4594)]
</stderr><stdout>
----------------------------------------------
trial-2374 gprs:trx-umtrx cs_paging_gprs_active.py
----------------------------------------------
11:54:36.448899 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:36.459414 tst                   gprs:trx-umtrx: Using 1 x bts (candidates: 1)
11:54:36.593491 tst         cs_paging_gprs_active.py: using LAC 28217
11:54:36.709601 tst         cs_paging_gprs_active.py: using RAC 167
11:54:36.826673 tst         cs_paging_gprs_active.py: using CellId 28217
11:54:36.943167 tst         cs_paging_gprs_active.py: using BVCI 28218
11:54:36.966187 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:36.976625 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:36.986862 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:36.997451 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:37.007959 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:37.018451 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:37.029082 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:37.039509 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:37.050094 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
11:54:37.165984 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
11:54:37.459761 tst      cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003...
11:54:37.595036 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
11:54:37.928792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4584): Launched
11:54:38.206211 run iperf3-srv_10.42.42.10(pid=4585): Launched
11:54:38.404485 tst      cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004...
11:54:38.538985 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
11:54:38.871985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4586): Launched
11:54:39.149064 run iperf3-srv_10.42.42.10(pid=4587): Launched
11:54:39.346793 tst      cs_paging_gprs_active.py:38: start network...
11:54:39.481484 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
11:54:39.999303 run          create_hlr_db(pid=4588): Launched
11:54:40.186214 bus                        /sierra_2: Setting Powered False
11:54:41.207739 run          create_hlr_db(pid=4588): Terminated: ok {rc=0}
11:54:41.614486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4590): Launched
11:54:41.916679 run    osmo-hlr_10.42.42.2(pid=4591): Launched
11:54:42.027343 run              osmo-stp_10.42.42.5: Starting osmo-stp
11:54:42.548602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4593): Launched
11:54:42.849585 run    osmo-stp_10.42.42.5(pid=4594): Launched
11:54:42.959067 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
11:54:43.483264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4596): Launched
11:54:43.590096 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
11:54:43.851959 run               patchelf(pid=4597): Launched
11:54:44.028317 run    osmo-stp_10.42.42.5(pid=4594): ERR: Terminated: ERROR {rc=1}  [trial-2374↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4594)]
11:54:44.157367 run    osmo-stp_10.42.42.5(pid=4594): stdout: 
| (launched: 2022-12-10_11:54:42.701157)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
11:54:44.286980 run    osmo-stp_10.42.42.5(pid=4594): stderr: 
| �[0;m�[38;5;43m20221210115442870 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221210115442870 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221210115442871 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221210115442871 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221210115442871 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221210115442872 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221210115442872 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
11:54:44.412248 run    osmo-stp_10.42.42.5(pid=4594): stdout: 
| (launched: 2022-12-10_11:54:42.701157)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
11:54:44.535932 run    osmo-stp_10.42.42.5(pid=4594): stderr: 
| �[0;m�[38;5;43m20221210115442870 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221210115442870 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221210115442871 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221210115442871 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221210115442871 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221210115442872 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221210115442872 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
11:54:44.679423 run               patchelf(pid=4597): Terminating (SIGINT)
11:54:44.848806 run               patchelf(pid=4597): Terminated: ok {rc=0}
11:54:44.879947 tst      cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4594): Process ended prematurely: osmo-stp_10.42.42.5(pid=4594) [trial-2374↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4594)]  [trial-2374↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38]
11:54:44.889146 tst      cs_paging_gprs_active.py:38: Test FAILED (8.5 sec)
11:54:44.949043 run    osmo-hlr_10.42.42.2(pid=4591): ERR: Terminated: ERROR {rc=237}  [trial-2374↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4591)]
11:54:44.997397 run    osmo-hlr_10.42.42.2(pid=4591): stdout: 
| (launched: 2022-12-10_11:54:41.767674) 
11:54:45.046500 run    osmo-hlr_10.42.42.2(pid=4591): stderr: 
| �[0;m�[1;31m20221210115441942 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221210115441942 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221210115441942 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221210115441942 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221210115441942 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221210115441942 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221210115441959 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221210115441970 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221210115441970 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221210115441970 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 
11:54:45.088019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4584): Terminating (SIGTERM)
11:54:45.127608 run iperf3-srv_10.42.42.10(pid=4585): Terminating (SIGTERM)
11:54:45.167228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4586): Terminating (SIGTERM)
11:54:45.206591 run iperf3-srv_10.42.42.10(pid=4587): Terminating (SIGTERM)
11:54:45.245959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4590): Terminating (SIGTERM)
11:54:45.285291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4593): Terminating (SIGTERM)
11:54:45.324706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4596): Terminating (SIGTERM)
11:54:45.334088 ---      ParallelTerminationStrategy: PID 4584 died...
11:54:45.387142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4584): Terminated: ok {rc=0}
11:54:45.396616 ---      ParallelTerminationStrategy: PID 4585 died...
11:54:45.449245 run iperf3-srv_10.42.42.10(pid=4585): Terminated {rc=256}
11:54:45.458674 ---      ParallelTerminationStrategy: PID 4586 died...
11:54:45.511242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4586): Terminated: ok {rc=0}
11:54:45.520726 ---      ParallelTerminationStrategy: PID 4587 died...
11:54:45.573414 run iperf3-srv_10.42.42.10(pid=4587): Terminated {rc=256}
11:54:45.582927 ---      ParallelTerminationStrategy: PID 4590 died...
11:54:45.635735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4590): Terminated: ok {rc=0}
11:54:45.645303 ---      ParallelTerminationStrategy: PID 4593 died...
11:54:45.697960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4593): Terminated: ok {rc=0}
11:54:45.707539 ---      ParallelTerminationStrategy: PID 4596 died...
11:54:45.760354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4596): Terminated: ok {rc=0}
11:54:45.847933 bus                          /gobi_0: Setting Powered False
11:54:46.965084 bus                          /gobi_0: Setting Powered False
11:54:48.074985 bus                          /gobi_6: Setting Powered False
</stdout></child><child><age>57</age><className>gprs:trx-umtrx</className><duration>8.0</duration><errorStackTrace>osmo-stp_10.42.42.5(pid=4606): Process ended prematurely: osmo-stp_10.42.42.5(pid=4606) [trial-2374↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4606)]</errorStackTrace><failedSince>2318</failedSince><name>iperf3.py</name><properties></properties><skipped>false</skipped><status>FAILED</status><stderr>Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "&lt;frozen importlib._bootstrap_external&gt;", line 728, in exec_module
  File "&lt;frozen importlib._bootstrap&gt;", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/iperf3.py", line 8, in &lt;module&gt;
    setup_run_iperf3_test_parallel(1)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 67, in setup_run_iperf3_test_parallel
    ggsn.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ggsn_osmo.py", line 57, in start
    util.change_elf_rpath(binary, util.prepend_library_path(lib), self.run_dir.new_dir('patchelf'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 57, in change_elf_rpath
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 214, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 211, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 421, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=4606): Process ended prematurely: osmo-stp_10.42.42.5(pid=4606) [trial-2374↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4606)]
</stderr><stdout>
----------------------------------------------
trial-2374 gprs:trx-umtrx iperf3.py
----------------------------------------------
11:54:49.184805 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:49.195855 tst                   gprs:trx-umtrx: Using 1 x bts (candidates: 1)
11:54:49.334151 tst                        iperf3.py: using LAC 28218
11:54:49.451399 tst                        iperf3.py: using RAC 168
11:54:49.571618 tst                        iperf3.py: using CellId 28218
11:54:49.690685 tst                        iperf3.py: using BVCI 28219
11:54:49.713604 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:49.724066 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:49.734421 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:49.745037 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:49.755460 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:49.765907 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:49.776480 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:49.786912 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:49.797600 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
11:54:50.073055 tst                      iperf3.py:8: start iperfv3 server 10.42.42.10:5003...
11:54:50.198969 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
11:54:50.511449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4598): Launched
11:54:50.771128 run iperf3-srv_10.42.42.10(pid=4599): Launched
11:54:50.955419 tst                      iperf3.py:8: start network...
11:54:51.081573 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
11:54:51.556022 run          create_hlr_db(pid=4600): Launched
11:54:51.730215 bus                          /gobi_6: Setting Powered False
11:54:52.751730 run          create_hlr_db(pid=4600): Terminated: ok {rc=0}
11:54:53.181797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4602): Launched
11:54:53.506001 run    osmo-hlr_10.42.42.2(pid=4603): Launched
11:54:53.627148 run              osmo-stp_10.42.42.5: Starting osmo-stp
11:54:54.189720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4605): Launched
11:54:54.511056 run    osmo-stp_10.42.42.5(pid=4606): Launched
11:54:54.628176 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
11:54:55.189521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4608): Launched
11:54:55.304715 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
11:54:55.585313 run               patchelf(pid=4609): Launched
11:54:55.773661 run    osmo-stp_10.42.42.5(pid=4606): ERR: Terminated: ERROR {rc=1}  [trial-2374↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4606)]
11:54:55.911996 run    osmo-stp_10.42.42.5(pid=4606): stdout: 
| (launched: 2022-12-10_11:54:54.353581)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
11:54:56.050433 run    osmo-stp_10.42.42.5(pid=4606): stderr: 
| �[0;m�[38;5;43m20221210115454545 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221210115454545 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221210115454545 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221210115454545 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221210115454548 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221210115454548 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221210115454548 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
11:54:56.183418 run    osmo-stp_10.42.42.5(pid=4606): stdout: 
| (launched: 2022-12-10_11:54:54.353581)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
11:54:56.315305 run    osmo-stp_10.42.42.5(pid=4606): stderr: 
| �[0;m�[38;5;43m20221210115454545 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221210115454545 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221210115454545 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221210115454545 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221210115454548 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221210115454548 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221210115454548 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
11:54:56.469315 run               patchelf(pid=4609): Terminating (SIGINT)
11:54:56.650195 run               patchelf(pid=4609): Terminated: ok {rc=0}
11:54:56.683293 tst                      iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4606): Process ended prematurely: osmo-stp_10.42.42.5(pid=4606) [trial-2374↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4606)]  [trial-2374↪gprs:trx-umtrx↪iperf3.py:8]
11:54:56.693108 tst                      iperf3.py:8: Test FAILED (7.5 sec)
11:54:56.755271 run    osmo-hlr_10.42.42.2(pid=4603): ERR: Terminated: ERROR {rc=237}  [trial-2374↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4603)]
11:54:56.806275 run    osmo-hlr_10.42.42.2(pid=4603): stdout: 
| (launched: 2022-12-10_11:54:53.347461) 
11:54:56.857992 run    osmo-hlr_10.42.42.2(pid=4603): stderr: 
| �[0;m�[1;31m20221210115453548 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221210115453548 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221210115453548 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221210115453548 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221210115453548 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221210115453548 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221210115453561 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221210115453569 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221210115453569 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221210115453569 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 
11:54:56.901781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4598): Terminating (SIGTERM)
11:54:56.943098 run iperf3-srv_10.42.42.10(pid=4599): Terminating (SIGTERM)
11:54:56.984488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4602): Terminating (SIGTERM)
11:54:57.025820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4605): Terminating (SIGTERM)
11:54:57.067143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4608): Terminating (SIGTERM)
11:54:57.076774 ---      ParallelTerminationStrategy: PID 4598 died...
11:54:57.132037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4598): Terminated: ok {rc=0}
11:54:57.142036 ---      ParallelTerminationStrategy: PID 4599 died...
11:54:57.196636 run iperf3-srv_10.42.42.10(pid=4599): Terminated {rc=256}
11:54:57.206638 ---      ParallelTerminationStrategy: PID 4602 died...
11:54:57.261519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4602): Terminated: ok {rc=0}
11:54:57.271636 ---      ParallelTerminationStrategy: PID 4605 died...
11:54:57.326411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4605): Terminated: ok {rc=0}
11:54:57.336408 ---      ParallelTerminationStrategy: PID 4608 died...
11:54:57.391077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4608): Terminated: ok {rc=0}
11:54:57.477471 bus                          /gobi_6: Setting Powered False
</stdout></child><child><age>200</age><className>gprs:trx-umtrx</className><duration>11.0</duration><errorStackTrace>osmo-stp_10.42.42.5(pid=4627): Process ended prematurely: osmo-stp_10.42.42.5(pid=4627) [trial-2374↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4627)]</errorStackTrace><failedSince>2175</failedSince><name>iperf3m4.py</name><properties></properties><skipped>false</skipped><status>FAILED</status><stderr>Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "&lt;frozen importlib._bootstrap_external&gt;", line 728, in exec_module
  File "&lt;frozen importlib._bootstrap&gt;", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/iperf3m4.py", line 8, in &lt;module&gt;
    setup_run_iperf3_test_parallel(4)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/lib/testlib.py", line 67, in setup_run_iperf3_test_parallel
    ggsn.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ggsn_osmo.py", line 57, in start
    util.change_elf_rpath(binary, util.prepend_library_path(lib), self.run_dir.new_dir('patchelf'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 57, in change_elf_rpath
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 214, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 211, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 421, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=4627): Process ended prematurely: osmo-stp_10.42.42.5(pid=4627) [trial-2374↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4627)]
</stderr><stdout>
----------------------------------------------
trial-2374 gprs:trx-umtrx iperf3m4.py
----------------------------------------------
11:54:58.591709 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:58.603437 tst                   gprs:trx-umtrx: Using 1 x bts (candidates: 1)
11:54:58.745722 tst                      iperf3m4.py: using LAC 28219
11:54:58.871684 tst                      iperf3m4.py: using RAC 169
11:54:58.999408 tst                      iperf3m4.py: using CellId 28219
11:54:59.125356 tst                      iperf3m4.py: using BVCI 28220
11:54:59.150059 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:59.161077 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:59.171736 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:59.182596 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:59.193281 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:59.203865 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:59.214807 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:59.225558 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:54:59.236380 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
11:54:59.351965 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
11:54:59.478652 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
11:54:59.594226 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
11:54:59.871987 tst                    iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003...
11:54:59.998236 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
11:55:00.311160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4610): Launched
11:55:00.571002 run iperf3-srv_10.42.42.10(pid=4611): Launched
11:55:00.754936 tst                    iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004...
11:55:00.887690 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
11:55:01.228029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4612): Launched
11:55:01.509989 run iperf3-srv_10.42.42.10(pid=4616): Launched
11:55:01.697751 tst                    iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005...
11:55:01.825966 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
11:55:02.159471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4617): Launched
11:55:02.421620 run iperf3-srv_10.42.42.10(pid=4618): Launched
11:55:02.605865 tst                    iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006...
11:55:02.731463 run           iperf3-srv_10.42.42.10: Starting iperf3-srv
11:55:03.043811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4619): Launched
11:55:03.303285 run iperf3-srv_10.42.42.10(pid=4620): Launched
11:55:03.487137 tst                    iperf3m4.py:8: start network...
11:55:03.612164 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
11:55:04.087375 run          create_hlr_db(pid=4621): Launched
11:55:04.261336 bus                          /gobi_6: Setting Powered False
11:55:05.283369 run          create_hlr_db(pid=4621): Terminated: ok {rc=0}
11:55:05.685184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4623): Launched
11:55:05.987760 run    osmo-hlr_10.42.42.2(pid=4624): Launched
11:55:06.099194 run              osmo-stp_10.42.42.5: Starting osmo-stp
11:55:06.624067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4626): Launched
11:55:06.927667 run    osmo-stp_10.42.42.5(pid=4627): Launched
11:55:07.038802 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
11:55:07.564294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4629): Launched
11:55:07.672084 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
11:55:07.935564 run               patchelf(pid=4630): Launched
11:55:08.111739 run    osmo-stp_10.42.42.5(pid=4627): ERR: Terminated: ERROR {rc=1}  [trial-2374↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4627)]
11:55:08.240667 run    osmo-stp_10.42.42.5(pid=4627): stdout: 
| (launched: 2022-12-10_11:55:06.777297)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
11:55:08.369922 run    osmo-stp_10.42.42.5(pid=4627): stderr: 
| �[0;m�[38;5;43m20221210115506948 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221210115506948 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221210115506948 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221210115506949 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221210115506949 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221210115506949 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221210115506949 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
11:55:08.494667 run    osmo-stp_10.42.42.5(pid=4627): stdout: 
| (launched: 2022-12-10_11:55:06.777297)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
11:55:08.617877 run    osmo-stp_10.42.42.5(pid=4627): stderr: 
| �[0;m�[38;5;43m20221210115506948 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221210115506948 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221210115506948 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221210115506949 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221210115506949 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221210115506949 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221210115506949 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
11:55:08.761788 run               patchelf(pid=4630): Terminating (SIGINT)
11:55:08.930707 run               patchelf(pid=4630): Terminated: ok {rc=0}
11:55:08.961847 tst                    iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4627): Process ended prematurely: osmo-stp_10.42.42.5(pid=4627) [trial-2374↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4627)]  [trial-2374↪gprs:trx-umtrx↪iperf3m4.py:8]
11:55:08.970988 tst                    iperf3m4.py:8: Test FAILED (10.4 sec)
11:55:09.031072 run    osmo-hlr_10.42.42.2(pid=4624): ERR: Terminated: ERROR {rc=237}  [trial-2374↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4624)]
11:55:09.079185 run    osmo-hlr_10.42.42.2(pid=4624): stdout: 
| (launched: 2022-12-10_11:55:05.838428) 
11:55:09.128420 run    osmo-hlr_10.42.42.2(pid=4624): stderr: 
| �[0;m�[1;31m20221210115506014 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221210115506014 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221210115506014 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221210115506014 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221210115506014 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221210115506014 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221210115506026 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221210115506035 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221210115506035 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221210115506035 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 
11:55:09.169780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4610): Terminating (SIGTERM)
11:55:09.208936 run iperf3-srv_10.42.42.10(pid=4611): Terminating (SIGTERM)
11:55:09.248480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4612): Terminating (SIGTERM)
11:55:09.287732 run iperf3-srv_10.42.42.10(pid=4616): Terminating (SIGTERM)
11:55:09.327329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4617): Terminating (SIGTERM)
11:55:09.366753 run iperf3-srv_10.42.42.10(pid=4618): Terminating (SIGTERM)
11:55:09.406018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4619): Terminating (SIGTERM)
11:55:09.445365 run iperf3-srv_10.42.42.10(pid=4620): Terminating (SIGTERM)
11:55:09.484729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4623): Terminating (SIGTERM)
11:55:09.523960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4626): Terminating (SIGTERM)
11:55:09.563322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4629): Terminating (SIGTERM)
11:55:09.572865 ---      ParallelTerminationStrategy: PID 4610 died...
11:55:09.625647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4610): Terminated: ok {rc=0}
11:55:09.635481 ---      ParallelTerminationStrategy: PID 4611 died...
11:55:09.688222 run iperf3-srv_10.42.42.10(pid=4611): Terminated {rc=256}
11:55:09.697700 ---      ParallelTerminationStrategy: PID 4612 died...
11:55:09.750340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4612): Terminated: ok {rc=0}
11:55:09.760052 ---      ParallelTerminationStrategy: PID 4616 died...
11:55:09.812577 run iperf3-srv_10.42.42.10(pid=4616): Terminated {rc=256}
11:55:09.822259 ---      ParallelTerminationStrategy: PID 4617 died...
11:55:09.875279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4617): Terminated: ok {rc=0}
11:55:09.884745 ---      ParallelTerminationStrategy: PID 4618 died...
11:55:09.937935 run iperf3-srv_10.42.42.10(pid=4618): Terminated {rc=256}
11:55:09.947679 ---      ParallelTerminationStrategy: PID 4619 died...
11:55:10.000407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4619): Terminated: ok {rc=0}
11:55:10.010235 ---      ParallelTerminationStrategy: PID 4620 died...
11:55:10.062788 run iperf3-srv_10.42.42.10(pid=4620): Terminated {rc=256}
11:55:10.072402 ---      ParallelTerminationStrategy: PID 4623 died...
11:55:10.124886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4623): Terminated: ok {rc=0}
11:55:10.134609 ---      ParallelTerminationStrategy: PID 4626 died...
11:55:10.187262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4626): Terminated: ok {rc=0}
11:55:10.197160 ---      ParallelTerminationStrategy: PID 4629 died...
11:55:10.250166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4629): Terminated: ok {rc=0}
11:55:10.338705 bus                          /gobi_4: Setting Powered False
11:55:11.446388 bus                          /gobi_4: Setting Powered False
11:55:12.555266 bus                          /gobi_1: Setting Powered False
11:55:13.661251 bus                          /gobi_1: Setting Powered False
11:55:14.773227 bus                          /gobi_0: Setting Powered False
11:55:15.885256 bus                          /gobi_0: Setting Powered False
11:55:17.009337 bus                          /gobi_6: Setting Powered False
</stdout></child><child><age>175</age><className>gprs:trx-umtrx</className><duration>7.0</duration><errorStackTrace>osmo-stp_10.42.42.5(pid=4637): Process ended prematurely: osmo-stp_10.42.42.5(pid=4637) [trial-2374↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4637)]</errorStackTrace><failedSince>2200</failedSince><name>ping.py</name><properties></properties><skipped>false</skipped><status>FAILED</status><stderr>Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "&lt;frozen importlib._bootstrap_external&gt;", line 728, in exec_module
  File "&lt;frozen importlib._bootstrap&gt;", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/ping.py", line 22, in &lt;module&gt;
    ggsn.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ggsn_osmo.py", line 57, in start
    util.change_elf_rpath(binary, util.prepend_library_path(lib), self.run_dir.new_dir('patchelf'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 57, in change_elf_rpath
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 214, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 211, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 421, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=4637): Process ended prematurely: osmo-stp_10.42.42.5(pid=4637) [trial-2374↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4637)]
</stderr><stdout>
----------------------------------------------
trial-2374 gprs:trx-umtrx ping.py
----------------------------------------------
11:55:18.077857 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:55:18.088709 tst                   gprs:trx-umtrx: Using 1 x bts (candidates: 1)
11:55:18.223615 tst                          ping.py: using LAC 28220
11:55:18.339523 tst                          ping.py: using RAC 170
11:55:18.457768 tst                          ping.py: using CellId 28220
11:55:18.582919 tst                          ping.py: using BVCI 28221
11:55:18.607309 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:55:18.618314 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:55:18.629321 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:55:18.640821 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:55:18.652100 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:55:18.663806 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:55:18.675415 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:55:18.687437 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
11:55:18.962345 tst                       ping.py:19: start network...
11:55:19.086073 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
11:55:19.553856 run          create_hlr_db(pid=4631): Launched
11:55:19.726341 bus                          /gobi_6: Setting Powered False
11:55:20.747319 run          create_hlr_db(pid=4631): Terminated: ok {rc=0}
11:55:21.141821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4633): Launched
11:55:21.439508 run    osmo-hlr_10.42.42.2(pid=4634): Launched
11:55:21.556275 run              osmo-stp_10.42.42.5: Starting osmo-stp
11:55:22.083044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4636): Launched
11:55:22.381379 run    osmo-stp_10.42.42.5(pid=4637): Launched
11:55:22.490236 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
11:55:23.008754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4639): Launched
11:55:23.115007 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
11:55:23.374201 run               patchelf(pid=4640): Launched
11:55:23.549620 run    osmo-stp_10.42.42.5(pid=4637): ERR: Terminated: ERROR {rc=1}  [trial-2374↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4637)]
11:55:23.677186 run    osmo-stp_10.42.42.5(pid=4637): stdout: 
| (launched: 2022-12-10_11:55:22.233657)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
11:55:23.805105 run    osmo-stp_10.42.42.5(pid=4637): stderr: 
| �[0;m�[38;5;43m20221210115522404 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221210115522404 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221210115522404 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221210115522405 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221210115522405 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221210115522405 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221210115522405 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
11:55:23.928766 run    osmo-stp_10.42.42.5(pid=4637): stdout: 
| (launched: 2022-12-10_11:55:22.233657)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
11:55:24.051183 run    osmo-stp_10.42.42.5(pid=4637): stderr: 
| �[0;m�[38;5;43m20221210115522404 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221210115522404 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221210115522404 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221210115522405 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221210115522405 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221210115522405 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221210115522405 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
11:55:24.193434 run               patchelf(pid=4640): Terminating (SIGINT)
11:55:24.360550 run               patchelf(pid=4640): Terminated: ok {rc=0}
11:55:24.390793 tst                       ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4637): Process ended prematurely: osmo-stp_10.42.42.5(pid=4637) [trial-2374↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4637)]  [trial-2374↪gprs:trx-umtrx↪ping.py:22]
11:55:24.399422 tst                       ping.py:22: Test FAILED (6.3 sec)
11:55:24.460129 run    osmo-hlr_10.42.42.2(pid=4634): ERR: Terminated: ERROR {rc=237}  [trial-2374↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4634)]
11:55:24.509370 run    osmo-hlr_10.42.42.2(pid=4634): stdout: 
| (launched: 2022-12-10_11:55:21.291775) 
11:55:24.559152 run    osmo-hlr_10.42.42.2(pid=4634): stderr: 
| �[0;m�[1;31m20221210115521466 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221210115521466 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221210115521466 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221210115521466 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221210115521466 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221210115521466 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221210115521478 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221210115521487 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221210115521487 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221210115521487 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 
11:55:24.601201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4633): Terminating (SIGTERM)
11:55:24.641284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4636): Terminating (SIGTERM)
11:55:24.681495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4639): Terminating (SIGTERM)
11:55:24.691083 ---      ParallelTerminationStrategy: PID 4633 died...
11:55:24.744939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4633): Terminated: ok {rc=0}
11:55:24.754708 ---      ParallelTerminationStrategy: PID 4636 died...
11:55:24.808097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4636): Terminated: ok {rc=0}
11:55:24.817930 ---      ParallelTerminationStrategy: PID 4639 died...
11:55:24.870993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4639): Terminated: ok {rc=0}
11:55:24.960785 bus                          /gobi_6: Setting Powered False
</stdout></child><child><age>236</age><className>gprs:trx-umtrx</className><duration>7.0</duration><errorStackTrace>osmo-stp_10.42.42.5(pid=4648): Process ended prematurely: osmo-stp_10.42.42.5(pid=4648) [trial-2374↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4648)]</errorStackTrace><failedSince>2139</failedSince><name>ping_idle_ping.py</name><properties></properties><skipped>false</skipped><status>FAILED</status><stderr>Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "&lt;frozen importlib._bootstrap_external&gt;", line 728, in exec_module
  File "&lt;frozen importlib._bootstrap&gt;", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/gprs/ping_idle_ping.py", line 27, in &lt;module&gt;
    ggsn.start()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ggsn_osmo.py", line 57, in start
    util.change_elf_rpath(binary, util.prepend_library_path(lib), self.run_dir.new_dir('patchelf'))
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 57, in change_elf_rpath
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 214, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 211, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 421, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=4648): Process ended prematurely: osmo-stp_10.42.42.5(pid=4648) [trial-2374↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4648)]
</stderr><stdout>
----------------------------------------------
trial-2374 gprs:trx-umtrx ping_idle_ping.py
----------------------------------------------
11:55:26.012738 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:55:26.024012 tst                   gprs:trx-umtrx: Using 1 x bts (candidates: 1)
11:55:26.160242 tst                ping_idle_ping.py: using LAC 28221
11:55:26.276780 tst                ping_idle_ping.py: using RAC 171
11:55:26.394672 tst                ping_idle_ping.py: using CellId 28221
11:55:26.511033 tst                ping_idle_ping.py: using BVCI 28222
11:55:26.533820 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:55:26.544295 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:55:26.554695 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:55:26.565234 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:55:26.575588 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:55:26.586093 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:55:26.596775 tst                   gprs:trx-umtrx: Using 1 x ip_address (candidates: 9)
11:55:26.607793 tst                   gprs:trx-umtrx: Using 1 x modem (candidates: 4)
11:55:26.899733 tst             ping_idle_ping.py:24: start network...
11:55:27.033350 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
11:55:27.545734 run          create_hlr_db(pid=4642): Launched
11:55:27.731423 bus                          /gobi_6: Setting Powered False
11:55:28.752828 run          create_hlr_db(pid=4642): Terminated: ok {rc=0}
11:55:29.153565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4644): Launched
11:55:29.454940 run    osmo-hlr_10.42.42.2(pid=4645): Launched
11:55:29.572196 run              osmo-stp_10.42.42.5: Starting osmo-stp
11:55:30.097909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4647): Launched
11:55:30.395212 run    osmo-stp_10.42.42.5(pid=4648): Launched
11:55:30.504396 run             osmo-ggsn_10.42.42.6: Starting osmo-ggsn
11:55:31.084328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4650): Launched
11:55:31.193519 run             osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn
11:55:31.476600 run               patchelf(pid=4651): Launched
11:55:31.655276 run    osmo-stp_10.42.42.5(pid=4648): ERR: Terminated: ERROR {rc=1}  [trial-2374↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4648)]
11:55:31.785928 run    osmo-stp_10.42.42.5(pid=4648): stdout: 
| (launched: 2022-12-10_11:55:30.248909)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
11:55:31.917476 run    osmo-stp_10.42.42.5(pid=4648): stderr: 
| �[0;m�[38;5;43m20221210115530420 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221210115530420 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221210115530420 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221210115530421 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221210115530421 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221210115530421 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221210115530421 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
11:55:32.043707 run    osmo-stp_10.42.42.5(pid=4648): stdout: 
| (launched: 2022-12-10_11:55:30.248909)
| Copyright (C) 2015-2020 by Harald Welte &amp;lt;laforge@gnumonks.org&amp;gt;
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later &amp;lt;http://gnu.org/licenses/gpl-2.0.html&amp;gt;
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
| 
| Free Software lives by contribution.  If you use this, please contribute!
|  
11:55:32.168763 run    osmo-stp_10.42.42.5(pid=4648): stderr: 
| �[0;m�[38;5;43m20221210115530420 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221210115530420 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221210115530420 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221210115530421 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221210115530421 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221210115530421 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221210115530421 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use 
11:55:32.311373 run               patchelf(pid=4651): Terminating (SIGINT)
11:55:32.478178 run               patchelf(pid=4651): Terminated: ok {rc=0}
11:55:32.508456 tst             ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4648): Process ended prematurely: osmo-stp_10.42.42.5(pid=4648) [trial-2374↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4648)]  [trial-2374↪gprs:trx-umtrx↪ping_idle_ping.py:27]
11:55:32.517116 tst             ping_idle_ping.py:27: Test FAILED (6.5 sec)
11:55:32.577406 run    osmo-hlr_10.42.42.2(pid=4645): ERR: Terminated: ERROR {rc=237}  [trial-2374↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4645)]
11:55:32.626945 run    osmo-hlr_10.42.42.2(pid=4645): stdout: 
| (launched: 2022-12-10_11:55:29.305767) 
11:55:32.676734 run    osmo-hlr_10.42.42.2(pid=4645): stderr: 
| �[0;m�[1;31m20221210115529481 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221210115529481 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221210115529481 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221210115529482 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221210115529482 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221210115529482 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221210115529493 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2374/run.2022-12-10_11-15-10/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221210115529504 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221210115529504 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221210115529504 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 
11:55:32.718839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4644): Terminating (SIGTERM)
11:55:32.758732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4647): Terminating (SIGTERM)
11:55:32.798600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4650): Terminating (SIGTERM)
11:55:32.808101 ---      ParallelTerminationStrategy: PID 4644 died...
11:55:32.861647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4644): Terminated: ok {rc=0}
11:55:32.871326 ---      ParallelTerminationStrategy: PID 4647 died...
11:55:32.924333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4647): Terminated: ok {rc=0}
11:55:32.934199 ---      ParallelTerminationStrategy: PID 4650 died...
11:55:32.987998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4650): Terminated: ok {rc=0}
11:55:33.076813 bus                          /gobi_6: Setting Powered False
</stdout></child><failCount>5</failCount><name>gprs:trx-umtrx</name><passCount>0</passCount><skipCount>0</skipCount></classResult>