57smpp6.0osmo-hlr_10.42.42.2(pid=2002): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2002) [trial-2387↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2002)]2331esme_connect_policy_acceptall.pyfalseFAILEDTraceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/smpp/esme_connect_policy_acceptall.py", line 23, in <module>
msc.start()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/msc_osmo.py", line 80, in start
self.ctrl.connect()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/osmo_ctrl.py", line 92, in connect
MainLoop.wait(self.try_connect, timestep=3, timeout=timeout)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-hlr_10.42.42.2(pid=2002): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2002) [trial-2387↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2002)]
----------------------------------------------
trial-2387 smpp esme_connect_policy_acceptall.py
----------------------------------------------
09:46:16.988855 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:17.000627 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:17.012528 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:17.024280 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:17.172716 tst esme_connect_policy_acceptall.py: using MSISDN 8093
09:46:17.283706 run osmo-stp_10.42.42.4: Starting osmo-stp
09:46:17.804493 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=1997): Launched
09:46:18.103764 run osmo-stp_10.42.42.4(pid=1998): Launched
09:46:18.210597 run osmo-hlr_10.42.42.2: Starting osmo-hlr
09:46:18.681801 run create_hlr_db(pid=1999): Launched
09:46:18.854569 bus /sierra_2: Setting Powered False
09:46:19.875002 run create_hlr_db(pid=1999): Terminated: ok {rc=0}
09:46:20.298006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2001): Launched
09:46:20.618414 run osmo-hlr_10.42.42.2(pid=2002): Launched
09:46:20.737461 run osmo-msc_10.42.42.5: Starting osmo-msc
09:46:21.321149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2004): Launched
09:46:21.640585 run osmo-msc_10.42.42.5(pid=2005): Launched
09:46:21.829754 run osmo-hlr_10.42.42.2(pid=2002): ERR: Terminated: ERROR {rc=237} [trial-2387↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2002)]
09:46:21.968634 run osmo-hlr_10.42.42.2(pid=2002): stdout:
| (launched: 2022-12-13_09:46:20.461187)
09:46:22.104124 run osmo-hlr_10.42.42.2(pid=2002): stderr:
| �[0;m�[1;31m20221213094620660 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221213094620661 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221213094620661 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221213094620661 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221213094620661 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221213094620661 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221213094620673 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221213094620681 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221213094620682 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221213094620682 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
09:46:22.232789 run osmo-hlr_10.42.42.2(pid=2002): stdout:
| (launched: 2022-12-13_09:46:20.461187)
09:46:22.361459 run osmo-hlr_10.42.42.2(pid=2002): stderr:
| �[0;m�[1;31m20221213094620660 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221213094620661 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221213094620661 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221213094620661 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221213094620661 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221213094620661 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221213094620673 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221213094620681 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221213094620682 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221213094620682 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
09:46:22.417524 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=2002): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2002) [trial-2387↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2002)] [trial-2387↪smpp↪esme_connect_policy_acceptall.py:23]
09:46:22.426299 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.4 sec)
09:46:22.488922 run osmo-msc_10.42.42.5(pid=2005): ERR: Terminated: ERROR {rc=9} [trial-2387↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=2005)]
09:46:22.540459 run osmo-msc_10.42.42.5(pid=2005): stdout:
| (launched: 2022-12-13_09:46:21.484083)
09:46:22.592443 run osmo-msc_10.42.42.5(pid=2005): stderr:
| �[0;m�[38;5;43m20221213094621854 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650)
| �[0;m�[38;5;43m20221213094621854 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568)
| �[0;m�[38;5;43m20221213094621854 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456)
| �[0;m�[38;5;45m20221213094621854 �[1;33mDLSCCP�[0;m�[38;5;45m �[1;33mNOTICE�[0;m�[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647)
| �[0;m�[38;5;43m20221213094621854 �[1;33mDLSS7�[0;m�[38;5;43m �[1;33mNOTICE�[0;m�[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458)
| �[0;m�[38;5;45m20221213094621854 �[1;32mDLSCCP�[0;m�[38;5;45m �[1;32mINFO�[0;m�[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108)
| �[0;m�[38;5;43m20221213094621854 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482)
| �[0;m20221213094621854 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822)
| 20221213094621855 �[1;31mDSGS�[0;m �[1;31mERROR�[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182)
| Starting SGs server failed
09:46:22.636526 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=1997): Terminating (SIGTERM)
09:46:22.678311 run osmo-stp_10.42.42.4(pid=1998): Terminating (SIGTERM)
09:46:22.720875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2001): Terminating (SIGTERM)
09:46:22.764357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2004): Terminating (SIGTERM)
09:46:22.775649 --- ParallelTerminationStrategy: PID 1997 died...
09:46:22.834741 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=1997): Terminated: ok {rc=0}
09:46:22.845119 --- ParallelTerminationStrategy: PID 1998 died...
09:46:22.900589 run osmo-stp_10.42.42.4(pid=1998): Terminated: ok {rc=0}
09:46:22.910655 --- ParallelTerminationStrategy: PID 2001 died...
09:46:22.966574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2001): Terminated: ok {rc=0}
09:46:22.976540 --- ParallelTerminationStrategy: PID 2004 died...
09:46:23.032136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2004): Terminated: ok {rc=0}
57smpp6.0osmo-hlr_10.42.42.2(pid=2013): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2013) [trial-2387↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2013)]2331esme_connect_policy_closed.pyfalseFAILEDTraceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/smpp/esme_connect_policy_closed.py", line 31, in <module>
msc.start()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/msc_osmo.py", line 80, in start
self.ctrl.connect()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/osmo_ctrl.py", line 92, in connect
MainLoop.wait(self.try_connect, timestep=3, timeout=timeout)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-hlr_10.42.42.2(pid=2013): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2013) [trial-2387↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2013)]
----------------------------------------------
trial-2387 smpp esme_connect_policy_closed.py
----------------------------------------------
09:46:23.046790 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:23.058166 tst smpp: Using 1 x bts (candidates: 1)
09:46:23.186197 tst esme_connect_policy_closed.py: using LAC 33124
09:46:23.313434 tst esme_connect_policy_closed.py: using RAC 229
09:46:23.440228 tst esme_connect_policy_closed.py: using CellId 33124
09:46:23.560333 tst esme_connect_policy_closed.py: using BVCI 33125
09:46:23.583381 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:23.593864 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:23.604174 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:23.710217 tst esme_connect_policy_closed.py: using MSISDN 8094
09:46:23.828237 tst esme_connect_policy_closed.py: using MSISDN 8095
09:46:23.934322 run osmo-stp_10.42.42.4: Starting osmo-stp
09:46:24.451605 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2008): Launched
09:46:24.751619 run osmo-stp_10.42.42.4(pid=2009): Launched
09:46:24.858640 run osmo-hlr_10.42.42.2: Starting osmo-hlr
09:46:25.330215 run create_hlr_db(pid=2010): Launched
09:46:26.506637 run create_hlr_db(pid=2010): Terminated: ok {rc=0}
09:46:26.814323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2012): Launched
09:46:27.114092 run osmo-hlr_10.42.42.2(pid=2013): Launched
09:46:27.228563 run osmo-msc_10.42.42.5: Starting osmo-msc
09:46:27.777358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2015): Launched
09:46:28.079447 run osmo-msc_10.42.42.5(pid=2016): Launched
09:46:28.256332 run osmo-hlr_10.42.42.2(pid=2013): ERR: Terminated: ERROR {rc=237} [trial-2387↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2013)]
09:46:28.397501 run osmo-hlr_10.42.42.2(pid=2013): stdout:
| (launched: 2022-12-13_09:46:26.966939)
09:46:28.534501 run osmo-hlr_10.42.42.2(pid=2013): stderr:
| �[0;m�[1;31m20221213094627139 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221213094627139 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221213094627139 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221213094627140 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221213094627140 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221213094627140 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221213094627151 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221213094627160 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221213094627161 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221213094627161 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
09:46:28.664104 run osmo-hlr_10.42.42.2(pid=2013): stdout:
| (launched: 2022-12-13_09:46:26.966939)
09:46:28.792521 run osmo-hlr_10.42.42.2(pid=2013): stderr:
| �[0;m�[1;31m20221213094627139 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221213094627139 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221213094627139 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221213094627140 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221213094627140 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221213094627140 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221213094627151 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221213094627160 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221213094627161 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221213094627161 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
09:46:28.848807 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=2013): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2013) [trial-2387↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2013)] [trial-2387↪smpp↪esme_connect_policy_closed.py:31]
09:46:28.857637 tst esme_connect_policy_closed.py:31: Test FAILED (5.8 sec)
09:46:28.920492 run osmo-msc_10.42.42.5(pid=2016): ERR: Terminated: ERROR {rc=9} [trial-2387↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=2016)]
09:46:28.972310 run osmo-msc_10.42.42.5(pid=2016): stdout:
| (launched: 2022-12-13_09:46:27.929964)
09:46:29.024836 run osmo-msc_10.42.42.5(pid=2016): stderr:
| �[0;m�[38;5;43m20221213094628244 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650)
| �[0;m�[38;5;43m20221213094628244 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568)
| �[0;m�[38;5;43m20221213094628245 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456)
| �[0;m�[38;5;45m20221213094628245 �[1;33mDLSCCP�[0;m�[38;5;45m �[1;33mNOTICE�[0;m�[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647)
| �[0;m�[38;5;43m20221213094628245 �[1;33mDLSS7�[0;m�[38;5;43m �[1;33mNOTICE�[0;m�[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458)
| �[0;m�[38;5;45m20221213094628245 �[1;32mDLSCCP�[0;m�[38;5;45m �[1;32mINFO�[0;m�[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108)
| �[0;m�[38;5;43m20221213094628245 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482)
| �[0;m20221213094628245 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822)
| 20221213094628245 �[1;31mDSGS�[0;m �[1;31mERROR�[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182)
| Starting SGs server failed
09:46:29.069035 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2008): Terminating (SIGTERM)
09:46:29.110849 run osmo-stp_10.42.42.4(pid=2009): Terminating (SIGTERM)
09:46:29.154015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2012): Terminating (SIGTERM)
09:46:29.197409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2015): Terminating (SIGTERM)
09:46:29.207263 --- ParallelTerminationStrategy: PID 2008 died...
09:46:29.265358 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2008): Terminated: ok {rc=0}
09:46:29.275814 --- ParallelTerminationStrategy: PID 2009 died...
09:46:29.332680 run osmo-stp_10.42.42.4(pid=2009): Terminated: ok {rc=0}
09:46:29.342926 --- ParallelTerminationStrategy: PID 2012 died...
09:46:29.399050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2012): Terminated: ok {rc=0}
09:46:29.409277 --- ParallelTerminationStrategy: PID 2015 died...
09:46:29.465418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2015): Terminated: ok {rc=0}
57smpp7.0osmo-stp_10.42.42.5(pid=2025): Process ended prematurely: osmo-stp_10.42.42.5(pid=2025) [trial-2387↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2025)]2331esme_ms_sms_storeforward.pyfalseFAILEDTraceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/smpp/esme_ms_sms_storeforward.py", line 30, in <module>
msc.start()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/msc_osmo.py", line 80, in start
self.ctrl.connect()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/osmo_ctrl.py", line 92, in connect
MainLoop.wait(self.try_connect, timestep=3, timeout=timeout)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=2025): Process ended prematurely: osmo-stp_10.42.42.5(pid=2025) [trial-2387↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2025)]
----------------------------------------------
trial-2387 smpp esme_ms_sms_storeforward.py
----------------------------------------------
09:46:29.480513 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:29.492002 tst smpp: Using 1 x bts (candidates: 1)
09:46:29.622722 tst esme_ms_sms_storeforward.py: using LAC 33125
09:46:29.748796 tst esme_ms_sms_storeforward.py: using RAC 230
09:46:29.879511 tst esme_ms_sms_storeforward.py: using CellId 33125
09:46:30.004068 tst esme_ms_sms_storeforward.py: using BVCI 33126
09:46:30.028483 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:30.039347 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:30.050110 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:30.060836 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:30.072107 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:30.083445 tst smpp: Using 1 x modem (candidates: 1)
09:46:30.302859 tst esme_ms_sms_storeforward.py: using MSISDN 8096
09:46:30.418008 run osmo-hlr_10.42.42.2: Starting osmo-hlr
09:46:30.971608 run create_hlr_db(pid=2019): Launched
09:46:32.171041 run create_hlr_db(pid=2019): Terminated: ok {rc=0}
09:46:32.503989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2021): Launched
09:46:32.823949 run osmo-hlr_10.42.42.2(pid=2022): Launched
09:46:32.941774 run osmo-stp_10.42.42.5: Starting osmo-stp
09:46:33.502997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2024): Launched
09:46:33.823659 run osmo-stp_10.42.42.5(pid=2025): Launched
09:46:33.940852 run osmo-msc_10.42.42.6: Starting osmo-msc
09:46:34.525533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2027): Launched
09:46:34.845703 run osmo-msc_10.42.42.6(pid=2028): Launched
09:46:35.033878 run osmo-stp_10.42.42.5(pid=2025): ERR: Terminated: ERROR {rc=1} [trial-2387↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2025)]
09:46:35.170166 run osmo-stp_10.42.42.5(pid=2025): stdout:
| (launched: 2022-12-13_09:46:33.666898)
| Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org>
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html>
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
|
| Free Software lives by contribution. If you use this, please contribute!
|
09:46:35.306687 run osmo-stp_10.42.42.5(pid=2025): stderr:
| �[0;m�[38;5;43m20221213094633859 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221213094633859 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221213094633859 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221213094633860 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221213094633862 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221213094633862 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221213094633862 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use
09:46:35.435397 run osmo-stp_10.42.42.5(pid=2025): stdout:
| (launched: 2022-12-13_09:46:33.666898)
| Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org>
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html>
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
|
| Free Software lives by contribution. If you use this, please contribute!
|
09:46:35.563034 run osmo-stp_10.42.42.5(pid=2025): stderr:
| �[0;m�[38;5;43m20221213094633859 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221213094633859 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221213094633859 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221213094633860 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221213094633862 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221213094633862 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221213094633862 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use
09:46:35.618641 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=2025): Process ended prematurely: osmo-stp_10.42.42.5(pid=2025) [trial-2387↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2025)] [trial-2387↪smpp↪esme_ms_sms_storeforward.py:30]
09:46:35.627120 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.1 sec)
09:46:35.688738 run osmo-hlr_10.42.42.2(pid=2022): ERR: Terminated: ERROR {rc=237} [trial-2387↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2022)]
09:46:35.740763 run osmo-hlr_10.42.42.2(pid=2022): stdout:
| (launched: 2022-12-13_09:46:32.667052)
09:46:35.792244 run osmo-hlr_10.42.42.2(pid=2022): stderr:
| �[0;m�[1;31m20221213094632865 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221213094632865 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221213094632865 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221213094632865 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221213094632865 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221213094632865 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221213094632891 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221213094632900 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221213094632901 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221213094632901 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
09:46:35.862295 run osmo-msc_10.42.42.6(pid=2028): ERR: Terminated: ERROR {rc=2} [trial-2387↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2028)]
09:46:35.913217 run osmo-msc_10.42.42.6(pid=2028): stdout:
| (launched: 2022-12-13_09:46:34.688725)
09:46:35.964883 run osmo-msc_10.42.42.6(pid=2028): stderr:
| �[0;m�[38;5;43m20221213094635011 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456)
| �[0;m20221213094635011 �[1;34mDLGLOBAL�[0;m �[1;34mDEBUG�[0;m validating counter group 0x7f6b41e42c40(sigtran_as) with 2 counters (rate_ctr.c:87)
| �[38;5;43m20221213094635011 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456)
| �[0;m�[38;5;43m20221213094635011 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034)
| �[0;m�[38;5;43m20221213094635011 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054)
| �[0;m�[38;5;43m20221213094635012 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831)
| �[0;m�[1;39m20221213094635013 �[1;34mDMNCC�[0;m�[1;39m �[1;34mDEBUG�[0;m�[1;39m Using internal MNCC handler. (msc_main.c:678)
| �[0;m20221213094635014 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935)
| 20221213094635014 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946)
| 20221213094635014 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99)
09:46:36.008552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2021): Terminating (SIGTERM)
09:46:36.050425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2024): Terminating (SIGTERM)
09:46:36.092434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2027): Terminating (SIGTERM)
09:46:36.102036 --- ParallelTerminationStrategy: PID 2021 died...
09:46:36.157045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2021): Terminated: ok {rc=0}
09:46:36.166881 --- ParallelTerminationStrategy: PID 2024 died...
09:46:36.221581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2024): Terminated: ok {rc=0}
09:46:36.231444 --- ParallelTerminationStrategy: PID 2027 died...
09:46:36.286095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2027): Terminated: ok {rc=0}
09:46:36.372695 bus /sierra_2: Setting Powered False
57smpp7.0osmo-stp_10.42.42.5(pid=2036): Process ended prematurely: osmo-stp_10.42.42.5(pid=2036) [trial-2387↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2036)]2331esme_ms_sms_transaction.pyfalseFAILEDTraceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/smpp/esme_ms_sms_transaction.py", line 28, in <module>
msc.start()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/msc_osmo.py", line 80, in start
self.ctrl.connect()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/osmo_ctrl.py", line 92, in connect
MainLoop.wait(self.try_connect, timestep=3, timeout=timeout)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=2036): Process ended prematurely: osmo-stp_10.42.42.5(pid=2036) [trial-2387↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2036)]
----------------------------------------------
trial-2387 smpp esme_ms_sms_transaction.py
----------------------------------------------
09:46:37.424472 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:37.435558 tst smpp: Using 1 x bts (candidates: 1)
09:46:37.558681 tst esme_ms_sms_transaction.py: using LAC 33126
09:46:37.676672 tst esme_ms_sms_transaction.py: using RAC 231
09:46:37.795748 tst esme_ms_sms_transaction.py: using CellId 33126
09:46:37.914892 tst esme_ms_sms_transaction.py: using BVCI 33127
09:46:37.937721 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:37.948088 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:37.958543 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:37.968830 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:37.979487 tst smpp: Using 1 x ip_address (candidates: 6)
09:46:37.990405 tst smpp: Using 1 x modem (candidates: 1)
09:46:38.210322 tst esme_ms_sms_transaction.py: using MSISDN 8097
09:46:38.317284 run osmo-hlr_10.42.42.2: Starting osmo-hlr
09:46:38.788222 run create_hlr_db(pid=2030): Launched
09:46:38.961443 bus /sierra_2: Setting Powered False
09:46:39.983022 run create_hlr_db(pid=2030): Terminated: ok {rc=0}
09:46:40.407785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2032): Launched
09:46:40.729440 run osmo-hlr_10.42.42.2(pid=2033): Launched
09:46:40.847607 run osmo-stp_10.42.42.5: Starting osmo-stp
09:46:41.403223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2035): Launched
09:46:41.723758 run osmo-stp_10.42.42.5(pid=2036): Launched
09:46:41.840447 run osmo-msc_10.42.42.6: Starting osmo-msc
09:46:42.423885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2038): Launched
09:46:42.743035 run osmo-msc_10.42.42.6(pid=2039): Launched
09:46:42.931122 run osmo-stp_10.42.42.5(pid=2036): ERR: Terminated: ERROR {rc=1} [trial-2387↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2036)]
09:46:43.067507 run osmo-stp_10.42.42.5(pid=2036): stdout:
| (launched: 2022-12-13_09:46:41.566433)
| Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org>
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html>
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
|
| Free Software lives by contribution. If you use this, please contribute!
|
09:46:43.202637 run osmo-stp_10.42.42.5(pid=2036): stderr:
| �[0;m�[38;5;43m20221213094641759 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221213094641760 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221213094641760 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221213094641760 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221213094641761 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221213094641761 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221213094641761 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use
09:46:43.332311 run osmo-stp_10.42.42.5(pid=2036): stdout:
| (launched: 2022-12-13_09:46:41.566433)
| Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org>
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html>
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
|
| Free Software lives by contribution. If you use this, please contribute!
|
09:46:43.460552 run osmo-stp_10.42.42.5(pid=2036): stderr:
| �[0;m�[38;5;43m20221213094641759 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221213094641760 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221213094641760 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221213094641760 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221213094641761 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221213094641761 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221213094641761 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use
09:46:43.516424 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=2036): Process ended prematurely: osmo-stp_10.42.42.5(pid=2036) [trial-2387↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2036)] [trial-2387↪smpp↪esme_ms_sms_transaction.py:28]
09:46:43.525322 tst esme_ms_sms_transaction.py:28: Test FAILED (6.1 sec)
09:46:43.587394 run osmo-hlr_10.42.42.2(pid=2033): ERR: Terminated: ERROR {rc=237} [trial-2387↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2033)]
09:46:43.638693 run osmo-hlr_10.42.42.2(pid=2033): stdout:
| (launched: 2022-12-13_09:46:40.571075)
09:46:43.690546 run osmo-hlr_10.42.42.2(pid=2033): stderr:
| �[0;m�[1;31m20221213094640770 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221213094640770 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221213094640770 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221213094640770 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221213094640770 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221213094640770 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221213094640782 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2387/run.2022-12-13_08-32-52/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221213094640791 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221213094640791 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221213094640791 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
09:46:43.760582 run osmo-msc_10.42.42.6(pid=2039): ERR: Terminated: ERROR {rc=2} [trial-2387↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2039)]
09:46:43.812226 run osmo-msc_10.42.42.6(pid=2039): stdout:
| (launched: 2022-12-13_09:46:42.586782)
09:46:43.864143 run osmo-msc_10.42.42.6(pid=2039): stderr:
| �[0;m�[38;5;43m20221213094642907 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456)
| �[0;m20221213094642907 �[1;34mDLGLOBAL�[0;m �[1;34mDEBUG�[0;m validating counter group 0x7f02c835dc40(sigtran_as) with 2 counters (rate_ctr.c:87)
| �[38;5;43m20221213094642907 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456)
| �[0;m�[38;5;43m20221213094642907 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034)
| �[0;m�[38;5;43m20221213094642908 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054)
| �[0;m�[38;5;43m20221213094642908 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831)
| �[0;m�[1;39m20221213094642910 �[1;34mDMNCC�[0;m�[1;39m �[1;34mDEBUG�[0;m�[1;39m Using internal MNCC handler. (msc_main.c:678)
| �[0;m20221213094642910 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935)
| 20221213094642910 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946)
| 20221213094642910 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99)
09:46:43.908235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2032): Terminating (SIGTERM)
09:46:43.949819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2035): Terminating (SIGTERM)
09:46:43.991875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2038): Terminating (SIGTERM)
09:46:44.001645 --- ParallelTerminationStrategy: PID 2032 died...
09:46:44.058275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2032): Terminated: ok {rc=0}
09:46:44.068430 --- ParallelTerminationStrategy: PID 2035 died...
09:46:44.124268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2035): Terminated: ok {rc=0}
09:46:44.134278 --- ParallelTerminationStrategy: PID 2038 died...
09:46:44.190222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2038): Terminated: ok {rc=0}
09:46:44.276365 bus /sierra_2: Setting Powered False
4smpp00