70smpp6.0osmo-hlr_10.42.42.2(pid=19067): Process ended prematurely: osmo-hlr_10.42.42.2(pid=19067) [trial-2400↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19067)]2331esme_connect_policy_acceptall.pyfalseFAILEDTraceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/smpp/esme_connect_policy_acceptall.py", line 23, in <module>
msc.start()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/msc_osmo.py", line 80, in start
self.ctrl.connect()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/osmo_ctrl.py", line 92, in connect
MainLoop.wait(self.try_connect, timestep=3, timeout=timeout)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-hlr_10.42.42.2(pid=19067): Process ended prematurely: osmo-hlr_10.42.42.2(pid=19067) [trial-2400↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19067)]
----------------------------------------------
trial-2400 smpp esme_connect_policy_acceptall.py
----------------------------------------------
06:43:34.783114 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:34.794288 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:34.805215 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:34.815996 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:34.932086 tst esme_connect_policy_acceptall.py: using MSISDN 8548
06:43:35.052595 run osmo-stp_10.42.42.4: Starting osmo-stp
06:43:35.633257 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19062): Launched
06:43:35.969937 run osmo-stp_10.42.42.4(pid=19063): Launched
06:43:36.090234 run osmo-hlr_10.42.42.2: Starting osmo-hlr
06:43:36.625464 run create_hlr_db(pid=19064): Launched
06:43:36.820680 bus /sierra_2: Setting Powered False
06:43:37.839371 run create_hlr_db(pid=19064): Terminated: ok {rc=0}
06:43:38.264838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19066): Launched
06:43:38.582044 run osmo-hlr_10.42.42.2(pid=19067): Launched
06:43:38.704568 run osmo-msc_10.42.42.5: Starting osmo-msc
06:43:39.289877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19069): Launched
06:43:39.607490 run osmo-msc_10.42.42.5(pid=19070): Launched
06:43:39.797183 run osmo-hlr_10.42.42.2(pid=19067): ERR: Terminated: ERROR {rc=237} [trial-2400↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19067)]
06:43:39.939455 run osmo-hlr_10.42.42.2(pid=19067): stdout:
| (launched: 2022-12-14_06:43:38.425122)
06:43:40.081129 run osmo-hlr_10.42.42.2(pid=19067): stderr:
| �[0;m�[1;31m20221214064338602 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221214064338602 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221214064338602 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221214064338602 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221214064338602 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221214064338602 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221214064338614 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221214064338624 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221214064338624 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221214064338624 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
06:43:40.215564 run osmo-hlr_10.42.42.2(pid=19067): stdout:
| (launched: 2022-12-14_06:43:38.425122)
06:43:40.348883 run osmo-hlr_10.42.42.2(pid=19067): stderr:
| �[0;m�[1;31m20221214064338602 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221214064338602 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221214064338602 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221214064338602 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221214064338602 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221214064338602 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221214064338614 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221214064338624 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221214064338624 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221214064338624 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
06:43:40.406972 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=19067): Process ended prematurely: osmo-hlr_10.42.42.2(pid=19067) [trial-2400↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19067)] [trial-2400↪smpp↪esme_connect_policy_acceptall.py:23]
06:43:40.415544 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.6 sec)
06:43:40.477805 run osmo-msc_10.42.42.5(pid=19070): ERR: Terminated: ERROR {rc=9} [trial-2400↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=19070)]
06:43:40.528812 run osmo-msc_10.42.42.5(pid=19070): stdout:
| (launched: 2022-12-14_06:43:39.449842)
06:43:40.580736 run osmo-msc_10.42.42.5(pid=19070): stderr:
| �[0;m�[38;5;43m20221214064339763 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650)
| �[0;m�[38;5;43m20221214064339763 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568)
| �[0;m�[38;5;43m20221214064339763 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456)
| �[0;m�[38;5;45m20221214064339764 �[1;33mDLSCCP�[0;m�[38;5;45m �[1;33mNOTICE�[0;m�[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647)
| �[0;m�[38;5;43m20221214064339764 �[1;33mDLSS7�[0;m�[38;5;43m �[1;33mNOTICE�[0;m�[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458)
| �[0;m�[38;5;45m20221214064339764 �[1;32mDLSCCP�[0;m�[38;5;45m �[1;32mINFO�[0;m�[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108)
| �[0;m�[38;5;43m20221214064339764 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482)
| �[0;m20221214064339764 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822)
| 20221214064339764 �[1;31mDSGS�[0;m �[1;31mERROR�[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182)
| Starting SGs server failed
06:43:40.624622 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19062): Terminating (SIGTERM)
06:43:40.666192 run osmo-stp_10.42.42.4(pid=19063): Terminating (SIGTERM)
06:43:40.708541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19066): Terminating (SIGTERM)
06:43:40.751981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19069): Terminating (SIGTERM)
06:43:40.763627 --- ParallelTerminationStrategy: PID 19062 died...
06:43:40.823254 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19062): Terminated: ok {rc=0}
06:43:40.834325 --- ParallelTerminationStrategy: PID 19063 died...
06:43:40.890021 run osmo-stp_10.42.42.4(pid=19063): Terminated: ok {rc=0}
06:43:40.899915 --- ParallelTerminationStrategy: PID 19066 died...
06:43:40.955576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19066): Terminated: ok {rc=0}
06:43:40.965670 --- ParallelTerminationStrategy: PID 19069 died...
06:43:41.021954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19069): Terminated: ok {rc=0}
70smpp7.0osmo-hlr_10.42.42.2(pid=19078): Process ended prematurely: osmo-hlr_10.42.42.2(pid=19078) [trial-2400↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19078)]2331esme_connect_policy_closed.pyfalseFAILEDTraceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/smpp/esme_connect_policy_closed.py", line 31, in <module>
msc.start()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/msc_osmo.py", line 80, in start
self.ctrl.connect()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/osmo_ctrl.py", line 92, in connect
MainLoop.wait(self.try_connect, timestep=3, timeout=timeout)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-hlr_10.42.42.2(pid=19078): Process ended prematurely: osmo-hlr_10.42.42.2(pid=19078) [trial-2400↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19078)]
----------------------------------------------
trial-2400 smpp esme_connect_policy_closed.py
----------------------------------------------
06:43:41.037302 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:41.048896 tst smpp: Using 1 x bts (candidates: 1)
06:43:41.178861 tst esme_connect_policy_closed.py: using LAC 39117
06:43:41.303881 tst esme_connect_policy_closed.py: using RAC 102
06:43:41.428915 tst esme_connect_policy_closed.py: using CellId 39117
06:43:41.553695 tst esme_connect_policy_closed.py: using BVCI 39118
06:43:41.577964 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:41.588439 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:41.598757 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:41.710433 tst esme_connect_policy_closed.py: using MSISDN 8549
06:43:41.836264 tst esme_connect_policy_closed.py: using MSISDN 8550
06:43:41.949682 run osmo-stp_10.42.42.4: Starting osmo-stp
06:43:42.497131 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19073): Launched
06:43:42.816616 run osmo-stp_10.42.42.4(pid=19074): Launched
06:43:42.930143 run osmo-hlr_10.42.42.2: Starting osmo-hlr
06:43:43.429223 run create_hlr_db(pid=19075): Launched
06:43:44.615228 run create_hlr_db(pid=19075): Terminated: ok {rc=0}
06:43:44.941527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19077): Launched
06:43:45.258679 run osmo-hlr_10.42.42.2(pid=19078): Launched
06:43:45.384832 run osmo-msc_10.42.42.5: Starting osmo-msc
06:43:46.004164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19080): Launched
06:43:46.458295 run osmo-msc_10.42.42.5(pid=19081): Launched
06:43:46.721886 run osmo-hlr_10.42.42.2(pid=19078): ERR: Terminated: ERROR {rc=237} [trial-2400↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19078)]
06:43:47.031059 run osmo-hlr_10.42.42.2(pid=19078): stdout:
| (launched: 2022-12-14_06:43:45.102613)
06:43:47.204375 run osmo-hlr_10.42.42.2(pid=19078): stderr:
| �[0;m�[1;31m20221214064345277 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221214064345277 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221214064345277 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221214064345277 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221214064345277 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221214064345277 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221214064345289 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221214064345297 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221214064345297 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221214064345297 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
06:43:47.339961 run osmo-hlr_10.42.42.2(pid=19078): stdout:
| (launched: 2022-12-14_06:43:45.102613)
06:43:47.473832 run osmo-hlr_10.42.42.2(pid=19078): stderr:
| �[0;m�[1;31m20221214064345277 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221214064345277 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221214064345277 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221214064345277 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221214064345277 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221214064345277 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221214064345289 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221214064345297 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221214064345297 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221214064345297 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
06:43:47.532586 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=19078): Process ended prematurely: osmo-hlr_10.42.42.2(pid=19078) [trial-2400↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19078)] [trial-2400↪smpp↪esme_connect_policy_closed.py:31]
06:43:47.541335 tst esme_connect_policy_closed.py:31: Test FAILED (6.5 sec)
06:43:47.604739 run osmo-msc_10.42.42.5(pid=19081): ERR: Terminated: ERROR {rc=9} [trial-2400↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=19081)]
06:43:47.656192 run osmo-msc_10.42.42.5(pid=19081): stdout:
| (launched: 2022-12-14_06:43:46.182588)
06:43:47.708404 run osmo-msc_10.42.42.5(pid=19081): stderr:
| �[0;m�[38;5;43m20221214064346817 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650)
| �[0;m�[38;5;43m20221214064346817 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568)
| �[0;m�[38;5;43m20221214064346817 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456)
| �[0;m�[38;5;45m20221214064346817 �[1;33mDLSCCP�[0;m�[38;5;45m �[1;33mNOTICE�[0;m�[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647)
| �[0;m�[38;5;43m20221214064346817 �[1;33mDLSS7�[0;m�[38;5;43m �[1;33mNOTICE�[0;m�[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458)
| �[0;m�[38;5;45m20221214064346817 �[1;32mDLSCCP�[0;m�[38;5;45m �[1;32mINFO�[0;m�[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108)
| �[0;m�[38;5;43m20221214064346817 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482)
| �[0;m20221214064346818 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822)
| 20221214064346818 �[1;31mDSGS�[0;m �[1;31mERROR�[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182)
| Starting SGs server failed
06:43:47.752575 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19073): Terminating (SIGTERM)
06:43:47.795275 run osmo-stp_10.42.42.4(pid=19074): Terminating (SIGTERM)
06:43:47.838455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19077): Terminating (SIGTERM)
06:43:47.883822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19080): Terminating (SIGTERM)
06:43:47.893869 --- ParallelTerminationStrategy: PID 19073 died...
06:43:47.952162 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19073): Terminated: ok {rc=0}
06:43:47.962397 --- ParallelTerminationStrategy: PID 19074 died...
06:43:48.018693 run osmo-stp_10.42.42.4(pid=19074): Terminated: ok {rc=0}
06:43:48.029210 --- ParallelTerminationStrategy: PID 19077 died...
06:43:48.085555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19077): Terminated: ok {rc=0}
06:43:48.095598 --- ParallelTerminationStrategy: PID 19080 died...
06:43:48.151581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19080): Terminated: ok {rc=0}
70smpp7.0osmo-stp_10.42.42.5(pid=19090): Process ended prematurely: osmo-stp_10.42.42.5(pid=19090) [trial-2400↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19090)]2331esme_ms_sms_storeforward.pyfalseFAILEDTraceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/smpp/esme_ms_sms_storeforward.py", line 30, in <module>
msc.start()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/msc_osmo.py", line 80, in start
self.ctrl.connect()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/osmo_ctrl.py", line 92, in connect
MainLoop.wait(self.try_connect, timestep=3, timeout=timeout)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=19090): Process ended prematurely: osmo-stp_10.42.42.5(pid=19090) [trial-2400↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19090)]
----------------------------------------------
trial-2400 smpp esme_ms_sms_storeforward.py
----------------------------------------------
06:43:48.166703 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:48.178499 tst smpp: Using 1 x bts (candidates: 1)
06:43:48.312197 tst esme_ms_sms_storeforward.py: using LAC 39118
06:43:48.435001 tst esme_ms_sms_storeforward.py: using RAC 103
06:43:48.558006 tst esme_ms_sms_storeforward.py: using CellId 39118
06:43:48.681254 tst esme_ms_sms_storeforward.py: using BVCI 39119
06:43:48.705692 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:48.716188 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:48.726849 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:48.737167 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:48.748365 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:48.759433 tst smpp: Using 1 x modem (candidates: 1)
06:43:48.991078 tst esme_ms_sms_storeforward.py: using MSISDN 8551
06:43:49.112393 run osmo-hlr_10.42.42.2: Starting osmo-hlr
06:43:49.650985 run create_hlr_db(pid=19084): Launched
06:43:50.847906 run create_hlr_db(pid=19084): Terminated: ok {rc=0}
06:43:51.198099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19086): Launched
06:43:51.539201 run osmo-hlr_10.42.42.2(pid=19087): Launched
06:43:51.667793 run osmo-stp_10.42.42.5: Starting osmo-stp
06:43:52.262551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19089): Launched
06:43:52.603613 run osmo-stp_10.42.42.5(pid=19090): Launched
06:43:52.727421 run osmo-msc_10.42.42.6: Starting osmo-msc
06:43:53.344042 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19092): Launched
06:43:53.682990 run osmo-msc_10.42.42.6(pid=19093): Launched
06:43:53.880092 run osmo-stp_10.42.42.5(pid=19090): ERR: Terminated: ERROR {rc=1} [trial-2400↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19090)]
06:43:54.022546 run osmo-stp_10.42.42.5(pid=19090): stdout:
| (launched: 2022-12-14_06:43:52.435585)
| Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org>
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html>
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
|
| Free Software lives by contribution. If you use this, please contribute!
|
06:43:54.163855 run osmo-stp_10.42.42.5(pid=19090): stderr:
| �[0;m�[38;5;43m20221214064352632 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221214064352632 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221214064352632 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221214064352633 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221214064352633 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221214064352633 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221214064352633 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use
06:43:54.299564 run osmo-stp_10.42.42.5(pid=19090): stdout:
| (launched: 2022-12-14_06:43:52.435585)
| Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org>
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html>
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
|
| Free Software lives by contribution. If you use this, please contribute!
|
06:43:54.434068 run osmo-stp_10.42.42.5(pid=19090): stderr:
| �[0;m�[38;5;43m20221214064352632 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221214064352632 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221214064352632 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221214064352633 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221214064352633 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221214064352633 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221214064352633 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use
06:43:54.492725 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=19090): Process ended prematurely: osmo-stp_10.42.42.5(pid=19090) [trial-2400↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19090)] [trial-2400↪smpp↪esme_ms_sms_storeforward.py:30]
06:43:54.501382 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.3 sec)
06:43:54.563951 run osmo-hlr_10.42.42.2(pid=19087): ERR: Terminated: ERROR {rc=237} [trial-2400↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19087)]
06:43:54.616105 run osmo-hlr_10.42.42.2(pid=19087): stdout:
| (launched: 2022-12-14_06:43:51.370796)
06:43:54.668762 run osmo-hlr_10.42.42.2(pid=19087): stderr:
| �[0;m�[1;31m20221214064351572 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221214064351572 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221214064351572 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221214064351572 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221214064351572 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221214064351572 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221214064351585 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221214064351594 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221214064351594 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221214064351594 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
06:43:54.739651 run osmo-msc_10.42.42.6(pid=19093): ERR: Terminated: ERROR {rc=2} [trial-2400↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19093)]
06:43:54.791427 run osmo-msc_10.42.42.6(pid=19093): stdout:
| (launched: 2022-12-14_06:43:53.515834)
06:43:54.843502 run osmo-msc_10.42.42.6(pid=19093): stderr:
| �[0;m�[38;5;43m20221214064353841 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456)
| �[0;m20221214064353841 �[1;34mDLGLOBAL�[0;m �[1;34mDEBUG�[0;m validating counter group 0x7f3d87667c40(sigtran_as) with 2 counters (rate_ctr.c:87)
| �[38;5;43m20221214064353841 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456)
| �[0;m�[38;5;43m20221214064353841 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034)
| �[0;m�[38;5;43m20221214064353841 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054)
| �[0;m�[38;5;43m20221214064353842 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831)
| �[0;m�[1;39m20221214064353845 �[1;34mDMNCC�[0;m�[1;39m �[1;34mDEBUG�[0;m�[1;39m Using internal MNCC handler. (msc_main.c:678)
| �[0;m20221214064353846 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935)
| 20221214064353846 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946)
| 20221214064353846 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99)
06:43:54.888052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19086): Terminating (SIGTERM)
06:43:54.930082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19089): Terminating (SIGTERM)
06:43:54.972233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19092): Terminating (SIGTERM)
06:43:54.981579 --- ParallelTerminationStrategy: PID 19086 died...
06:43:55.037606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19086): Terminated: ok {rc=0}
06:43:55.047616 --- ParallelTerminationStrategy: PID 19089 died...
06:43:55.103293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19089): Terminated: ok {rc=0}
06:43:55.113363 --- ParallelTerminationStrategy: PID 19092 died...
06:43:55.169012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19092): Terminated: ok {rc=0}
06:43:55.256214 bus /sierra_2: Setting Powered False
70smpp7.0osmo-stp_10.42.42.5(pid=19101): Process ended prematurely: osmo-stp_10.42.42.5(pid=19101) [trial-2400↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19101)]2331esme_ms_sms_transaction.pyfalseFAILEDTraceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/smpp/esme_ms_sms_transaction.py", line 28, in <module>
msc.start()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/msc_osmo.py", line 80, in start
self.ctrl.connect()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/osmo_ctrl.py", line 92, in connect
MainLoop.wait(self.try_connect, timestep=3, timeout=timeout)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=19101): Process ended prematurely: osmo-stp_10.42.42.5(pid=19101) [trial-2400↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19101)]
----------------------------------------------
trial-2400 smpp esme_ms_sms_transaction.py
----------------------------------------------
06:43:56.308604 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:56.320452 tst smpp: Using 1 x bts (candidates: 1)
06:43:56.453960 tst esme_ms_sms_transaction.py: using LAC 39119
06:43:56.587650 tst esme_ms_sms_transaction.py: using RAC 104
06:43:56.720645 tst esme_ms_sms_transaction.py: using CellId 39119
06:43:56.854548 tst esme_ms_sms_transaction.py: using BVCI 39120
06:43:56.880287 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:56.891251 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:56.902187 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:56.912897 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:56.923807 tst smpp: Using 1 x ip_address (candidates: 6)
06:43:56.934683 tst smpp: Using 1 x modem (candidates: 1)
06:43:57.167301 tst esme_ms_sms_transaction.py: using MSISDN 8552
06:43:57.288652 run osmo-hlr_10.42.42.2: Starting osmo-hlr
06:43:57.827234 run create_hlr_db(pid=19095): Launched
06:43:58.023803 bus /sierra_2: Setting Powered False
06:43:59.043776 run create_hlr_db(pid=19095): Terminated: ok {rc=0}
06:43:59.492942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19097): Launched
06:43:59.834148 run osmo-hlr_10.42.42.2(pid=19098): Launched
06:43:59.961872 run osmo-stp_10.42.42.5: Starting osmo-stp
06:44:00.547139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19100): Launched
06:44:00.885725 run osmo-stp_10.42.42.5(pid=19101): Launched
06:44:01.112162 run osmo-msc_10.42.42.6: Starting osmo-msc
06:44:01.811801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19103): Launched
06:44:02.344514 run osmo-msc_10.42.42.6(pid=19104): Launched
06:44:02.591357 run osmo-stp_10.42.42.5(pid=19101): ERR: Terminated: ERROR {rc=1} [trial-2400↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19101)]
06:44:02.722508 run osmo-stp_10.42.42.5(pid=19101): stdout:
| (launched: 2022-12-14_06:44:00.718430)
| Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org>
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html>
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
|
| Free Software lives by contribution. If you use this, please contribute!
|
06:44:02.854630 run osmo-stp_10.42.42.5(pid=19101): stderr:
| �[0;m�[38;5;43m20221214064401000 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221214064401000 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221214064401000 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221214064401001 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221214064401001 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221214064401001 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221214064401001 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use
06:44:02.981628 run osmo-stp_10.42.42.5(pid=19101): stdout:
| (launched: 2022-12-14_06:44:00.718430)
| Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org>
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html>
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
|
| Free Software lives by contribution. If you use this, please contribute!
|
06:44:03.107717 run osmo-stp_10.42.42.5(pid=19101): stderr:
| �[0;m�[38;5;43m20221214064401000 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221214064401000 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221214064401000 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221214064401001 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221214064401001 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221214064401001 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221214064401001 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use
06:44:03.162775 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=19101): Process ended prematurely: osmo-stp_10.42.42.5(pid=19101) [trial-2400↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=19101)] [trial-2400↪smpp↪esme_ms_sms_transaction.py:28]
06:44:03.171005 tst esme_ms_sms_transaction.py:28: Test FAILED (6.9 sec)
06:44:03.231592 run osmo-hlr_10.42.42.2(pid=19098): ERR: Terminated: ERROR {rc=237} [trial-2400↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=19098)]
06:44:03.281039 run osmo-hlr_10.42.42.2(pid=19098): stdout:
| (launched: 2022-12-14_06:43:59.665723)
06:44:03.331014 run osmo-hlr_10.42.42.2(pid=19098): stderr:
| �[0;m�[1;31m20221214064359867 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221214064359867 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221214064359867 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221214064359867 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221214064359867 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221214064359867 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221214064359880 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2400/run.2022-12-14_05-28-31/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221214064359890 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221214064359890 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221214064359890 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
06:44:03.398951 run osmo-msc_10.42.42.6(pid=19104): ERR: Terminated: ERROR {rc=2} [trial-2400↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=19104)]
06:44:03.448390 run osmo-msc_10.42.42.6(pid=19104): stdout:
| (launched: 2022-12-14_06:44:01.985997)
06:44:03.498597 run osmo-msc_10.42.42.6(pid=19104): stderr:
| �[0;m�[38;5;43m20221214064402301 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456)
| �[0;m20221214064402301 �[1;34mDLGLOBAL�[0;m �[1;34mDEBUG�[0;m validating counter group 0x7fe1c6b96c40(sigtran_as) with 2 counters (rate_ctr.c:87)
| �[38;5;43m20221214064402301 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456)
| �[0;m�[38;5;43m20221214064402302 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034)
| �[0;m�[38;5;43m20221214064402302 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054)
| �[0;m�[38;5;43m20221214064402302 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831)
| �[0;m�[1;39m20221214064402305 �[1;34mDMNCC�[0;m�[1;39m �[1;34mDEBUG�[0;m�[1;39m Using internal MNCC handler. (msc_main.c:678)
| �[0;m20221214064402306 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935)
| 20221214064402306 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946)
| 20221214064402306 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99)
06:44:03.541298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19097): Terminating (SIGTERM)
06:44:03.581548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19100): Terminating (SIGTERM)
06:44:03.621720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19103): Terminating (SIGTERM)
06:44:03.630881 --- ParallelTerminationStrategy: PID 19097 died...
06:44:03.685276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19097): Terminated: ok {rc=0}
06:44:03.694778 --- ParallelTerminationStrategy: PID 19100 died...
06:44:03.748441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19100): Terminated: ok {rc=0}
06:44:03.757986 --- ParallelTerminationStrategy: PID 19103 died...
06:44:03.812224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19103): Terminated: ok {rc=0}
06:44:03.900511 bus /sierra_2: Setting Powered False
4smpp00