40smpp6.0osmo-hlr_10.42.42.2(pid=6445): Process ended prematurely: osmo-hlr_10.42.42.2(pid=6445) [trial-2370↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6445)]2331esme_connect_policy_acceptall.pyfalseFAILEDTraceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/smpp/esme_connect_policy_acceptall.py", line 23, in <module>
msc.start()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/msc_osmo.py", line 80, in start
self.ctrl.connect()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/osmo_ctrl.py", line 92, in connect
MainLoop.wait(self.try_connect, timestep=3, timeout=timeout)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-hlr_10.42.42.2(pid=6445): Process ended prematurely: osmo-hlr_10.42.42.2(pid=6445) [trial-2370↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6445)]
----------------------------------------------
trial-2370 smpp esme_connect_policy_acceptall.py
----------------------------------------------
06:41:13.084429 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:13.095244 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:13.106460 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:13.118043 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:13.229538 tst esme_connect_policy_acceptall.py: using MSISDN 7595
06:41:13.342760 run osmo-stp_10.42.42.4: Starting osmo-stp
06:41:13.891673 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6440): Launched
06:41:14.207917 run osmo-stp_10.42.42.4(pid=6441): Launched
06:41:14.321460 run osmo-hlr_10.42.42.2: Starting osmo-hlr
06:41:14.829817 run create_hlr_db(pid=6442): Launched
06:41:15.015736 bus /sierra_2: Setting Powered False
06:41:16.066582 run create_hlr_db(pid=6442): Terminated: ok {rc=0}
06:41:16.521551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6444): Launched
06:41:16.977024 run osmo-hlr_10.42.42.2(pid=6445): Launched
06:41:17.173102 run osmo-msc_10.42.42.5: Starting osmo-msc
06:41:17.785745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6447): Launched
06:41:18.105877 run osmo-msc_10.42.42.5(pid=6448): Launched
06:41:18.293586 run osmo-hlr_10.42.42.2(pid=6445): ERR: Terminated: ERROR {rc=237} [trial-2370↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6445)]
06:41:18.428548 run osmo-hlr_10.42.42.2(pid=6445): stdout:
| (launched: 2022-12-10_06:41:16.686095)
06:41:18.563771 run osmo-hlr_10.42.42.2(pid=6445): stderr:
| �[0;m�[1;31m20221210064117029 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221210064117029 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221210064117029 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221210064117029 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221210064117029 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221210064117030 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221210064117050 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221210064117068 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221210064117068 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221210064117068 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
06:41:18.692300 run osmo-hlr_10.42.42.2(pid=6445): stdout:
| (launched: 2022-12-10_06:41:16.686095)
06:41:18.819722 run osmo-hlr_10.42.42.2(pid=6445): stderr:
| �[0;m�[1;31m20221210064117029 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221210064117029 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221210064117029 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221210064117029 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221210064117029 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221210064117030 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221210064117050 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221210064117068 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221210064117068 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221210064117068 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
06:41:18.875801 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=6445): Process ended prematurely: osmo-hlr_10.42.42.2(pid=6445) [trial-2370↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6445)] [trial-2370↪smpp↪esme_connect_policy_acceptall.py:23]
06:41:18.884371 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.8 sec)
06:41:18.946410 run osmo-msc_10.42.42.5(pid=6448): ERR: Terminated: ERROR {rc=9} [trial-2370↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=6448)]
06:41:18.997623 run osmo-msc_10.42.42.5(pid=6448): stdout:
| (launched: 2022-12-10_06:41:17.949102)
06:41:19.049429 run osmo-msc_10.42.42.5(pid=6448): stderr:
| �[0;m�[38;5;43m20221210064118309 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650)
| �[0;m�[38;5;43m20221210064118309 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568)
| �[0;m�[38;5;43m20221210064118309 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456)
| �[0;m�[38;5;45m20221210064118309 �[1;33mDLSCCP�[0;m�[38;5;45m �[1;33mNOTICE�[0;m�[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647)
| �[0;m�[38;5;43m20221210064118309 �[1;33mDLSS7�[0;m�[38;5;43m �[1;33mNOTICE�[0;m�[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458)
| �[0;m�[38;5;45m20221210064118309 �[1;32mDLSCCP�[0;m�[38;5;45m �[1;32mINFO�[0;m�[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108)
| �[0;m�[38;5;43m20221210064118309 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482)
| �[0;m20221210064118310 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822)
| 20221210064118310 �[1;31mDSGS�[0;m �[1;31mERROR�[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182)
| Starting SGs server failed
06:41:19.093566 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6440): Terminating (SIGTERM)
06:41:19.135225 run osmo-stp_10.42.42.4(pid=6441): Terminating (SIGTERM)
06:41:19.177623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6444): Terminating (SIGTERM)
06:41:19.221026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6447): Terminating (SIGTERM)
06:41:19.231636 --- ParallelTerminationStrategy: PID 6440 died...
06:41:19.288597 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6440): Terminated: ok {rc=0}
06:41:19.298661 --- ParallelTerminationStrategy: PID 6441 died...
06:41:19.354250 run osmo-stp_10.42.42.4(pid=6441): Terminated: ok {rc=0}
06:41:19.364122 --- ParallelTerminationStrategy: PID 6444 died...
06:41:19.419389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6444): Terminated: ok {rc=0}
06:41:19.429386 --- ParallelTerminationStrategy: PID 6447 died...
06:41:19.484796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6447): Terminated: ok {rc=0}
40smpp7.0osmo-hlr_10.42.42.2(pid=6456): Process ended prematurely: osmo-hlr_10.42.42.2(pid=6456) [trial-2370↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6456)]2331esme_connect_policy_closed.pyfalseFAILEDTraceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/smpp/esme_connect_policy_closed.py", line 31, in <module>
msc.start()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/msc_osmo.py", line 80, in start
self.ctrl.connect()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/osmo_ctrl.py", line 92, in connect
MainLoop.wait(self.try_connect, timestep=3, timeout=timeout)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-hlr_10.42.42.2(pid=6456): Process ended prematurely: osmo-hlr_10.42.42.2(pid=6456) [trial-2370↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6456)]
----------------------------------------------
trial-2370 smpp esme_connect_policy_closed.py
----------------------------------------------
06:41:19.499600 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:19.511102 tst smpp: Using 1 x bts (candidates: 1)
06:41:19.647221 tst esme_connect_policy_closed.py: using LAC 26556
06:41:19.772358 tst esme_connect_policy_closed.py: using RAC 36
06:41:19.897246 tst esme_connect_policy_closed.py: using CellId 26556
06:41:20.023096 tst esme_connect_policy_closed.py: using BVCI 26557
06:41:20.047624 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:20.058464 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:20.069179 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:20.182397 tst esme_connect_policy_closed.py: using MSISDN 7596
06:41:20.306729 tst esme_connect_policy_closed.py: using MSISDN 7597
06:41:20.420754 run osmo-stp_10.42.42.4: Starting osmo-stp
06:41:20.976162 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6451): Launched
06:41:21.297348 run osmo-stp_10.42.42.4(pid=6452): Launched
06:41:21.411833 run osmo-hlr_10.42.42.2: Starting osmo-hlr
06:41:21.924694 run create_hlr_db(pid=6453): Launched
06:41:23.113200 run create_hlr_db(pid=6453): Terminated: ok {rc=0}
06:41:23.445170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6455): Launched
06:41:23.766115 run osmo-hlr_10.42.42.2(pid=6456): Launched
06:41:23.881535 run osmo-msc_10.42.42.5: Starting osmo-msc
06:41:24.471620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6458): Launched
06:41:24.792919 run osmo-msc_10.42.42.5(pid=6459): Launched
06:41:24.981416 run osmo-hlr_10.42.42.2(pid=6456): ERR: Terminated: ERROR {rc=237} [trial-2370↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6456)]
06:41:25.117654 run osmo-hlr_10.42.42.2(pid=6456): stdout:
| (launched: 2022-12-10_06:41:23.608631)
06:41:25.253651 run osmo-hlr_10.42.42.2(pid=6456): stderr:
| �[0;m�[1;31m20221210064123802 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221210064123802 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221210064123802 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221210064123802 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221210064123802 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221210064123802 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221210064123814 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221210064123823 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221210064123823 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221210064123823 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
06:41:25.382906 run osmo-hlr_10.42.42.2(pid=6456): stdout:
| (launched: 2022-12-10_06:41:23.608631)
06:41:25.510745 run osmo-hlr_10.42.42.2(pid=6456): stderr:
| �[0;m�[1;31m20221210064123802 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221210064123802 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221210064123802 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221210064123802 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221210064123802 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221210064123802 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221210064123814 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221210064123823 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221210064123823 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221210064123823 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
06:41:25.567112 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=6456): Process ended prematurely: osmo-hlr_10.42.42.2(pid=6456) [trial-2370↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6456)] [trial-2370↪smpp↪esme_connect_policy_closed.py:31]
06:41:25.575556 tst esme_connect_policy_closed.py:31: Test FAILED (6.1 sec)
06:41:25.637939 run osmo-msc_10.42.42.5(pid=6459): ERR: Terminated: ERROR {rc=9} [trial-2370↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=6459)]
06:41:25.689521 run osmo-msc_10.42.42.5(pid=6459): stdout:
| (launched: 2022-12-10_06:41:24.635264)
06:41:25.741680 run osmo-msc_10.42.42.5(pid=6459): stderr:
| �[0;m�[38;5;43m20221210064125018 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650)
| �[0;m�[38;5;43m20221210064125018 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568)
| �[0;m�[38;5;43m20221210064125018 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456)
| �[0;m�[38;5;45m20221210064125018 �[1;33mDLSCCP�[0;m�[38;5;45m �[1;33mNOTICE�[0;m�[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647)
| �[0;m�[38;5;43m20221210064125018 �[1;33mDLSS7�[0;m�[38;5;43m �[1;33mNOTICE�[0;m�[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458)
| �[0;m�[38;5;45m20221210064125019 �[1;32mDLSCCP�[0;m�[38;5;45m �[1;32mINFO�[0;m�[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108)
| �[0;m�[38;5;43m20221210064125019 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482)
| �[0;m20221210064125019 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822)
| 20221210064125019 �[1;31mDSGS�[0;m �[1;31mERROR�[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182)
| Starting SGs server failed
06:41:25.785932 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6451): Terminating (SIGTERM)
06:41:25.827461 run osmo-stp_10.42.42.4(pid=6452): Terminating (SIGTERM)
06:41:25.869863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6455): Terminating (SIGTERM)
06:41:25.913946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6458): Terminating (SIGTERM)
06:41:25.924347 --- ParallelTerminationStrategy: PID 6451 died...
06:41:25.982743 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=6451): Terminated: ok {rc=0}
06:41:25.992759 --- ParallelTerminationStrategy: PID 6452 died...
06:41:26.047847 run osmo-stp_10.42.42.4(pid=6452): Terminated: ok {rc=0}
06:41:26.057798 --- ParallelTerminationStrategy: PID 6455 died...
06:41:26.113113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6455): Terminated: ok {rc=0}
06:41:26.123037 --- ParallelTerminationStrategy: PID 6458 died...
06:41:26.178425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6458): Terminated: ok {rc=0}
40smpp7.0osmo-stp_10.42.42.5(pid=6468): Process ended prematurely: osmo-stp_10.42.42.5(pid=6468) [trial-2370↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6468)]2331esme_ms_sms_storeforward.pyfalseFAILEDTraceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/smpp/esme_ms_sms_storeforward.py", line 30, in <module>
msc.start()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/msc_osmo.py", line 80, in start
self.ctrl.connect()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/osmo_ctrl.py", line 92, in connect
MainLoop.wait(self.try_connect, timestep=3, timeout=timeout)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=6468): Process ended prematurely: osmo-stp_10.42.42.5(pid=6468) [trial-2370↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6468)]
----------------------------------------------
trial-2370 smpp esme_ms_sms_storeforward.py
----------------------------------------------
06:41:26.193272 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:26.204705 tst smpp: Using 1 x bts (candidates: 1)
06:41:26.336238 tst esme_ms_sms_storeforward.py: using LAC 26557
06:41:26.464027 tst esme_ms_sms_storeforward.py: using RAC 37
06:41:26.589783 tst esme_ms_sms_storeforward.py: using CellId 26557
06:41:26.717264 tst esme_ms_sms_storeforward.py: using BVCI 26558
06:41:26.741855 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:26.752616 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:26.763426 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:26.774117 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:26.784802 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:26.795471 tst smpp: Using 1 x modem (candidates: 1)
06:41:27.017438 tst esme_ms_sms_storeforward.py: using MSISDN 7598
06:41:27.131776 run osmo-hlr_10.42.42.2: Starting osmo-hlr
06:41:27.644747 run create_hlr_db(pid=6462): Launched
06:41:28.833257 run create_hlr_db(pid=6462): Terminated: ok {rc=0}
06:41:29.165059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6464): Launched
06:41:29.487058 run osmo-hlr_10.42.42.2(pid=6465): Launched
06:41:29.604680 run osmo-stp_10.42.42.5: Starting osmo-stp
06:41:30.167209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6467): Launched
06:41:30.488889 run osmo-stp_10.42.42.5(pid=6468): Launched
06:41:30.605704 run osmo-msc_10.42.42.6: Starting osmo-msc
06:41:31.244244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6470): Launched
06:41:31.576739 run osmo-msc_10.42.42.6(pid=6471): Launched
06:41:31.957731 run osmo-stp_10.42.42.5(pid=6468): ERR: Terminated: ERROR {rc=1} [trial-2370↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6468)]
06:41:32.231344 run osmo-stp_10.42.42.5(pid=6468): stdout:
| (launched: 2022-12-10_06:41:30.330552)
| Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org>
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html>
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
|
| Free Software lives by contribution. If you use this, please contribute!
|
06:41:32.401626 run osmo-stp_10.42.42.5(pid=6468): stderr:
| �[0;m�[38;5;43m20221210064130520 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221210064130520 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221210064130520 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221210064130521 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221210064130521 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221210064130521 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221210064130521 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use
06:41:32.530595 run osmo-stp_10.42.42.5(pid=6468): stdout:
| (launched: 2022-12-10_06:41:30.330552)
| Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org>
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html>
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
|
| Free Software lives by contribution. If you use this, please contribute!
|
06:41:32.657950 run osmo-stp_10.42.42.5(pid=6468): stderr:
| �[0;m�[38;5;43m20221210064130520 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221210064130520 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221210064130520 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221210064130521 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221210064130521 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221210064130521 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221210064130521 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use
06:41:32.713945 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=6468): Process ended prematurely: osmo-stp_10.42.42.5(pid=6468) [trial-2370↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6468)] [trial-2370↪smpp↪esme_ms_sms_storeforward.py:30]
06:41:32.722608 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.5 sec)
06:41:32.784460 run osmo-hlr_10.42.42.2(pid=6465): ERR: Terminated: ERROR {rc=237} [trial-2370↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6465)]
06:41:32.835542 run osmo-hlr_10.42.42.2(pid=6465): stdout:
| (launched: 2022-12-10_06:41:29.328065)
06:41:32.887351 run osmo-hlr_10.42.42.2(pid=6465): stderr:
| �[0;m�[1;31m20221210064129526 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221210064129526 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221210064129526 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221210064129526 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221210064129526 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221210064129526 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221210064129538 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221210064129546 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221210064129547 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221210064129547 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
06:41:32.957461 run osmo-msc_10.42.42.6(pid=6471): ERR: Terminated: ERROR {rc=2} [trial-2370↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6471)]
06:41:33.008295 run osmo-msc_10.42.42.6(pid=6471): stdout:
| (launched: 2022-12-10_06:41:31.419642)
06:41:33.059758 run osmo-msc_10.42.42.6(pid=6471): stderr:
| �[0;m�[38;5;43m20221210064131922 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456)
| �[0;m20221210064131922 �[1;34mDLGLOBAL�[0;m �[1;34mDEBUG�[0;m validating counter group 0x7f9098a16c40(sigtran_as) with 2 counters (rate_ctr.c:87)
| �[38;5;43m20221210064131922 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456)
| �[0;m�[38;5;43m20221210064131922 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034)
| �[0;m�[38;5;43m20221210064131922 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054)
| �[0;m�[38;5;43m20221210064131922 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831)
| �[0;m�[1;39m20221210064131924 �[1;34mDMNCC�[0;m�[1;39m �[1;34mDEBUG�[0;m�[1;39m Using internal MNCC handler. (msc_main.c:678)
| �[0;m20221210064131925 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935)
| 20221210064131925 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946)
| 20221210064131925 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99)
06:41:33.103818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6464): Terminating (SIGTERM)
06:41:33.145132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6467): Terminating (SIGTERM)
06:41:33.186580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6470): Terminating (SIGTERM)
06:41:33.196057 --- ParallelTerminationStrategy: PID 6464 died...
06:41:33.251908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6464): Terminated: ok {rc=0}
06:41:33.261947 --- ParallelTerminationStrategy: PID 6467 died...
06:41:33.317216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6467): Terminated: ok {rc=0}
06:41:33.327215 --- ParallelTerminationStrategy: PID 6470 died...
06:41:33.382709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6470): Terminated: ok {rc=0}
06:41:33.468726 bus /sierra_2: Setting Powered False
40smpp7.0osmo-stp_10.42.42.5(pid=6479): Process ended prematurely: osmo-stp_10.42.42.5(pid=6479) [trial-2370↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6479)]2331esme_ms_sms_transaction.pyfalseFAILEDTraceback (most recent call last):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
self.path)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
spec.loader.exec_module( importlib.util.module_from_spec(spec) )
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/sysmocom/suites/smpp/esme_ms_sms_transaction.py", line 28, in <module>
msc.start()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/msc_osmo.py", line 80, in start
self.ctrl.connect()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/osmo_ctrl.py", line 92, in connect
MainLoop.wait(self.try_connect, timestep=3, timeout=timeout)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
self.poll(may_block=True)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
self.deferred_handling.handle_queue()
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
handler(*args, **kwargs)
File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll
raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-stp_10.42.42.5(pid=6479): Process ended prematurely: osmo-stp_10.42.42.5(pid=6479) [trial-2370↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6479)]
----------------------------------------------
trial-2370 smpp esme_ms_sms_transaction.py
----------------------------------------------
06:41:34.519758 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:34.531015 tst smpp: Using 1 x bts (candidates: 1)
06:41:34.655196 tst esme_ms_sms_transaction.py: using LAC 26558
06:41:34.775216 tst esme_ms_sms_transaction.py: using RAC 38
06:41:34.895005 tst esme_ms_sms_transaction.py: using CellId 26558
06:41:35.012323 tst esme_ms_sms_transaction.py: using BVCI 26559
06:41:35.035326 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:35.045769 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:35.056142 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:35.066672 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:35.077179 tst smpp: Using 1 x ip_address (candidates: 6)
06:41:35.087662 tst smpp: Using 1 x modem (candidates: 1)
06:41:35.300942 tst esme_ms_sms_transaction.py: using MSISDN 7599
06:41:35.408850 run osmo-hlr_10.42.42.2: Starting osmo-hlr
06:41:35.881129 run create_hlr_db(pid=6473): Launched
06:41:36.055439 bus /sierra_2: Setting Powered False
06:41:37.074728 run create_hlr_db(pid=6473): Terminated: ok {rc=0}
06:41:37.504338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6475): Launched
06:41:37.826309 run osmo-hlr_10.42.42.2(pid=6476): Launched
06:41:37.943915 run osmo-stp_10.42.42.5: Starting osmo-stp
06:41:38.499611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6478): Launched
06:41:38.819805 run osmo-stp_10.42.42.5(pid=6479): Launched
06:41:38.935493 run osmo-msc_10.42.42.6: Starting osmo-msc
06:41:39.520585 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6481): Launched
06:41:39.840784 run osmo-msc_10.42.42.6(pid=6482): Launched
06:41:40.030242 run osmo-stp_10.42.42.5(pid=6479): ERR: Terminated: ERROR {rc=1} [trial-2370↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6479)]
06:41:40.169005 run osmo-stp_10.42.42.5(pid=6479): stdout:
| (launched: 2022-12-10_06:41:38.662373)
| Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org>
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html>
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
|
| Free Software lives by contribution. If you use this, please contribute!
|
06:41:40.303884 run osmo-stp_10.42.42.5(pid=6479): stderr:
| �[0;m�[38;5;43m20221210064138854 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221210064138854 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221210064138855 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221210064138855 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221210064138855 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221210064138856 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221210064138856 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use
06:41:40.432739 run osmo-stp_10.42.42.5(pid=6479): stdout:
| (launched: 2022-12-10_06:41:38.662373)
| Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org>
| Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy
| License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html>
| This is free software: you are free to change and redistribute it.
| There is NO WARRANTY, to the extent permitted by law.
|
| Free Software lives by contribution. If you use this, please contribute!
|
06:41:40.560679 run osmo-stp_10.42.42.5(pid=6479): stderr:
| �[0;m�[38;5;43m20221210064138854 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189)
| �[0;m�[38;5;43m20221210064138854 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207)
| �[0;m�[38;5;43m20221210064138855 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235)
| �[0;m20221210064138855 �[1;33mDLGLOBAL�[0;m �[1;33mNOTICE�[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822)
| % Unable to bind xUA server to IP(s)
| 20221210064138855 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935)
| 20221210064138856 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946)
| 20221210064138856 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99)
| Error binding VTY port
| : Address already in use
06:41:40.617031 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=6479): Process ended prematurely: osmo-stp_10.42.42.5(pid=6479) [trial-2370↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6479)] [trial-2370↪smpp↪esme_ms_sms_transaction.py:28]
06:41:40.625758 tst esme_ms_sms_transaction.py:28: Test FAILED (6.1 sec)
06:41:40.688010 run osmo-hlr_10.42.42.2(pid=6476): ERR: Terminated: ERROR {rc=237} [trial-2370↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6476)]
06:41:40.739267 run osmo-hlr_10.42.42.2(pid=6476): stdout:
| (launched: 2022-12-10_06:41:37.668462)
06:41:40.791397 run osmo-hlr_10.42.42.2(pid=6476): stderr:
| �[0;m�[1;31m20221210064137867 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579)
| �[0;m�[1;31m20221210064137867 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579)
| �[0;m�[1;31m20221210064137867 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579)
| �[0;m�[1;31m20221210064137867 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579)
| �[0;m�[1;31m20221210064137867 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m SQLite3 compiled with 'USE_URI' (db.c:579)
| �[0;m�[1;31m20221210064137867 �[1;34mDDB�[0;m�[1;31m �[1;34mDEBUG�[0;m�[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596)
| �[0;m�[1;31m20221210064137883 �[1;33mDDB�[0;m�[1;31m �[1;33mNOTICE�[0;m�[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2370/run.2022-12-10_05-27-43/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636)
| �[0;m20221210064137891 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935)
| 20221210064137891 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946)
| 20221210064137891 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99)
06:41:40.861974 run osmo-msc_10.42.42.6(pid=6482): ERR: Terminated: ERROR {rc=2} [trial-2370↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6482)]
06:41:40.913250 run osmo-msc_10.42.42.6(pid=6482): stdout:
| (launched: 2022-12-10_06:41:39.682920)
06:41:40.965144 run osmo-msc_10.42.42.6(pid=6482): stderr:
| �[0;m�[38;5;43m20221210064140003 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456)
| �[0;m20221210064140003 �[1;34mDLGLOBAL�[0;m �[1;34mDEBUG�[0;m validating counter group 0x7ffbd3a58c40(sigtran_as) with 2 counters (rate_ctr.c:87)
| �[38;5;43m20221210064140003 �[1;34mDLSS7�[0;m�[38;5;43m �[1;34mDEBUG�[0;m�[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456)
| �[0;m�[38;5;43m20221210064140003 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034)
| �[0;m�[38;5;43m20221210064140003 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054)
| �[0;m�[38;5;43m20221210064140003 �[1;32mDLSS7�[0;m�[38;5;43m �[1;32mINFO�[0;m�[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831)
| �[0;m�[1;39m20221210064140005 �[1;34mDMNCC�[0;m�[1;39m �[1;34mDEBUG�[0;m�[1;39m Using internal MNCC handler. (msc_main.c:678)
| �[0;m20221210064140006 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935)
| 20221210064140006 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946)
| 20221210064140006 �[1;31mDLGLOBAL�[0;m �[1;31mERROR�[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99)
06:41:41.008871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6475): Terminating (SIGTERM)
06:41:41.050258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6478): Terminating (SIGTERM)
06:41:41.091876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6481): Terminating (SIGTERM)
06:41:41.101564 --- ParallelTerminationStrategy: PID 6475 died...
06:41:41.156826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6475): Terminated: ok {rc=0}
06:41:41.166924 --- ParallelTerminationStrategy: PID 6478 died...
06:41:41.222203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6478): Terminated: ok {rc=0}
06:41:41.232297 --- ParallelTerminationStrategy: PID 6481 died...
06:41:41.287946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6481): Terminated: ok {rc=0}
06:41:41.375241 bus /sierra_2: Setting Powered False
4smpp00