Failed
ttcn3_bts_tests:oc2g.ttcn3_bts_tests.py (from ttcn3_bts_tests_oc2g)
Failing for the past 2 builds
(Since Failed )
Stacktrace
osmo-mgw_10.42.42.3(pid=26023): Process ended prematurely: osmo-mgw_10.42.42.3(pid=26023) [trial-2741↪ttcn3_bts_tests:oc2g↪ttcn3_bts_tests.py:47↪ttcn3_bts_tests.py↪osmo-mgw_10.42.42.3↪osmo-mgw_10.42.42.3(pid=26023)]
Standard Output
---------------------------------------------- trial-2741 ttcn3_bts_tests:oc2g ttcn3_bts_tests.py ---------------------------------------------- 00:21:27.038315 tst ttcn3_bts_tests:oc2g: Using 1 x ip_address (candidates: 8) 00:21:27.051757 tst ttcn3_bts_tests:oc2g: Using 1 x ip_address (candidates: 8) 00:21:27.065089 tst ttcn3_bts_tests:oc2g: Using 1 x ip_address (candidates: 8) 00:21:27.078480 tst ttcn3_bts_tests:oc2g: Using 1 x ip_address (candidates: 8) 00:21:27.091807 tst ttcn3_bts_tests:oc2g: Using 1 x ip_address (candidates: 8) 00:21:27.105037 tst ttcn3_bts_tests:oc2g: Using 1 x ip_address (candidates: 8) 00:21:27.118337 tst ttcn3_bts_tests:oc2g: Using 1 x ip_address (candidates: 8) 00:21:27.131965 tst ttcn3_bts_tests:oc2g: Using 1 x bts (candidates: 1) 00:21:27.267083 tst ttcn3_bts_tests.py: using LAC 9757 00:21:27.398771 tst ttcn3_bts_tests.py: using RAC 67 00:21:27.530528 tst ttcn3_bts_tests.py: using CellId 9757 00:21:27.662704 tst ttcn3_bts_tests.py: using BVCI 2040 00:21:27.688159 tst ttcn3_bts_tests:oc2g: Using 1 x osmocon_phone (candidates: 1) 00:21:27.873568 tst ttcn3_bts_tests.py:35: Starting CNI 00:21:28.008657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 00:21:28.492857 run create_hlr_db(pid=26012): Launched 00:21:29.678697 run create_hlr_db(pid=26012): Terminated: ok {rc=0} 00:21:29.999019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26014): Launched 00:21:30.314317 run osmo-hlr_10.42.42.2(pid=26015): Launched 00:21:30.435127 run osmo-stp_10.42.42.4: Starting osmo-stp 00:21:30.974695 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26017): Launched 00:21:31.290888 run osmo-stp_10.42.42.4(pid=26018): Launched 00:21:31.400234 run osmo-msc_10.42.42.5: Starting osmo-msc 00:21:31.938971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26019): Launched 00:21:32.244970 run osmo-msc_10.42.42.5(pid=26020): Launched 00:21:32.357083 run osmo-mgw_10.42.42.3: Starting osmo-mgw 00:21:32.879901 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=26022): Launched 00:21:33.204980 run osmo-mgw_10.42.42.3(pid=26023): Launched 00:21:33.235263 tst ttcn3_bts_tests:oc2g: Using 1 x ip_address (candidates: 8) 00:21:33.336486 run osmo-bsc_10.42.42.8: Starting osmo-bsc 00:21:33.976226 run pcap-recorder_any(filters='host 10.42.42.8 or host 10.42.42.9 and port not 22')(pid=26025): Launched 00:21:34.297993 run osmo-bsc_10.42.42.8(pid=26026): Launched 00:21:34.406832 run osmo-bts-oc2g: Starting OsmoBtsOC2G to connect to osmo-bsc_10.42.42.8 00:21:35.343203 run rm-remote-dir(pid=26027): Launched 00:21:35.534989 run osmo-mgw_10.42.42.3(pid=26023): ERR: Terminated: ERROR {rc=255} [trial-2741↪ttcn3_bts_tests:oc2g↪ttcn3_bts_tests.py:47↪ttcn3_bts_tests.py↪osmo-mgw_10.42.42.3↪osmo-mgw_10.42.42.3(pid=26023)] 00:21:35.675138 run osmo-mgw_10.42.42.3(pid=26023): stdout: | (launched: 2020-11-07_00:21:33.050897) 00:21:35.815554 run osmo-mgw_10.42.42.3(pid=26023): stderr: | (launched: 2020-11-07_00:21:33.099968) | range must end at an odd port number, autocorrecting port (16000) to: 16001 | <0002> socket.c:912 unable to bind socket:10.42.42.3:4243: Address already in use | <0002> socket.c:923 no suitable addr found for: 10.42.42.3:4243 | <0002> telnet_interface.c:100 Cannot bind telnet at 10.42.42.3 4243 00:21:35.950559 run osmo-mgw_10.42.42.3(pid=26023): stdout: | (launched: 2020-11-07_00:21:33.050897) 00:21:36.084545 run osmo-mgw_10.42.42.3(pid=26023): stderr: | (launched: 2020-11-07_00:21:33.099968) | range must end at an odd port number, autocorrecting port (16000) to: 16001 | <0002> socket.c:912 unable to bind socket:10.42.42.3:4243: Address already in use | <0002> socket.c:923 no suitable addr found for: 10.42.42.3:4243 | <0002> telnet_interface.c:100 Cannot bind telnet at 10.42.42.3 4243 00:21:36.238245 run rm-remote-dir(pid=26027): Terminating (SIGINT) 00:21:36.417781 run rm-remote-dir(pid=26027): Terminated: ok {rc=0} 00:21:36.452083 tst ttcn3_bts_tests.py:47: ERR: Error: osmo-mgw_10.42.42.3(pid=26023): Process ended prematurely: osmo-mgw_10.42.42.3(pid=26023) [trial-2741↪ttcn3_bts_tests:oc2g↪ttcn3_bts_tests.py:47↪ttcn3_bts_tests.py↪osmo-mgw_10.42.42.3↪osmo-mgw_10.42.42.3(pid=26023)] [trial-2741↪ttcn3_bts_tests:oc2g↪ttcn3_bts_tests.py:47] 00:21:36.465454 tst ttcn3_bts_tests.py:47: Test FAILED (9.5 sec) 00:21:36.537727 run osmo-hlr_10.42.42.2(pid=26015): ERR: Terminated: ERROR {rc=255} [trial-2741↪ttcn3_bts_tests:oc2g↪ttcn3_bts_tests.py↪ttcn3_bts_tests.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26015)] 00:21:36.597038 run osmo-hlr_10.42.42.2(pid=26015): stdout: | (launched: 2020-11-07_00:21:30.155584) 00:21:36.657384 run osmo-hlr_10.42.42.2(pid=26015): stderr: | �[0;m�[1;31m20201107002130313 �[1;34mDDB�[0;m�[1;31m <0001> db.c:544 SQLite3 compiled with 'SECURE_DELETE' | �[0;m�[1;31m20201107002130313 �[1;34mDDB�[0;m�[1;31m <0001> db.c:544 SQLite3 compiled with 'SOUNDEX' | �[0;m�[1;31m20201107002130313 �[1;34mDDB�[0;m�[1;31m <0001> db.c:544 SQLite3 compiled with 'SYSTEM_MALLOC' | �[0;m�[1;31m20201107002130313 �[1;34mDDB�[0;m�[1;31m <0001> db.c:544 SQLite3 compiled with 'TEMP_STORE=1' | �[0;m�[1;31m20201107002130313 �[1;34mDDB�[0;m�[1;31m <0001> db.c:544 SQLite3 compiled with 'THREADSAFE=1' | �[0;m�[1;31m20201107002130313 �[1;34mDDB�[0;m�[1;31m <0001> db.c:561 Not setting SQL log callback: SQLite3 compiled without support for it | �[0;m�[1;31m20201107002130332 �[1;33mDDB�[0;m�[1;31m <0001> db.c:601 Database '/home/jenkins/workspace/osmo-gsm-tester_ttcn3/trial-2741/run.2020-11-07_00-20-43/ttcn3_bts_tests:oc2g/ttcn3_bts_tests.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 5 | �[0;m20201107002130339 �[1;31mDLGLOBAL�[0;m <0008> socket.c:912 unable to bind socket:10.42.42.2:4258: Address already in use | 20201107002130339 �[1;31mDLGLOBAL�[0;m <0008> socket.c:923 no suitable addr found for: 10.42.42.2:4258 | 20201107002130339 �[1;31mDLGLOBAL�[0;m <0008> telnet_interface.c:100 Cannot bind telnet at 10.42.42.2 4258 00:21:36.738638 run osmo-msc_10.42.42.5(pid=26020): ERR: Terminated: ERROR {rc=9} [trial-2741↪ttcn3_bts_tests:oc2g↪ttcn3_bts_tests.py↪ttcn3_bts_tests.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=26020)] 00:21:36.797520 run osmo-msc_10.42.42.5(pid=26020): stdout: | (launched: 2020-11-07_00:21:32.094939) 00:21:36.858443 run osmo-msc_10.42.42.5(pid=26020): stderr: | 20201107002132612 �[1;34mDLSS7�[0;m <001f> osmo_ss7.c:1493 XUA_ASP(asp0)[0x6120000081a0]{ASP_DOWN}: Terminating (cause = OSMO_FSM_TERM_REQUEST) | 20201107002132612 �[1;34mDLSS7�[0;m <001f> osmo_ss7.c:1493 XUA_ASP(asp0)[0x6120000081a0]{ASP_DOWN}: Freeing instance | 20201107002132612 �[1;34mDLSS7�[0;m <001f> fsm.c:573 XUA_ASP(asp0)[0x6120000081a0]{ASP_DOWN}: Deallocated | 20201107002132612 �[1;34mDLSS7�[0;m <001f> fsm.c:461 XUA_ASP(asp0)[0x612000012fa0]{ASP_DOWN}: Allocated | 20201107002132612 �[1;33mDLSCCP�[0;m <0020> sccp_user.c:631 OsmoMSC-A-Iu: Using ASP instance asp0 | 20201107002132612 �[1;33mDLSS7�[0;m <001f> osmo_ss7.c:440 0: Creating SCCP instance | 20201107002132612 �[1;34mDLSS7�[0;m <001f> osmo_ss7.c:464 registering user=SCCP for SI 3 with priv 0x612000012e20 | 20201107002132612 �[1;33mDLGLOBAL�[0;m <0013> socket.c:801 unable to bind socket: 0.0.0.0:29118: Address already in use | 20201107002132612 �[1;31mDSGS�[0;m <0011> sgs_server.c:182 SGs socket cannot be opened: Address already in use | Starting SGs server failed 00:21:36.910577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26014): Terminating (SIGTERM) 00:21:36.963968 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26017): Terminating (SIGTERM) 00:21:37.015651 run osmo-stp_10.42.42.4(pid=26018): Terminating (SIGTERM) 00:21:37.069020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26019): Terminating (SIGTERM) 00:21:37.123566 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=26022): Terminating (SIGTERM) 00:21:37.175343 run pcap-recorder_any(filters='host 10.42.42.8 or host 10.42.42.9 and port not 22')(pid=26025): Terminating (SIGTERM) 00:21:37.226886 run osmo-bsc_10.42.42.8(pid=26026): Terminating (SIGTERM) 00:21:37.238615 --- ParallelTerminationStrategy: PID 26014 died... 00:21:37.306755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26014): Terminated: ok {rc=0} 00:21:37.318821 --- ParallelTerminationStrategy: PID 26017 died... 00:21:37.386369 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=26017): Terminated: ok {rc=0} 00:21:37.398557 --- ParallelTerminationStrategy: PID 26018 died... 00:21:37.465911 run osmo-stp_10.42.42.4(pid=26018): Terminated: ok {rc=0} 00:21:37.478110 --- ParallelTerminationStrategy: PID 26019 died... 00:21:37.545707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26019): Terminated: ok {rc=0} 00:21:37.558248 --- ParallelTerminationStrategy: PID 26022 died... 00:21:37.626531 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=26022): Terminated: ok {rc=0} 00:21:37.638691 --- ParallelTerminationStrategy: PID 26025 died... 00:21:37.706798 run pcap-recorder_any(filters='host 10.42.42.8 or host 10.42.42.9 and port not 22')(pid=26025): Terminated: ok {rc=0} 00:21:40.402414 --- ParallelTerminationStrategy: PID 26026 died... 00:21:40.472247 run osmo-bsc_10.42.42.8(pid=26026): Terminated: ok {rc=0}
Standard Error
Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run self.path) File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 367, in run_python_file spec.loader.exec_module( importlib.util.module_from_spec(spec) ) File "<frozen importlib._bootstrap_external>", line 673, in exec_module File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/sysmocom/ttcn3/suites/ttcn3_bts_tests/ttcn3_bts_tests.py", line 47, in <module> bts.start(keepalive=True) File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_oc2g.py", line 119, in start rem_host.recreate_remote_dir(self.remote_inst) File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 141, in recreate_remote_dir self.rm_remote_dir(remote_dir) File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 134, in rm_remote_dir self.run_remote_sync('rm-remote-dir', ('test', '!', '-d', remote_dir_str, '||', 'rm', '-rf', remote_dir_str)) File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 129, in run_remote_sync proc.launch_sync() File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 204, in launch_sync raise e File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 201, in launch_sync self.wait() File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 367, in wait MainLoop.wait(self.terminated, timeout=timeout) File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep): File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise self.poll(may_block=True) File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 140, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-mgw_10.42.42.3(pid=26023): Process ended prematurely: osmo-mgw_10.42.42.3(pid=26023) [trial-2741↪ttcn3_bts_tests:oc2g↪ttcn3_bts_tests.py:47↪ttcn3_bts_tests.py↪osmo-mgw_10.42.42.3↪osmo-mgw_10.42.42.3(pid=26023)]