Skip to content

Failed

ttcn3_bts_tests:oc2g.ttcn3_bts_tests.py (from ttcn3_bts_tests_oc2g)

Failing for the past 3 builds (Since #2740 )
Took 10 sec.

Stacktrace

osmo-mgw_10.42.42.3(pid=10702): Process ended prematurely: osmo-mgw_10.42.42.3(pid=10702) [trial-2742↪ttcn3_bts_tests:oc2g↪ttcn3_bts_tests.py:47↪ttcn3_bts_tests.py↪osmo-mgw_10.42.42.3↪osmo-mgw_10.42.42.3(pid=10702)]

Standard Output

----------------------------------------------
trial-2742 ttcn3_bts_tests:oc2g ttcn3_bts_tests.py
----------------------------------------------
00:21:52.815014 tst             ttcn3_bts_tests:oc2g: Using 1 x ip_address (candidates: 8)
00:21:52.828699 tst             ttcn3_bts_tests:oc2g: Using 1 x ip_address (candidates: 8)
00:21:52.842840 tst             ttcn3_bts_tests:oc2g: Using 1 x ip_address (candidates: 8)
00:21:52.857016 tst             ttcn3_bts_tests:oc2g: Using 1 x ip_address (candidates: 8)
00:21:52.871098 tst             ttcn3_bts_tests:oc2g: Using 1 x ip_address (candidates: 8)
00:21:52.885014 tst             ttcn3_bts_tests:oc2g: Using 1 x ip_address (candidates: 8)
00:21:52.898982 tst             ttcn3_bts_tests:oc2g: Using 1 x ip_address (candidates: 8)
00:21:52.912908 tst             ttcn3_bts_tests:oc2g: Using 1 x bts (candidates: 1)
00:21:53.049893 tst               ttcn3_bts_tests.py: using LAC 9760
00:21:53.179422 tst               ttcn3_bts_tests.py: using RAC 70
00:21:53.308775 tst               ttcn3_bts_tests.py: using CellId 9760
00:21:53.437555 tst               ttcn3_bts_tests.py: using BVCI 2043
00:21:53.463524 tst             ttcn3_bts_tests:oc2g: Using 1 x osmocon_phone (candidates: 1)
00:21:53.653849 tst            ttcn3_bts_tests.py:35: Starting CNI
00:21:53.791252 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
00:21:54.293593 run         create_hlr_db(pid=10691): Launched
00:21:55.495508 run         create_hlr_db(pid=10691): Terminated: ok {rc=0}
00:21:55.834516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10693): Launched
00:21:56.156670 run   osmo-hlr_10.42.42.2(pid=10694): Launched
00:21:56.279449 run              osmo-stp_10.42.42.4: Starting osmo-stp
00:21:56.820494 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10696): Launched
00:21:57.136418 run   osmo-stp_10.42.42.4(pid=10697): Launched
00:21:57.247335 run              osmo-msc_10.42.42.5: Starting osmo-msc
00:21:57.795262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10698): Launched
00:21:58.115989 run   osmo-msc_10.42.42.5(pid=10699): Launched
00:21:58.242760 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
00:21:58.815186 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10701): Launched
00:21:59.147885 run   osmo-mgw_10.42.42.3(pid=10702): Launched
00:21:59.174658 tst             ttcn3_bts_tests:oc2g: Using 1 x ip_address (candidates: 8)
00:21:59.284595 run              osmo-bsc_10.42.42.8: Starting osmo-bsc
00:21:59.966184 run pcap-recorder_any(filters='host 10.42.42.8 or host 10.42.42.9 and port not 22')(pid=10704): Launched
00:22:00.292910 run   osmo-bsc_10.42.42.8(pid=10705): Launched
00:22:00.403450 run                    osmo-bts-oc2g: Starting OsmoBtsOC2G to connect to osmo-bsc_10.42.42.8
00:22:01.365253 run         rm-remote-dir(pid=10706): Launched
00:22:01.573535 run   osmo-mgw_10.42.42.3(pid=10702): ERR: Terminated: ERROR {rc=255}  [trial-2742↪ttcn3_bts_tests:oc2g↪ttcn3_bts_tests.py:47↪ttcn3_bts_tests.py↪osmo-mgw_10.42.42.3↪osmo-mgw_10.42.42.3(pid=10702)]
00:22:01.724400 run   osmo-mgw_10.42.42.3(pid=10702): stdout:
 | (launched: 2020-11-08_00:21:58.987680) 
00:22:01.875659 run   osmo-mgw_10.42.42.3(pid=10702): stderr:
 | (launched: 2020-11-08_00:21:59.036999)
| range must end at an odd port number, autocorrecting port (16000) to: 16001
| <0002> socket.c:912 unable to bind socket:10.42.42.3:4243: Address already in use
| <0002> socket.c:923 no suitable addr found for: 10.42.42.3:4243
| <0002> telnet_interface.c:100 Cannot bind telnet at 10.42.42.3 4243 
00:22:02.021675 run   osmo-mgw_10.42.42.3(pid=10702): stdout:
 | (launched: 2020-11-08_00:21:58.987680) 
00:22:02.165694 run   osmo-mgw_10.42.42.3(pid=10702): stderr:
 | (launched: 2020-11-08_00:21:59.036999)
| range must end at an odd port number, autocorrecting port (16000) to: 16001
| <0002> socket.c:912 unable to bind socket:10.42.42.3:4243: Address already in use
| <0002> socket.c:923 no suitable addr found for: 10.42.42.3:4243
| <0002> telnet_interface.c:100 Cannot bind telnet at 10.42.42.3 4243 
00:22:02.331682 run         rm-remote-dir(pid=10706): Terminating (SIGINT)
00:22:02.526524 run         rm-remote-dir(pid=10706): Terminated: ok {rc=0}
00:22:02.564066 tst            ttcn3_bts_tests.py:47: ERR: Error: osmo-mgw_10.42.42.3(pid=10702): Process ended prematurely: osmo-mgw_10.42.42.3(pid=10702) [trial-2742↪ttcn3_bts_tests:oc2g↪ttcn3_bts_tests.py:47↪ttcn3_bts_tests.py↪osmo-mgw_10.42.42.3↪osmo-mgw_10.42.42.3(pid=10702)]  [trial-2742↪ttcn3_bts_tests:oc2g↪ttcn3_bts_tests.py:47]
00:22:02.579015 tst            ttcn3_bts_tests.py:47: Test FAILED (9.8 sec)
00:22:02.656720 run   osmo-hlr_10.42.42.2(pid=10694): ERR: Terminated: ERROR {rc=255}  [trial-2742↪ttcn3_bts_tests:oc2g↪ttcn3_bts_tests.py↪ttcn3_bts_tests.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10694)]
00:22:02.719796 run   osmo-hlr_10.42.42.2(pid=10694): stdout:
 | (launched: 2020-11-08_00:21:55.994512) 
00:22:02.783790 run   osmo-hlr_10.42.42.2(pid=10694): stderr:
 | �[0;m�[1;31m20201108002156153 �[1;34mDDB�[0;m�[1;31m <0001> db.c:544 SQLite3 compiled with 'SECURE_DELETE'
| �[0;m�[1;31m20201108002156153 �[1;34mDDB�[0;m�[1;31m <0001> db.c:544 SQLite3 compiled with 'SOUNDEX'
| �[0;m�[1;31m20201108002156153 �[1;34mDDB�[0;m�[1;31m <0001> db.c:544 SQLite3 compiled with 'SYSTEM_MALLOC'
| �[0;m�[1;31m20201108002156153 �[1;34mDDB�[0;m�[1;31m <0001> db.c:544 SQLite3 compiled with 'TEMP_STORE=1'
| �[0;m�[1;31m20201108002156153 �[1;34mDDB�[0;m�[1;31m <0001> db.c:544 SQLite3 compiled with 'THREADSAFE=1'
| �[0;m�[1;31m20201108002156153 �[1;34mDDB�[0;m�[1;31m <0001> db.c:561 Not setting SQL log callback: SQLite3 compiled without support for it
| �[0;m�[1;31m20201108002156172 �[1;33mDDB�[0;m�[1;31m <0001> db.c:601 Database '/home/jenkins/workspace/osmo-gsm-tester_ttcn3/trial-2742/run.2020-11-08_00-21-08/ttcn3_bts_tests:oc2g/ttcn3_bts_tests.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 5
| �[0;m20201108002156178 �[1;31mDLGLOBAL�[0;m <0008> socket.c:912 unable to bind socket:10.42.42.2:4258: Address already in use
| 20201108002156179 �[1;31mDLGLOBAL�[0;m <0008> socket.c:923 no suitable addr found for: 10.42.42.2:4258
| 20201108002156179 �[1;31mDLGLOBAL�[0;m <0008> telnet_interface.c:100 Cannot bind telnet at 10.42.42.2 4258 
00:22:02.870555 run   osmo-msc_10.42.42.5(pid=10699): ERR: Terminated: ERROR {rc=9}  [trial-2742↪ttcn3_bts_tests:oc2g↪ttcn3_bts_tests.py↪ttcn3_bts_tests.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=10699)]
00:22:02.937803 run   osmo-msc_10.42.42.5(pid=10699): stdout:
 | (launched: 2020-11-08_00:21:57.954530) 
00:22:03.001884 run   osmo-msc_10.42.42.5(pid=10699): stderr:
 | 20201108002158464 �[1;34mDLSS7�[0;m <001f> osmo_ss7.c:1493 XUA_ASP(asp0)[0x6120000081a0]{ASP_DOWN}: Terminating (cause = OSMO_FSM_TERM_REQUEST)
| 20201108002158464 �[1;34mDLSS7�[0;m <001f> osmo_ss7.c:1493 XUA_ASP(asp0)[0x6120000081a0]{ASP_DOWN}: Freeing instance
| 20201108002158464 �[1;34mDLSS7�[0;m <001f> fsm.c:573 XUA_ASP(asp0)[0x6120000081a0]{ASP_DOWN}: Deallocated
| 20201108002158464 �[1;34mDLSS7�[0;m <001f> fsm.c:461 XUA_ASP(asp0)[0x612000012fa0]{ASP_DOWN}: Allocated
| 20201108002158464 �[1;33mDLSCCP�[0;m <0020> sccp_user.c:631 OsmoMSC-A-Iu: Using ASP instance asp0
| 20201108002158464 �[1;33mDLSS7�[0;m <001f> osmo_ss7.c:440 0: Creating SCCP instance
| 20201108002158464 �[1;34mDLSS7�[0;m <001f> osmo_ss7.c:464 registering user=SCCP for SI 3 with priv 0x612000012e20
| 20201108002158464 �[1;33mDLGLOBAL�[0;m <0013> socket.c:801 unable to bind socket: 0.0.0.0:29118: Address already in use
| 20201108002158465 �[1;31mDSGS�[0;m <0011> sgs_server.c:182 SGs socket cannot be opened: Address already in use
| Starting SGs server failed 
00:22:03.056335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10693): Terminating (SIGTERM)
00:22:03.108052 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10696): Terminating (SIGTERM)
00:22:03.159625 run   osmo-stp_10.42.42.4(pid=10697): Terminating (SIGTERM)
00:22:03.211951 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10698): Terminating (SIGTERM)
00:22:03.266223 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10701): Terminating (SIGTERM)
00:22:03.318373 run pcap-recorder_any(filters='host 10.42.42.8 or host 10.42.42.9 and port not 22')(pid=10704): Terminating (SIGTERM)
00:22:03.370044 run   osmo-bsc_10.42.42.8(pid=10705): Terminating (SIGTERM)
00:22:03.381922 ---      ParallelTerminationStrategy: PID 10693 died...
00:22:03.450822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10693): Terminated: ok {rc=0}
00:22:03.463919 ---      ParallelTerminationStrategy: PID 10696 died...
00:22:03.533045 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10696): Terminated: ok {rc=0}
00:22:03.545471 ---      ParallelTerminationStrategy: PID 10697 died...
00:22:03.614065 run   osmo-stp_10.42.42.4(pid=10697): Terminated: ok {rc=0}
00:22:03.626309 ---      ParallelTerminationStrategy: PID 10698 died...
00:22:03.695010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10698): Terminated: ok {rc=0}
00:22:03.707443 ---      ParallelTerminationStrategy: PID 10701 died...
00:22:03.775985 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10701): Terminated: ok {rc=0}
00:22:03.788421 ---      ParallelTerminationStrategy: PID 10704 died...
00:22:03.857304 run pcap-recorder_any(filters='host 10.42.42.8 or host 10.42.42.9 and port not 22')(pid=10704): Terminated: ok {rc=0}
00:22:06.552877 ---      ParallelTerminationStrategy: PID 10705 died...
00:22:06.623821 run   osmo-bsc_10.42.42.8(pid=10705): Terminated: ok {rc=0}

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 367, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 673, in exec_module
  File "<frozen importlib._bootstrap>", line 222, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/sysmocom/ttcn3/suites/ttcn3_bts_tests/ttcn3_bts_tests.py", line 47, in <module>
    bts.start(keepalive=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/obj/bts_oc2g.py", line 119, in start
    rem_host.recreate_remote_dir(self.remote_inst)
  File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 141, in recreate_remote_dir
    self.rm_remote_dir(remote_dir)
  File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 134, in rm_remote_dir
    self.run_remote_sync('rm-remote-dir', ('test', '!', '-d', remote_dir_str, '||', 'rm', '-rf', remote_dir_str))
  File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/remote.py", line 129, in run_remote_sync
    proc.launch_sync()
  File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 204, in launch_sync
    raise e
  File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 201, in launch_sync
    self.wait()
  File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/process.py", line 367, in wait
    MainLoop.wait(self.terminated, timeout=timeout)
  File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 108, in wait
    if not self.wait_no_raise(condition, condition_args, condition_kwargs, timeout, timestep):
  File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 98, in wait_no_raise
    self.poll(may_block=True)
  File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll
    self.deferred_handling.handle_queue()
  File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue
    handler(*args, **kwargs)
  File "/home/jenkins/workspace/osmo-gsm-tester_ttcn3/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 140, in poll
    raise log_module.Error('Process ended prematurely: %s' % proc.name())
osmo_gsm_tester.core.log.Error: osmo-mgw_10.42.42.3(pid=10702): Process ended prematurely: osmo-mgw_10.42.42.3(pid=10702) [trial-2742↪ttcn3_bts_tests:oc2g↪ttcn3_bts_tests.py:47↪ttcn3_bts_tests.py↪osmo-mgw_10.42.42.3↪osmo-mgw_10.42.42.3(pid=10702)]