Skip to content

Failed

voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any)

Failing for the past 97 builds (Since #751 )
Took 1 min 11 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f5ab0535d90>, timeout=10, timestep=1} [trial-847↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-847 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py
----------------------------------------------
13:23:18.123812 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
13:23:18.135570 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1)
13:23:18.289280 tst              mo_mt_call_osmux.py: using LAC 10763
13:23:18.412131 tst              mo_mt_call_osmux.py: using RAC 53
13:23:18.537909 tst              mo_mt_call_osmux.py: using CellId 10763
13:23:18.664242 tst              mo_mt_call_osmux.py: using BVCI 10759
13:23:18.688504 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
13:23:18.699638 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
13:23:18.710616 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
13:23:18.721849 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
13:23:18.733058 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
13:23:18.744204 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2)
13:23:18.845559 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2)
13:23:19.040289 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
13:23:19.543255 run         create_hlr_db(pid=22715): Launched
13:23:19.726886 bus                        /sierra_1: Setting Powered False
13:23:20.747162 run         create_hlr_db(pid=22715): Terminated: ok {rc=0}
13:23:21.196626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22717): Launched
13:23:21.535803 run   osmo-hlr_10.42.42.2(pid=22718): Launched
13:23:21.657948 run              osmo-stp_10.42.42.5: Starting osmo-stp
13:23:22.239941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22719): Launched
13:23:22.577676 run   osmo-stp_10.42.42.5(pid=22720): Launched
13:23:22.697437 run              osmo-msc_10.42.42.6: Starting osmo-msc
13:23:23.311280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22721): Launched
13:23:23.650111 run   osmo-msc_10.42.42.6(pid=22722): Launched
13:23:26.829821 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
13:23:27.413855 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22723): Launched
13:23:27.752234 run   osmo-mgw_10.42.42.3(pid=22724): Launched
13:23:27.872195 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
13:23:28.446052 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22725): Launched
13:23:28.784358 run   osmo-mgw_10.42.42.4(pid=22726): Launched
13:23:28.906764 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
13:23:29.611471 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22727): Launched
13:23:29.950777 run   osmo-bsc_10.42.42.7(pid=22728): Launched
13:23:36.230815 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
13:23:36.803741 run         rm-remote-dir(pid=22729): Launched
13:23:39.000674 run         rm-remote-dir(pid=22729): Terminated: ok {rc=0}
13:23:39.343296 run         mk-remote-dir(pid=22730): Launched
13:23:41.539197 run         mk-remote-dir(pid=22730): Terminated: ok {rc=0}
13:23:41.827770 run    scp-inst-to-remote(pid=22731): Launched
13:23:56.041693 run    scp-inst-to-remote(pid=22731): Terminated: ok {rc=0}
13:23:56.377732 run         mk-remote-dir(pid=22733): Launched
13:23:59.572390 run         mk-remote-dir(pid=22733): Terminated: ok {rc=0}
13:23:59.861878 run     scp-cfg-to-remote(pid=22734): Launched
13:24:02.056430 run     scp-cfg-to-remote(pid=22734): Terminated: ok {rc=0}
13:24:02.391382 run   reload-dsp-firmware(pid=22736): Launched
13:24:06.585335 run   reload-dsp-firmware(pid=22736): Terminated: ok {rc=0}
13:24:06.908969 run        osmo-bts-sysmo(pid=22737): Launched
13:24:12.152693 tst              mo_mt_call_osmux.py: using MSISDN 7017
13:24:12.328053 bus                        /sierra_1: Setting Powered True
13:24:15.905488 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='7017', subscriber_id=1}
13:24:16.051634 tst              mo_mt_call_osmux.py: using MSISDN 7018
13:24:16.233444 bus                        /sierra_2: Setting Powered True
13:24:28.594647 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f5ab0535d90&gt;, timeout=10, timestep=1} [trial-847↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-847↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8]
13:24:28.602588 tst            mo_mt_call_osmux.py:8: Test FAILED (70.5 sec)
13:24:28.638264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22717): Terminating (SIGTERM)
13:24:28.679848 run   osmo-hlr_10.42.42.2(pid=22718): Terminating (SIGTERM)
13:24:28.727690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22719): Terminating (SIGTERM)
13:24:28.772905 run   osmo-stp_10.42.42.5(pid=22720): Terminating (SIGTERM)
13:24:28.837579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22721): Terminating (SIGTERM)
13:24:28.880815 run   osmo-msc_10.42.42.6(pid=22722): Terminating (SIGTERM)
13:24:28.926048 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22723): Terminating (SIGTERM)
13:24:28.969109 run   osmo-mgw_10.42.42.3(pid=22724): Terminating (SIGTERM)
13:24:29.011642 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22725): Terminating (SIGTERM)
13:24:29.054272 run   osmo-mgw_10.42.42.4(pid=22726): Terminating (SIGTERM)
13:24:29.097744 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22727): Terminating (SIGTERM)
13:24:29.140906 run   osmo-bsc_10.42.42.7(pid=22728): Terminating (SIGTERM)
13:24:29.184685 run        osmo-bts-sysmo(pid=22737): Terminating (SIGTERM)
13:24:29.196257 ---      ParallelTerminationStrategy: PID 22717 died...
13:24:29.253523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=22717): Terminated: ok {rc=0}
13:24:29.264080 ---      ParallelTerminationStrategy: PID 22718 died...
13:24:29.321582 run   osmo-hlr_10.42.42.2(pid=22718): Terminated: ok {rc=0}
13:24:29.332192 ---      ParallelTerminationStrategy: PID 22719 died...
13:24:29.388573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=22719): Terminated: ok {rc=0}
13:24:29.399425 ---      ParallelTerminationStrategy: PID 22720 died...
13:24:29.456181 run   osmo-stp_10.42.42.5(pid=22720): Terminated: ok {rc=0}
13:24:29.466434 ---      ParallelTerminationStrategy: PID 22721 died...
13:24:29.522963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=22721): Terminated: ok {rc=0}
13:24:29.533445 ---      ParallelTerminationStrategy: PID 22722 died...
13:24:29.588576 run   osmo-msc_10.42.42.6(pid=22722): Terminated: ok {rc=0}
13:24:29.598836 ---      ParallelTerminationStrategy: PID 22723 died...
13:24:29.654784 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=22723): Terminated: ok {rc=0}
13:24:29.665292 ---      ParallelTerminationStrategy: PID 22724 died...
13:24:29.720799 run   osmo-mgw_10.42.42.3(pid=22724): Terminated {rc=15}
13:24:29.731044 ---      ParallelTerminationStrategy: PID 22725 died...
13:24:29.786674 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=22725): Terminated: ok {rc=0}
13:24:29.796924 ---      ParallelTerminationStrategy: PID 22726 died...
13:24:29.852306 run   osmo-mgw_10.42.42.4(pid=22726): Terminated {rc=15}
13:24:29.862539 ---      ParallelTerminationStrategy: PID 22727 died...
13:24:29.918079 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=22727): Terminated: ok {rc=0}
13:24:29.928305 ---      ParallelTerminationStrategy: PID 22728 died...
13:24:29.983572 run   osmo-bsc_10.42.42.7(pid=22728): Terminated: ok {rc=0}
13:24:29.993920 ---      ParallelTerminationStrategy: PID 22737 died...
13:24:30.049236 run        osmo-bts-sysmo(pid=22737): Terminated: ok {rc=0}
13:24:30.154756 bus                        /sierra_2: Setting Online False
13:24:31.240253 bus                        /sierra_2: Setting Powered False
13:24:36.968243 bus                        /sierra_2: Setting Powered False
13:24:38.071009 bus                        /sierra_2: Setting Powered False
13:24:39.201945 bus                        /sierra_1: Setting Online False
13:24:40.285585 bus                        /sierra_1: Setting Powered False
13:24:45.964725 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f5ab0535d90>, timeout=10, timestep=1} [trial-847↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]