Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchf+cfg-codec-fr2)

Failing for the past 50 builds (Since #751 )
Took 1 min 5 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f602cdc7d08>, timeout=10, timestep=1} [trial-800↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-800 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py
----------------------------------------------
05:36:52.131330 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6)
05:36:52.144447 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1)
05:36:52.295077 tst              mo_mt_call_osmux.py: using LAC 6995
05:36:52.420820 tst              mo_mt_call_osmux.py: using RAC 110
05:36:52.548899 tst              mo_mt_call_osmux.py: using CellId 6995
05:36:52.679066 tst              mo_mt_call_osmux.py: using BVCI 6991
05:36:52.705014 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6)
05:36:52.716704 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6)
05:36:52.728261 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6)
05:36:52.739798 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6)
05:36:52.751353 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6)
05:36:52.762825 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2)
05:36:52.865229 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2)
05:36:53.054887 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
05:36:53.553592 run         create_hlr_db(pid=13341): Launched
05:36:53.735424 bus                        /sierra_1: Setting Powered False
05:36:54.756593 run         create_hlr_db(pid=13341): Terminated: ok {rc=0}
05:36:55.203128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13343): Launched
05:36:55.540500 run   osmo-hlr_10.42.42.2(pid=13344): Launched
05:36:55.662700 run              osmo-stp_10.42.42.5: Starting osmo-stp
05:36:56.244992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13345): Launched
05:36:56.580192 run   osmo-stp_10.42.42.5(pid=13346): Launched
05:36:56.699123 run              osmo-msc_10.42.42.6: Starting osmo-msc
05:36:57.309414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13347): Launched
05:36:57.646752 run   osmo-msc_10.42.42.6(pid=13348): Launched
05:37:00.825432 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
05:37:01.408103 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13349): Launched
05:37:01.744160 run   osmo-mgw_10.42.42.3(pid=13350): Launched
05:37:01.863520 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
05:37:02.434910 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13351): Launched
05:37:02.768613 run   osmo-mgw_10.42.42.4(pid=13352): Launched
05:37:02.888143 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
05:37:03.584920 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13353): Launched
05:37:03.920829 run   osmo-bsc_10.42.42.7(pid=13354): Launched
05:37:10.188852 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
05:37:10.765355 run         rm-remote-dir(pid=13355): Launched
05:37:12.971852 run         rm-remote-dir(pid=13355): Terminated: ok {rc=0}
05:37:13.328842 run         mk-remote-dir(pid=13356): Launched
05:37:14.533612 run         mk-remote-dir(pid=13356): Terminated: ok {rc=0}
05:37:14.835767 run    scp-inst-to-remote(pid=13358): Launched
05:37:28.058588 run    scp-inst-to-remote(pid=13358): Terminated: ok {rc=0}
05:37:28.411394 run         mk-remote-dir(pid=13362): Launched
05:37:30.613772 run         mk-remote-dir(pid=13362): Terminated: ok {rc=0}
05:37:30.917768 run     scp-cfg-to-remote(pid=13363): Launched
05:37:32.119935 run     scp-cfg-to-remote(pid=13363): Terminated: ok {rc=0}
05:37:32.467282 run   reload-dsp-firmware(pid=13365): Launched
05:37:35.667419 run   reload-dsp-firmware(pid=13365): Terminated: ok {rc=0}
05:37:36.008678 run        osmo-bts-sysmo(pid=13366): Launched
05:37:40.252022 tst              mo_mt_call_osmux.py: using MSISDN 4510
05:37:40.426023 bus                        /sierra_1: Setting Powered True
05:37:43.894715 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4510', subscriber_id=1}
05:37:44.033749 tst              mo_mt_call_osmux.py: using MSISDN 4511
05:37:44.217440 bus                        /sierra_2: Setting Powered True
05:37:56.583318 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f602cdc7d08&gt;, timeout=10, timestep=1} [trial-800↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-800↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8]
05:37:56.590789 tst            mo_mt_call_osmux.py:8: Test FAILED (64.5 sec)
05:37:56.625429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13343): Terminating (SIGTERM)
05:37:56.665079 run   osmo-hlr_10.42.42.2(pid=13344): Terminating (SIGTERM)
05:37:56.705025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13345): Terminating (SIGTERM)
05:37:56.749050 run   osmo-stp_10.42.42.5(pid=13346): Terminating (SIGTERM)
05:37:56.792565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13347): Terminating (SIGTERM)
05:37:56.838034 run   osmo-msc_10.42.42.6(pid=13348): Terminating (SIGTERM)
05:37:56.884292 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13349): Terminating (SIGTERM)
05:37:56.926815 run   osmo-mgw_10.42.42.3(pid=13350): Terminating (SIGTERM)
05:37:56.969747 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13351): Terminating (SIGTERM)
05:37:57.012577 run   osmo-mgw_10.42.42.4(pid=13352): Terminating (SIGTERM)
05:37:57.057298 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13353): Terminating (SIGTERM)
05:37:57.099643 run   osmo-bsc_10.42.42.7(pid=13354): Terminating (SIGTERM)
05:37:57.141477 run        osmo-bts-sysmo(pid=13366): Terminating (SIGTERM)
05:37:57.151139 ---      ParallelTerminationStrategy: PID 13343 died...
05:37:57.208526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13343): Terminated: ok {rc=0}
05:37:57.218989 ---      ParallelTerminationStrategy: PID 13344 died...
05:37:57.276143 run   osmo-hlr_10.42.42.2(pid=13344): Terminated: ok {rc=0}
05:37:57.286836 ---      ParallelTerminationStrategy: PID 13345 died...
05:37:57.343393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13345): Terminated: ok {rc=0}
05:37:57.353891 ---      ParallelTerminationStrategy: PID 13346 died...
05:37:57.410845 run   osmo-stp_10.42.42.5(pid=13346): Terminated: ok {rc=0}
05:37:57.421006 ---      ParallelTerminationStrategy: PID 13347 died...
05:37:57.477307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13347): Terminated: ok {rc=0}
05:37:57.487626 ---      ParallelTerminationStrategy: PID 13348 died...
05:37:57.542745 run   osmo-msc_10.42.42.6(pid=13348): Terminated: ok {rc=0}
05:37:57.552873 ---      ParallelTerminationStrategy: PID 13349 died...
05:37:57.608315 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13349): Terminated: ok {rc=0}
05:37:57.618425 ---      ParallelTerminationStrategy: PID 13350 died...
05:37:57.673838 run   osmo-mgw_10.42.42.3(pid=13350): Terminated {rc=15}
05:37:57.684296 ---      ParallelTerminationStrategy: PID 13351 died...
05:37:57.739471 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13351): Terminated: ok {rc=0}
05:37:57.749521 ---      ParallelTerminationStrategy: PID 13352 died...
05:37:57.804537 run   osmo-mgw_10.42.42.4(pid=13352): Terminated {rc=15}
05:37:57.814564 ---      ParallelTerminationStrategy: PID 13353 died...
05:37:57.869873 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13353): Terminated: ok {rc=0}
05:37:57.879881 ---      ParallelTerminationStrategy: PID 13354 died...
05:37:57.935422 run   osmo-bsc_10.42.42.7(pid=13354): Terminated: ok {rc=0}
05:37:57.945647 ---      ParallelTerminationStrategy: PID 13366 died...
05:37:58.000957 run        osmo-bts-sysmo(pid=13366): Terminated: ok {rc=0}
05:37:58.106932 bus                        /sierra_2: Setting Online False
05:37:59.192147 bus                        /sierra_2: Setting Powered False
05:38:04.962829 bus                        /sierra_2: Setting Powered False
05:38:06.067937 bus                        /sierra_2: Setting Powered False
05:38:07.196016 bus                        /sierra_1: Setting Online False
05:38:08.282868 bus                        /sierra_1: Setting Powered False
05:38:13.969016 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f602cdc7d08>, timeout=10, timestep=1} [trial-800↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]