Skip to content

Failed

voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any)

Failing for the past 85 builds (Since #751 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6c941afa60>, timeout=10, timestep=1} [trial-835↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-835 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py
----------------------------------------------
22:51:42.130425 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
22:51:42.142837 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1)
22:51:42.299799 tst              mo_mt_call_osmux.py: using LAC 9803
22:51:42.425793 tst              mo_mt_call_osmux.py: using RAC 113
22:51:42.551244 tst              mo_mt_call_osmux.py: using CellId 9803
22:51:42.675731 tst              mo_mt_call_osmux.py: using BVCI 9799
22:51:42.699668 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
22:51:42.711040 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
22:51:42.722139 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
22:51:42.733370 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
22:51:42.744769 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
22:51:42.755983 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2)
22:51:42.862786 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2)
22:51:43.055796 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
22:51:43.552954 run         create_hlr_db(pid=14788): Launched
22:51:43.734399 bus                        /sierra_1: Setting Powered False
22:51:44.765991 run         create_hlr_db(pid=14788): Terminated: ok {rc=0}
22:51:45.190828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14790): Launched
22:51:45.510615 run   osmo-hlr_10.42.42.2(pid=14791): Launched
22:51:45.622686 run              osmo-stp_10.42.42.5: Starting osmo-stp
22:51:46.171081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14792): Launched
22:51:46.492021 run   osmo-stp_10.42.42.5(pid=14793): Launched
22:51:46.603851 run              osmo-msc_10.42.42.6: Starting osmo-msc
22:51:47.180745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14794): Launched
22:51:47.499627 run   osmo-msc_10.42.42.6(pid=14795): Launched
22:51:50.668580 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
22:51:51.218568 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14796): Launched
22:51:51.538203 run   osmo-mgw_10.42.42.3(pid=14797): Launched
22:51:51.650270 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
22:51:52.190851 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14798): Launched
22:51:52.514122 run   osmo-mgw_10.42.42.4(pid=14799): Launched
22:51:52.625762 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
22:51:53.288468 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14800): Launched
22:51:53.608139 run   osmo-bsc_10.42.42.7(pid=14801): Launched
22:51:59.893237 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
22:52:00.496356 run         rm-remote-dir(pid=14802): Launched
22:52:02.703691 run         rm-remote-dir(pid=14802): Terminated: ok {rc=0}
22:52:03.063252 run         mk-remote-dir(pid=14803): Launched
22:52:05.269097 run         mk-remote-dir(pid=14803): Terminated: ok {rc=0}
22:52:05.574796 run    scp-inst-to-remote(pid=14804): Launched
22:52:18.798568 run    scp-inst-to-remote(pid=14804): Terminated: ok {rc=0}
22:52:19.155236 run         mk-remote-dir(pid=14808): Launched
22:52:22.359893 run         mk-remote-dir(pid=14808): Terminated: ok {rc=0}
22:52:22.664884 run     scp-cfg-to-remote(pid=14809): Launched
22:52:24.867915 run     scp-cfg-to-remote(pid=14809): Terminated: ok {rc=0}
22:52:25.219059 run   reload-dsp-firmware(pid=14811): Launched
22:52:29.422784 run   reload-dsp-firmware(pid=14811): Terminated: ok {rc=0}
22:52:29.763188 run        osmo-bts-sysmo(pid=14812): Launched
22:52:35.014570 tst              mo_mt_call_osmux.py: using MSISDN 6381
22:52:35.198560 bus                        /sierra_1: Setting Powered True
22:52:38.671466 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6381', subscriber_id=1}
22:52:38.810056 tst              mo_mt_call_osmux.py: using MSISDN 6382
22:52:38.981711 bus                        /sierra_2: Setting Powered True
22:52:51.329279 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f6c941afa60&gt;, timeout=10, timestep=1} [trial-835↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-835↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8]
22:52:51.336503 tst            mo_mt_call_osmux.py:8: Test FAILED (69.2 sec)
22:52:51.371012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14790): Terminating (SIGTERM)
22:52:51.410609 run   osmo-hlr_10.42.42.2(pid=14791): Terminating (SIGTERM)
22:52:51.451312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14792): Terminating (SIGTERM)
22:52:51.493453 run   osmo-stp_10.42.42.5(pid=14793): Terminating (SIGTERM)
22:52:51.537023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14794): Terminating (SIGTERM)
22:52:51.579415 run   osmo-msc_10.42.42.6(pid=14795): Terminating (SIGTERM)
22:52:51.623992 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14796): Terminating (SIGTERM)
22:52:51.666532 run   osmo-mgw_10.42.42.3(pid=14797): Terminating (SIGTERM)
22:52:51.709127 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14798): Terminating (SIGTERM)
22:52:51.750858 run   osmo-mgw_10.42.42.4(pid=14799): Terminating (SIGTERM)
22:52:51.792902 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14800): Terminating (SIGTERM)
22:52:51.832276 run   osmo-bsc_10.42.42.7(pid=14801): Terminating (SIGTERM)
22:52:51.872402 run        osmo-bts-sysmo(pid=14812): Terminating (SIGTERM)
22:52:51.883088 ---      ParallelTerminationStrategy: PID 14790 died...
22:52:51.939283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14790): Terminated: ok {rc=0}
22:52:51.950147 ---      ParallelTerminationStrategy: PID 14791 died...
22:52:52.005568 run   osmo-hlr_10.42.42.2(pid=14791): Terminated: ok {rc=0}
22:52:52.020125 ---      ParallelTerminationStrategy: PID 14792 died...
22:52:52.073769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14792): Terminated: ok {rc=0}
22:52:52.083797 ---      ParallelTerminationStrategy: PID 14793 died...
22:52:52.137134 run   osmo-stp_10.42.42.5(pid=14793): Terminated: ok {rc=0}
22:52:52.147365 ---      ParallelTerminationStrategy: PID 14794 died...
22:52:52.200999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14794): Terminated: ok {rc=0}
22:52:52.210878 ---      ParallelTerminationStrategy: PID 14795 died...
22:52:52.264118 run   osmo-msc_10.42.42.6(pid=14795): Terminated: ok {rc=0}
22:52:52.274222 ---      ParallelTerminationStrategy: PID 14796 died...
22:52:52.327653 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14796): Terminated: ok {rc=0}
22:52:52.338174 ---      ParallelTerminationStrategy: PID 14797 died...
22:52:52.391921 run   osmo-mgw_10.42.42.3(pid=14797): Terminated {rc=15}
22:52:52.401900 ---      ParallelTerminationStrategy: PID 14798 died...
22:52:52.455726 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14798): Terminated: ok {rc=0}
22:52:52.466101 ---      ParallelTerminationStrategy: PID 14799 died...
22:52:52.519792 run   osmo-mgw_10.42.42.4(pid=14799): Terminated {rc=15}
22:52:52.530155 ---      ParallelTerminationStrategy: PID 14800 died...
22:52:52.583966 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14800): Terminated: ok {rc=0}
22:52:52.594035 ---      ParallelTerminationStrategy: PID 14801 died...
22:52:52.647597 run   osmo-bsc_10.42.42.7(pid=14801): Terminated: ok {rc=0}
22:52:52.658142 ---      ParallelTerminationStrategy: PID 14812 died...
22:52:52.712071 run        osmo-bts-sysmo(pid=14812): Terminated: ok {rc=0}
22:52:52.820522 bus                        /sierra_2: Setting Online False
22:52:53.904456 bus                        /sierra_2: Setting Powered False
22:52:59.959076 bus                        /sierra_2: Setting Powered False
22:53:01.064198 bus                        /sierra_2: Setting Powered False
22:53:02.192753 bus                        /sierra_1: Setting Online False
22:53:03.278530 bus                        /sierra_1: Setting Powered False
22:53:08.961368 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6c941afa60>, timeout=10, timestep=1} [trial-835↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]