Skip to content

Failed

voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any)

Failing for the past 67 builds (Since #751 )
Took 1 min 7 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f28b441abf8>, timeout=10, timestep=1} [trial-817↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-817 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py
----------------------------------------------
01:29:53.134192 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
01:29:53.146608 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1)
01:29:53.299935 tst              mo_mt_call_osmux.py: using LAC 8363
01:29:53.424504 tst              mo_mt_call_osmux.py: using RAC 203
01:29:53.548994 tst              mo_mt_call_osmux.py: using CellId 8363
01:29:53.674066 tst              mo_mt_call_osmux.py: using BVCI 8359
01:29:53.698069 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
01:29:53.709293 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
01:29:53.720267 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
01:29:53.731471 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
01:29:53.742833 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
01:29:53.754530 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2)
01:29:53.861211 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2)
01:29:54.061659 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
01:29:54.600561 run         create_hlr_db(pid=31689): Launched
01:29:54.794469 bus                        /sierra_1: Setting Powered False
01:29:55.817243 run         create_hlr_db(pid=31689): Terminated: ok {rc=0}
01:29:56.242440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31691): Launched
01:29:56.561245 run   osmo-hlr_10.42.42.2(pid=31692): Launched
01:29:56.674687 run              osmo-stp_10.42.42.5: Starting osmo-stp
01:29:57.220737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31693): Launched
01:29:57.537411 run   osmo-stp_10.42.42.5(pid=31694): Launched
01:29:57.649005 run              osmo-msc_10.42.42.6: Starting osmo-msc
01:29:58.225455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31695): Launched
01:29:58.543254 run   osmo-msc_10.42.42.6(pid=31696): Launched
01:30:01.712110 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
01:30:02.258942 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31700): Launched
01:30:02.576478 run   osmo-mgw_10.42.42.3(pid=31701): Launched
01:30:02.688425 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
01:30:03.226501 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31702): Launched
01:30:03.545111 run   osmo-mgw_10.42.42.4(pid=31703): Launched
01:30:03.657546 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
01:30:04.323855 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31704): Launched
01:30:04.664871 run   osmo-bsc_10.42.42.7(pid=31705): Launched
01:30:10.950224 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
01:30:11.555989 run         rm-remote-dir(pid=31706): Launched
01:30:13.764730 run         rm-remote-dir(pid=31706): Terminated: ok {rc=0}
01:30:14.128368 run         mk-remote-dir(pid=31707): Launched
01:30:16.334875 run         mk-remote-dir(pid=31707): Terminated: ok {rc=0}
01:30:16.641050 run    scp-inst-to-remote(pid=31708): Launched
01:30:29.863104 run    scp-inst-to-remote(pid=31708): Terminated: ok {rc=0}
01:30:30.220998 run         mk-remote-dir(pid=31710): Launched
01:30:32.424978 run         mk-remote-dir(pid=31710): Terminated: ok {rc=0}
01:30:32.730516 run     scp-cfg-to-remote(pid=31711): Launched
01:30:34.935916 run     scp-cfg-to-remote(pid=31711): Terminated: ok {rc=0}
01:30:35.286813 run   reload-dsp-firmware(pid=31713): Launched
01:30:37.487472 run   reload-dsp-firmware(pid=31713): Terminated: ok {rc=0}
01:30:37.830931 run        osmo-bts-sysmo(pid=31714): Launched
01:30:43.087741 tst              mo_mt_call_osmux.py: using MSISDN 5427
01:30:43.264050 bus                        /sierra_1: Setting Powered True
01:30:46.752110 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5427', subscriber_id=1}
01:30:46.890846 tst              mo_mt_call_osmux.py: using MSISDN 5428
01:30:47.062035 bus                        /sierra_2: Setting Powered True
01:30:59.448123 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f28b441abf8&gt;, timeout=10, timestep=1} [trial-817↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-817↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8]
01:30:59.455292 tst            mo_mt_call_osmux.py:8: Test FAILED (66.4 sec)
01:30:59.489611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31691): Terminating (SIGTERM)
01:30:59.529125 run   osmo-hlr_10.42.42.2(pid=31692): Terminating (SIGTERM)
01:30:59.570233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31693): Terminating (SIGTERM)
01:30:59.613689 run   osmo-stp_10.42.42.5(pid=31694): Terminating (SIGTERM)
01:30:59.664159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31695): Terminating (SIGTERM)
01:30:59.704472 run   osmo-msc_10.42.42.6(pid=31696): Terminating (SIGTERM)
01:30:59.744415 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31700): Terminating (SIGTERM)
01:30:59.783577 run   osmo-mgw_10.42.42.3(pid=31701): Terminating (SIGTERM)
01:30:59.823477 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31702): Terminating (SIGTERM)
01:30:59.862864 run   osmo-mgw_10.42.42.4(pid=31703): Terminating (SIGTERM)
01:30:59.902637 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31704): Terminating (SIGTERM)
01:30:59.941786 run   osmo-bsc_10.42.42.7(pid=31705): Terminating (SIGTERM)
01:30:59.981109 run        osmo-bts-sysmo(pid=31714): Terminating (SIGTERM)
01:30:59.990636 ---      ParallelTerminationStrategy: PID 31691 died...
01:31:00.043775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31691): Terminated: ok {rc=0}
01:31:00.053555 ---      ParallelTerminationStrategy: PID 31692 died...
01:31:00.106405 run   osmo-hlr_10.42.42.2(pid=31692): Terminated: ok {rc=0}
01:31:00.116040 ---      ParallelTerminationStrategy: PID 31693 died...
01:31:00.169377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31693): Terminated: ok {rc=0}
01:31:00.179209 ---      ParallelTerminationStrategy: PID 31694 died...
01:31:00.232171 run   osmo-stp_10.42.42.5(pid=31694): Terminated: ok {rc=0}
01:31:00.241941 ---      ParallelTerminationStrategy: PID 31695 died...
01:31:00.294781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31695): Terminated: ok {rc=0}
01:31:00.304445 ---      ParallelTerminationStrategy: PID 31700 died...
01:31:00.357556 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31700): Terminated: ok {rc=0}
01:31:00.367580 ---      ParallelTerminationStrategy: PID 31701 died...
01:31:00.420959 run   osmo-mgw_10.42.42.3(pid=31701): Terminated {rc=15}
01:31:00.430894 ---      ParallelTerminationStrategy: PID 31702 died...
01:31:00.484723 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31702): Terminated: ok {rc=0}
01:31:00.494865 ---      ParallelTerminationStrategy: PID 31703 died...
01:31:00.548965 run   osmo-mgw_10.42.42.4(pid=31703): Terminated {rc=15}
01:31:00.559422 ---      ParallelTerminationStrategy: PID 31704 died...
01:31:00.612463 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31704): Terminated: ok {rc=0}
01:31:00.622270 ---      ParallelTerminationStrategy: PID 31705 died...
01:31:00.677709 run   osmo-bsc_10.42.42.7(pid=31705): Terminated: ok {rc=0}
01:31:00.687967 ---      ParallelTerminationStrategy: PID 31714 died...
01:31:00.742544 run        osmo-bts-sysmo(pid=31714): Terminated: ok {rc=0}
01:31:00.920792 ---      ParallelTerminationStrategy: PID 31696 died...
01:31:00.975397 run   osmo-msc_10.42.42.6(pid=31696): Terminated: ok {rc=0}
01:31:01.084194 bus                        /sierra_2: Setting Online False
01:31:02.168020 bus                        /sierra_2: Setting Powered False
01:31:07.965643 bus                        /sierra_2: Setting Powered False
01:31:09.072080 bus                        /sierra_2: Setting Powered False
01:31:10.199681 bus                        /sierra_1: Setting Online False
01:31:11.282994 bus                        /sierra_1: Setting Powered False
01:31:16.962247 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f28b441abf8>, timeout=10, timestep=1} [trial-817↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]