Skip to content

Failed

voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any.mo_mt_call.py (from voice_sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any)

Failing for the past 90 builds (Since #751 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f447871d0d0>, timeout=10, timestep=1} [trial-840↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-840 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py
----------------------------------------------
05:47:06.980231 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
05:47:06.991445 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1)
05:47:07.139278 tst                    mo_mt_call.py: using LAC 10202
05:47:07.267260 tst                    mo_mt_call.py: using RAC 2
05:47:07.388008 tst                    mo_mt_call.py: using CellId 10202
05:47:07.510680 tst                    mo_mt_call.py: using BVCI 10198
05:47:07.534414 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
05:47:07.545643 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
05:47:07.557116 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
05:47:07.568595 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
05:47:07.579867 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
05:47:07.590979 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2)
05:47:07.696740 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2)
05:47:07.894543 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
05:47:08.421735 run         create_hlr_db(pid=27479): Launched
05:47:08.612600 bus                        /sierra_1: Setting Powered False
05:47:09.634128 run         create_hlr_db(pid=27479): Terminated: ok {rc=0}
05:47:10.075337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27481): Launched
05:47:10.406443 run   osmo-hlr_10.42.42.2(pid=27482): Launched
05:47:10.525767 run              osmo-stp_10.42.42.5: Starting osmo-stp
05:47:11.097978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27483): Launched
05:47:11.428042 run   osmo-stp_10.42.42.5(pid=27484): Launched
05:47:11.546244 run              osmo-msc_10.42.42.6: Starting osmo-msc
05:47:12.147964 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27485): Launched
05:47:12.478821 run   osmo-msc_10.42.42.6(pid=27486): Launched
05:47:15.654057 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
05:47:16.219923 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27488): Launched
05:47:16.532621 run   osmo-mgw_10.42.42.3(pid=27489): Launched
05:47:16.643052 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
05:47:17.176123 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27490): Launched
05:47:17.486521 run   osmo-mgw_10.42.42.4(pid=27491): Launched
05:47:17.597916 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
05:47:18.248030 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27492): Launched
05:47:18.559965 run   osmo-bsc_10.42.42.7(pid=27493): Launched
05:47:24.838922 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
05:47:25.427743 run         rm-remote-dir(pid=27494): Launched
05:47:27.623708 run         rm-remote-dir(pid=27494): Terminated: ok {rc=0}
05:47:27.957989 run         mk-remote-dir(pid=27495): Launched
05:47:30.151366 run         mk-remote-dir(pid=27495): Terminated: ok {rc=0}
05:47:30.438914 run    scp-inst-to-remote(pid=27496): Launched
05:47:44.661370 run    scp-inst-to-remote(pid=27496): Terminated: ok {rc=0}
05:47:45.009206 run         mk-remote-dir(pid=27498): Launched
05:47:47.208456 run         mk-remote-dir(pid=27498): Terminated: ok {rc=0}
05:47:47.506213 run     scp-cfg-to-remote(pid=27499): Launched
05:47:50.708773 run     scp-cfg-to-remote(pid=27499): Terminated: ok {rc=0}
05:47:51.052148 run   reload-dsp-firmware(pid=27501): Launched
05:47:54.251744 run   reload-dsp-firmware(pid=27501): Terminated: ok {rc=0}
05:47:54.586629 run        osmo-bts-sysmo(pid=27502): Launched
05:47:59.838304 tst                    mo_mt_call.py: using MSISDN 6644
05:48:00.011665 bus                        /sierra_1: Setting Powered True
05:48:03.501433 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6644', subscriber_id=1}
05:48:03.643924 tst                    mo_mt_call.py: using MSISDN 6645
05:48:03.816649 bus                        /sierra_2: Setting Powered True
05:48:16.173586 tst                  mo_mt_call.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f447871d0d0&gt;, timeout=10, timestep=1} [trial-840↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]  [trial-840↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8]
05:48:16.180766 tst                  mo_mt_call.py:8: Test FAILED (69.2 sec)
05:48:16.215099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27481): Terminating (SIGTERM)
05:48:16.254390 run   osmo-hlr_10.42.42.2(pid=27482): Terminating (SIGTERM)
05:48:16.294507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27483): Terminating (SIGTERM)
05:48:16.337518 run   osmo-stp_10.42.42.5(pid=27484): Terminating (SIGTERM)
05:48:16.380244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27485): Terminating (SIGTERM)
05:48:16.422283 run   osmo-msc_10.42.42.6(pid=27486): Terminating (SIGTERM)
05:48:16.464662 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27488): Terminating (SIGTERM)
05:48:16.505850 run   osmo-mgw_10.42.42.3(pid=27489): Terminating (SIGTERM)
05:48:16.546818 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27490): Terminating (SIGTERM)
05:48:16.587980 run   osmo-mgw_10.42.42.4(pid=27491): Terminating (SIGTERM)
05:48:16.629398 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27492): Terminating (SIGTERM)
05:48:16.668103 run   osmo-bsc_10.42.42.7(pid=27493): Terminating (SIGTERM)
05:48:16.707084 run        osmo-bts-sysmo(pid=27502): Terminating (SIGTERM)
05:48:16.716422 ---      ParallelTerminationStrategy: PID 27481 died...
05:48:16.768772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27481): Terminated: ok {rc=0}
05:48:16.779367 ---      ParallelTerminationStrategy: PID 27482 died...
05:48:16.833228 run   osmo-hlr_10.42.42.2(pid=27482): Terminated: ok {rc=0}
05:48:16.843567 ---      ParallelTerminationStrategy: PID 27483 died...
05:48:16.897463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27483): Terminated: ok {rc=0}
05:48:16.907768 ---      ParallelTerminationStrategy: PID 27484 died...
05:48:16.960704 run   osmo-stp_10.42.42.5(pid=27484): Terminated: ok {rc=0}
05:48:16.970346 ---      ParallelTerminationStrategy: PID 27485 died...
05:48:17.022562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27485): Terminated: ok {rc=0}
05:48:17.032381 ---      ParallelTerminationStrategy: PID 27486 died...
05:48:17.085756 run   osmo-msc_10.42.42.6(pid=27486): Terminated: ok {rc=0}
05:48:17.095485 ---      ParallelTerminationStrategy: PID 27488 died...
05:48:17.148008 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27488): Terminated: ok {rc=0}
05:48:17.158011 ---      ParallelTerminationStrategy: PID 27489 died...
05:48:17.211180 run   osmo-mgw_10.42.42.3(pid=27489): Terminated {rc=15}
05:48:17.220810 ---      ParallelTerminationStrategy: PID 27490 died...
05:48:17.273240 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27490): Terminated: ok {rc=0}
05:48:17.283092 ---      ParallelTerminationStrategy: PID 27491 died...
05:48:17.335580 run   osmo-mgw_10.42.42.4(pid=27491): Terminated {rc=15}
05:48:17.345296 ---      ParallelTerminationStrategy: PID 27492 died...
05:48:17.398440 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27492): Terminated: ok {rc=0}
05:48:17.408151 ---      ParallelTerminationStrategy: PID 27493 died...
05:48:17.461229 run   osmo-bsc_10.42.42.7(pid=27493): Terminated: ok {rc=0}
05:48:17.470943 ---      ParallelTerminationStrategy: PID 27502 died...
05:48:17.523527 run        osmo-bts-sysmo(pid=27502): Terminated: ok {rc=0}
05:48:17.630729 bus                        /sierra_2: Setting Online False
05:48:18.713970 bus                        /sierra_2: Setting Powered False
05:48:24.057845 bus                        /sierra_2: Setting Powered False
05:48:25.165606 bus                        /sierra_2: Setting Powered False
05:48:26.293454 bus                        /sierra_1: Setting Online False
05:48:27.381810 bus                        /sierra_1: Setting Powered False
05:48:32.958541 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call.py", line 8, in <module>
    test_mo_mt_call(False, False)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f447871d0d0>, timeout=10, timestep=1} [trial-840↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]