Skip to content

Failed

voice:sysmo+mod-bts0-dynts-osmo.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-dynts-osmo)

Failing for the past 70 builds (Since #751 )
Took 1 min 8 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fb3401ea950>, timeout=10, timestep=1} [trial-820↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-820 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py
----------------------------------------------
05:51:16.129325 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
05:51:16.141645 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1)
05:51:16.299401 tst              mo_mt_call_osmux.py: using LAC 8605
05:51:16.430013 tst              mo_mt_call_osmux.py: using RAC 190
05:51:16.566634 tst              mo_mt_call_osmux.py: using CellId 8605
05:51:16.694930 tst              mo_mt_call_osmux.py: using BVCI 8601
05:51:16.720413 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
05:51:16.731904 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
05:51:16.743143 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
05:51:16.754385 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
05:51:16.765658 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
05:51:16.776876 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
05:51:16.878152 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
05:51:17.066910 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
05:51:17.562191 run          create_hlr_db(pid=7706): Launched
05:51:17.742012 bus                        /sierra_1: Setting Powered False
05:51:18.765869 run          create_hlr_db(pid=7706): Terminated: ok {rc=0}
05:51:19.211291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7708): Launched
05:51:19.552121 run    osmo-hlr_10.42.42.2(pid=7709): Launched
05:51:19.674287 run              osmo-stp_10.42.42.5: Starting osmo-stp
05:51:20.255622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7710): Launched
05:51:20.574012 run    osmo-stp_10.42.42.5(pid=7711): Launched
05:51:20.686946 run              osmo-msc_10.42.42.6: Starting osmo-msc
05:51:21.268845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7712): Launched
05:51:21.582710 run    osmo-msc_10.42.42.6(pid=7713): Launched
05:51:24.749597 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
05:51:25.294393 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=7714): Launched
05:51:25.633333 run    osmo-mgw_10.42.42.3(pid=7715): Launched
05:51:25.754187 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
05:51:26.322797 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7716): Launched
05:51:26.661307 run    osmo-mgw_10.42.42.4(pid=7717): Launched
05:51:26.781312 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
05:51:27.477328 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=7718): Launched
05:51:27.815004 run    osmo-bsc_10.42.42.7(pid=7719): Launched
05:51:34.099201 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
05:51:34.695834 run          rm-remote-dir(pid=7720): Launched
05:51:36.902493 run          rm-remote-dir(pid=7720): Terminated: ok {rc=0}
05:51:37.258536 run          mk-remote-dir(pid=7721): Launched
05:51:39.462668 run          mk-remote-dir(pid=7721): Terminated: ok {rc=0}
05:51:39.763659 run     scp-inst-to-remote(pid=7722): Launched
05:51:52.987215 run     scp-inst-to-remote(pid=7722): Terminated: ok {rc=0}
05:51:53.339004 run          mk-remote-dir(pid=7724): Launched
05:51:55.540101 run          mk-remote-dir(pid=7724): Terminated: ok {rc=0}
05:51:55.841608 run      scp-cfg-to-remote(pid=7725): Launched
05:51:58.044667 run      scp-cfg-to-remote(pid=7725): Terminated: ok {rc=0}
05:51:58.392863 run    reload-dsp-firmware(pid=7727): Launched
05:52:01.592095 run    reload-dsp-firmware(pid=7727): Terminated: ok {rc=0}
05:52:01.931856 run         osmo-bts-sysmo(pid=7728): Launched
05:52:07.174776 tst              mo_mt_call_osmux.py: using MSISDN 5590
05:52:07.358138 bus                        /sierra_1: Setting Powered True
05:52:10.845033 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5590', subscriber_id=1}
05:52:10.987492 tst              mo_mt_call_osmux.py: using MSISDN 5591
05:52:11.169476 bus                        /sierra_2: Setting Powered True
05:52:23.539451 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fb3401ea950&gt;, timeout=10, timestep=1} [trial-820↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-820↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8]
05:52:23.547578 tst            mo_mt_call_osmux.py:8: Test FAILED (67.5 sec)
05:52:23.583440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7708): Terminating (SIGTERM)
05:52:23.626094 run    osmo-hlr_10.42.42.2(pid=7709): Terminating (SIGTERM)
05:52:23.671587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7710): Terminating (SIGTERM)
05:52:23.716761 run    osmo-stp_10.42.42.5(pid=7711): Terminating (SIGTERM)
05:52:23.768873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7712): Terminating (SIGTERM)
05:52:23.825808 run    osmo-msc_10.42.42.6(pid=7713): Terminating (SIGTERM)
05:52:23.871744 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=7714): Terminating (SIGTERM)
05:52:23.916862 run    osmo-mgw_10.42.42.3(pid=7715): Terminating (SIGTERM)
05:52:23.971760 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7716): Terminating (SIGTERM)
05:52:24.014595 run    osmo-mgw_10.42.42.4(pid=7717): Terminating (SIGTERM)
05:52:24.060745 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=7718): Terminating (SIGTERM)
05:52:24.102723 run    osmo-bsc_10.42.42.7(pid=7719): Terminating (SIGTERM)
05:52:24.144417 run         osmo-bts-sysmo(pid=7728): Terminating (SIGTERM)
05:52:24.153969 ---      ParallelTerminationStrategy: PID 7708 died...
05:52:24.210710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7708): Terminated: ok {rc=0}
05:52:24.220660 ---      ParallelTerminationStrategy: PID 7709 died...
05:52:24.276039 run    osmo-hlr_10.42.42.2(pid=7709): Terminated: ok {rc=0}
05:52:24.286023 ---      ParallelTerminationStrategy: PID 7710 died...
05:52:24.341381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7710): Terminated: ok {rc=0}
05:52:24.351273 ---      ParallelTerminationStrategy: PID 7711 died...
05:52:24.406354 run    osmo-stp_10.42.42.5(pid=7711): Terminated: ok {rc=0}
05:52:24.416405 ---      ParallelTerminationStrategy: PID 7712 died...
05:52:24.472155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7712): Terminated: ok {rc=0}
05:52:24.482143 ---      ParallelTerminationStrategy: PID 7713 died...
05:52:24.537503 run    osmo-msc_10.42.42.6(pid=7713): Terminated: ok {rc=0}
05:52:24.547448 ---      ParallelTerminationStrategy: PID 7714 died...
05:52:24.602968 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=7714): Terminated: ok {rc=0}
05:52:24.613492 ---      ParallelTerminationStrategy: PID 7715 died...
05:52:24.670280 run    osmo-mgw_10.42.42.3(pid=7715): Terminated {rc=15}
05:52:24.680790 ---      ParallelTerminationStrategy: PID 7716 died...
05:52:24.737773 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=7716): Terminated: ok {rc=0}
05:52:24.748231 ---      ParallelTerminationStrategy: PID 7717 died...
05:52:24.805353 run    osmo-mgw_10.42.42.4(pid=7717): Terminated {rc=15}
05:52:24.815970 ---      ParallelTerminationStrategy: PID 7718 died...
05:52:24.872510 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=7718): Terminated: ok {rc=0}
05:52:24.882592 ---      ParallelTerminationStrategy: PID 7719 died...
05:52:24.938134 run    osmo-bsc_10.42.42.7(pid=7719): Terminated: ok {rc=0}
05:52:24.948127 ---      ParallelTerminationStrategy: PID 7728 died...
05:52:25.003684 run         osmo-bts-sysmo(pid=7728): Terminated: ok {rc=0}
05:52:25.111485 bus                        /sierra_2: Setting Online False
05:52:26.195454 bus                        /sierra_2: Setting Powered False
05:52:31.972685 bus                        /sierra_2: Setting Powered False
05:52:33.075814 bus                        /sierra_2: Setting Powered False
05:52:34.208945 bus                        /sierra_1: Setting Online False
05:52:35.294189 bus                        /sierra_1: Setting Powered False
05:52:40.969215 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fb3401ea950>, timeout=10, timestep=1} [trial-820↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]