Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchf+cfg-codec-fr3)

Failing for the past 95 builds (Since #751 )
Took 1 min 11 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f2a4cdf61e0>, timeout=10, timestep=1} [trial-845↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-845 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py
----------------------------------------------
10:42:08.126904 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
10:42:08.138940 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1)
10:42:08.290478 tst              mo_mt_call_osmux.py: using LAC 10597
10:42:08.417418 tst              mo_mt_call_osmux.py: using RAC 142
10:42:08.545032 tst              mo_mt_call_osmux.py: using CellId 10597
10:42:08.671106 tst              mo_mt_call_osmux.py: using BVCI 10593
10:42:08.695570 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
10:42:08.706851 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
10:42:08.717903 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
10:42:08.729073 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
10:42:08.740259 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
10:42:08.751690 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
10:42:08.855983 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
10:42:09.058431 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
10:42:09.602191 run          create_hlr_db(pid=5658): Launched
10:42:09.797868 bus                        /sierra_1: Setting Powered False
10:42:10.819880 run          create_hlr_db(pid=5658): Terminated: ok {rc=0}
10:42:11.248710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5660): Launched
10:42:11.570718 run    osmo-hlr_10.42.42.2(pid=5661): Launched
10:42:11.686029 run              osmo-stp_10.42.42.5: Starting osmo-stp
10:42:12.243428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5662): Launched
10:42:12.565230 run    osmo-stp_10.42.42.5(pid=5663): Launched
10:42:12.678266 run              osmo-msc_10.42.42.6: Starting osmo-msc
10:42:13.264725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5664): Launched
10:42:13.586555 run    osmo-msc_10.42.42.6(pid=5665): Launched
10:42:16.757451 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
10:42:17.316901 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5666): Launched
10:42:17.638631 run    osmo-mgw_10.42.42.3(pid=5667): Launched
10:42:17.751632 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
10:42:18.294950 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5668): Launched
10:42:18.617965 run    osmo-mgw_10.42.42.4(pid=5669): Launched
10:42:18.731539 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
10:42:19.399451 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5670): Launched
10:42:19.721979 run    osmo-bsc_10.42.42.7(pid=5671): Launched
10:42:25.993763 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
10:42:26.566746 run          rm-remote-dir(pid=5672): Launched
10:42:28.774769 run          rm-remote-dir(pid=5672): Terminated: ok {rc=0}
10:42:29.137655 run          mk-remote-dir(pid=5673): Launched
10:42:31.345769 run          mk-remote-dir(pid=5673): Terminated: ok {rc=0}
10:42:31.652218 run     scp-inst-to-remote(pid=5674): Launched
10:42:45.870125 run     scp-inst-to-remote(pid=5674): Terminated: ok {rc=0}
10:42:46.208280 run          mk-remote-dir(pid=5676): Launched
10:42:48.404753 run          mk-remote-dir(pid=5676): Terminated: ok {rc=0}
10:42:48.693375 run      scp-cfg-to-remote(pid=5677): Launched
10:42:51.891016 run      scp-cfg-to-remote(pid=5677): Terminated: ok {rc=0}
10:42:52.224142 run    reload-dsp-firmware(pid=5679): Launched
10:42:56.418619 run    reload-dsp-firmware(pid=5679): Terminated: ok {rc=0}
10:42:56.744001 run         osmo-bts-sysmo(pid=5680): Launched
10:43:01.996088 tst              mo_mt_call_osmux.py: using MSISDN 6899
10:43:02.173330 bus                        /sierra_1: Setting Powered True
10:43:05.669418 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6899', subscriber_id=1}
10:43:05.807341 tst              mo_mt_call_osmux.py: using MSISDN 6900
10:43:05.990794 bus                        /sierra_2: Setting Powered True
10:43:18.363550 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f2a4cdf61e0&gt;, timeout=10, timestep=1} [trial-845↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-845↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8]
10:43:18.371802 tst            mo_mt_call_osmux.py:8: Test FAILED (70.3 sec)
10:43:18.408770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5660): Terminating (SIGTERM)
10:43:18.451982 run    osmo-hlr_10.42.42.2(pid=5661): Terminating (SIGTERM)
10:43:18.496220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5662): Terminating (SIGTERM)
10:43:18.539961 run    osmo-stp_10.42.42.5(pid=5663): Terminating (SIGTERM)
10:43:18.605114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5664): Terminating (SIGTERM)
10:43:18.668542 run    osmo-msc_10.42.42.6(pid=5665): Terminating (SIGTERM)
10:43:18.711115 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5666): Terminating (SIGTERM)
10:43:18.753682 run    osmo-mgw_10.42.42.3(pid=5667): Terminating (SIGTERM)
10:43:18.797068 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5668): Terminating (SIGTERM)
10:43:18.839579 run    osmo-mgw_10.42.42.4(pid=5669): Terminating (SIGTERM)
10:43:18.882645 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5670): Terminating (SIGTERM)
10:43:18.925896 run    osmo-bsc_10.42.42.7(pid=5671): Terminating (SIGTERM)
10:43:18.969598 run         osmo-bts-sysmo(pid=5680): Terminating (SIGTERM)
10:43:18.979713 ---      ParallelTerminationStrategy: PID 5660 died...
10:43:19.038865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5660): Terminated: ok {rc=0}
10:43:19.049791 ---      ParallelTerminationStrategy: PID 5661 died...
10:43:19.107565 run    osmo-hlr_10.42.42.2(pid=5661): Terminated: ok {rc=0}
10:43:19.118349 ---      ParallelTerminationStrategy: PID 5662 died...
10:43:19.176051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5662): Terminated: ok {rc=0}
10:43:19.186877 ---      ParallelTerminationStrategy: PID 5663 died...
10:43:19.244072 run    osmo-stp_10.42.42.5(pid=5663): Terminated: ok {rc=0}
10:43:19.254473 ---      ParallelTerminationStrategy: PID 5664 died...
10:43:19.311366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5664): Terminated: ok {rc=0}
10:43:19.322054 ---      ParallelTerminationStrategy: PID 5666 died...
10:43:19.378914 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=5666): Terminated: ok {rc=0}
10:43:19.389343 ---      ParallelTerminationStrategy: PID 5667 died...
10:43:19.445817 run    osmo-mgw_10.42.42.3(pid=5667): Terminated {rc=15}
10:43:19.456126 ---      ParallelTerminationStrategy: PID 5668 died...
10:43:19.513046 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5668): Terminated: ok {rc=0}
10:43:19.523437 ---      ParallelTerminationStrategy: PID 5669 died...
10:43:19.580053 run    osmo-mgw_10.42.42.4(pid=5669): Terminated {rc=15}
10:43:19.590399 ---      ParallelTerminationStrategy: PID 5670 died...
10:43:19.648178 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=5670): Terminated: ok {rc=0}
10:43:19.659155 ---      ParallelTerminationStrategy: PID 5671 died...
10:43:19.716990 run    osmo-bsc_10.42.42.7(pid=5671): Terminated: ok {rc=0}
10:43:19.727780 ---      ParallelTerminationStrategy: PID 5680 died...
10:43:19.785883 run         osmo-bts-sysmo(pid=5680): Terminated: ok {rc=0}
10:43:19.964829 ---      ParallelTerminationStrategy: PID 5665 died...
10:43:20.023494 run    osmo-msc_10.42.42.6(pid=5665): Terminated: ok {rc=0}
10:43:20.132569 bus                        /sierra_2: Setting Online False
10:43:21.220219 bus                        /sierra_2: Setting Powered False
10:43:26.972945 bus                        /sierra_2: Setting Powered False
10:43:28.078044 bus                        /sierra_2: Setting Powered False
10:43:29.212275 bus                        /sierra_1: Setting Online False
10:43:30.299839 bus                        /sierra_1: Setting Powered False
10:43:35.966762 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f2a4cdf61e0>, timeout=10, timestep=1} [trial-845↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]