Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchh+cfg-codec-hr3)

Failing for the past 64 builds (Since #751 )
Took 1 min 7 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f8282d411e0>, timeout=10, timestep=1} [trial-814↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-814 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py
----------------------------------------------
22:01:30.124299 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
22:01:30.136649 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1)
22:01:30.289431 tst              mo_mt_call_osmux.py: using LAC 8121
22:01:30.419841 tst              mo_mt_call_osmux.py: using RAC 216
22:01:30.552067 tst              mo_mt_call_osmux.py: using CellId 8121
22:01:30.678373 tst              mo_mt_call_osmux.py: using BVCI 8117
22:01:30.703367 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
22:01:30.715064 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
22:01:30.726631 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
22:01:30.738171 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
22:01:30.749754 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
22:01:30.761337 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
22:01:30.864868 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
22:01:31.051983 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
22:01:31.542102 run         create_hlr_db(pid=20529): Launched
22:01:31.720258 bus                        /sierra_1: Setting Powered False
22:01:32.741089 run         create_hlr_db(pid=20529): Terminated: ok {rc=0}
22:01:33.178671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20531): Launched
22:01:33.509058 run   osmo-hlr_10.42.42.2(pid=20532): Launched
22:01:33.628443 run              osmo-stp_10.42.42.5: Starting osmo-stp
22:01:34.199078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20533): Launched
22:01:34.531102 run   osmo-stp_10.42.42.5(pid=20534): Launched
22:01:34.648187 run              osmo-msc_10.42.42.6: Starting osmo-msc
22:01:35.256917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20535): Launched
22:01:35.590424 run   osmo-msc_10.42.42.6(pid=20536): Launched
22:01:38.766794 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
22:01:39.344284 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=20537): Launched
22:01:39.675865 run   osmo-mgw_10.42.42.3(pid=20538): Launched
22:01:39.793771 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
22:01:40.357991 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=20539): Launched
22:01:40.690092 run   osmo-mgw_10.42.42.4(pid=20540): Launched
22:01:40.808859 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
22:01:41.497369 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=20541): Launched
22:01:41.827984 run   osmo-bsc_10.42.42.7(pid=20542): Launched
22:01:48.109207 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
22:01:48.700368 run         rm-remote-dir(pid=20543): Launched
22:01:50.894629 run         rm-remote-dir(pid=20543): Terminated: ok {rc=0}
22:01:51.226969 run         mk-remote-dir(pid=20544): Launched
22:01:53.418206 run         mk-remote-dir(pid=20544): Terminated: ok {rc=0}
22:01:53.699144 run    scp-inst-to-remote(pid=20545): Launched
22:02:06.915895 run    scp-inst-to-remote(pid=20545): Terminated: ok {rc=0}
22:02:07.268439 run         mk-remote-dir(pid=20547): Launched
22:02:08.466578 run         mk-remote-dir(pid=20547): Terminated: ok {rc=0}
22:02:08.765855 run     scp-cfg-to-remote(pid=20548): Launched
22:02:10.967222 run     scp-cfg-to-remote(pid=20548): Terminated: ok {rc=0}
22:02:11.310105 run   reload-dsp-firmware(pid=20550): Launched
22:02:14.509291 run   reload-dsp-firmware(pid=20550): Terminated: ok {rc=0}
22:02:14.844676 run        osmo-bts-sysmo(pid=20553): Launched
22:02:20.095886 tst              mo_mt_call_osmux.py: using MSISDN 5264
22:02:20.277264 bus                        /sierra_1: Setting Powered True
22:02:23.737653 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5264', subscriber_id=1}
22:02:23.872247 tst              mo_mt_call_osmux.py: using MSISDN 5265
22:02:24.041488 bus                        /sierra_2: Setting Powered True
22:02:36.399589 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f8282d411e0&gt;, timeout=10, timestep=1} [trial-814↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-814↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8]
22:02:36.406880 tst            mo_mt_call_osmux.py:8: Test FAILED (66.3 sec)
22:02:36.440934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20531): Terminating (SIGTERM)
22:02:36.479967 run   osmo-hlr_10.42.42.2(pid=20532): Terminating (SIGTERM)
22:02:36.519531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20533): Terminating (SIGTERM)
22:02:36.563646 run   osmo-stp_10.42.42.5(pid=20534): Terminating (SIGTERM)
22:02:36.604532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20535): Terminating (SIGTERM)
22:02:36.645509 run   osmo-msc_10.42.42.6(pid=20536): Terminating (SIGTERM)
22:02:36.687063 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=20537): Terminating (SIGTERM)
22:02:36.730380 run   osmo-mgw_10.42.42.3(pid=20538): Terminating (SIGTERM)
22:02:36.772825 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=20539): Terminating (SIGTERM)
22:02:36.814250 run   osmo-mgw_10.42.42.4(pid=20540): Terminating (SIGTERM)
22:02:36.856410 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=20541): Terminating (SIGTERM)
22:02:36.895340 run   osmo-bsc_10.42.42.7(pid=20542): Terminating (SIGTERM)
22:02:36.936137 run        osmo-bts-sysmo(pid=20553): Terminating (SIGTERM)
22:02:36.946033 ---      ParallelTerminationStrategy: PID 20531 died...
22:02:37.004479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20531): Terminated: ok {rc=0}
22:02:37.015677 ---      ParallelTerminationStrategy: PID 20532 died...
22:02:37.082485 run   osmo-hlr_10.42.42.2(pid=20532): Terminated: ok {rc=0}
22:02:37.093021 ---      ParallelTerminationStrategy: PID 20533 died...
22:02:37.146510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20533): Terminated: ok {rc=0}
22:02:37.156196 ---      ParallelTerminationStrategy: PID 20534 died...
22:02:37.209235 run   osmo-stp_10.42.42.5(pid=20534): Terminated: ok {rc=0}
22:02:37.219070 ---      ParallelTerminationStrategy: PID 20535 died...
22:02:37.272400 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20535): Terminated: ok {rc=0}
22:02:37.282088 ---      ParallelTerminationStrategy: PID 20536 died...
22:02:37.335442 run   osmo-msc_10.42.42.6(pid=20536): Terminated: ok {rc=0}
22:02:37.345063 ---      ParallelTerminationStrategy: PID 20537 died...
22:02:37.401388 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=20537): Terminated: ok {rc=0}
22:02:37.411206 ---      ParallelTerminationStrategy: PID 20538 died...
22:02:37.464228 run   osmo-mgw_10.42.42.3(pid=20538): Terminated {rc=15}
22:02:37.474313 ---      ParallelTerminationStrategy: PID 20539 died...
22:02:37.527269 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=20539): Terminated: ok {rc=0}
22:02:37.536872 ---      ParallelTerminationStrategy: PID 20540 died...
22:02:37.589534 run   osmo-mgw_10.42.42.4(pid=20540): Terminated {rc=15}
22:02:37.599365 ---      ParallelTerminationStrategy: PID 20541 died...
22:02:37.652466 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=20541): Terminated: ok {rc=0}
22:02:37.662355 ---      ParallelTerminationStrategy: PID 20542 died...
22:02:37.715105 run   osmo-bsc_10.42.42.7(pid=20542): Terminated: ok {rc=0}
22:02:37.724752 ---      ParallelTerminationStrategy: PID 20553 died...
22:02:37.777533 run        osmo-bts-sysmo(pid=20553): Terminated: ok {rc=0}
22:02:37.885472 bus                        /sierra_2: Setting Online False
22:02:38.968692 bus                        /sierra_2: Setting Powered False
22:02:44.967054 bus                        /sierra_2: Setting Powered False
22:02:46.068396 bus                        /sierra_2: Setting Powered False
22:02:47.198772 bus                        /sierra_1: Setting Online False
22:02:48.281599 bus                        /sierra_1: Setting Powered False
22:02:53.961213 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f8282d411e0>, timeout=10, timestep=1} [trial-814↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]