Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchf+cfg-codec-fr3)

Failing for the past 90 builds (Since #751 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f447871d1e0>, timeout=10, timestep=1} [trial-840↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-840 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py
----------------------------------------------
05:39:46.128492 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
05:39:46.140218 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1)
05:39:46.291560 tst              mo_mt_call_osmux.py: using LAC 10197
05:39:46.414480 tst              mo_mt_call_osmux.py: using RAC 252
05:39:46.541638 tst              mo_mt_call_osmux.py: using CellId 10197
05:39:46.671761 tst              mo_mt_call_osmux.py: using BVCI 10193
05:39:46.697451 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
05:39:46.709210 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
05:39:46.721598 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
05:39:46.734354 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
05:39:46.745531 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
05:39:46.756541 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
05:39:46.859863 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
05:39:47.049399 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
05:39:47.540300 run         create_hlr_db(pid=27309): Launched
05:39:47.719773 bus                        /sierra_1: Setting Powered False
05:39:48.741252 run         create_hlr_db(pid=27309): Terminated: ok {rc=0}
05:39:49.183862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27311): Launched
05:39:49.518480 run   osmo-hlr_10.42.42.2(pid=27312): Launched
05:39:49.638990 run              osmo-stp_10.42.42.5: Starting osmo-stp
05:39:50.213241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27313): Launched
05:39:50.546946 run   osmo-stp_10.42.42.5(pid=27314): Launched
05:39:50.664664 run              osmo-msc_10.42.42.6: Starting osmo-msc
05:39:51.267628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27315): Launched
05:39:51.599691 run   osmo-msc_10.42.42.6(pid=27316): Launched
05:39:54.776371 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
05:39:55.355447 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27317): Launched
05:39:55.687747 run   osmo-mgw_10.42.42.3(pid=27318): Launched
05:39:55.805819 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
05:39:56.371544 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27319): Launched
05:39:56.703773 run   osmo-mgw_10.42.42.4(pid=27320): Launched
05:39:56.822181 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
05:39:57.511822 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27321): Launched
05:39:57.844999 run   osmo-bsc_10.42.42.7(pid=27322): Launched
05:40:04.126889 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
05:40:04.724093 run         rm-remote-dir(pid=27327): Launched
05:40:06.929669 run         rm-remote-dir(pid=27327): Terminated: ok {rc=0}
05:40:07.285258 run         mk-remote-dir(pid=27328): Launched
05:40:09.488555 run         mk-remote-dir(pid=27328): Terminated: ok {rc=0}
05:40:09.787330 run    scp-inst-to-remote(pid=27329): Launched
05:40:24.008456 run    scp-inst-to-remote(pid=27329): Terminated: ok {rc=0}
05:40:24.357369 run         mk-remote-dir(pid=27331): Launched
05:40:26.559173 run         mk-remote-dir(pid=27331): Terminated: ok {rc=0}
05:40:26.858579 run     scp-cfg-to-remote(pid=27332): Launched
05:40:30.063219 run     scp-cfg-to-remote(pid=27332): Terminated: ok {rc=0}
05:40:30.407924 run   reload-dsp-firmware(pid=27334): Launched
05:40:33.606772 run   reload-dsp-firmware(pid=27334): Terminated: ok {rc=0}
05:40:33.943353 run        osmo-bts-sysmo(pid=27335): Launched
05:40:39.197730 tst              mo_mt_call_osmux.py: using MSISDN 6634
05:40:39.371418 bus                        /sierra_1: Setting Powered True
05:40:42.831937 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6634', subscriber_id=1}
05:40:42.966571 tst              mo_mt_call_osmux.py: using MSISDN 6635
05:40:43.137038 bus                        /sierra_2: Setting Powered True
05:40:55.509285 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f447871d1e0&gt;, timeout=10, timestep=1} [trial-840↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-840↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8]
05:40:55.516502 tst            mo_mt_call_osmux.py:8: Test FAILED (69.4 sec)
05:40:55.550731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27311): Terminating (SIGTERM)
05:40:55.590053 run   osmo-hlr_10.42.42.2(pid=27312): Terminating (SIGTERM)
05:40:55.629884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27313): Terminating (SIGTERM)
05:40:55.674020 run   osmo-stp_10.42.42.5(pid=27314): Terminating (SIGTERM)
05:40:55.717619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27315): Terminating (SIGTERM)
05:40:55.759541 run   osmo-msc_10.42.42.6(pid=27316): Terminating (SIGTERM)
05:40:55.806423 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27317): Terminating (SIGTERM)
05:40:55.848977 run   osmo-mgw_10.42.42.3(pid=27318): Terminating (SIGTERM)
05:40:55.905584 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27319): Terminating (SIGTERM)
05:40:55.947939 run   osmo-mgw_10.42.42.4(pid=27320): Terminating (SIGTERM)
05:40:55.988215 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27321): Terminating (SIGTERM)
05:40:56.028199 run   osmo-bsc_10.42.42.7(pid=27322): Terminating (SIGTERM)
05:40:56.067731 run        osmo-bts-sysmo(pid=27335): Terminating (SIGTERM)
05:40:56.076990 ---      ParallelTerminationStrategy: PID 27311 died...
05:40:56.132021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27311): Terminated: ok {rc=0}
05:40:56.143171 ---      ParallelTerminationStrategy: PID 27312 died...
05:40:56.198646 run   osmo-hlr_10.42.42.2(pid=27312): Terminated: ok {rc=0}
05:40:56.209655 ---      ParallelTerminationStrategy: PID 27313 died...
05:40:56.264283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27313): Terminated: ok {rc=0}
05:40:56.274126 ---      ParallelTerminationStrategy: PID 27314 died...
05:40:56.327478 run   osmo-stp_10.42.42.5(pid=27314): Terminated: ok {rc=0}
05:40:56.337240 ---      ParallelTerminationStrategy: PID 27315 died...
05:40:56.393879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27315): Terminated: ok {rc=0}
05:40:56.403446 ---      ParallelTerminationStrategy: PID 27316 died...
05:40:56.456320 run   osmo-msc_10.42.42.6(pid=27316): Terminated: ok {rc=0}
05:40:56.466307 ---      ParallelTerminationStrategy: PID 27317 died...
05:40:56.519228 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27317): Terminated: ok {rc=0}
05:40:56.529254 ---      ParallelTerminationStrategy: PID 27318 died...
05:40:56.582538 run   osmo-mgw_10.42.42.3(pid=27318): Terminated {rc=15}
05:40:56.592150 ---      ParallelTerminationStrategy: PID 27319 died...
05:40:56.645081 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27319): Terminated: ok {rc=0}
05:40:56.654848 ---      ParallelTerminationStrategy: PID 27320 died...
05:40:56.707671 run   osmo-mgw_10.42.42.4(pid=27320): Terminated {rc=15}
05:40:56.717777 ---      ParallelTerminationStrategy: PID 27321 died...
05:40:56.770675 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27321): Terminated: ok {rc=0}
05:40:56.780701 ---      ParallelTerminationStrategy: PID 27322 died...
05:40:56.833720 run   osmo-bsc_10.42.42.7(pid=27322): Terminated: ok {rc=0}
05:40:56.843490 ---      ParallelTerminationStrategy: PID 27335 died...
05:40:56.896287 run        osmo-bts-sysmo(pid=27335): Terminated: ok {rc=0}
05:40:57.004802 bus                        /sierra_2: Setting Online False
05:40:58.088324 bus                        /sierra_2: Setting Powered False
05:41:03.961609 bus                        /sierra_2: Setting Powered False
05:41:05.066295 bus                        /sierra_2: Setting Powered False
05:41:06.192378 bus                        /sierra_1: Setting Online False
05:41:07.274819 bus                        /sierra_1: Setting Powered False
05:41:12.967681 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f447871d1e0>, timeout=10, timestep=1} [trial-840↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]