Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3.mo_mt_call.py (from voice_sysmo+mod-bts0-ts-tchh+cfg-codec-hr3)

Failing for the past 85 builds (Since #751 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6c94286730>, timeout=10, timestep=1} [trial-835↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-835 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py
----------------------------------------------
22:47:18.996777 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
22:47:19.008205 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1)
22:47:19.162759 tst                    mo_mt_call.py: using LAC 9800
22:47:19.293232 tst                    mo_mt_call.py: using RAC 110
22:47:19.427416 tst                    mo_mt_call.py: using CellId 9800
22:47:19.555829 tst                    mo_mt_call.py: using BVCI 9796
22:47:19.581115 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
22:47:19.592614 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
22:47:19.603925 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
22:47:19.615363 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
22:47:19.626655 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
22:47:19.637980 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
22:47:19.740198 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
22:47:19.939047 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
22:47:20.472040 run         create_hlr_db(pid=14695): Launched
22:47:20.665381 bus                        /sierra_1: Setting Powered False
22:47:21.686218 run         create_hlr_db(pid=14695): Terminated: ok {rc=0}
22:47:22.130834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14697): Launched
22:47:22.464910 run   osmo-hlr_10.42.42.2(pid=14698): Launched
22:47:22.585923 run              osmo-stp_10.42.42.5: Starting osmo-stp
22:47:23.164539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14699): Launched
22:47:23.498507 run   osmo-stp_10.42.42.5(pid=14700): Launched
22:47:23.617635 run              osmo-msc_10.42.42.6: Starting osmo-msc
22:47:24.224739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14701): Launched
22:47:24.560587 run   osmo-msc_10.42.42.6(pid=14702): Launched
22:47:27.729255 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
22:47:28.273324 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14703): Launched
22:47:28.587581 run   osmo-mgw_10.42.42.3(pid=14704): Launched
22:47:28.699749 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
22:47:29.238916 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14705): Launched
22:47:29.558706 run   osmo-mgw_10.42.42.4(pid=14706): Launched
22:47:29.670778 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
22:47:30.331548 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14707): Launched
22:47:30.654462 run   osmo-bsc_10.42.42.7(pid=14708): Launched
22:47:36.923572 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
22:47:37.489758 run         rm-remote-dir(pid=14709): Launched
22:47:39.685647 run         rm-remote-dir(pid=14709): Terminated: ok {rc=0}
22:47:40.026235 run         mk-remote-dir(pid=14710): Launched
22:47:42.220180 run         mk-remote-dir(pid=14710): Terminated: ok {rc=0}
22:47:42.505983 run    scp-inst-to-remote(pid=14711): Launched
22:47:56.729660 run    scp-inst-to-remote(pid=14711): Terminated: ok {rc=0}
22:47:57.083767 run         mk-remote-dir(pid=14713): Launched
22:47:59.287235 run         mk-remote-dir(pid=14713): Terminated: ok {rc=0}
22:47:59.590480 run     scp-cfg-to-remote(pid=14714): Launched
22:48:01.794674 run     scp-cfg-to-remote(pid=14714): Terminated: ok {rc=0}
22:48:02.145479 run   reload-dsp-firmware(pid=14716): Launched
22:48:06.349473 run   reload-dsp-firmware(pid=14716): Terminated: ok {rc=0}
22:48:06.691514 run        osmo-bts-sysmo(pid=14717): Launched
22:48:11.946441 tst                    mo_mt_call.py: using MSISDN 6375
22:48:12.123178 bus                        /sierra_1: Setting Powered True
22:48:15.611064 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6375', subscriber_id=1}
22:48:15.761746 tst                    mo_mt_call.py: using MSISDN 6376
22:48:15.935619 bus                        /sierra_2: Setting Powered True
22:48:28.277955 tst                  mo_mt_call.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f6c94286730&gt;, timeout=10, timestep=1} [trial-835↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]  [trial-835↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8]
22:48:28.285398 tst                  mo_mt_call.py:8: Test FAILED (69.3 sec)
22:48:28.320728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14697): Terminating (SIGTERM)
22:48:28.360204 run   osmo-hlr_10.42.42.2(pid=14698): Terminating (SIGTERM)
22:48:28.401940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14699): Terminating (SIGTERM)
22:48:28.444747 run   osmo-stp_10.42.42.5(pid=14700): Terminating (SIGTERM)
22:48:28.487833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14701): Terminating (SIGTERM)
22:48:28.532641 run   osmo-msc_10.42.42.6(pid=14702): Terminating (SIGTERM)
22:48:28.575789 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14703): Terminating (SIGTERM)
22:48:28.618438 run   osmo-mgw_10.42.42.3(pid=14704): Terminating (SIGTERM)
22:48:28.674882 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14705): Terminating (SIGTERM)
22:48:28.715819 run   osmo-mgw_10.42.42.4(pid=14706): Terminating (SIGTERM)
22:48:28.756050 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14707): Terminating (SIGTERM)
22:48:28.795754 run   osmo-bsc_10.42.42.7(pid=14708): Terminating (SIGTERM)
22:48:28.835377 run        osmo-bts-sysmo(pid=14717): Terminating (SIGTERM)
22:48:28.844870 ---      ParallelTerminationStrategy: PID 14697 died...
22:48:28.900119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14697): Terminated: ok {rc=0}
22:48:28.910800 ---      ParallelTerminationStrategy: PID 14698 died...
22:48:28.966684 run   osmo-hlr_10.42.42.2(pid=14698): Terminated: ok {rc=0}
22:48:28.977404 ---      ParallelTerminationStrategy: PID 14699 died...
22:48:29.033126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14699): Terminated: ok {rc=0}
22:48:29.043070 ---      ParallelTerminationStrategy: PID 14700 died...
22:48:29.096284 run   osmo-stp_10.42.42.5(pid=14700): Terminated: ok {rc=0}
22:48:29.106289 ---      ParallelTerminationStrategy: PID 14701 died...
22:48:29.159233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14701): Terminated: ok {rc=0}
22:48:29.169249 ---      ParallelTerminationStrategy: PID 14702 died...
22:48:29.222645 run   osmo-msc_10.42.42.6(pid=14702): Terminated: ok {rc=0}
22:48:29.232658 ---      ParallelTerminationStrategy: PID 14703 died...
22:48:29.286224 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14703): Terminated: ok {rc=0}
22:48:29.296099 ---      ParallelTerminationStrategy: PID 14704 died...
22:48:29.349070 run   osmo-mgw_10.42.42.3(pid=14704): Terminated {rc=15}
22:48:29.362560 ---      ParallelTerminationStrategy: PID 14705 died...
22:48:29.416181 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14705): Terminated: ok {rc=0}
22:48:29.426166 ---      ParallelTerminationStrategy: PID 14706 died...
22:48:29.479114 run   osmo-mgw_10.42.42.4(pid=14706): Terminated {rc=15}
22:48:29.489138 ---      ParallelTerminationStrategy: PID 14707 died...
22:48:29.542582 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14707): Terminated: ok {rc=0}
22:48:29.552609 ---      ParallelTerminationStrategy: PID 14708 died...
22:48:29.606014 run   osmo-bsc_10.42.42.7(pid=14708): Terminated: ok {rc=0}
22:48:29.615868 ---      ParallelTerminationStrategy: PID 14717 died...
22:48:29.669282 run        osmo-bts-sysmo(pid=14717): Terminated: ok {rc=0}
22:48:29.771318 bus                        /sierra_2: Setting Online False
22:48:30.856807 bus                        /sierra_2: Setting Powered False
22:48:36.192542 bus                        /sierra_2: Setting Powered False
22:48:37.298080 bus                        /sierra_2: Setting Powered False
22:48:38.430248 bus                        /sierra_1: Setting Online False
22:48:39.514572 bus                        /sierra_1: Setting Powered False
22:48:44.969371 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call.py", line 8, in <module>
    test_mo_mt_call(False, False)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6c94286730>, timeout=10, timestep=1} [trial-835↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]