Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3.mo_mt_call.py (from voice_sysmo+mod-bts0-ts-tchh+cfg-codec-hr3)

Failing for the past 92 builds (Since #751 )
Took 1 min 11 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f1918ac1400>, timeout=10, timestep=1} [trial-842↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-842 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py
----------------------------------------------
07:44:48.996335 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:44:49.007877 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1)
07:44:49.162645 tst                    mo_mt_call.py: using LAC 10360
07:44:49.291910 tst                    mo_mt_call.py: using RAC 160
07:44:49.420508 tst                    mo_mt_call.py: using CellId 10360
07:44:49.550911 tst                    mo_mt_call.py: using BVCI 10356
07:44:49.576059 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:44:49.587592 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:44:49.599024 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:44:49.610392 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:44:49.621792 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
07:44:49.633139 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
07:44:49.736646 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
07:44:49.935410 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
07:44:50.457658 run         create_hlr_db(pid=31640): Launched
07:44:50.637461 bus                        /sierra_1: Setting Powered False
07:44:51.658766 run         create_hlr_db(pid=31640): Terminated: ok {rc=0}
07:44:52.077762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31642): Launched
07:44:52.392006 run   osmo-hlr_10.42.42.2(pid=31643): Launched
07:44:52.503756 run              osmo-stp_10.42.42.5: Starting osmo-stp
07:44:53.047184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31644): Launched
07:44:53.361064 run   osmo-stp_10.42.42.5(pid=31645): Launched
07:44:53.471605 run              osmo-msc_10.42.42.6: Starting osmo-msc
07:44:54.042151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31647): Launched
07:44:54.357967 run   osmo-msc_10.42.42.6(pid=31648): Launched
07:44:57.533757 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
07:44:58.114040 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31649): Launched
07:44:58.449272 run   osmo-mgw_10.42.42.3(pid=31650): Launched
07:44:58.568025 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
07:44:59.136860 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31651): Launched
07:44:59.472553 run   osmo-mgw_10.42.42.4(pid=31652): Launched
07:44:59.592150 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
07:45:00.287337 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31653): Launched
07:45:00.621641 run   osmo-bsc_10.42.42.7(pid=31654): Launched
07:45:06.896133 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
07:45:07.461075 run         rm-remote-dir(pid=31658): Launched
07:45:09.655763 run         rm-remote-dir(pid=31658): Terminated: ok {rc=0}
07:45:09.993536 run         mk-remote-dir(pid=31659): Launched
07:45:12.188202 run         mk-remote-dir(pid=31659): Terminated: ok {rc=0}
07:45:12.476777 run    scp-inst-to-remote(pid=31660): Launched
07:45:26.698466 run    scp-inst-to-remote(pid=31660): Terminated: ok {rc=0}
07:45:27.055592 run         mk-remote-dir(pid=31662): Launched
07:45:29.257095 run         mk-remote-dir(pid=31662): Terminated: ok {rc=0}
07:45:29.559209 run     scp-cfg-to-remote(pid=31664): Launched
07:45:32.764702 run     scp-cfg-to-remote(pid=31664): Terminated: ok {rc=0}
07:45:33.115431 run   reload-dsp-firmware(pid=31666): Launched
07:45:36.305379 run   reload-dsp-firmware(pid=31666): Terminated: ok {rc=0}
07:45:36.623229 run        osmo-bts-sysmo(pid=31667): Launched
07:45:42.875982 tst                    mo_mt_call.py: using MSISDN 6746
07:45:43.061234 bus                        /sierra_1: Setting Powered True
07:45:46.558097 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6746', subscriber_id=1}
07:45:46.696848 tst                    mo_mt_call.py: using MSISDN 6747
07:45:46.867678 bus                        /sierra_2: Setting Powered True
07:45:59.227726 tst                  mo_mt_call.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f1918ac1400&gt;, timeout=10, timestep=1} [trial-842↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]  [trial-842↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8]
07:45:59.236071 tst                  mo_mt_call.py:8: Test FAILED (70.3 sec)
07:45:59.271878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31642): Terminating (SIGTERM)
07:45:59.313569 run   osmo-hlr_10.42.42.2(pid=31643): Terminating (SIGTERM)
07:45:59.356556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31644): Terminating (SIGTERM)
07:45:59.399900 run   osmo-stp_10.42.42.5(pid=31645): Terminating (SIGTERM)
07:45:59.464813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31647): Terminating (SIGTERM)
07:45:59.524499 run   osmo-msc_10.42.42.6(pid=31648): Terminating (SIGTERM)
07:45:59.570304 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31649): Terminating (SIGTERM)
07:45:59.611598 run   osmo-mgw_10.42.42.3(pid=31650): Terminating (SIGTERM)
07:45:59.653560 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31651): Terminating (SIGTERM)
07:45:59.695043 run   osmo-mgw_10.42.42.4(pid=31652): Terminating (SIGTERM)
07:45:59.737908 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31653): Terminating (SIGTERM)
07:45:59.779498 run   osmo-bsc_10.42.42.7(pid=31654): Terminating (SIGTERM)
07:45:59.820996 run        osmo-bts-sysmo(pid=31667): Terminating (SIGTERM)
07:45:59.830830 ---      ParallelTerminationStrategy: PID 31642 died...
07:45:59.887878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31642): Terminated: ok {rc=0}
07:45:59.898479 ---      ParallelTerminationStrategy: PID 31643 died...
07:45:59.954910 run   osmo-hlr_10.42.42.2(pid=31643): Terminated: ok {rc=0}
07:45:59.965713 ---      ParallelTerminationStrategy: PID 31644 died...
07:46:00.022740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31644): Terminated: ok {rc=0}
07:46:00.033387 ---      ParallelTerminationStrategy: PID 31645 died...
07:46:00.090165 run   osmo-stp_10.42.42.5(pid=31645): Terminated: ok {rc=0}
07:46:00.100808 ---      ParallelTerminationStrategy: PID 31647 died...
07:46:00.157187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31647): Terminated: ok {rc=0}
07:46:00.167465 ---      ParallelTerminationStrategy: PID 31649 died...
07:46:00.223743 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31649): Terminated: ok {rc=0}
07:46:00.234162 ---      ParallelTerminationStrategy: PID 31650 died...
07:46:00.289464 run   osmo-mgw_10.42.42.3(pid=31650): Terminated {rc=15}
07:46:00.299595 ---      ParallelTerminationStrategy: PID 31651 died...
07:46:00.354811 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31651): Terminated: ok {rc=0}
07:46:00.364956 ---      ParallelTerminationStrategy: PID 31652 died...
07:46:00.420593 run   osmo-mgw_10.42.42.4(pid=31652): Terminated {rc=15}
07:46:00.431781 ---      ParallelTerminationStrategy: PID 31653 died...
07:46:00.489262 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31653): Terminated: ok {rc=0}
07:46:00.499914 ---      ParallelTerminationStrategy: PID 31654 died...
07:46:00.556131 run   osmo-bsc_10.42.42.7(pid=31654): Terminated: ok {rc=0}
07:46:00.566850 ---      ParallelTerminationStrategy: PID 31667 died...
07:46:00.623317 run        osmo-bts-sysmo(pid=31667): Terminated: ok {rc=0}
07:46:00.802216 ---      ParallelTerminationStrategy: PID 31648 died...
07:46:00.859643 run   osmo-msc_10.42.42.6(pid=31648): Terminated: ok {rc=0}
07:46:00.965440 bus                        /sierra_2: Setting Online False
07:46:02.051618 bus                        /sierra_2: Setting Powered False
07:46:07.963495 bus                        /sierra_2: Setting Powered False
07:46:09.069053 bus                        /sierra_2: Setting Powered False
07:46:10.196661 bus                        /sierra_1: Setting Online False
07:46:11.283555 bus                        /sierra_1: Setting Powered False
07:46:16.970854 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call.py", line 8, in <module>
    test_mo_mt_call(False, False)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f1918ac1400>, timeout=10, timestep=1} [trial-842↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]