Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchf+cfg-codec-fr3)

Failing for the past 96 builds (Since #751 )
Took 1 min 11 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6092dc6730>, timeout=10, timestep=1} [trial-846↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-846 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py
----------------------------------------------
12:13:39.124821 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
12:13:39.137032 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1)
12:13:39.292603 tst              mo_mt_call_osmux.py: using LAC 10677
12:13:39.424730 tst              mo_mt_call_osmux.py: using RAC 222
12:13:39.559561 tst              mo_mt_call_osmux.py: using CellId 10677
12:13:39.690040 tst              mo_mt_call_osmux.py: using BVCI 10673
12:13:39.715475 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
12:13:39.726993 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
12:13:39.738393 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
12:13:39.749745 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
12:13:39.760937 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
12:13:39.772265 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
12:13:39.875516 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
12:13:40.071732 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
12:13:40.583717 run         create_hlr_db(pid=19100): Launched
12:13:40.776474 bus                        /sierra_1: Setting Powered False
12:13:41.797679 run         create_hlr_db(pid=19100): Terminated: ok {rc=0}
12:13:42.220282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19102): Launched
12:13:42.533586 run   osmo-hlr_10.42.42.2(pid=19103): Launched
12:13:42.645549 run              osmo-stp_10.42.42.5: Starting osmo-stp
12:13:43.188542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19104): Launched
12:13:43.504017 run   osmo-stp_10.42.42.5(pid=19105): Launched
12:13:43.615088 run              osmo-msc_10.42.42.6: Starting osmo-msc
12:13:44.187160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19106): Launched
12:13:44.500286 run   osmo-msc_10.42.42.6(pid=19108): Launched
12:13:47.667200 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
12:13:48.212539 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19109): Launched
12:13:48.526350 run   osmo-mgw_10.42.42.3(pid=19110): Launched
12:13:48.636958 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
12:13:49.172645 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19111): Launched
12:13:49.490825 run   osmo-mgw_10.42.42.4(pid=19112): Launched
12:13:49.601971 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
12:13:50.253683 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19113): Launched
12:13:50.567385 run   osmo-bsc_10.42.42.7(pid=19114): Launched
12:13:56.831699 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
12:13:57.388269 run         rm-remote-dir(pid=19115): Launched
12:13:59.581448 run         rm-remote-dir(pid=19115): Terminated: ok {rc=0}
12:13:59.917467 run         mk-remote-dir(pid=19116): Launched
12:14:02.112548 run         mk-remote-dir(pid=19116): Terminated: ok {rc=0}
12:14:02.395505 run    scp-inst-to-remote(pid=19117): Launched
12:14:16.618429 run    scp-inst-to-remote(pid=19117): Terminated: ok {rc=0}
12:14:16.970465 run         mk-remote-dir(pid=19119): Launched
12:14:20.172805 run         mk-remote-dir(pid=19119): Terminated: ok {rc=0}
12:14:20.474531 run     scp-cfg-to-remote(pid=19120): Launched
12:14:22.666672 run     scp-cfg-to-remote(pid=19120): Terminated: ok {rc=0}
12:14:22.992247 run   reload-dsp-firmware(pid=19141): Launched
12:14:27.183186 run   reload-dsp-firmware(pid=19141): Terminated: ok {rc=0}
12:14:27.499708 run        osmo-bts-sysmo(pid=19142): Launched
12:14:32.739386 tst              mo_mt_call_osmux.py: using MSISDN 6952
12:14:32.921916 bus                        /sierra_1: Setting Powered True
12:14:36.410133 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6952', subscriber_id=1}
12:14:36.553308 tst              mo_mt_call_osmux.py: using MSISDN 6953
12:14:36.735887 bus                        /sierra_2: Setting Powered True
12:14:49.087951 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f6092dc6730&gt;, timeout=10, timestep=1} [trial-846↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-846↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8]
12:14:49.096364 tst            mo_mt_call_osmux.py:8: Test FAILED (70.0 sec)
12:14:49.132305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19102): Terminating (SIGTERM)
12:14:49.174082 run   osmo-hlr_10.42.42.2(pid=19103): Terminating (SIGTERM)
12:14:49.218830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19104): Terminating (SIGTERM)
12:14:49.265542 run   osmo-stp_10.42.42.5(pid=19105): Terminating (SIGTERM)
12:14:49.328262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19106): Terminating (SIGTERM)
12:14:49.372528 run   osmo-msc_10.42.42.6(pid=19108): Terminating (SIGTERM)
12:14:49.423185 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19109): Terminating (SIGTERM)
12:14:49.468669 run   osmo-mgw_10.42.42.3(pid=19110): Terminating (SIGTERM)
12:14:49.512384 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19111): Terminating (SIGTERM)
12:14:49.556389 run   osmo-mgw_10.42.42.4(pid=19112): Terminating (SIGTERM)
12:14:49.612238 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19113): Terminating (SIGTERM)
12:14:49.654786 run   osmo-bsc_10.42.42.7(pid=19114): Terminating (SIGTERM)
12:14:49.696433 run        osmo-bts-sysmo(pid=19142): Terminating (SIGTERM)
12:14:49.706269 ---      ParallelTerminationStrategy: PID 19102 died...
12:14:49.762435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=19102): Terminated: ok {rc=0}
12:14:49.772547 ---      ParallelTerminationStrategy: PID 19103 died...
12:14:49.830977 run   osmo-hlr_10.42.42.2(pid=19103): Terminated: ok {rc=0}
12:14:49.842458 ---      ParallelTerminationStrategy: PID 19104 died...
12:14:49.899871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=19104): Terminated: ok {rc=0}
12:14:49.911016 ---      ParallelTerminationStrategy: PID 19105 died...
12:14:49.968471 run   osmo-stp_10.42.42.5(pid=19105): Terminated: ok {rc=0}
12:14:49.979447 ---      ParallelTerminationStrategy: PID 19106 died...
12:14:50.038038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=19106): Terminated: ok {rc=0}
12:14:50.048335 ---      ParallelTerminationStrategy: PID 19108 died...
12:14:50.104379 run   osmo-msc_10.42.42.6(pid=19108): Terminated: ok {rc=0}
12:14:50.114649 ---      ParallelTerminationStrategy: PID 19109 died...
12:14:50.170453 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=19109): Terminated: ok {rc=0}
12:14:50.180739 ---      ParallelTerminationStrategy: PID 19110 died...
12:14:50.236513 run   osmo-mgw_10.42.42.3(pid=19110): Terminated {rc=15}
12:14:50.246649 ---      ParallelTerminationStrategy: PID 19111 died...
12:14:50.307126 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=19111): Terminated: ok {rc=0}
12:14:50.317111 ---      ParallelTerminationStrategy: PID 19112 died...
12:14:50.372361 run   osmo-mgw_10.42.42.4(pid=19112): Terminated {rc=15}
12:14:50.382500 ---      ParallelTerminationStrategy: PID 19113 died...
12:14:50.437777 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=19113): Terminated: ok {rc=0}
12:14:50.447923 ---      ParallelTerminationStrategy: PID 19114 died...
12:14:50.503657 run   osmo-bsc_10.42.42.7(pid=19114): Terminated: ok {rc=0}
12:14:50.514072 ---      ParallelTerminationStrategy: PID 19142 died...
12:14:50.569431 run        osmo-bts-sysmo(pid=19142): Terminated: ok {rc=0}
12:14:50.676239 bus                        /sierra_2: Setting Online False
12:14:51.760085 bus                        /sierra_2: Setting Powered False
12:14:57.093121 bus                        /sierra_2: Setting Powered False
12:14:58.197186 bus                        /sierra_2: Setting Powered False
12:14:59.324812 bus                        /sierra_1: Setting Online False
12:15:00.411358 bus                        /sierra_1: Setting Powered False
12:15:05.969804 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6092dc6730>, timeout=10, timestep=1} [trial-846↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]