Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchf+cfg-codec-fr3)

Failing for the past 83 builds (Since #751 )
Took 1 min 9 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f5de48c9e18>, timeout=10, timestep=1} [trial-833↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-833 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py
----------------------------------------------
20:41:58.130793 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
20:41:58.142967 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1)
20:41:58.300485 tst              mo_mt_call_osmux.py: using LAC 9637
20:41:58.433601 tst              mo_mt_call_osmux.py: using RAC 202
20:41:58.566855 tst              mo_mt_call_osmux.py: using CellId 9637
20:41:58.698271 tst              mo_mt_call_osmux.py: using BVCI 9633
20:41:58.723882 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
20:41:58.735453 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
20:41:58.746900 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
20:41:58.758365 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
20:41:58.769734 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
20:41:58.781080 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
20:41:58.885438 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
20:41:59.086735 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
20:41:59.623124 run          create_hlr_db(pid=9763): Launched
20:41:59.816741 bus                        /sierra_1: Setting Powered False
20:42:00.838458 run          create_hlr_db(pid=9763): Terminated: ok {rc=0}
20:42:01.294110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9776): Launched
20:42:01.630880 run    osmo-hlr_10.42.42.2(pid=9777): Launched
20:42:01.752446 run              osmo-stp_10.42.42.5: Starting osmo-stp
20:42:02.334578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9778): Launched
20:42:02.669002 run    osmo-stp_10.42.42.5(pid=9779): Launched
20:42:02.788426 run              osmo-msc_10.42.42.6: Starting osmo-msc
20:42:03.401849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9780): Launched
20:42:03.740237 run    osmo-msc_10.42.42.6(pid=9781): Launched
20:42:06.919473 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
20:42:07.502727 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=9782): Launched
20:42:07.838184 run    osmo-mgw_10.42.42.3(pid=9783): Launched
20:42:07.958280 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
20:42:08.530777 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9784): Launched
20:42:08.867931 run    osmo-mgw_10.42.42.4(pid=9785): Launched
20:42:08.989026 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
20:42:09.687244 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=9786): Launched
20:42:10.025006 run    osmo-bsc_10.42.42.7(pid=9787): Launched
20:42:16.314770 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
20:42:16.913344 run          rm-remote-dir(pid=9788): Launched
20:42:19.119442 run          rm-remote-dir(pid=9788): Terminated: ok {rc=0}
20:42:19.478544 run          mk-remote-dir(pid=9789): Launched
20:42:21.683038 run          mk-remote-dir(pid=9789): Terminated: ok {rc=0}
20:42:21.985024 run     scp-inst-to-remote(pid=9790): Launched
20:42:35.195238 run     scp-inst-to-remote(pid=9790): Terminated: ok {rc=0}
20:42:35.526876 run          mk-remote-dir(pid=9792): Launched
20:42:38.718935 run          mk-remote-dir(pid=9792): Terminated: ok {rc=0}
20:42:39.002680 run      scp-cfg-to-remote(pid=9793): Launched
20:42:41.193536 run      scp-cfg-to-remote(pid=9793): Terminated: ok {rc=0}
20:42:41.521078 run    reload-dsp-firmware(pid=9795): Launched
20:42:44.712652 run    reload-dsp-firmware(pid=9795): Terminated: ok {rc=0}
20:42:45.032283 run         osmo-bts-sysmo(pid=9796): Launched
20:42:50.286513 tst              mo_mt_call_osmux.py: using MSISDN 6263
20:42:50.470669 bus                        /sierra_1: Setting Powered True
20:42:53.970668 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6263', subscriber_id=1}
20:42:54.107216 tst              mo_mt_call_osmux.py: using MSISDN 6264
20:42:54.278969 bus                        /sierra_2: Setting Powered True
20:43:06.648675 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f5de48c9e18&gt;, timeout=10, timestep=1} [trial-833↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-833↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8]
20:43:06.656018 tst            mo_mt_call_osmux.py:8: Test FAILED (68.6 sec)
20:43:06.690768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9776): Terminating (SIGTERM)
20:43:06.730765 run    osmo-hlr_10.42.42.2(pid=9777): Terminating (SIGTERM)
20:43:06.771546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9778): Terminating (SIGTERM)
20:43:06.814829 run    osmo-stp_10.42.42.5(pid=9779): Terminating (SIGTERM)
20:43:06.858104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9780): Terminating (SIGTERM)
20:43:06.902206 run    osmo-msc_10.42.42.6(pid=9781): Terminating (SIGTERM)
20:43:06.943604 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=9782): Terminating (SIGTERM)
20:43:06.988493 run    osmo-mgw_10.42.42.3(pid=9783): Terminating (SIGTERM)
20:43:07.045611 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9784): Terminating (SIGTERM)
20:43:07.087438 run    osmo-mgw_10.42.42.4(pid=9785): Terminating (SIGTERM)
20:43:07.128075 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=9786): Terminating (SIGTERM)
20:43:07.167997 run    osmo-bsc_10.42.42.7(pid=9787): Terminating (SIGTERM)
20:43:07.208029 run         osmo-bts-sysmo(pid=9796): Terminating (SIGTERM)
20:43:07.217342 ---      ParallelTerminationStrategy: PID 9776 died...
20:43:07.271519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9776): Terminated: ok {rc=0}
20:43:07.281815 ---      ParallelTerminationStrategy: PID 9777 died...
20:43:07.336542 run    osmo-hlr_10.42.42.2(pid=9777): Terminated: ok {rc=0}
20:43:07.346635 ---      ParallelTerminationStrategy: PID 9778 died...
20:43:07.401128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9778): Terminated: ok {rc=0}
20:43:07.411342 ---      ParallelTerminationStrategy: PID 9779 died...
20:43:07.464220 run    osmo-stp_10.42.42.5(pid=9779): Terminated: ok {rc=0}
20:43:07.474115 ---      ParallelTerminationStrategy: PID 9780 died...
20:43:07.527773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9780): Terminated: ok {rc=0}
20:43:07.537456 ---      ParallelTerminationStrategy: PID 9781 died...
20:43:07.590164 run    osmo-msc_10.42.42.6(pid=9781): Terminated: ok {rc=0}
20:43:07.599963 ---      ParallelTerminationStrategy: PID 9782 died...
20:43:07.652835 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=9782): Terminated: ok {rc=0}
20:43:07.662702 ---      ParallelTerminationStrategy: PID 9783 died...
20:43:07.715570 run    osmo-mgw_10.42.42.3(pid=9783): Terminated {rc=15}
20:43:07.725338 ---      ParallelTerminationStrategy: PID 9784 died...
20:43:07.778454 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=9784): Terminated: ok {rc=0}
20:43:07.788124 ---      ParallelTerminationStrategy: PID 9785 died...
20:43:07.840895 run    osmo-mgw_10.42.42.4(pid=9785): Terminated {rc=15}
20:43:07.850731 ---      ParallelTerminationStrategy: PID 9786 died...
20:43:07.903941 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=9786): Terminated: ok {rc=0}
20:43:07.914019 ---      ParallelTerminationStrategy: PID 9787 died...
20:43:07.966906 run    osmo-bsc_10.42.42.7(pid=9787): Terminated: ok {rc=0}
20:43:07.976814 ---      ParallelTerminationStrategy: PID 9796 died...
20:43:08.029836 run         osmo-bts-sysmo(pid=9796): Terminated: ok {rc=0}
20:43:08.138683 bus                        /sierra_2: Setting Online False
20:43:09.222171 bus                        /sierra_2: Setting Powered False
20:43:14.964496 bus                        /sierra_2: Setting Powered False
20:43:16.071049 bus                        /sierra_2: Setting Powered False
20:43:17.203118 bus                        /sierra_1: Setting Online False
20:43:18.287298 bus                        /sierra_1: Setting Powered False
20:43:23.961073 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f5de48c9e18>, timeout=10, timestep=1} [trial-833↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]