Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchf+cfg-codec-fr3)

Failing for the past 82 builds (Since #751 )
Took 1 min 9 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f11a4baea60>, timeout=10, timestep=1} [trial-832↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-832 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py
----------------------------------------------
19:41:55.130087 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
19:41:55.141935 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1)
19:41:55.296188 tst              mo_mt_call_osmux.py: using LAC 9557
19:41:55.420782 tst              mo_mt_call_osmux.py: using RAC 122
19:41:55.547056 tst              mo_mt_call_osmux.py: using CellId 9557
19:41:55.671504 tst              mo_mt_call_osmux.py: using BVCI 9553
19:41:55.696153 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
19:41:55.707507 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
19:41:55.718520 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
19:41:55.729697 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
19:41:55.740831 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
19:41:55.751998 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
19:41:55.857369 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
19:41:56.051694 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
19:41:56.559039 run          create_hlr_db(pid=7986): Launched
19:41:56.745066 bus                        /sierra_1: Setting Powered False
19:41:57.765562 run          create_hlr_db(pid=7986): Terminated: ok {rc=0}
19:41:58.194972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7988): Launched
19:41:58.518077 run    osmo-hlr_10.42.42.2(pid=7989): Launched
19:41:58.634116 run              osmo-stp_10.42.42.5: Starting osmo-stp
19:41:59.190226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7990): Launched
19:41:59.514942 run    osmo-stp_10.42.42.5(pid=7991): Launched
19:41:59.629862 run              osmo-msc_10.42.42.6: Starting osmo-msc
19:42:00.215685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7992): Launched
19:42:00.543525 run    osmo-msc_10.42.42.6(pid=7993): Launched
19:42:03.724067 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
19:42:04.314331 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=8002): Launched
19:42:04.654786 run    osmo-mgw_10.42.42.3(pid=8003): Launched
19:42:04.775484 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
19:42:05.355543 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8004): Launched
19:42:05.697005 run    osmo-mgw_10.42.42.4(pid=8005): Launched
19:42:05.818829 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
19:42:06.523490 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=8006): Launched
19:42:06.865717 run    osmo-bsc_10.42.42.7(pid=8007): Launched
19:42:13.152906 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
19:42:13.764627 run          rm-remote-dir(pid=8008): Launched
19:42:15.975720 run          rm-remote-dir(pid=8008): Terminated: ok {rc=0}
19:42:16.327938 run          mk-remote-dir(pid=8009): Launched
19:42:18.526023 run          mk-remote-dir(pid=8009): Terminated: ok {rc=0}
19:42:18.817461 run     scp-inst-to-remote(pid=8010): Launched
19:42:32.031527 run     scp-inst-to-remote(pid=8010): Terminated: ok {rc=0}
19:42:32.376194 run          mk-remote-dir(pid=8012): Launched
19:42:35.573657 run          mk-remote-dir(pid=8012): Terminated: ok {rc=0}
19:42:35.865141 run      scp-cfg-to-remote(pid=8013): Launched
19:42:38.062617 run      scp-cfg-to-remote(pid=8013): Terminated: ok {rc=0}
19:42:38.395771 run    reload-dsp-firmware(pid=8015): Launched
19:42:41.590268 run    reload-dsp-firmware(pid=8015): Terminated: ok {rc=0}
19:42:41.915414 run         osmo-bts-sysmo(pid=8016): Launched
19:42:47.162714 tst              mo_mt_call_osmux.py: using MSISDN 6210
19:42:47.350169 bus                        /sierra_1: Setting Powered True
19:42:50.852090 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6210', subscriber_id=1}
19:42:50.994997 tst              mo_mt_call_osmux.py: using MSISDN 6211
19:42:51.169739 bus                        /sierra_2: Setting Powered True
19:43:03.532461 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f11a4baea60&gt;, timeout=10, timestep=1} [trial-832↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-832↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8]
19:43:03.539743 tst            mo_mt_call_osmux.py:8: Test FAILED (68.4 sec)
19:43:03.574172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7988): Terminating (SIGTERM)
19:43:03.613616 run    osmo-hlr_10.42.42.2(pid=7989): Terminating (SIGTERM)
19:43:03.654405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7990): Terminating (SIGTERM)
19:43:03.695658 run    osmo-stp_10.42.42.5(pid=7991): Terminating (SIGTERM)
19:43:03.738596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7992): Terminating (SIGTERM)
19:43:03.782121 run    osmo-msc_10.42.42.6(pid=7993): Terminating (SIGTERM)
19:43:03.829802 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=8002): Terminating (SIGTERM)
19:43:03.872730 run    osmo-mgw_10.42.42.3(pid=8003): Terminating (SIGTERM)
19:43:03.929680 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8004): Terminating (SIGTERM)
19:43:03.971156 run    osmo-mgw_10.42.42.4(pid=8005): Terminating (SIGTERM)
19:43:04.011210 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=8006): Terminating (SIGTERM)
19:43:04.050733 run    osmo-bsc_10.42.42.7(pid=8007): Terminating (SIGTERM)
19:43:04.090132 run         osmo-bts-sysmo(pid=8016): Terminating (SIGTERM)
19:43:04.099485 ---      ParallelTerminationStrategy: PID 7988 died...
19:43:04.154359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=7988): Terminated: ok {rc=0}
19:43:04.164433 ---      ParallelTerminationStrategy: PID 7989 died...
19:43:04.218647 run    osmo-hlr_10.42.42.2(pid=7989): Terminated: ok {rc=0}
19:43:04.229119 ---      ParallelTerminationStrategy: PID 7990 died...
19:43:04.283223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=7990): Terminated: ok {rc=0}
19:43:04.293461 ---      ParallelTerminationStrategy: PID 7991 died...
19:43:04.346260 run    osmo-stp_10.42.42.5(pid=7991): Terminated: ok {rc=0}
19:43:04.356094 ---      ParallelTerminationStrategy: PID 7992 died...
19:43:04.412542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=7992): Terminated: ok {rc=0}
19:43:04.422446 ---      ParallelTerminationStrategy: PID 7993 died...
19:43:04.475416 run    osmo-msc_10.42.42.6(pid=7993): Terminated: ok {rc=0}
19:43:04.485032 ---      ParallelTerminationStrategy: PID 8002 died...
19:43:04.538521 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=8002): Terminated: ok {rc=0}
19:43:04.548109 ---      ParallelTerminationStrategy: PID 8003 died...
19:43:04.601366 run    osmo-mgw_10.42.42.3(pid=8003): Terminated {rc=15}
19:43:04.611007 ---      ParallelTerminationStrategy: PID 8004 died...
19:43:04.664058 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=8004): Terminated: ok {rc=0}
19:43:04.674001 ---      ParallelTerminationStrategy: PID 8005 died...
19:43:04.726769 run    osmo-mgw_10.42.42.4(pid=8005): Terminated {rc=15}
19:43:04.736509 ---      ParallelTerminationStrategy: PID 8006 died...
19:43:04.789573 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=8006): Terminated: ok {rc=0}
19:43:04.799437 ---      ParallelTerminationStrategy: PID 8007 died...
19:43:04.852321 run    osmo-bsc_10.42.42.7(pid=8007): Terminated: ok {rc=0}
19:43:04.862089 ---      ParallelTerminationStrategy: PID 8016 died...
19:43:04.915494 run         osmo-bts-sysmo(pid=8016): Terminated: ok {rc=0}
19:43:05.023242 bus                        /sierra_2: Setting Online False
19:43:06.106152 bus                        /sierra_2: Setting Powered False
19:43:11.960637 bus                        /sierra_2: Setting Powered False
19:43:13.061275 bus                        /sierra_2: Setting Powered False
19:43:14.191465 bus                        /sierra_1: Setting Online False
19:43:15.274514 bus                        /sierra_1: Setting Powered False
19:43:20.961491 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f11a4baea60>, timeout=10, timestep=1} [trial-832↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]