Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1.mo_mt_call.py (from voice_sysmo+mod-bts0-ts-tchf+cfg-codec-fr1)

Failing for the past 90 builds (Since #751 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f447871de18>, timeout=10, timestep=1} [trial-840↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-840 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py
----------------------------------------------
05:32:26.936179 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6)
05:32:26.947771 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1)
05:32:27.102986 tst                    mo_mt_call.py: using LAC 10192
05:32:27.231667 tst                    mo_mt_call.py: using RAC 247
05:32:27.362930 tst                    mo_mt_call.py: using CellId 10192
05:32:27.491421 tst                    mo_mt_call.py: using BVCI 10188
05:32:27.516661 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6)
05:32:27.528156 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6)
05:32:27.539604 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6)
05:32:27.551375 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6)
05:32:27.562940 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6)
05:32:27.574441 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2)
05:32:27.674934 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2)
05:32:27.862449 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
05:32:28.348717 run         create_hlr_db(pid=27147): Launched
05:32:28.528239 bus                        /sierra_1: Setting Powered False
05:32:29.550467 run         create_hlr_db(pid=27147): Terminated: ok {rc=0}
05:32:29.965679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27149): Launched
05:32:30.278566 run   osmo-hlr_10.42.42.2(pid=27150): Launched
05:32:30.390744 run              osmo-stp_10.42.42.5: Starting osmo-stp
05:32:30.933602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27151): Launched
05:32:31.245632 run   osmo-stp_10.42.42.5(pid=27152): Launched
05:32:31.356399 run              osmo-msc_10.42.42.6: Starting osmo-msc
05:32:31.924359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27153): Launched
05:32:32.236370 run   osmo-msc_10.42.42.6(pid=27154): Launched
05:32:35.403073 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
05:32:35.947157 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27155): Launched
05:32:36.259899 run   osmo-mgw_10.42.42.3(pid=27156): Launched
05:32:36.370743 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
05:32:36.903758 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27157): Launched
05:32:37.216007 run   osmo-mgw_10.42.42.4(pid=27158): Launched
05:32:37.326991 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
05:32:37.975619 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27159): Launched
05:32:38.302919 run   osmo-bsc_10.42.42.7(pid=27160): Launched
05:32:44.583978 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
05:32:45.180225 run         rm-remote-dir(pid=27161): Launched
05:32:47.385580 run         rm-remote-dir(pid=27161): Terminated: ok {rc=0}
05:32:47.742017 run         mk-remote-dir(pid=27162): Launched
05:32:49.945666 run         mk-remote-dir(pid=27162): Terminated: ok {rc=0}
05:32:50.246496 run    scp-inst-to-remote(pid=27163): Launched
05:33:04.468860 run    scp-inst-to-remote(pid=27163): Terminated: ok {rc=0}
05:33:04.819047 run         mk-remote-dir(pid=27165): Launched
05:33:07.019633 run         mk-remote-dir(pid=27165): Terminated: ok {rc=0}
05:33:07.318106 run     scp-cfg-to-remote(pid=27166): Launched
05:33:10.512432 run     scp-cfg-to-remote(pid=27166): Terminated: ok {rc=0}
05:33:10.835920 run   reload-dsp-firmware(pid=27168): Launched
05:33:14.024505 run   reload-dsp-firmware(pid=27168): Terminated: ok {rc=0}
05:33:14.341210 run        osmo-bts-sysmo(pid=27169): Launched
05:33:19.593996 tst                    mo_mt_call.py: using MSISDN 6624
05:33:19.767271 bus                        /sierra_1: Setting Powered True
05:33:23.237419 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6624', subscriber_id=1}
05:33:23.380381 tst                    mo_mt_call.py: using MSISDN 6625
05:33:23.560280 bus                        /sierra_2: Setting Powered True
05:33:35.917735 tst                  mo_mt_call.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f447871de18&gt;, timeout=10, timestep=1} [trial-840↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]  [trial-840↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8]
05:33:35.925375 tst                  mo_mt_call.py:8: Test FAILED (69.0 sec)
05:33:35.960715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27149): Terminating (SIGTERM)
05:33:36.002412 run   osmo-hlr_10.42.42.2(pid=27150): Terminating (SIGTERM)
05:33:36.044824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27151): Terminating (SIGTERM)
05:33:36.087909 run   osmo-stp_10.42.42.5(pid=27152): Terminating (SIGTERM)
05:33:36.149066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27153): Terminating (SIGTERM)
05:33:36.209761 run   osmo-msc_10.42.42.6(pid=27154): Terminating (SIGTERM)
05:33:36.253440 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27155): Terminating (SIGTERM)
05:33:36.296707 run   osmo-mgw_10.42.42.3(pid=27156): Terminating (SIGTERM)
05:33:36.352480 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27157): Terminating (SIGTERM)
05:33:36.396438 run   osmo-mgw_10.42.42.4(pid=27158): Terminating (SIGTERM)
05:33:36.451572 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27159): Terminating (SIGTERM)
05:33:36.492894 run   osmo-bsc_10.42.42.7(pid=27160): Terminating (SIGTERM)
05:33:36.535284 run        osmo-bts-sysmo(pid=27169): Terminating (SIGTERM)
05:33:36.546666 ---      ParallelTerminationStrategy: PID 27149 died...
05:33:36.603669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27149): Terminated: ok {rc=0}
05:33:36.614382 ---      ParallelTerminationStrategy: PID 27150 died...
05:33:36.670936 run   osmo-hlr_10.42.42.2(pid=27150): Terminated: ok {rc=0}
05:33:36.681685 ---      ParallelTerminationStrategy: PID 27151 died...
05:33:36.738159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27151): Terminated: ok {rc=0}
05:33:36.748649 ---      ParallelTerminationStrategy: PID 27152 died...
05:33:36.804108 run   osmo-stp_10.42.42.5(pid=27152): Terminated: ok {rc=0}
05:33:36.813996 ---      ParallelTerminationStrategy: PID 27153 died...
05:33:36.868633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27153): Terminated: ok {rc=0}
05:33:36.878571 ---      ParallelTerminationStrategy: PID 27154 died...
05:33:36.933409 run   osmo-msc_10.42.42.6(pid=27154): Terminated: ok {rc=0}
05:33:36.943246 ---      ParallelTerminationStrategy: PID 27155 died...
05:33:36.998485 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=27155): Terminated: ok {rc=0}
05:33:37.008445 ---      ParallelTerminationStrategy: PID 27156 died...
05:33:37.063407 run   osmo-mgw_10.42.42.3(pid=27156): Terminated {rc=15}
05:33:37.073373 ---      ParallelTerminationStrategy: PID 27157 died...
05:33:37.129020 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=27157): Terminated: ok {rc=0}
05:33:37.139245 ---      ParallelTerminationStrategy: PID 27158 died...
05:33:37.194331 run   osmo-mgw_10.42.42.4(pid=27158): Terminated {rc=15}
05:33:37.204254 ---      ParallelTerminationStrategy: PID 27159 died...
05:33:37.259486 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=27159): Terminated: ok {rc=0}
05:33:37.269508 ---      ParallelTerminationStrategy: PID 27160 died...
05:33:37.324345 run   osmo-bsc_10.42.42.7(pid=27160): Terminated: ok {rc=0}
05:33:37.334337 ---      ParallelTerminationStrategy: PID 27169 died...
05:33:37.390433 run        osmo-bts-sysmo(pid=27169): Terminated: ok {rc=0}
05:33:37.496208 bus                        /sierra_2: Setting Online False
05:33:38.581112 bus                        /sierra_2: Setting Powered False
05:33:43.962683 bus                        /sierra_2: Setting Powered False
05:33:45.064679 bus                        /sierra_2: Setting Powered False
05:33:46.195512 bus                        /sierra_1: Setting Online False
05:33:47.279620 bus                        /sierra_1: Setting Powered False
05:33:52.956737 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call.py", line 8, in <module>
    test_mo_mt_call(False, False)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f447871de18>, timeout=10, timestep=1} [trial-840↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪/sierra_2]