Skip to content

Failed

voice:sysmo+mod-bts0-dynts-osmo.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-dynts-osmo)

Failing for the past 71 builds (Since #751 )
Took 1 min 8 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f9c681aeb70>, timeout=10, timestep=1} [trial-821↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-821 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py
----------------------------------------------
06:50:38.130826 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
06:50:38.143356 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1)
06:50:38.295564 tst              mo_mt_call_osmux.py: using LAC 8685
06:50:38.421920 tst              mo_mt_call_osmux.py: using RAC 15
06:50:38.548246 tst              mo_mt_call_osmux.py: using CellId 8685
06:50:38.673009 tst              mo_mt_call_osmux.py: using BVCI 8681
06:50:38.697370 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
06:50:38.708439 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
06:50:38.719371 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
06:50:38.730468 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
06:50:38.741646 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
06:50:38.752565 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
06:50:38.857791 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
06:50:39.058504 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
06:50:39.601447 run         create_hlr_db(pid=10086): Launched
06:50:39.797087 bus                        /sierra_1: Setting Powered False
06:50:40.819142 run         create_hlr_db(pid=10086): Terminated: ok {rc=0}
06:50:41.248890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10089): Launched
06:50:41.569501 run   osmo-hlr_10.42.42.2(pid=10090): Launched
06:50:41.684690 run              osmo-stp_10.42.42.5: Starting osmo-stp
06:50:42.239767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10091): Launched
06:50:42.562531 run   osmo-stp_10.42.42.5(pid=10092): Launched
06:50:42.676152 run              osmo-msc_10.42.42.6: Starting osmo-msc
06:50:43.256990 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10093): Launched
06:50:43.579105 run   osmo-msc_10.42.42.6(pid=10094): Launched
06:50:46.750165 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
06:50:47.307513 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10095): Launched
06:50:47.630001 run   osmo-mgw_10.42.42.3(pid=10096): Launched
06:50:47.744481 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
06:50:48.286963 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10097): Launched
06:50:48.612228 run   osmo-mgw_10.42.42.4(pid=10098): Launched
06:50:48.726390 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
06:50:49.391286 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=10099): Launched
06:50:49.716576 run   osmo-bsc_10.42.42.7(pid=10100): Launched
06:50:55.987733 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
06:50:56.559959 run         rm-remote-dir(pid=10101): Launched
06:50:58.758196 run         rm-remote-dir(pid=10101): Terminated: ok {rc=0}
06:50:59.100330 run         mk-remote-dir(pid=10102): Launched
06:51:01.296498 run         mk-remote-dir(pid=10102): Terminated: ok {rc=0}
06:51:01.585846 run    scp-inst-to-remote(pid=10103): Launched
06:51:14.799357 run    scp-inst-to-remote(pid=10103): Terminated: ok {rc=0}
06:51:15.138014 run         mk-remote-dir(pid=10105): Launched
06:51:17.331271 run         mk-remote-dir(pid=10105): Terminated: ok {rc=0}
06:51:17.620218 run     scp-cfg-to-remote(pid=10106): Launched
06:51:19.813196 run     scp-cfg-to-remote(pid=10106): Terminated: ok {rc=0}
06:51:20.147606 run   reload-dsp-firmware(pid=10108): Launched
06:51:23.339200 run   reload-dsp-firmware(pid=10108): Terminated: ok {rc=0}
06:51:23.662455 run        osmo-bts-sysmo(pid=10109): Launched
06:51:28.908554 tst              mo_mt_call_osmux.py: using MSISDN 5643
06:51:29.085103 bus                        /sierra_1: Setting Powered True
06:51:32.574514 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5643', subscriber_id=1}
06:51:32.712636 tst              mo_mt_call_osmux.py: using MSISDN 5644
06:51:32.887168 bus                        /sierra_2: Setting Powered True
06:51:45.256870 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f9c681aeb70&gt;, timeout=10, timestep=1} [trial-821↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-821↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8]
06:51:45.265100 tst            mo_mt_call_osmux.py:8: Test FAILED (67.2 sec)
06:51:45.301895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10089): Terminating (SIGTERM)
06:51:45.344121 run   osmo-hlr_10.42.42.2(pid=10090): Terminating (SIGTERM)
06:51:45.388142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10091): Terminating (SIGTERM)
06:51:45.432938 run   osmo-stp_10.42.42.5(pid=10092): Terminating (SIGTERM)
06:51:45.501710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10093): Terminating (SIGTERM)
06:51:45.547975 run   osmo-msc_10.42.42.6(pid=10094): Terminating (SIGTERM)
06:51:45.592002 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10095): Terminating (SIGTERM)
06:51:45.637914 run   osmo-mgw_10.42.42.3(pid=10096): Terminating (SIGTERM)
06:51:45.693910 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10097): Terminating (SIGTERM)
06:51:45.739589 run   osmo-mgw_10.42.42.4(pid=10098): Terminating (SIGTERM)
06:51:45.783734 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=10099): Terminating (SIGTERM)
06:51:45.827560 run   osmo-bsc_10.42.42.7(pid=10100): Terminating (SIGTERM)
06:51:45.869871 run        osmo-bts-sysmo(pid=10109): Terminating (SIGTERM)
06:51:45.879616 ---      ParallelTerminationStrategy: PID 10089 died...
06:51:45.937179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10089): Terminated: ok {rc=0}
06:51:45.948027 ---      ParallelTerminationStrategy: PID 10090 died...
06:51:46.006319 run   osmo-hlr_10.42.42.2(pid=10090): Terminated: ok {rc=0}
06:51:46.017025 ---      ParallelTerminationStrategy: PID 10091 died...
06:51:46.079376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10091): Terminated: ok {rc=0}
06:51:46.090153 ---      ParallelTerminationStrategy: PID 10092 died...
06:51:46.152511 run   osmo-stp_10.42.42.5(pid=10092): Terminated: ok {rc=0}
06:51:46.162785 ---      ParallelTerminationStrategy: PID 10093 died...
06:51:46.219494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10093): Terminated: ok {rc=0}
06:51:46.229900 ---      ParallelTerminationStrategy: PID 10094 died...
06:51:46.286544 run   osmo-msc_10.42.42.6(pid=10094): Terminated: ok {rc=0}
06:51:46.296845 ---      ParallelTerminationStrategy: PID 10095 died...
06:51:46.353130 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=10095): Terminated: ok {rc=0}
06:51:46.363491 ---      ParallelTerminationStrategy: PID 10096 died...
06:51:46.419830 run   osmo-mgw_10.42.42.3(pid=10096): Terminated {rc=15}
06:51:46.430039 ---      ParallelTerminationStrategy: PID 10097 died...
06:51:46.486154 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=10097): Terminated: ok {rc=0}
06:51:46.496348 ---      ParallelTerminationStrategy: PID 10098 died...
06:51:46.552729 run   osmo-mgw_10.42.42.4(pid=10098): Terminated {rc=15}
06:51:46.562921 ---      ParallelTerminationStrategy: PID 10099 died...
06:51:46.618972 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=10099): Terminated: ok {rc=0}
06:51:46.629337 ---      ParallelTerminationStrategy: PID 10100 died...
06:51:46.685846 run   osmo-bsc_10.42.42.7(pid=10100): Terminated: ok {rc=0}
06:51:46.696464 ---      ParallelTerminationStrategy: PID 10109 died...
06:51:46.752896 run        osmo-bts-sysmo(pid=10109): Terminated: ok {rc=0}
06:51:46.861321 bus                        /sierra_2: Setting Online False
06:51:47.948892 bus                        /sierra_2: Setting Powered False
06:51:53.970258 bus                        /sierra_2: Setting Powered False
06:51:55.078999 bus                        /sierra_2: Setting Powered False
06:51:56.209062 bus                        /sierra_1: Setting Online False
06:51:57.297017 bus                        /sierra_1: Setting Powered False
06:52:02.973758 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f9c681aeb70>, timeout=10, timestep=1} [trial-821↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]