Skip to content

Failed

voice:sysmo+mod-bts0-dynts-osmo.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-dynts-osmo)

Failing for the past 51 builds (Since #751 )
Took 1 min 5 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f2e12079400>, timeout=10, timestep=1} [trial-801↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-801 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py
----------------------------------------------
06:49:01.133776 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
06:49:01.145549 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1)
06:49:01.298535 tst              mo_mt_call_osmux.py: using LAC 7085
06:49:01.426968 tst              mo_mt_call_osmux.py: using RAC 200
06:49:01.550616 tst              mo_mt_call_osmux.py: using CellId 7085
06:49:01.675720 tst              mo_mt_call_osmux.py: using BVCI 7081
06:49:01.699549 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
06:49:01.710584 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
06:49:01.721549 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
06:49:01.732491 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
06:49:01.743502 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
06:49:01.754671 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
06:49:01.854337 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
06:49:02.043168 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
06:49:02.535495 run         create_hlr_db(pid=16106): Launched
06:49:02.715596 bus                        /sierra_1: Setting Powered False
06:49:03.736856 run         create_hlr_db(pid=16106): Terminated: ok {rc=0}
06:49:04.176754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16108): Launched
06:49:04.507554 run   osmo-hlr_10.42.42.2(pid=16109): Launched
06:49:04.627168 run              osmo-stp_10.42.42.5: Starting osmo-stp
06:49:05.200088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16110): Launched
06:49:05.531053 run   osmo-stp_10.42.42.5(pid=16111): Launched
06:49:05.648368 run              osmo-msc_10.42.42.6: Starting osmo-msc
06:49:06.251113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16112): Launched
06:49:06.587135 run   osmo-msc_10.42.42.6(pid=16113): Launched
06:49:09.763341 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
06:49:10.339042 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=16114): Launched
06:49:10.672102 run   osmo-mgw_10.42.42.3(pid=16115): Launched
06:49:10.790103 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
06:49:11.355779 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16116): Launched
06:49:11.691574 run   osmo-mgw_10.42.42.4(pid=16117): Launched
06:49:11.811165 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
06:49:12.508556 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=16118): Launched
06:49:12.845297 run   osmo-bsc_10.42.42.7(pid=16119): Launched
06:49:19.129643 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
06:49:19.726237 run         rm-remote-dir(pid=16121): Launched
06:49:21.932561 run         rm-remote-dir(pid=16121): Terminated: ok {rc=0}
06:49:22.290756 run         mk-remote-dir(pid=16122): Launched
06:49:23.494376 run         mk-remote-dir(pid=16122): Terminated: ok {rc=0}
06:49:23.797226 run    scp-inst-to-remote(pid=16123): Launched
06:49:37.011448 run    scp-inst-to-remote(pid=16123): Terminated: ok {rc=0}
06:49:37.347712 run         mk-remote-dir(pid=16125): Launched
06:49:39.539001 run         mk-remote-dir(pid=16125): Terminated: ok {rc=0}
06:49:39.825595 run     scp-cfg-to-remote(pid=16126): Launched
06:49:41.017529 run     scp-cfg-to-remote(pid=16126): Terminated: ok {rc=0}
06:49:41.348943 run   reload-dsp-firmware(pid=16128): Launched
06:49:44.545990 run   reload-dsp-firmware(pid=16128): Terminated: ok {rc=0}
06:49:44.887368 run        osmo-bts-sysmo(pid=16129): Launched
06:49:49.139920 tst              mo_mt_call_osmux.py: using MSISDN 4583
06:49:49.322118 bus                        /sierra_1: Setting Powered True
06:49:52.814146 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4583', subscriber_id=1}
06:49:52.997064 tst              mo_mt_call_osmux.py: using MSISDN 4584
06:49:53.180069 bus                        /sierra_2: Setting Powered True
06:50:05.559131 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f2e12079400&gt;, timeout=10, timestep=1} [trial-801↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-801↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8]
06:50:05.567352 tst            mo_mt_call_osmux.py:8: Test FAILED (64.5 sec)
06:50:05.606149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16108): Terminating (SIGTERM)
06:50:05.651231 run   osmo-hlr_10.42.42.2(pid=16109): Terminating (SIGTERM)
06:50:05.738641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16110): Terminating (SIGTERM)
06:50:05.828748 run   osmo-stp_10.42.42.5(pid=16111): Terminating (SIGTERM)
06:50:05.935800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16112): Terminating (SIGTERM)
06:50:06.033087 run   osmo-msc_10.42.42.6(pid=16113): Terminating (SIGTERM)
06:50:06.103611 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=16114): Terminating (SIGTERM)
06:50:06.198315 run   osmo-mgw_10.42.42.3(pid=16115): Terminating (SIGTERM)
06:50:06.302738 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16116): Terminating (SIGTERM)
06:50:06.394023 run   osmo-mgw_10.42.42.4(pid=16117): Terminating (SIGTERM)
06:50:06.481053 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=16118): Terminating (SIGTERM)
06:50:06.558675 run   osmo-bsc_10.42.42.7(pid=16119): Terminating (SIGTERM)
06:50:06.600478 run        osmo-bts-sysmo(pid=16129): Terminating (SIGTERM)
06:50:06.612879 ---      ParallelTerminationStrategy: PID 16108 died...
06:50:06.702590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16108): Terminated: ok {rc=0}
06:50:06.729927 ---      ParallelTerminationStrategy: PID 16109 died...
06:50:06.844176 run   osmo-hlr_10.42.42.2(pid=16109): Terminated: ok {rc=0}
06:50:06.869989 ---      ParallelTerminationStrategy: PID 16110 died...
06:50:06.984856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16110): Terminated: ok {rc=0}
06:50:07.007936 ---      ParallelTerminationStrategy: PID 16111 died...
06:50:07.124731 run   osmo-stp_10.42.42.5(pid=16111): Terminated: ok {rc=0}
06:50:07.135234 ---      ParallelTerminationStrategy: PID 16112 died...
06:50:07.195993 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16112): Terminated: ok {rc=0}
06:50:07.206651 ---      ParallelTerminationStrategy: PID 16113 died...
06:50:07.263605 run   osmo-msc_10.42.42.6(pid=16113): Terminated: ok {rc=0}
06:50:07.274724 ---      ParallelTerminationStrategy: PID 16114 died...
06:50:07.332500 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=16114): Terminated: ok {rc=0}
06:50:07.343189 ---      ParallelTerminationStrategy: PID 16115 died...
06:50:07.400212 run   osmo-mgw_10.42.42.3(pid=16115): Terminated {rc=15}
06:50:07.410901 ---      ParallelTerminationStrategy: PID 16116 died...
06:50:07.467856 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=16116): Terminated: ok {rc=0}
06:50:07.478533 ---      ParallelTerminationStrategy: PID 16117 died...
06:50:07.536602 run   osmo-mgw_10.42.42.4(pid=16117): Terminated {rc=15}
06:50:07.547300 ---      ParallelTerminationStrategy: PID 16118 died...
06:50:07.604474 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=16118): Terminated: ok {rc=0}
06:50:07.615249 ---      ParallelTerminationStrategy: PID 16119 died...
06:50:07.672305 run   osmo-bsc_10.42.42.7(pid=16119): Terminated: ok {rc=0}
06:50:07.682978 ---      ParallelTerminationStrategy: PID 16129 died...
06:50:07.740684 run        osmo-bts-sysmo(pid=16129): Terminated: ok {rc=0}
06:50:07.848747 bus                        /sierra_2: Setting Online False
06:50:08.934027 bus                        /sierra_2: Setting Powered False
06:50:14.967976 bus                        /sierra_2: Setting Powered False
06:50:16.070971 bus                        /sierra_2: Setting Powered False
06:50:17.203466 bus                        /sierra_1: Setting Online False
06:50:18.288624 bus                        /sierra_1: Setting Powered False
06:50:23.972980 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f2e12079400>, timeout=10, timestep=1} [trial-801↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]