Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchf+cfg-codec-fr3)

Failing for the past 50 builds (Since #751 )
Took 1 min 5 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f602cd94400>, timeout=10, timestep=1} [trial-800↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-800 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py
----------------------------------------------
05:39:38.123341 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
05:39:38.135146 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1)
05:39:38.284014 tst              mo_mt_call_osmux.py: using LAC 6997
05:39:38.409007 tst              mo_mt_call_osmux.py: using RAC 112
05:39:38.533996 tst              mo_mt_call_osmux.py: using CellId 6997
05:39:38.657408 tst              mo_mt_call_osmux.py: using BVCI 6993
05:39:38.681358 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
05:39:38.692438 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
05:39:38.703423 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
05:39:38.714591 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
05:39:38.725721 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6)
05:39:38.736898 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
05:39:38.837620 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2)
05:39:39.028409 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
05:39:39.527312 run         create_hlr_db(pid=13402): Launched
05:39:39.708400 bus                        /sierra_1: Setting Powered False
05:39:40.729445 run         create_hlr_db(pid=13402): Terminated: ok {rc=0}
05:39:41.177665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13404): Launched
05:39:41.516184 run   osmo-hlr_10.42.42.2(pid=13405): Launched
05:39:41.637901 run              osmo-stp_10.42.42.5: Starting osmo-stp
05:39:42.217321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13406): Launched
05:39:42.552605 run   osmo-stp_10.42.42.5(pid=13407): Launched
05:39:42.671077 run              osmo-msc_10.42.42.6: Starting osmo-msc
05:39:43.282650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13408): Launched
05:39:43.621097 run   osmo-msc_10.42.42.6(pid=13409): Launched
05:39:46.799093 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
05:39:47.379884 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13410): Launched
05:39:47.717203 run   osmo-mgw_10.42.42.3(pid=13411): Launched
05:39:47.836862 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
05:39:48.406379 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13412): Launched
05:39:48.743508 run   osmo-mgw_10.42.42.4(pid=13413): Launched
05:39:48.862758 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
05:39:49.563416 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13414): Launched
05:39:49.901559 run   osmo-bsc_10.42.42.7(pid=13415): Launched
05:39:56.187649 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
05:39:56.784967 run         rm-remote-dir(pid=13416): Launched
05:39:58.990971 run         rm-remote-dir(pid=13416): Terminated: ok {rc=0}
05:39:59.350809 run         mk-remote-dir(pid=13417): Launched
05:40:00.555388 run         mk-remote-dir(pid=13417): Terminated: ok {rc=0}
05:40:00.857253 run    scp-inst-to-remote(pid=13418): Launched
05:40:14.081038 run    scp-inst-to-remote(pid=13418): Terminated: ok {rc=0}
05:40:14.436034 run         mk-remote-dir(pid=13423): Launched
05:40:15.637517 run         mk-remote-dir(pid=13423): Terminated: ok {rc=0}
05:40:15.940425 run     scp-cfg-to-remote(pid=13424): Launched
05:40:18.144148 run     scp-cfg-to-remote(pid=13424): Terminated: ok {rc=0}
05:40:18.493889 run   reload-dsp-firmware(pid=13426): Launched
05:40:21.685550 run   reload-dsp-firmware(pid=13426): Terminated: ok {rc=0}
05:40:22.006249 run        osmo-bts-sysmo(pid=13427): Launched
05:40:26.250405 tst              mo_mt_call_osmux.py: using MSISDN 4514
05:40:26.435313 bus                        /sierra_1: Setting Powered True
05:40:29.904200 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4514', subscriber_id=1}
05:40:30.043210 tst              mo_mt_call_osmux.py: using MSISDN 4515
05:40:30.226658 bus                        /sierra_2: Setting Powered True
05:40:42.601942 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f602cd94400&gt;, timeout=10, timestep=1} [trial-800↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-800↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8]
05:40:42.610264 tst            mo_mt_call_osmux.py:8: Test FAILED (64.5 sec)
05:40:42.646061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13404): Terminating (SIGTERM)
05:40:42.687829 run   osmo-hlr_10.42.42.2(pid=13405): Terminating (SIGTERM)
05:40:42.731196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13406): Terminating (SIGTERM)
05:40:42.776005 run   osmo-stp_10.42.42.5(pid=13407): Terminating (SIGTERM)
05:40:42.833095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13408): Terminating (SIGTERM)
05:40:42.882259 run   osmo-msc_10.42.42.6(pid=13409): Terminating (SIGTERM)
05:40:42.929203 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13410): Terminating (SIGTERM)
05:40:42.973002 run   osmo-mgw_10.42.42.3(pid=13411): Terminating (SIGTERM)
05:40:43.017212 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13412): Terminating (SIGTERM)
05:40:43.059590 run   osmo-mgw_10.42.42.4(pid=13413): Terminating (SIGTERM)
05:40:43.103090 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13414): Terminating (SIGTERM)
05:40:43.147728 run   osmo-bsc_10.42.42.7(pid=13415): Terminating (SIGTERM)
05:40:43.189694 run        osmo-bts-sysmo(pid=13427): Terminating (SIGTERM)
05:40:43.199438 ---      ParallelTerminationStrategy: PID 13404 died...
05:40:43.255777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13404): Terminated: ok {rc=0}
05:40:43.265904 ---      ParallelTerminationStrategy: PID 13405 died...
05:40:43.321440 run   osmo-hlr_10.42.42.2(pid=13405): Terminated: ok {rc=0}
05:40:43.331560 ---      ParallelTerminationStrategy: PID 13406 died...
05:40:43.388007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13406): Terminated: ok {rc=0}
05:40:43.398466 ---      ParallelTerminationStrategy: PID 13407 died...
05:40:43.454166 run   osmo-stp_10.42.42.5(pid=13407): Terminated: ok {rc=0}
05:40:43.464186 ---      ParallelTerminationStrategy: PID 13408 died...
05:40:43.519867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13408): Terminated: ok {rc=0}
05:40:43.530005 ---      ParallelTerminationStrategy: PID 13409 died...
05:40:43.590341 run   osmo-msc_10.42.42.6(pid=13409): Terminated: ok {rc=0}
05:40:43.601034 ---      ParallelTerminationStrategy: PID 13410 died...
05:40:43.657963 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=13410): Terminated: ok {rc=0}
05:40:43.669034 ---      ParallelTerminationStrategy: PID 13411 died...
05:40:43.726112 run   osmo-mgw_10.42.42.3(pid=13411): Terminated {rc=15}
05:40:43.737093 ---      ParallelTerminationStrategy: PID 13412 died...
05:40:43.794246 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=13412): Terminated: ok {rc=0}
05:40:43.805295 ---      ParallelTerminationStrategy: PID 13413 died...
05:40:43.861805 run   osmo-mgw_10.42.42.4(pid=13413): Terminated {rc=15}
05:40:43.872049 ---      ParallelTerminationStrategy: PID 13414 died...
05:40:43.928047 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=13414): Terminated: ok {rc=0}
05:40:43.938307 ---      ParallelTerminationStrategy: PID 13415 died...
05:40:43.994218 run   osmo-bsc_10.42.42.7(pid=13415): Terminated: ok {rc=0}
05:40:44.004472 ---      ParallelTerminationStrategy: PID 13427 died...
05:40:44.060342 run        osmo-bts-sysmo(pid=13427): Terminated: ok {rc=0}
05:40:44.167479 bus                        /sierra_2: Setting Online False
05:40:45.254042 bus                        /sierra_2: Setting Powered False
05:40:50.968450 bus                        /sierra_2: Setting Powered False
05:40:52.071602 bus                        /sierra_2: Setting Powered False
05:40:53.204155 bus                        /sierra_1: Setting Online False
05:40:54.287482 bus                        /sierra_1: Setting Powered False
05:40:59.963122 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f602cd94400>, timeout=10, timestep=1} [trial-800↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]