Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchh+cfg-codec-hr3)

Failing for the past 91 builds (Since #751 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f37780d6268>, timeout=10, timestep=1} [trial-841↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-841 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py
----------------------------------------------
06:45:52.126996 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
06:45:52.139294 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1)
06:45:52.295436 tst              mo_mt_call_osmux.py: using LAC 10281
06:45:52.428480 tst              mo_mt_call_osmux.py: using RAC 81
06:45:52.561528 tst              mo_mt_call_osmux.py: using CellId 10281
06:45:52.694319 tst              mo_mt_call_osmux.py: using BVCI 10277
06:45:52.720035 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
06:45:52.731666 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
06:45:52.743200 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
06:45:52.754703 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
06:45:52.766209 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6)
06:45:52.777719 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
06:45:52.879337 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2)
06:45:53.069524 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
06:45:53.566333 run         create_hlr_db(pid=29353): Launched
06:45:53.748055 bus                        /sierra_1: Setting Powered False
06:45:54.769840 run         create_hlr_db(pid=29353): Terminated: ok {rc=0}
06:45:55.216215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29355): Launched
06:45:55.554044 run   osmo-hlr_10.42.42.2(pid=29356): Launched
06:45:55.675836 run              osmo-stp_10.42.42.5: Starting osmo-stp
06:45:56.258333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29357): Launched
06:45:56.594079 run   osmo-stp_10.42.42.5(pid=29358): Launched
06:45:56.713688 run              osmo-msc_10.42.42.6: Starting osmo-msc
06:45:57.324215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29359): Launched
06:45:57.660589 run   osmo-msc_10.42.42.6(pid=29360): Launched
06:46:00.839550 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
06:46:01.421115 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=29361): Launched
06:46:01.758246 run   osmo-mgw_10.42.42.3(pid=29362): Launched
06:46:01.878429 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
06:46:02.450545 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29363): Launched
06:46:02.784196 run   osmo-mgw_10.42.42.4(pid=29364): Launched
06:46:02.904960 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
06:46:03.609402 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=29365): Launched
06:46:03.947168 run   osmo-bsc_10.42.42.7(pid=29366): Launched
06:46:10.233847 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
06:46:10.836892 run         rm-remote-dir(pid=29367): Launched
06:46:13.045515 run         rm-remote-dir(pid=29367): Terminated: ok {rc=0}
06:46:13.405234 run         mk-remote-dir(pid=29368): Launched
06:46:15.612283 run         mk-remote-dir(pid=29368): Terminated: ok {rc=0}
06:46:15.915041 run    scp-inst-to-remote(pid=29369): Launched
06:46:30.141868 run    scp-inst-to-remote(pid=29369): Terminated: ok {rc=0}
06:46:30.496057 run         mk-remote-dir(pid=29372): Launched
06:46:32.699874 run         mk-remote-dir(pid=29372): Terminated: ok {rc=0}
06:46:33.004221 run     scp-cfg-to-remote(pid=29373): Launched
06:46:36.212262 run     scp-cfg-to-remote(pid=29373): Terminated: ok {rc=0}
06:46:36.561808 run   reload-dsp-firmware(pid=29375): Launched
06:46:39.754852 run   reload-dsp-firmware(pid=29375): Terminated: ok {rc=0}
06:46:40.076880 run        osmo-bts-sysmo(pid=29376): Launched
06:46:45.333104 tst              mo_mt_call_osmux.py: using MSISDN 6695
06:46:45.510187 bus                        /sierra_1: Setting Powered True
06:46:49.005634 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6695', subscriber_id=1}
06:46:49.148740 tst              mo_mt_call_osmux.py: using MSISDN 6696
06:46:49.332537 bus                        /sierra_2: Setting Powered True
06:47:01.693609 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f37780d6268&gt;, timeout=10, timestep=1} [trial-841↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-841↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8]
06:47:01.701715 tst            mo_mt_call_osmux.py:8: Test FAILED (69.6 sec)
06:47:01.737918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29355): Terminating (SIGTERM)
06:47:01.779811 run   osmo-hlr_10.42.42.2(pid=29356): Terminating (SIGTERM)
06:47:01.823405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29357): Terminating (SIGTERM)
06:47:01.868998 run   osmo-stp_10.42.42.5(pid=29358): Terminating (SIGTERM)
06:47:01.920540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29359): Terminating (SIGTERM)
06:47:01.966691 run   osmo-msc_10.42.42.6(pid=29360): Terminating (SIGTERM)
06:47:02.038444 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=29361): Terminating (SIGTERM)
06:47:02.100378 run   osmo-mgw_10.42.42.3(pid=29362): Terminating (SIGTERM)
06:47:02.155916 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29363): Terminating (SIGTERM)
06:47:02.199111 run   osmo-mgw_10.42.42.4(pid=29364): Terminating (SIGTERM)
06:47:02.242514 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=29365): Terminating (SIGTERM)
06:47:02.284621 run   osmo-bsc_10.42.42.7(pid=29366): Terminating (SIGTERM)
06:47:02.326809 run        osmo-bts-sysmo(pid=29376): Terminating (SIGTERM)
06:47:02.336682 ---      ParallelTerminationStrategy: PID 29355 died...
06:47:02.394057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29355): Terminated: ok {rc=0}
06:47:02.404690 ---      ParallelTerminationStrategy: PID 29356 died...
06:47:02.461489 run   osmo-hlr_10.42.42.2(pid=29356): Terminated: ok {rc=0}
06:47:02.471878 ---      ParallelTerminationStrategy: PID 29357 died...
06:47:02.528680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29357): Terminated: ok {rc=0}
06:47:02.539039 ---      ParallelTerminationStrategy: PID 29358 died...
06:47:02.595587 run   osmo-stp_10.42.42.5(pid=29358): Terminated: ok {rc=0}
06:47:02.606086 ---      ParallelTerminationStrategy: PID 29359 died...
06:47:02.662567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29359): Terminated: ok {rc=0}
06:47:02.672985 ---      ParallelTerminationStrategy: PID 29360 died...
06:47:02.729390 run   osmo-msc_10.42.42.6(pid=29360): Terminated: ok {rc=0}
06:47:02.739832 ---      ParallelTerminationStrategy: PID 29361 died...
06:47:02.796428 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=29361): Terminated: ok {rc=0}
06:47:02.806896 ---      ParallelTerminationStrategy: PID 29362 died...
06:47:02.863305 run   osmo-mgw_10.42.42.3(pid=29362): Terminated {rc=15}
06:47:02.873709 ---      ParallelTerminationStrategy: PID 29363 died...
06:47:02.929882 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29363): Terminated: ok {rc=0}
06:47:02.940323 ---      ParallelTerminationStrategy: PID 29364 died...
06:47:02.997000 run   osmo-mgw_10.42.42.4(pid=29364): Terminated {rc=15}
06:47:03.007987 ---      ParallelTerminationStrategy: PID 29365 died...
06:47:03.065487 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=29365): Terminated: ok {rc=0}
06:47:03.076475 ---      ParallelTerminationStrategy: PID 29376 died...
06:47:03.134337 run        osmo-bts-sysmo(pid=29376): Terminated: ok {rc=0}
06:47:03.313448 ---      ParallelTerminationStrategy: PID 29366 died...
06:47:03.371250 run   osmo-bsc_10.42.42.7(pid=29366): Terminated: ok {rc=0}
06:47:03.479350 bus                        /sierra_2: Setting Online False
06:47:04.566657 bus                        /sierra_2: Setting Powered False
06:47:09.959982 bus                        /sierra_2: Setting Powered False
06:47:11.067293 bus                        /sierra_2: Setting Powered False
06:47:12.196948 bus                        /sierra_1: Setting Online False
06:47:13.281608 bus                        /sierra_1: Setting Powered False
06:47:18.961959 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f37780d6268>, timeout=10, timestep=1} [trial-841↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]