Skip to content

Failed

voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any)

Failing for the past 98 builds (Since #751 )
Took 1 min 11 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f9bf435ae18>, timeout=10, timestep=1} [trial-848↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-848 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py
----------------------------------------------
15:58:43.130251 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
15:58:43.142499 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1)
15:58:43.297574 tst              mo_mt_call_osmux.py: using LAC 10843
15:58:43.430265 tst              mo_mt_call_osmux.py: using RAC 133
15:58:43.566187 tst              mo_mt_call_osmux.py: using CellId 10843
15:58:43.696459 tst              mo_mt_call_osmux.py: using BVCI 10839
15:58:43.721960 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
15:58:43.733569 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
15:58:43.744990 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
15:58:43.756446 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
15:58:43.767926 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6)
15:58:43.779348 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2)
15:58:43.885732 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2)
15:58:44.083964 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
15:58:44.620284 run         create_hlr_db(pid=25355): Launched
15:58:44.813814 bus                        /sierra_1: Setting Powered False
15:58:45.835281 run         create_hlr_db(pid=25355): Terminated: ok {rc=0}
15:58:46.260420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25357): Launched
15:58:46.580290 run   osmo-hlr_10.42.42.2(pid=25358): Launched
15:58:46.694215 run              osmo-stp_10.42.42.5: Starting osmo-stp
15:58:47.244518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25359): Launched
15:58:47.566113 run   osmo-stp_10.42.42.5(pid=25360): Launched
15:58:47.678440 run              osmo-msc_10.42.42.6: Starting osmo-msc
15:58:48.256034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25361): Launched
15:58:48.576312 run   osmo-msc_10.42.42.6(pid=25362): Launched
15:58:51.746252 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
15:58:52.296492 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=25363): Launched
15:58:52.614955 run   osmo-mgw_10.42.42.3(pid=25364): Launched
15:58:52.727643 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
15:58:53.266329 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=25365): Launched
15:58:53.588194 run   osmo-mgw_10.42.42.4(pid=25366): Launched
15:58:53.700852 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
15:58:54.362090 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=25367): Launched
15:58:54.680242 run   osmo-bsc_10.42.42.7(pid=25368): Launched
15:59:00.955675 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
15:59:01.554430 run         rm-remote-dir(pid=25369): Launched
15:59:03.760375 run         rm-remote-dir(pid=25369): Terminated: ok {rc=0}
15:59:04.117352 run         mk-remote-dir(pid=25370): Launched
15:59:06.322177 run         mk-remote-dir(pid=25370): Terminated: ok {rc=0}
15:59:06.623974 run    scp-inst-to-remote(pid=25371): Launched
15:59:20.836926 run    scp-inst-to-remote(pid=25371): Terminated: ok {rc=0}
15:59:21.170899 run         mk-remote-dir(pid=25373): Launched
15:59:24.363678 run         mk-remote-dir(pid=25373): Terminated: ok {rc=0}
15:59:24.647948 run     scp-cfg-to-remote(pid=25374): Launched
15:59:26.838910 run     scp-cfg-to-remote(pid=25374): Terminated: ok {rc=0}
15:59:27.167157 run   reload-dsp-firmware(pid=25376): Launched
15:59:31.369602 run   reload-dsp-firmware(pid=25376): Terminated: ok {rc=0}
15:59:31.709548 run        osmo-bts-sysmo(pid=25377): Launched
15:59:36.964949 tst              mo_mt_call_osmux.py: using MSISDN 7070
15:59:37.140131 bus                        /sierra_1: Setting Powered True
15:59:40.635692 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='7070', subscriber_id=1}
15:59:40.770109 tst              mo_mt_call_osmux.py: using MSISDN 7071
15:59:40.940544 bus                        /sierra_2: Setting Powered True
15:59:53.300210 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f9bf435ae18&gt;, timeout=10, timestep=1} [trial-848↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-848↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8]
15:59:53.308144 tst            mo_mt_call_osmux.py:8: Test FAILED (70.2 sec)
15:59:53.344035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25357): Terminating (SIGTERM)
15:59:53.385427 run   osmo-hlr_10.42.42.2(pid=25358): Terminating (SIGTERM)
15:59:53.428787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25359): Terminating (SIGTERM)
15:59:53.471894 run   osmo-stp_10.42.42.5(pid=25360): Terminating (SIGTERM)
15:59:53.541245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25361): Terminating (SIGTERM)
15:59:53.584216 run   osmo-msc_10.42.42.6(pid=25362): Terminating (SIGTERM)
15:59:53.630499 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=25363): Terminating (SIGTERM)
15:59:53.677306 run   osmo-mgw_10.42.42.3(pid=25364): Terminating (SIGTERM)
15:59:53.733899 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=25365): Terminating (SIGTERM)
15:59:53.777066 run   osmo-mgw_10.42.42.4(pid=25366): Terminating (SIGTERM)
15:59:53.820697 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=25367): Terminating (SIGTERM)
15:59:53.863454 run   osmo-bsc_10.42.42.7(pid=25368): Terminating (SIGTERM)
15:59:53.905281 run        osmo-bts-sysmo(pid=25377): Terminating (SIGTERM)
15:59:53.915235 ---      ParallelTerminationStrategy: PID 25357 died...
15:59:53.972466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25357): Terminated: ok {rc=0}
15:59:53.983050 ---      ParallelTerminationStrategy: PID 25358 died...
15:59:54.039283 run   osmo-hlr_10.42.42.2(pid=25358): Terminated: ok {rc=0}
15:59:54.049774 ---      ParallelTerminationStrategy: PID 25359 died...
15:59:54.105851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25359): Terminated: ok {rc=0}
15:59:54.116452 ---      ParallelTerminationStrategy: PID 25360 died...
15:59:54.172286 run   osmo-stp_10.42.42.5(pid=25360): Terminated: ok {rc=0}
15:59:54.182426 ---      ParallelTerminationStrategy: PID 25361 died...
15:59:54.237935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25361): Terminated: ok {rc=0}
15:59:54.248109 ---      ParallelTerminationStrategy: PID 25362 died...
15:59:54.303574 run   osmo-msc_10.42.42.6(pid=25362): Terminated: ok {rc=0}
15:59:54.313843 ---      ParallelTerminationStrategy: PID 25363 died...
15:59:54.369283 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=25363): Terminated: ok {rc=0}
15:59:54.379584 ---      ParallelTerminationStrategy: PID 25364 died...
15:59:54.434673 run   osmo-mgw_10.42.42.3(pid=25364): Terminated {rc=15}
15:59:54.444832 ---      ParallelTerminationStrategy: PID 25365 died...
15:59:54.500596 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=25365): Terminated: ok {rc=0}
15:59:54.510895 ---      ParallelTerminationStrategy: PID 25366 died...
15:59:54.566048 run   osmo-mgw_10.42.42.4(pid=25366): Terminated {rc=15}
15:59:54.576235 ---      ParallelTerminationStrategy: PID 25367 died...
15:59:54.631725 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=25367): Terminated: ok {rc=0}
15:59:54.642087 ---      ParallelTerminationStrategy: PID 25368 died...
15:59:54.697085 run   osmo-bsc_10.42.42.7(pid=25368): Terminated: ok {rc=0}
15:59:54.707336 ---      ParallelTerminationStrategy: PID 25377 died...
15:59:54.762715 run        osmo-bts-sysmo(pid=25377): Terminated: ok {rc=0}
15:59:54.868546 bus                        /sierra_2: Setting Online False
15:59:55.955057 bus                        /sierra_2: Setting Powered False
16:00:01.967265 bus                        /sierra_2: Setting Powered False
16:00:03.067363 bus                        /sierra_2: Setting Powered False
16:00:04.198982 bus                        /sierra_1: Setting Online False
16:00:05.281962 bus                        /sierra_1: Setting Powered False
16:00:10.969715 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f9bf435ae18>, timeout=10, timestep=1} [trial-848↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]