Skip to content

Failed

voice:sysmo+mod-bts0-dynts-osmo.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-dynts-osmo)

Failing for the past 72 builds (Since #751 )
Took 1 min 7 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fd2c56dbc80>, timeout=10, timestep=1} [trial-822↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-822 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py
----------------------------------------------
07:50:09.119693 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:50:09.131641 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1)
07:50:09.276920 tst              mo_mt_call_osmux.py: using LAC 8765
07:50:09.397036 tst              mo_mt_call_osmux.py: using RAC 95
07:50:09.518033 tst              mo_mt_call_osmux.py: using CellId 8765
07:50:09.637924 tst              mo_mt_call_osmux.py: using BVCI 8761
07:50:09.661644 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:50:09.672706 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:50:09.683737 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:50:09.695186 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:50:09.706407 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:50:09.717561 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
07:50:09.817675 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
07:50:10.005032 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
07:50:10.515702 run         create_hlr_db(pid=11928): Launched
07:50:10.707261 bus                        /sierra_1: Setting Powered False
07:50:11.727232 run         create_hlr_db(pid=11928): Terminated: ok {rc=0}
07:50:12.145683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11930): Launched
07:50:12.459703 run   osmo-hlr_10.42.42.2(pid=11931): Launched
07:50:12.572138 run              osmo-stp_10.42.42.5: Starting osmo-stp
07:50:13.117197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11932): Launched
07:50:13.433511 run   osmo-stp_10.42.42.5(pid=11933): Launched
07:50:13.544965 run              osmo-msc_10.42.42.6: Starting osmo-msc
07:50:14.124407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11934): Launched
07:50:14.441326 run   osmo-msc_10.42.42.6(pid=11935): Launched
07:50:17.608688 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
07:50:18.153962 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11936): Launched
07:50:18.470726 run   osmo-mgw_10.42.42.3(pid=11937): Launched
07:50:18.582028 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
07:50:19.119444 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11938): Launched
07:50:19.436193 run   osmo-mgw_10.42.42.4(pid=11939): Launched
07:50:19.547548 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
07:50:20.203016 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11940): Launched
07:50:20.519466 run   osmo-bsc_10.42.42.7(pid=11941): Launched
07:50:26.786470 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
07:50:27.352606 run         rm-remote-dir(pid=11942): Launched
07:50:29.546877 run         rm-remote-dir(pid=11942): Terminated: ok {rc=0}
07:50:29.883067 run         mk-remote-dir(pid=11943): Launched
07:50:32.075646 run         mk-remote-dir(pid=11943): Terminated: ok {rc=0}
07:50:32.361611 run    scp-inst-to-remote(pid=11944): Launched
07:50:45.586432 run    scp-inst-to-remote(pid=11944): Terminated: ok {rc=0}
07:50:45.938164 run         mk-remote-dir(pid=11946): Launched
07:50:48.139355 run         mk-remote-dir(pid=11946): Terminated: ok {rc=0}
07:50:48.440468 run     scp-cfg-to-remote(pid=11947): Launched
07:50:50.635027 run     scp-cfg-to-remote(pid=11947): Terminated: ok {rc=0}
07:50:50.961971 run   reload-dsp-firmware(pid=11949): Launched
07:50:54.150834 run   reload-dsp-firmware(pid=11949): Terminated: ok {rc=0}
07:50:54.470248 run        osmo-bts-sysmo(pid=11950): Launched
07:50:59.724095 tst              mo_mt_call_osmux.py: using MSISDN 5696
07:50:59.907317 bus                        /sierra_1: Setting Powered True
07:51:03.398831 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5696', subscriber_id=1}
07:51:03.534939 tst              mo_mt_call_osmux.py: using MSISDN 5697
07:51:03.705113 bus                        /sierra_2: Setting Powered True
07:51:16.053933 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fd2c56dbc80&gt;, timeout=10, timestep=1} [trial-822↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-822↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8]
07:51:16.061382 tst            mo_mt_call_osmux.py:8: Test FAILED (67.0 sec)
07:51:16.095774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11930): Terminating (SIGTERM)
07:51:16.135319 run   osmo-hlr_10.42.42.2(pid=11931): Terminating (SIGTERM)
07:51:16.182768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11932): Terminating (SIGTERM)
07:51:16.227828 run   osmo-stp_10.42.42.5(pid=11933): Terminating (SIGTERM)
07:51:16.289641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11934): Terminating (SIGTERM)
07:51:16.333384 run   osmo-msc_10.42.42.6(pid=11935): Terminating (SIGTERM)
07:51:16.377332 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11936): Terminating (SIGTERM)
07:51:16.423078 run   osmo-mgw_10.42.42.3(pid=11937): Terminating (SIGTERM)
07:51:16.468547 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11938): Terminating (SIGTERM)
07:51:16.513855 run   osmo-mgw_10.42.42.4(pid=11939): Terminating (SIGTERM)
07:51:16.569233 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11940): Terminating (SIGTERM)
07:51:16.612278 run   osmo-bsc_10.42.42.7(pid=11941): Terminating (SIGTERM)
07:51:16.654121 run        osmo-bts-sysmo(pid=11950): Terminating (SIGTERM)
07:51:16.664496 ---      ParallelTerminationStrategy: PID 11930 died...
07:51:16.720479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11930): Terminated: ok {rc=0}
07:51:16.731099 ---      ParallelTerminationStrategy: PID 11931 died...
07:51:16.787956 run   osmo-hlr_10.42.42.2(pid=11931): Terminated: ok {rc=0}
07:51:16.798770 ---      ParallelTerminationStrategy: PID 11932 died...
07:51:16.855986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11932): Terminated: ok {rc=0}
07:51:16.866898 ---      ParallelTerminationStrategy: PID 11933 died...
07:51:16.923497 run   osmo-stp_10.42.42.5(pid=11933): Terminated: ok {rc=0}
07:51:16.934217 ---      ParallelTerminationStrategy: PID 11934 died...
07:51:16.990925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11934): Terminated: ok {rc=0}
07:51:17.001015 ---      ParallelTerminationStrategy: PID 11935 died...
07:51:17.056295 run   osmo-msc_10.42.42.6(pid=11935): Terminated: ok {rc=0}
07:51:17.066302 ---      ParallelTerminationStrategy: PID 11936 died...
07:51:17.121563 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=11936): Terminated: ok {rc=0}
07:51:17.131432 ---      ParallelTerminationStrategy: PID 11937 died...
07:51:17.186526 run   osmo-mgw_10.42.42.3(pid=11937): Terminated {rc=15}
07:51:17.196398 ---      ParallelTerminationStrategy: PID 11938 died...
07:51:17.251415 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=11938): Terminated: ok {rc=0}
07:51:17.261585 ---      ParallelTerminationStrategy: PID 11939 died...
07:51:17.316935 run   osmo-mgw_10.42.42.4(pid=11939): Terminated {rc=15}
07:51:17.326890 ---      ParallelTerminationStrategy: PID 11940 died...
07:51:17.381889 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=11940): Terminated: ok {rc=0}
07:51:17.391856 ---      ParallelTerminationStrategy: PID 11941 died...
07:51:17.446680 run   osmo-bsc_10.42.42.7(pid=11941): Terminated: ok {rc=0}
07:51:17.456623 ---      ParallelTerminationStrategy: PID 11950 died...
07:51:17.511479 run        osmo-bts-sysmo(pid=11950): Terminated: ok {rc=0}
07:51:17.616807 bus                        /sierra_2: Setting Online False
07:51:18.702571 bus                        /sierra_2: Setting Powered False
07:51:24.068689 bus                        /sierra_2: Setting Powered False
07:51:25.169979 bus                        /sierra_2: Setting Powered False
07:51:26.301842 bus                        /sierra_1: Setting Online False
07:51:27.386537 bus                        /sierra_1: Setting Powered False
07:51:32.968284 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fd2c56dbc80>, timeout=10, timestep=1} [trial-822↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]