Skip to content

Failed

voice:sysmo+mod-bts0-dynts-osmo.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-dynts-osmo)

Failing for the past 92 builds (Since #751 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f191898f2f0>, timeout=10, timestep=1} [trial-842↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-842 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py
----------------------------------------------
07:52:12.114930 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:52:12.126630 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1)
07:52:12.281582 tst              mo_mt_call_osmux.py: using LAC 10365
07:52:12.403525 tst              mo_mt_call_osmux.py: using RAC 165
07:52:12.525524 tst              mo_mt_call_osmux.py: using CellId 10365
07:52:12.645627 tst              mo_mt_call_osmux.py: using BVCI 10361
07:52:12.668760 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:52:12.679741 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:52:12.690502 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:52:12.701414 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:52:12.712339 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
07:52:12.723364 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
07:52:12.827655 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
07:52:13.021131 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
07:52:13.546396 run         create_hlr_db(pid=31799): Launched
07:52:13.736106 bus                        /sierra_1: Setting Powered False
07:52:14.755714 run         create_hlr_db(pid=31799): Terminated: ok {rc=0}
07:52:15.169525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31803): Launched
07:52:15.476416 run   osmo-hlr_10.42.42.2(pid=31804): Launched
07:52:15.586495 run              osmo-stp_10.42.42.5: Starting osmo-stp
07:52:16.119838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31805): Launched
07:52:16.429285 run   osmo-stp_10.42.42.5(pid=31809): Launched
07:52:16.538351 run              osmo-msc_10.42.42.6: Starting osmo-msc
07:52:17.094648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31810): Launched
07:52:17.403472 run   osmo-msc_10.42.42.6(pid=31811): Launched
07:52:20.566807 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
07:52:21.096871 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31812): Launched
07:52:21.403861 run   osmo-mgw_10.42.42.3(pid=31813): Launched
07:52:21.513699 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
07:52:22.036407 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31814): Launched
07:52:22.342868 run   osmo-mgw_10.42.42.4(pid=31815): Launched
07:52:22.451643 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
07:52:23.091894 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31816): Launched
07:52:23.400104 run   osmo-bsc_10.42.42.7(pid=31817): Launched
07:52:29.679255 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
07:52:30.267082 run         rm-remote-dir(pid=31818): Launched
07:52:32.470251 run         rm-remote-dir(pid=31818): Terminated: ok {rc=0}
07:52:32.822504 run         mk-remote-dir(pid=31819): Launched
07:52:35.014676 run         mk-remote-dir(pid=31819): Terminated: ok {rc=0}
07:52:35.293302 run    scp-inst-to-remote(pid=31820): Launched
07:52:49.512674 run    scp-inst-to-remote(pid=31820): Terminated: ok {rc=0}
07:52:49.860414 run         mk-remote-dir(pid=31822): Launched
07:52:52.059638 run         mk-remote-dir(pid=31822): Terminated: ok {rc=0}
07:52:52.356159 run     scp-cfg-to-remote(pid=31823): Launched
07:52:55.559218 run     scp-cfg-to-remote(pid=31823): Terminated: ok {rc=0}
07:52:55.902463 run   reload-dsp-firmware(pid=31825): Launched
07:52:59.099614 run   reload-dsp-firmware(pid=31825): Terminated: ok {rc=0}
07:52:59.431765 run        osmo-bts-sysmo(pid=31826): Launched
07:53:05.682706 tst              mo_mt_call_osmux.py: using MSISDN 6756
07:53:05.865984 bus                        /sierra_1: Setting Powered True
07:53:09.328504 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6756', subscriber_id=1}
07:53:09.462660 tst              mo_mt_call_osmux.py: using MSISDN 6757
07:53:09.630926 bus                        /sierra_2: Setting Powered True
07:53:21.983048 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f191898f2f0&gt;, timeout=10, timestep=1} [trial-842↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-842↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8]
07:53:21.990462 tst            mo_mt_call_osmux.py:8: Test FAILED (69.9 sec)
07:53:22.024711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31803): Terminating (SIGTERM)
07:53:22.063909 run   osmo-hlr_10.42.42.2(pid=31804): Terminating (SIGTERM)
07:53:22.103751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31805): Terminating (SIGTERM)
07:53:22.145701 run   osmo-stp_10.42.42.5(pid=31809): Terminating (SIGTERM)
07:53:22.196530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31810): Terminating (SIGTERM)
07:53:22.243018 run   osmo-msc_10.42.42.6(pid=31811): Terminating (SIGTERM)
07:53:22.286489 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31812): Terminating (SIGTERM)
07:53:22.331527 run   osmo-mgw_10.42.42.3(pid=31813): Terminating (SIGTERM)
07:53:22.374037 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31814): Terminating (SIGTERM)
07:53:22.417078 run   osmo-mgw_10.42.42.4(pid=31815): Terminating (SIGTERM)
07:53:22.480154 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31816): Terminating (SIGTERM)
07:53:22.521634 run   osmo-bsc_10.42.42.7(pid=31817): Terminating (SIGTERM)
07:53:22.563554 run        osmo-bts-sysmo(pid=31826): Terminating (SIGTERM)
07:53:22.573725 ---      ParallelTerminationStrategy: PID 31803 died...
07:53:22.630514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31803): Terminated: ok {rc=0}
07:53:22.642348 ---      ParallelTerminationStrategy: PID 31804 died...
07:53:22.699033 run   osmo-hlr_10.42.42.2(pid=31804): Terminated: ok {rc=0}
07:53:22.709988 ---      ParallelTerminationStrategy: PID 31805 died...
07:53:22.766933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31805): Terminated: ok {rc=0}
07:53:22.777505 ---      ParallelTerminationStrategy: PID 31809 died...
07:53:22.834658 run   osmo-stp_10.42.42.5(pid=31809): Terminated: ok {rc=0}
07:53:22.846130 ---      ParallelTerminationStrategy: PID 31810 died...
07:53:22.902627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31810): Terminated: ok {rc=0}
07:53:22.912994 ---      ParallelTerminationStrategy: PID 31811 died...
07:53:22.969129 run   osmo-msc_10.42.42.6(pid=31811): Terminated: ok {rc=0}
07:53:22.979230 ---      ParallelTerminationStrategy: PID 31812 died...
07:53:23.035101 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=31812): Terminated: ok {rc=0}
07:53:23.045348 ---      ParallelTerminationStrategy: PID 31813 died...
07:53:23.101131 run   osmo-mgw_10.42.42.3(pid=31813): Terminated {rc=15}
07:53:23.111384 ---      ParallelTerminationStrategy: PID 31814 died...
07:53:23.167669 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=31814): Terminated: ok {rc=0}
07:53:23.178162 ---      ParallelTerminationStrategy: PID 31815 died...
07:53:23.233866 run   osmo-mgw_10.42.42.4(pid=31815): Terminated {rc=15}
07:53:23.244412 ---      ParallelTerminationStrategy: PID 31816 died...
07:53:23.300532 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=31816): Terminated: ok {rc=0}
07:53:23.310644 ---      ParallelTerminationStrategy: PID 31817 died...
07:53:23.366741 run   osmo-bsc_10.42.42.7(pid=31817): Terminated: ok {rc=0}
07:53:23.376876 ---      ParallelTerminationStrategy: PID 31826 died...
07:53:23.433570 run        osmo-bts-sysmo(pid=31826): Terminated: ok {rc=0}
07:53:23.538168 bus                        /sierra_2: Setting Online False
07:53:24.624181 bus                        /sierra_2: Setting Powered False
07:53:29.970729 bus                        /sierra_2: Setting Powered False
07:53:31.075666 bus                        /sierra_2: Setting Powered False
07:53:32.203286 bus                        /sierra_1: Setting Online False
07:53:33.290300 bus                        /sierra_1: Setting Powered False
07:53:38.957949 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f191898f2f0>, timeout=10, timestep=1} [trial-842↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]