Skip to content

Failed

voice:sysmo+mod-bts0-dynts-osmo.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-dynts-osmo)

Failing for the past 56 builds (Since #751 )
Took 1 min 6 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f8301585400>, timeout=10, timestep=1} [trial-806↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-806 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py
----------------------------------------------
11:41:10.123390 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
11:41:10.135049 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1)
11:41:10.291384 tst              mo_mt_call_osmux.py: using LAC 7485
11:41:10.414826 tst              mo_mt_call_osmux.py: using RAC 90
11:41:10.538588 tst              mo_mt_call_osmux.py: using CellId 7485
11:41:10.661792 tst              mo_mt_call_osmux.py: using BVCI 7481
11:41:10.685481 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
11:41:10.696281 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
11:41:10.707113 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
11:41:10.718115 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
11:41:10.728883 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
11:41:10.739817 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
11:41:10.843131 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
11:41:11.038580 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
11:41:11.564456 run         create_hlr_db(pid=29481): Launched
11:41:11.753845 bus                        /sierra_1: Setting Powered False
11:41:12.774528 run         create_hlr_db(pid=29481): Terminated: ok {rc=0}
11:41:13.212867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29483): Launched
11:41:13.541391 run   osmo-hlr_10.42.42.2(pid=29484): Launched
11:41:13.659616 run              osmo-stp_10.42.42.5: Starting osmo-stp
11:41:14.230877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29485): Launched
11:41:14.559429 run   osmo-stp_10.42.42.5(pid=29486): Launched
11:41:14.676012 run              osmo-msc_10.42.42.6: Starting osmo-msc
11:41:15.275737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29487): Launched
11:41:15.606787 run   osmo-msc_10.42.42.6(pid=29488): Launched
11:41:18.782005 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
11:41:19.353902 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=29493): Launched
11:41:19.682843 run   osmo-mgw_10.42.42.3(pid=29494): Launched
11:41:19.800459 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
11:41:20.360966 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29495): Launched
11:41:20.690319 run   osmo-mgw_10.42.42.4(pid=29496): Launched
11:41:20.808278 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
11:41:21.495102 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=29497): Launched
11:41:21.826429 run   osmo-bsc_10.42.42.7(pid=29498): Launched
11:41:28.107327 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
11:41:28.698285 run         rm-remote-dir(pid=29500): Launched
11:41:30.900559 run         rm-remote-dir(pid=29500): Terminated: ok {rc=0}
11:41:31.251582 run         mk-remote-dir(pid=29501): Launched
11:41:32.452214 run         mk-remote-dir(pid=29501): Terminated: ok {rc=0}
11:41:32.748248 run    scp-inst-to-remote(pid=29502): Launched
11:41:45.967060 run    scp-inst-to-remote(pid=29502): Terminated: ok {rc=0}
11:41:46.312861 run         mk-remote-dir(pid=29504): Launched
11:41:48.511735 run         mk-remote-dir(pid=29504): Terminated: ok {rc=0}
11:41:48.809269 run     scp-cfg-to-remote(pid=29505): Launched
11:41:51.007814 run     scp-cfg-to-remote(pid=29505): Terminated: ok {rc=0}
11:41:51.351359 run   reload-dsp-firmware(pid=29507): Launched
11:41:53.547981 run   reload-dsp-firmware(pid=29507): Terminated: ok {rc=0}
11:41:53.882368 run        osmo-bts-sysmo(pid=29508): Launched
11:41:59.135070 tst              mo_mt_call_osmux.py: using MSISDN 4848
11:41:59.315835 bus                        /sierra_1: Setting Powered True
11:42:02.806839 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='4848', subscriber_id=1}
11:42:02.943045 tst              mo_mt_call_osmux.py: using MSISDN 4849
11:42:03.111473 bus                        /sierra_2: Setting Powered True
11:42:15.450670 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f8301585400&gt;, timeout=10, timestep=1} [trial-806↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-806↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8]
11:42:15.458766 tst            mo_mt_call_osmux.py:8: Test FAILED (65.4 sec)
11:42:15.497964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29483): Terminating (SIGTERM)
11:42:15.540428 run   osmo-hlr_10.42.42.2(pid=29484): Terminating (SIGTERM)
11:42:15.584212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29485): Terminating (SIGTERM)
11:42:15.628513 run   osmo-stp_10.42.42.5(pid=29486): Terminating (SIGTERM)
11:42:15.681686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29487): Terminating (SIGTERM)
11:42:15.726835 run   osmo-msc_10.42.42.6(pid=29488): Terminating (SIGTERM)
11:42:15.791673 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=29493): Terminating (SIGTERM)
11:42:15.844975 run   osmo-mgw_10.42.42.3(pid=29494): Terminating (SIGTERM)
11:42:15.901371 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29495): Terminating (SIGTERM)
11:42:15.944340 run   osmo-mgw_10.42.42.4(pid=29496): Terminating (SIGTERM)
11:42:15.999180 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=29497): Terminating (SIGTERM)
11:42:16.039065 run   osmo-bsc_10.42.42.7(pid=29498): Terminating (SIGTERM)
11:42:16.079551 run        osmo-bts-sysmo(pid=29508): Terminating (SIGTERM)
11:42:16.091414 ---      ParallelTerminationStrategy: PID 29483 died...
11:42:16.148277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29483): Terminated: ok {rc=0}
11:42:16.158630 ---      ParallelTerminationStrategy: PID 29484 died...
11:42:16.214517 run   osmo-hlr_10.42.42.2(pid=29484): Terminated: ok {rc=0}
11:42:16.224071 ---      ParallelTerminationStrategy: PID 29485 died...
11:42:16.276988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29485): Terminated: ok {rc=0}
11:42:16.286634 ---      ParallelTerminationStrategy: PID 29486 died...
11:42:16.339214 run   osmo-stp_10.42.42.5(pid=29486): Terminated: ok {rc=0}
11:42:16.348783 ---      ParallelTerminationStrategy: PID 29487 died...
11:42:16.401739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29487): Terminated: ok {rc=0}
11:42:16.411371 ---      ParallelTerminationStrategy: PID 29488 died...
11:42:16.464381 run   osmo-msc_10.42.42.6(pid=29488): Terminated: ok {rc=0}
11:42:16.474035 ---      ParallelTerminationStrategy: PID 29493 died...
11:42:16.527065 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=29493): Terminated: ok {rc=0}
11:42:16.536761 ---      ParallelTerminationStrategy: PID 29494 died...
11:42:16.590663 run   osmo-mgw_10.42.42.3(pid=29494): Terminated {rc=15}
11:42:16.600138 ---      ParallelTerminationStrategy: PID 29495 died...
11:42:16.653345 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=29495): Terminated: ok {rc=0}
11:42:16.662914 ---      ParallelTerminationStrategy: PID 29496 died...
11:42:16.716032 run   osmo-mgw_10.42.42.4(pid=29496): Terminated {rc=15}
11:42:16.725834 ---      ParallelTerminationStrategy: PID 29497 died...
11:42:16.778825 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=29497): Terminated: ok {rc=0}
11:42:16.788522 ---      ParallelTerminationStrategy: PID 29498 died...
11:42:16.841522 run   osmo-bsc_10.42.42.7(pid=29498): Terminated: ok {rc=0}
11:42:16.851232 ---      ParallelTerminationStrategy: PID 29508 died...
11:42:16.904178 run        osmo-bts-sysmo(pid=29508): Terminated: ok {rc=0}
11:42:17.006520 bus                        /sierra_2: Setting Online False
11:42:18.091246 bus                        /sierra_2: Setting Powered False
11:42:23.968060 bus                        /sierra_2: Setting Powered False
11:42:25.073281 bus                        /sierra_2: Setting Powered False
11:42:26.200145 bus                        /sierra_1: Setting Online False
11:42:27.285849 bus                        /sierra_1: Setting Powered False
11:42:32.968874 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f8301585400>, timeout=10, timestep=1} [trial-806↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]