Skip to content

Failed

voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-ts-tchh+cfg-codec-hr1)

Failing for the past 85 builds (Since #751 )
Took 1 min 10 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6c9421e378>, timeout=10, timestep=1} [trial-835↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-835 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py
----------------------------------------------
22:45:50.130498 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6)
22:45:50.142539 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1)
22:45:50.297099 tst              mo_mt_call_osmux.py: using LAC 9799
22:45:50.428893 tst              mo_mt_call_osmux.py: using RAC 109
22:45:50.559342 tst              mo_mt_call_osmux.py: using CellId 9799
22:45:50.688493 tst              mo_mt_call_osmux.py: using BVCI 9795
22:45:50.713789 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6)
22:45:50.725350 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6)
22:45:50.736667 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6)
22:45:50.748058 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6)
22:45:50.759587 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6)
22:45:50.771095 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2)
22:45:50.876734 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2)
22:45:51.073744 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
22:45:51.604851 run         create_hlr_db(pid=14661): Launched
22:45:51.796269 bus                        /sierra_1: Setting Powered False
22:45:52.817273 run         create_hlr_db(pid=14661): Terminated: ok {rc=0}
22:45:53.257979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14663): Launched
22:45:53.591278 run   osmo-hlr_10.42.42.2(pid=14664): Launched
22:45:53.710236 run              osmo-stp_10.42.42.5: Starting osmo-stp
22:45:54.283799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14665): Launched
22:45:54.616533 run   osmo-stp_10.42.42.5(pid=14666): Launched
22:45:54.734569 run              osmo-msc_10.42.42.6: Starting osmo-msc
22:45:55.338005 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14667): Launched
22:45:55.670155 run   osmo-msc_10.42.42.6(pid=14668): Launched
22:45:58.847236 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
22:45:59.422452 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14669): Launched
22:45:59.756684 run   osmo-mgw_10.42.42.3(pid=14670): Launched
22:45:59.875661 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
22:46:00.443071 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14671): Launched
22:46:00.776126 run   osmo-mgw_10.42.42.4(pid=14672): Launched
22:46:00.895274 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
22:46:01.590961 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14673): Launched
22:46:01.923907 run   osmo-bsc_10.42.42.7(pid=14674): Launched
22:46:08.204727 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
22:46:08.798647 run         rm-remote-dir(pid=14676): Launched
22:46:10.994029 run         rm-remote-dir(pid=14676): Terminated: ok {rc=0}
22:46:11.328794 run         mk-remote-dir(pid=14677): Launched
22:46:13.522599 run         mk-remote-dir(pid=14677): Terminated: ok {rc=0}
22:46:13.806752 run    scp-inst-to-remote(pid=14678): Launched
22:46:27.016416 run    scp-inst-to-remote(pid=14678): Terminated: ok {rc=0}
22:46:27.347442 run         mk-remote-dir(pid=14680): Launched
22:46:30.539545 run         mk-remote-dir(pid=14680): Terminated: ok {rc=0}
22:46:30.824480 run     scp-cfg-to-remote(pid=14681): Launched
22:46:33.014684 run     scp-cfg-to-remote(pid=14681): Terminated: ok {rc=0}
22:46:33.340868 run   reload-dsp-firmware(pid=14683): Launched
22:46:37.532996 run   reload-dsp-firmware(pid=14683): Terminated: ok {rc=0}
22:46:37.851825 run        osmo-bts-sysmo(pid=14684): Launched
22:46:43.090720 tst              mo_mt_call_osmux.py: using MSISDN 6373
22:46:43.263191 bus                        /sierra_1: Setting Powered True
22:46:46.738693 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6373', subscriber_id=1}
22:46:46.880290 tst              mo_mt_call_osmux.py: using MSISDN 6374
22:46:47.053258 bus                        /sierra_2: Setting Powered True
22:46:59.431244 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f6c9421e378&gt;, timeout=10, timestep=1} [trial-835↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-835↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8]
22:46:59.439350 tst            mo_mt_call_osmux.py:8: Test FAILED (69.3 sec)
22:46:59.475372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14663): Terminating (SIGTERM)
22:46:59.516635 run   osmo-hlr_10.42.42.2(pid=14664): Terminating (SIGTERM)
22:46:59.559635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14665): Terminating (SIGTERM)
22:46:59.603336 run   osmo-stp_10.42.42.5(pid=14666): Terminating (SIGTERM)
22:46:59.652069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14667): Terminating (SIGTERM)
22:46:59.715854 run   osmo-msc_10.42.42.6(pid=14668): Terminating (SIGTERM)
22:46:59.764592 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14669): Terminating (SIGTERM)
22:46:59.810255 run   osmo-mgw_10.42.42.3(pid=14670): Terminating (SIGTERM)
22:46:59.865713 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14671): Terminating (SIGTERM)
22:46:59.908681 run   osmo-mgw_10.42.42.4(pid=14672): Terminating (SIGTERM)
22:46:59.950881 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14673): Terminating (SIGTERM)
22:46:59.990710 run   osmo-bsc_10.42.42.7(pid=14674): Terminating (SIGTERM)
22:47:00.031128 run        osmo-bts-sysmo(pid=14684): Terminating (SIGTERM)
22:47:00.042006 ---      ParallelTerminationStrategy: PID 14663 died...
22:47:00.096677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14663): Terminated: ok {rc=0}
22:47:00.107743 ---      ParallelTerminationStrategy: PID 14664 died...
22:47:00.163380 run   osmo-hlr_10.42.42.2(pid=14664): Terminated: ok {rc=0}
22:47:00.173126 ---      ParallelTerminationStrategy: PID 14665 died...
22:47:00.226511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14665): Terminated: ok {rc=0}
22:47:00.236323 ---      ParallelTerminationStrategy: PID 14666 died...
22:47:00.289377 run   osmo-stp_10.42.42.5(pid=14666): Terminated: ok {rc=0}
22:47:00.299425 ---      ParallelTerminationStrategy: PID 14667 died...
22:47:00.352531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14667): Terminated: ok {rc=0}
22:47:00.362240 ---      ParallelTerminationStrategy: PID 14668 died...
22:47:00.415037 run   osmo-msc_10.42.42.6(pid=14668): Terminated: ok {rc=0}
22:47:00.424751 ---      ParallelTerminationStrategy: PID 14669 died...
22:47:00.478095 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14669): Terminated: ok {rc=0}
22:47:00.487833 ---      ParallelTerminationStrategy: PID 14670 died...
22:47:00.540939 run   osmo-mgw_10.42.42.3(pid=14670): Terminated {rc=15}
22:47:00.550752 ---      ParallelTerminationStrategy: PID 14671 died...
22:47:00.603932 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14671): Terminated: ok {rc=0}
22:47:00.614093 ---      ParallelTerminationStrategy: PID 14672 died...
22:47:00.667229 run   osmo-mgw_10.42.42.4(pid=14672): Terminated {rc=15}
22:47:00.677287 ---      ParallelTerminationStrategy: PID 14673 died...
22:47:00.730143 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14673): Terminated: ok {rc=0}
22:47:00.740187 ---      ParallelTerminationStrategy: PID 14674 died...
22:47:00.793544 run   osmo-bsc_10.42.42.7(pid=14674): Terminated: ok {rc=0}
22:47:00.803480 ---      ParallelTerminationStrategy: PID 14684 died...
22:47:00.857032 run        osmo-bts-sysmo(pid=14684): Terminated: ok {rc=0}
22:47:00.965976 bus                        /sierra_2: Setting Online False
22:47:02.050212 bus                        /sierra_2: Setting Powered False
22:47:07.960352 bus                        /sierra_2: Setting Powered False
22:47:09.059458 bus                        /sierra_2: Setting Powered False
22:47:10.185327 bus                        /sierra_1: Setting Online False
22:47:11.267617 bus                        /sierra_1: Setting Powered False
22:47:16.965764 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f6c9421e378>, timeout=10, timestep=1} [trial-835↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]