Skip to content

Failed

voice:sysmo+mod-bts0-dynts-osmo.mo_mt_call_osmux.py (from voice_sysmo+mod-bts0-dynts-osmo)

Failing for the past 73 builds (Since #751 )
Took 1 min 8 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fc0b4489268>, timeout=10, timestep=1} [trial-823↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-823 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py
----------------------------------------------
08:49:33.168713 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
08:49:33.180430 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1)
08:49:33.338977 tst              mo_mt_call_osmux.py: using LAC 8845
08:49:33.467119 tst              mo_mt_call_osmux.py: using RAC 175
08:49:33.589129 tst              mo_mt_call_osmux.py: using CellId 8845
08:49:33.712578 tst              mo_mt_call_osmux.py: using BVCI 8841
08:49:33.736189 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
08:49:33.747159 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
08:49:33.757847 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
08:49:33.769277 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
08:49:33.780596 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6)
08:49:33.791991 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
08:49:33.896845 tst  voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2)
08:49:34.086018 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
08:49:34.576962 run         create_hlr_db(pid=14264): Launched
08:49:34.756713 bus                        /sierra_1: Setting Powered False
08:49:35.778831 run         create_hlr_db(pid=14264): Terminated: ok {rc=0}
08:49:36.197084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14266): Launched
08:49:36.512946 run   osmo-hlr_10.42.42.2(pid=14267): Launched
08:49:36.625129 run              osmo-stp_10.42.42.5: Starting osmo-stp
08:49:37.165813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14268): Launched
08:49:37.479968 run   osmo-stp_10.42.42.5(pid=14269): Launched
08:49:37.591171 run              osmo-msc_10.42.42.6: Starting osmo-msc
08:49:38.160739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14270): Launched
08:49:38.481464 run   osmo-msc_10.42.42.6(pid=14271): Launched
08:49:41.649273 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
08:49:42.190528 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14272): Launched
08:49:42.505956 run   osmo-mgw_10.42.42.3(pid=14273): Launched
08:49:42.617830 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
08:49:43.150572 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14274): Launched
08:49:43.464574 run   osmo-mgw_10.42.42.4(pid=14275): Launched
08:49:43.576181 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
08:49:44.228268 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14276): Launched
08:49:44.546097 run   osmo-bsc_10.42.42.7(pid=14277): Launched
08:49:50.827337 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
08:49:51.421692 run         rm-remote-dir(pid=14278): Launched
08:49:53.627727 run         rm-remote-dir(pid=14278): Terminated: ok {rc=0}
08:49:53.984994 run         mk-remote-dir(pid=14279): Launched
08:49:56.189768 run         mk-remote-dir(pid=14279): Terminated: ok {rc=0}
08:49:56.491083 run    scp-inst-to-remote(pid=14280): Launched
08:50:09.713527 run    scp-inst-to-remote(pid=14280): Terminated: ok {rc=0}
08:50:10.066336 run         mk-remote-dir(pid=14285): Launched
08:50:12.268945 run         mk-remote-dir(pid=14285): Terminated: ok {rc=0}
08:50:12.569670 run     scp-cfg-to-remote(pid=14286): Launched
08:50:14.772658 run     scp-cfg-to-remote(pid=14286): Terminated: ok {rc=0}
08:50:15.119037 run   reload-dsp-firmware(pid=14288): Launched
08:50:18.318789 run   reload-dsp-firmware(pid=14288): Terminated: ok {rc=0}
08:50:18.655864 run        osmo-bts-sysmo(pid=14289): Launched
08:50:23.911957 tst              mo_mt_call_osmux.py: using MSISDN 5749
08:50:24.095130 bus                        /sierra_1: Setting Powered True
08:50:27.590546 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5749', subscriber_id=1}
08:50:27.729621 tst              mo_mt_call_osmux.py: using MSISDN 5750
08:50:27.911393 bus                        /sierra_2: Setting Powered True
08:50:40.281725 tst            mo_mt_call_osmux.py:8: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fc0b4489268&gt;, timeout=10, timestep=1} [trial-823↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]  [trial-823↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8]
08:50:40.290032 tst            mo_mt_call_osmux.py:8: Test FAILED (67.2 sec)
08:50:40.326914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14266): Terminating (SIGTERM)
08:50:40.369561 run   osmo-hlr_10.42.42.2(pid=14267): Terminating (SIGTERM)
08:50:40.416200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14268): Terminating (SIGTERM)
08:50:40.461513 run   osmo-stp_10.42.42.5(pid=14269): Terminating (SIGTERM)
08:50:40.503415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14270): Terminating (SIGTERM)
08:50:40.549063 run   osmo-msc_10.42.42.6(pid=14271): Terminating (SIGTERM)
08:50:40.592452 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14272): Terminating (SIGTERM)
08:50:40.635632 run   osmo-mgw_10.42.42.3(pid=14273): Terminating (SIGTERM)
08:50:40.697125 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14274): Terminating (SIGTERM)
08:50:40.737580 run   osmo-mgw_10.42.42.4(pid=14275): Terminating (SIGTERM)
08:50:40.778672 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14276): Terminating (SIGTERM)
08:50:40.819158 run   osmo-bsc_10.42.42.7(pid=14277): Terminating (SIGTERM)
08:50:40.859371 run        osmo-bts-sysmo(pid=14289): Terminating (SIGTERM)
08:50:40.868508 ---      ParallelTerminationStrategy: PID 14266 died...
08:50:40.922654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14266): Terminated: ok {rc=0}
08:50:40.932207 ---      ParallelTerminationStrategy: PID 14267 died...
08:50:40.985894 run   osmo-hlr_10.42.42.2(pid=14267): Terminated: ok {rc=0}
08:50:40.995512 ---      ParallelTerminationStrategy: PID 14268 died...
08:50:41.048933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14268): Terminated: ok {rc=0}
08:50:41.058726 ---      ParallelTerminationStrategy: PID 14269 died...
08:50:41.113202 run   osmo-stp_10.42.42.5(pid=14269): Terminated: ok {rc=0}
08:50:41.123443 ---      ParallelTerminationStrategy: PID 14270 died...
08:50:41.178299 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14270): Terminated: ok {rc=0}
08:50:41.188572 ---      ParallelTerminationStrategy: PID 14271 died...
08:50:41.243657 run   osmo-msc_10.42.42.6(pid=14271): Terminated: ok {rc=0}
08:50:41.253579 ---      ParallelTerminationStrategy: PID 14272 died...
08:50:41.307356 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=14272): Terminated: ok {rc=0}
08:50:41.316954 ---      ParallelTerminationStrategy: PID 14273 died...
08:50:41.370798 run   osmo-mgw_10.42.42.3(pid=14273): Terminated {rc=15}
08:50:41.380358 ---      ParallelTerminationStrategy: PID 14274 died...
08:50:41.433914 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14274): Terminated: ok {rc=0}
08:50:41.443640 ---      ParallelTerminationStrategy: PID 14275 died...
08:50:41.497221 run   osmo-mgw_10.42.42.4(pid=14275): Terminated {rc=15}
08:50:41.507077 ---      ParallelTerminationStrategy: PID 14276 died...
08:50:41.561535 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=14276): Terminated: ok {rc=0}
08:50:41.571246 ---      ParallelTerminationStrategy: PID 14277 died...
08:50:41.625330 run   osmo-bsc_10.42.42.7(pid=14277): Terminated: ok {rc=0}
08:50:41.635154 ---      ParallelTerminationStrategy: PID 14289 died...
08:50:41.689089 run        osmo-bts-sysmo(pid=14289): Terminated: ok {rc=0}
08:50:41.799352 bus                        /sierra_2: Setting Online False
08:50:42.883842 bus                        /sierra_2: Setting Powered False
08:50:48.967792 bus                        /sierra_2: Setting Powered False
08:50:50.069068 bus                        /sierra_2: Setting Powered False
08:50:51.202212 bus                        /sierra_1: Setting Online False
08:50:52.287003 bus                        /sierra_1: Setting Powered False
08:50:57.970124 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/mo_mt_call_osmux.py", line 8, in <module>
    test_mo_mt_call(True, True)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/voice/lib/testlib.py", line 39, in test_mo_mt_call
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fc0b4489268>, timeout=10, timestep=1} [trial-823↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪/sierra_2]