Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 80 builds (Since #751 )
Took 1 min 9 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7ff311d0e730>, timeout=10, timestep=1} [trial-830↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-830 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
17:55:01.019924 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
17:55:01.031224 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
17:55:01.162265 tst          emergency_mo_mt_call.py: using LAC 9406
17:55:01.289452 tst          emergency_mo_mt_call.py: using RAC 226
17:55:01.414631 tst          emergency_mo_mt_call.py: using CellId 9406
17:55:01.542926 tst          emergency_mo_mt_call.py: using BVCI 9402
17:55:01.567763 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
17:55:01.578916 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
17:55:01.589997 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
17:55:01.600841 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
17:55:01.611920 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
17:55:01.622868 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
17:55:01.722539 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
17:55:01.916769 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
17:55:02.436406 run          create_hlr_db(pid=3594): Launched
17:55:02.624725 bus                        /sierra_1: Setting Powered False
17:55:03.645110 run          create_hlr_db(pid=3594): Terminated: ok {rc=0}
17:55:04.080653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3596): Launched
17:55:04.407300 run    osmo-hlr_10.42.42.2(pid=3597): Launched
17:55:04.523980 run              osmo-stp_10.42.42.5: Starting osmo-stp
17:55:05.087545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3598): Launched
17:55:05.412973 run    osmo-stp_10.42.42.5(pid=3599): Launched
17:55:05.539676 tst          emergency_mo_mt_call.py: using MSISDN 6122
17:55:05.700997 run              osmo-msc_10.42.42.6: Starting osmo-msc
17:55:06.295420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3600): Launched
17:55:06.622296 run    osmo-msc_10.42.42.6(pid=3601): Launched
17:55:09.795179 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
17:55:10.361772 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=3602): Launched
17:55:10.688210 run    osmo-mgw_10.42.42.3(pid=3603): Launched
17:55:10.803495 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
17:55:11.358839 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3604): Launched
17:55:11.685042 run    osmo-mgw_10.42.42.4(pid=3605): Launched
17:55:11.800633 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
17:55:12.480837 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=3606): Launched
17:55:12.806051 run    osmo-bsc_10.42.42.7(pid=3607): Launched
17:55:19.081447 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
17:55:19.663091 run          rm-remote-dir(pid=3608): Launched
17:55:21.864427 run          rm-remote-dir(pid=3608): Terminated: ok {rc=0}
17:55:22.214841 run          mk-remote-dir(pid=3609): Launched
17:55:24.407267 run          mk-remote-dir(pid=3609): Terminated: ok {rc=0}
17:55:24.687731 run     scp-inst-to-remote(pid=3610): Launched
17:55:37.903533 run     scp-inst-to-remote(pid=3610): Terminated: ok {rc=0}
17:55:38.248947 run          mk-remote-dir(pid=3612): Launched
17:55:41.448629 run          mk-remote-dir(pid=3612): Terminated: ok {rc=0}
17:55:41.744879 run      scp-cfg-to-remote(pid=3613): Launched
17:55:43.944536 run      scp-cfg-to-remote(pid=3613): Terminated: ok {rc=0}
17:55:44.284901 run    reload-dsp-firmware(pid=3615): Launched
17:55:47.481970 run    reload-dsp-firmware(pid=3615): Terminated: ok {rc=0}
17:55:47.813571 run         osmo-bts-sysmo(pid=3616): Launched
17:55:53.062026 tst          emergency_mo_mt_call.py: using MSISDN 6123
17:55:53.233046 bus                        /sierra_1: Setting Powered True
17:55:56.696329 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6123', subscriber_id=1}
17:55:56.876344 bus                        /sierra_2: Setting Powered True
17:56:09.226716 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7ff311d0e730&gt;, timeout=10, timestep=1} [trial-830↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-830↪emergency:sysmo↪emergency_mo_mt_call.py:31]
17:56:09.233476 tst       emergency_mo_mt_call.py:31: Test FAILED (68.2 sec)
17:56:09.268050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3596): Terminating (SIGTERM)
17:56:09.307805 run    osmo-hlr_10.42.42.2(pid=3597): Terminating (SIGTERM)
17:56:09.348507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3598): Terminating (SIGTERM)
17:56:09.391929 run    osmo-stp_10.42.42.5(pid=3599): Terminating (SIGTERM)
17:56:09.444094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3600): Terminating (SIGTERM)
17:56:09.487986 run    osmo-msc_10.42.42.6(pid=3601): Terminating (SIGTERM)
17:56:09.531660 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=3602): Terminating (SIGTERM)
17:56:09.575916 run    osmo-mgw_10.42.42.3(pid=3603): Terminating (SIGTERM)
17:56:09.631475 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3604): Terminating (SIGTERM)
17:56:09.688765 run    osmo-mgw_10.42.42.4(pid=3605): Terminating (SIGTERM)
17:56:09.732688 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=3606): Terminating (SIGTERM)
17:56:09.775296 run    osmo-bsc_10.42.42.7(pid=3607): Terminating (SIGTERM)
17:56:09.818903 run         osmo-bts-sysmo(pid=3616): Terminating (SIGTERM)
17:56:09.828719 ---      ParallelTerminationStrategy: PID 3596 died...
17:56:09.886482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3596): Terminated: ok {rc=0}
17:56:09.896759 ---      ParallelTerminationStrategy: PID 3597 died...
17:56:09.954659 run    osmo-hlr_10.42.42.2(pid=3597): Terminated: ok {rc=0}
17:56:09.965281 ---      ParallelTerminationStrategy: PID 3598 died...
17:56:10.022785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3598): Terminated: ok {rc=0}
17:56:10.033585 ---      ParallelTerminationStrategy: PID 3599 died...
17:56:10.091117 run    osmo-stp_10.42.42.5(pid=3599): Terminated: ok {rc=0}
17:56:10.101779 ---      ParallelTerminationStrategy: PID 3600 died...
17:56:10.160251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3600): Terminated: ok {rc=0}
17:56:10.170594 ---      ParallelTerminationStrategy: PID 3601 died...
17:56:10.227435 run    osmo-msc_10.42.42.6(pid=3601): Terminated: ok {rc=0}
17:56:10.237700 ---      ParallelTerminationStrategy: PID 3602 died...
17:56:10.293333 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=3602): Terminated: ok {rc=0}
17:56:10.303507 ---      ParallelTerminationStrategy: PID 3603 died...
17:56:10.359336 run    osmo-mgw_10.42.42.3(pid=3603): Terminated {rc=15}
17:56:10.369412 ---      ParallelTerminationStrategy: PID 3604 died...
17:56:10.424669 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3604): Terminated: ok {rc=0}
17:56:10.434732 ---      ParallelTerminationStrategy: PID 3605 died...
17:56:10.490391 run    osmo-mgw_10.42.42.4(pid=3605): Terminated {rc=15}
17:56:10.500417 ---      ParallelTerminationStrategy: PID 3606 died...
17:56:10.555998 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=3606): Terminated: ok {rc=0}
17:56:10.566124 ---      ParallelTerminationStrategy: PID 3607 died...
17:56:10.621800 run    osmo-bsc_10.42.42.7(pid=3607): Terminated: ok {rc=0}
17:56:10.631867 ---      ParallelTerminationStrategy: PID 3616 died...
17:56:10.687406 run         osmo-bts-sysmo(pid=3616): Terminated: ok {rc=0}
17:56:10.793722 bus                        /sierra_2: Setting Online False
17:56:11.879351 bus                        /sierra_2: Setting Powered False
17:56:17.960747 bus                        /sierra_2: Setting Powered False
17:56:19.066948 bus                        /sierra_2: Setting Powered False
17:56:20.195485 bus                        /sierra_1: Setting Online False
17:56:21.278173 bus                        /sierra_1: Setting Powered False
17:56:26.969074 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7ff311d0e730>, timeout=10, timestep=1} [trial-830↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]