Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 79 builds (Since #751 )
Took 1 min 9 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fe8d8148c80>, timeout=10, timestep=1} [trial-829↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-829 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
16:55:14.005475 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
16:55:14.016655 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
16:55:14.157726 tst          emergency_mo_mt_call.py: using LAC 9326
16:55:14.291308 tst          emergency_mo_mt_call.py: using RAC 146
16:55:14.418838 tst          emergency_mo_mt_call.py: using CellId 9326
16:55:14.545652 tst          emergency_mo_mt_call.py: using BVCI 9322
16:55:14.570337 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
16:55:14.581522 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
16:55:14.592600 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
16:55:14.603626 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
16:55:14.614662 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
16:55:14.625629 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
16:55:14.730701 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
16:55:14.929828 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
16:55:15.454440 run           create_hlr_db(pid=645): Launched
16:55:15.643590 bus                        /sierra_1: Setting Powered False
16:55:16.663425 run           create_hlr_db(pid=645): Terminated: ok {rc=0}
16:55:17.075232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=647): Launched
16:55:17.382478 run     osmo-hlr_10.42.42.2(pid=648): Launched
16:55:17.492104 run              osmo-stp_10.42.42.5: Starting osmo-stp
16:55:18.023897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=649): Launched
16:55:18.330342 run     osmo-stp_10.42.42.5(pid=650): Launched
16:55:18.452417 tst          emergency_mo_mt_call.py: using MSISDN 6069
16:55:18.603730 run              osmo-msc_10.42.42.6: Starting osmo-msc
16:55:19.164580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=651): Launched
16:55:19.475971 run     osmo-msc_10.42.42.6(pid=652): Launched
16:55:22.639766 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
16:55:23.175727 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=653): Launched
16:55:23.485266 run     osmo-mgw_10.42.42.3(pid=654): Launched
16:55:23.594452 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
16:55:24.115748 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=655): Launched
16:55:24.424240 run     osmo-mgw_10.42.42.4(pid=656): Launched
16:55:24.533984 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
16:55:25.175762 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=657): Launched
16:55:25.489129 run     osmo-bsc_10.42.42.7(pid=658): Launched
16:55:31.766267 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
16:55:32.350606 run           rm-remote-dir(pid=659): Launched
16:55:34.552605 run           rm-remote-dir(pid=659): Terminated: ok {rc=0}
16:55:34.903905 run           mk-remote-dir(pid=660): Launched
16:55:37.103986 run           mk-remote-dir(pid=660): Terminated: ok {rc=0}
16:55:37.400665 run      scp-inst-to-remote(pid=661): Launched
16:55:50.619437 run      scp-inst-to-remote(pid=661): Terminated: ok {rc=0}
16:55:50.966049 run           mk-remote-dir(pid=663): Launched
16:55:53.163895 run           mk-remote-dir(pid=663): Terminated: ok {rc=0}
16:55:53.462720 run       scp-cfg-to-remote(pid=664): Launched
16:55:56.663646 run       scp-cfg-to-remote(pid=664): Terminated: ok {rc=0}
16:55:57.005800 run     reload-dsp-firmware(pid=666): Launched
16:56:00.202698 run     reload-dsp-firmware(pid=666): Terminated: ok {rc=0}
16:56:00.535704 run          osmo-bts-sysmo(pid=667): Launched
16:56:05.790596 tst          emergency_mo_mt_call.py: using MSISDN 6070
16:56:05.962395 bus                        /sierra_1: Setting Powered True
16:56:09.451203 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6070', subscriber_id=1}
16:56:09.642582 bus                        /sierra_2: Setting Powered True
16:56:22.008563 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7fe8d8148c80&gt;, timeout=10, timestep=1} [trial-829↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-829↪emergency:sysmo↪emergency_mo_mt_call.py:31]
16:56:22.015794 tst       emergency_mo_mt_call.py:31: Test FAILED (68.0 sec)
16:56:22.051598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=647): Terminating (SIGTERM)
16:56:22.092976 run     osmo-hlr_10.42.42.2(pid=648): Terminating (SIGTERM)
16:56:22.135823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=649): Terminating (SIGTERM)
16:56:22.178504 run     osmo-stp_10.42.42.5(pid=650): Terminating (SIGTERM)
16:56:22.227821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=651): Terminating (SIGTERM)
16:56:22.272418 run     osmo-msc_10.42.42.6(pid=652): Terminating (SIGTERM)
16:56:22.317113 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=653): Terminating (SIGTERM)
16:56:22.361650 run     osmo-mgw_10.42.42.3(pid=654): Terminating (SIGTERM)
16:56:22.420187 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=655): Terminating (SIGTERM)
16:56:22.462339 run     osmo-mgw_10.42.42.4(pid=656): Terminating (SIGTERM)
16:56:22.518955 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=657): Terminating (SIGTERM)
16:56:22.559063 run     osmo-bsc_10.42.42.7(pid=658): Terminating (SIGTERM)
16:56:22.598739 run          osmo-bts-sysmo(pid=667): Terminating (SIGTERM)
16:56:22.608476 ---      ParallelTerminationStrategy: PID 647 died...
16:56:22.662803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=647): Terminated: ok {rc=0}
16:56:22.672184 ---      ParallelTerminationStrategy: PID 648 died...
16:56:22.730659 run     osmo-hlr_10.42.42.2(pid=648): Terminated: ok {rc=0}
16:56:22.740702 ---      ParallelTerminationStrategy: PID 649 died...
16:56:22.795014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=649): Terminated: ok {rc=0}
16:56:22.805824 ---      ParallelTerminationStrategy: PID 650 died...
16:56:22.861031 run     osmo-stp_10.42.42.5(pid=650): Terminated: ok {rc=0}
16:56:22.870535 ---      ParallelTerminationStrategy: PID 651 died...
16:56:22.923625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=651): Terminated: ok {rc=0}
16:56:22.933841 ---      ParallelTerminationStrategy: PID 652 died...
16:56:22.986918 run     osmo-msc_10.42.42.6(pid=652): Terminated: ok {rc=0}
16:56:22.996997 ---      ParallelTerminationStrategy: PID 653 died...
16:56:23.051078 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=653): Terminated: ok {rc=0}
16:56:23.060605 ---      ParallelTerminationStrategy: PID 654 died...
16:56:23.113852 run     osmo-mgw_10.42.42.3(pid=654): Terminated {rc=15}
16:56:23.123948 ---      ParallelTerminationStrategy: PID 655 died...
16:56:23.177320 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=655): Terminated: ok {rc=0}
16:56:23.187524 ---      ParallelTerminationStrategy: PID 656 died...
16:56:23.241254 run     osmo-mgw_10.42.42.4(pid=656): Terminated {rc=15}
16:56:23.251342 ---      ParallelTerminationStrategy: PID 657 died...
16:56:23.305277 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=657): Terminated: ok {rc=0}
16:56:23.314840 ---      ParallelTerminationStrategy: PID 658 died...
16:56:23.368831 run     osmo-bsc_10.42.42.7(pid=658): Terminated: ok {rc=0}
16:56:23.378417 ---      ParallelTerminationStrategy: PID 667 died...
16:56:23.432526 run          osmo-bts-sysmo(pid=667): Terminated: ok {rc=0}
16:56:23.540503 bus                        /sierra_2: Setting Online False
16:56:24.624916 bus                        /sierra_2: Setting Powered False
16:56:29.991269 bus                        /sierra_2: Setting Powered False
16:56:31.093105 bus                        /sierra_2: Setting Powered False
16:56:32.225328 bus                        /sierra_1: Setting Online False
16:56:33.310275 bus                        /sierra_1: Setting Powered False
16:56:38.957464 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7fe8d8148c80>, timeout=10, timestep=1} [trial-829↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]