Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 94 builds (Since #751 )
Took 1 min 11 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f36201ba400>, timeout=10, timestep=1} [trial-844↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-844 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
09:54:53.010956 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
09:54:53.021711 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
09:54:53.154687 tst          emergency_mo_mt_call.py: using LAC 10526
09:54:53.284036 tst          emergency_mo_mt_call.py: using RAC 71
09:54:53.410531 tst          emergency_mo_mt_call.py: using CellId 10526
09:54:53.537637 tst          emergency_mo_mt_call.py: using BVCI 10522
09:54:53.562522 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
09:54:53.573894 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
09:54:53.584918 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
09:54:53.595945 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
09:54:53.607083 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
09:54:53.618079 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
09:54:53.723294 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
09:54:53.908830 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
09:54:54.404925 run          create_hlr_db(pid=3623): Launched
09:54:54.594496 bus                        /sierra_1: Setting Powered False
09:54:55.614941 run          create_hlr_db(pid=3623): Terminated: ok {rc=0}
09:54:56.048606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3625): Launched
09:54:56.374845 run    osmo-hlr_10.42.42.2(pid=3626): Launched
09:54:56.491428 run              osmo-stp_10.42.42.5: Starting osmo-stp
09:54:57.054075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3627): Launched
09:54:57.380599 run    osmo-stp_10.42.42.5(pid=3628): Launched
09:54:57.509813 tst          emergency_mo_mt_call.py: using MSISDN 6864
09:54:57.670623 run              osmo-msc_10.42.42.6: Starting osmo-msc
09:54:58.263167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3629): Launched
09:54:58.588148 run    osmo-msc_10.42.42.6(pid=3630): Launched
09:55:01.760776 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
09:55:02.343578 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=3639): Launched
09:55:02.777531 run    osmo-mgw_10.42.42.3(pid=3646): Launched
09:55:02.914667 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
09:55:03.488884 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3747): Launched
09:55:03.867987 run    osmo-mgw_10.42.42.4(pid=3823): Launched
09:55:04.041212 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
09:55:04.784870 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=3905): Launched
09:55:05.130780 run    osmo-bsc_10.42.42.7(pid=3935): Launched
09:55:11.401121 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
09:55:11.947196 run          rm-remote-dir(pid=4186): Launched
09:55:14.137245 run          rm-remote-dir(pid=4186): Terminated: ok {rc=0}
09:55:14.462505 run          mk-remote-dir(pid=4187): Launched
09:55:16.653557 run          mk-remote-dir(pid=4187): Terminated: ok {rc=0}
09:55:16.929600 run     scp-inst-to-remote(pid=4188): Launched
09:55:31.145566 run     scp-inst-to-remote(pid=4188): Terminated: ok {rc=0}
09:55:31.487955 run          mk-remote-dir(pid=4190): Launched
09:55:33.685438 run          mk-remote-dir(pid=4190): Terminated: ok {rc=0}
09:55:33.978694 run      scp-cfg-to-remote(pid=4191): Launched
09:55:37.175745 run      scp-cfg-to-remote(pid=4191): Terminated: ok {rc=0}
09:55:37.512978 run    reload-dsp-firmware(pid=4193): Launched
09:55:41.711389 run    reload-dsp-firmware(pid=4193): Terminated: ok {rc=0}
09:55:42.040579 run         osmo-bts-sysmo(pid=4194): Launched
09:55:47.288303 tst          emergency_mo_mt_call.py: using MSISDN 6865
09:55:47.466634 bus                        /sierra_1: Setting Powered True
09:55:50.951822 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='6865', subscriber_id=1}
09:55:51.142179 bus                        /sierra_2: Setting Powered True
09:56:03.511781 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f36201ba400&gt;, timeout=10, timestep=1} [trial-844↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-844↪emergency:sysmo↪emergency_mo_mt_call.py:31]
09:56:03.518569 tst       emergency_mo_mt_call.py:31: Test FAILED (70.5 sec)
09:56:03.553530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3625): Terminating (SIGTERM)
09:56:03.598377 run    osmo-hlr_10.42.42.2(pid=3626): Terminating (SIGTERM)
09:56:03.642299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3627): Terminating (SIGTERM)
09:56:03.686870 run    osmo-stp_10.42.42.5(pid=3628): Terminating (SIGTERM)
09:56:03.741586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3629): Terminating (SIGTERM)
09:56:03.799030 run    osmo-msc_10.42.42.6(pid=3630): Terminating (SIGTERM)
09:56:03.843958 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=3639): Terminating (SIGTERM)
09:56:03.889829 run    osmo-mgw_10.42.42.3(pid=3646): Terminating (SIGTERM)
09:56:03.947521 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3747): Terminating (SIGTERM)
09:56:03.993684 run    osmo-mgw_10.42.42.4(pid=3823): Terminating (SIGTERM)
09:56:04.045844 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=3905): Terminating (SIGTERM)
09:56:04.088070 run    osmo-bsc_10.42.42.7(pid=3935): Terminating (SIGTERM)
09:56:04.130387 run         osmo-bts-sysmo(pid=4194): Terminating (SIGTERM)
09:56:04.140178 ---      ParallelTerminationStrategy: PID 3625 died...
09:56:04.196973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3625): Terminated: ok {rc=0}
09:56:04.207749 ---      ParallelTerminationStrategy: PID 3626 died...
09:56:04.264410 run    osmo-hlr_10.42.42.2(pid=3626): Terminated: ok {rc=0}
09:56:04.275057 ---      ParallelTerminationStrategy: PID 3627 died...
09:56:04.333094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3627): Terminated: ok {rc=0}
09:56:04.344212 ---      ParallelTerminationStrategy: PID 3628 died...
09:56:04.402901 run    osmo-stp_10.42.42.5(pid=3628): Terminated: ok {rc=0}
09:56:04.414091 ---      ParallelTerminationStrategy: PID 3629 died...
09:56:04.472175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3629): Terminated: ok {rc=0}
09:56:04.482808 ---      ParallelTerminationStrategy: PID 3630 died...
09:56:04.540470 run    osmo-msc_10.42.42.6(pid=3630): Terminated: ok {rc=0}
09:56:04.550697 ---      ParallelTerminationStrategy: PID 3639 died...
09:56:04.607175 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=3639): Terminated: ok {rc=0}
09:56:04.617553 ---      ParallelTerminationStrategy: PID 3646 died...
09:56:04.673694 run    osmo-mgw_10.42.42.3(pid=3646): Terminated {rc=15}
09:56:04.683785 ---      ParallelTerminationStrategy: PID 3747 died...
09:56:04.740161 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=3747): Terminated: ok {rc=0}
09:56:04.750261 ---      ParallelTerminationStrategy: PID 3823 died...
09:56:04.806489 run    osmo-mgw_10.42.42.4(pid=3823): Terminated {rc=15}
09:56:04.816778 ---      ParallelTerminationStrategy: PID 3905 died...
09:56:04.873497 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=3905): Terminated: ok {rc=0}
09:56:04.883677 ---      ParallelTerminationStrategy: PID 3935 died...
09:56:04.939885 run    osmo-bsc_10.42.42.7(pid=3935): Terminated: ok {rc=0}
09:56:04.950112 ---      ParallelTerminationStrategy: PID 4194 died...
09:56:05.006447 run         osmo-bts-sysmo(pid=4194): Terminated: ok {rc=0}
09:56:05.114169 bus                        /sierra_2: Setting Online False
09:56:06.200589 bus                        /sierra_2: Setting Powered False
09:56:11.967607 bus                        /sierra_2: Setting Powered False
09:56:13.074408 bus                        /sierra_2: Setting Powered False
09:56:14.203297 bus                        /sierra_1: Setting Online False
09:56:15.288956 bus                        /sierra_1: Setting Powered False
09:56:20.969981 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f36201ba400>, timeout=10, timestep=1} [trial-844↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]