Skip to content

Failed

emergency:sysmo.emergency_mo_mt_call.py (from emergency_sysmo)

Failing for the past 76 builds (Since #751 )
Took 1 min 7 sec.

Stacktrace

/sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f2fd0362268>, timeout=10, timestep=1} [trial-826↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]

Standard Output

----------------------------------------------
trial-826 emergency:sysmo emergency_mo_mt_call.py
----------------------------------------------
11:49:48.008289 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
11:49:48.019146 tst                  emergency:sysmo: Using 1 x bts (candidates: 1)
11:49:48.144151 tst          emergency_mo_mt_call.py: using LAC 9086
11:49:48.265813 tst          emergency_mo_mt_call.py: using RAC 161
11:49:48.383811 tst          emergency_mo_mt_call.py: using CellId 9086
11:49:48.502884 tst          emergency_mo_mt_call.py: using BVCI 9082
11:49:48.525949 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
11:49:48.536568 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
11:49:48.547079 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
11:49:48.557770 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
11:49:48.568293 tst                  emergency:sysmo: Using 1 x ip_address (candidates: 6)
11:49:48.579029 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
11:49:48.682049 tst                  emergency:sysmo: Using 1 x modem (candidates: 4)
11:49:48.877686 run              osmo-hlr_10.42.42.2: Starting osmo-hlr
11:49:49.397576 run         create_hlr_db(pid=20850): Launched
11:49:49.587550 bus                        /sierra_1: Setting Powered False
11:49:50.606929 run         create_hlr_db(pid=20850): Terminated: ok {rc=0}
11:49:51.043083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20852): Launched
11:49:51.368775 run   osmo-hlr_10.42.42.2(pid=20853): Launched
11:49:51.485414 run              osmo-stp_10.42.42.5: Starting osmo-stp
11:49:52.049487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20854): Launched
11:49:52.376805 run   osmo-stp_10.42.42.5(pid=20855): Launched
11:49:52.501655 tst          emergency_mo_mt_call.py: using MSISDN 5910
11:49:52.651868 run              osmo-msc_10.42.42.6: Starting osmo-msc
11:49:53.209440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20856): Launched
11:49:53.516010 run   osmo-msc_10.42.42.6(pid=20857): Launched
11:49:56.678458 run              osmo-mgw_10.42.42.3: Starting osmo-mgw
11:49:57.208349 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=20858): Launched
11:49:57.516914 run   osmo-mgw_10.42.42.3(pid=20859): Launched
11:49:57.624864 run              osmo-mgw_10.42.42.4: Starting osmo-mgw
11:49:58.143389 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=20860): Launched
11:49:58.451413 run   osmo-mgw_10.42.42.4(pid=20861): Launched
11:49:58.560419 run              osmo-bsc_10.42.42.7: Starting osmo-bsc
11:49:59.199170 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=20862): Launched
11:49:59.507967 run   osmo-bsc_10.42.42.7(pid=20863): Launched
11:50:05.767784 run                   osmo-bts-sysmo: Starting sysmoBTS to connect to osmo-bsc_10.42.42.7
11:50:06.311630 run         rm-remote-dir(pid=20867): Launched
11:50:08.502306 run         rm-remote-dir(pid=20867): Terminated: ok {rc=0}
11:50:08.831767 run         mk-remote-dir(pid=20868): Launched
11:50:11.021414 run         mk-remote-dir(pid=20868): Terminated: ok {rc=0}
11:50:11.301233 run    scp-inst-to-remote(pid=20869): Launched
11:50:24.511806 run    scp-inst-to-remote(pid=20869): Terminated: ok {rc=0}
11:50:24.857241 run         mk-remote-dir(pid=20871): Launched
11:50:27.056901 run         mk-remote-dir(pid=20871): Terminated: ok {rc=0}
11:50:27.354677 run     scp-cfg-to-remote(pid=20872): Launched
11:50:29.553537 run     scp-cfg-to-remote(pid=20872): Terminated: ok {rc=0}
11:50:29.895193 run   reload-dsp-firmware(pid=20874): Launched
11:50:34.095371 run   reload-dsp-firmware(pid=20874): Terminated: ok {rc=0}
11:50:34.427988 run        osmo-bts-sysmo(pid=20875): Launched
11:50:38.678626 tst          emergency_mo_mt_call.py: using MSISDN 5911
11:50:38.849313 bus                        /sierra_1: Setting Powered True
11:50:42.314989 run              osmo-hlr_10.42.42.2: Add subscriber {algo=1, algo_str='comp128v1', imsi='901700000009031', msisdn='5911', subscriber_id=1}
11:50:42.509918 bus                        /sierra_2: Setting Powered True
11:50:54.882636 tst       emergency_mo_mt_call.py:31: ERR: Error: /sierra_2: Wait timeout {condition=&lt;function Modem.imsi.&lt;locals&gt;.&lt;lambda&gt; at 0x7f2fd0362268&gt;, timeout=10, timestep=1} [trial-826↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]  [trial-826↪emergency:sysmo↪emergency_mo_mt_call.py:31]
11:50:54.889484 tst       emergency_mo_mt_call.py:31: Test FAILED (66.9 sec)
11:50:54.925993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20852): Terminating (SIGTERM)
11:50:54.966376 run   osmo-hlr_10.42.42.2(pid=20853): Terminating (SIGTERM)
11:50:55.007843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20854): Terminating (SIGTERM)
11:50:55.051296 run   osmo-stp_10.42.42.5(pid=20855): Terminating (SIGTERM)
11:50:55.102848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20856): Terminating (SIGTERM)
11:50:55.148142 run   osmo-msc_10.42.42.6(pid=20857): Terminating (SIGTERM)
11:50:55.191611 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=20858): Terminating (SIGTERM)
11:50:55.237840 run   osmo-mgw_10.42.42.3(pid=20859): Terminating (SIGTERM)
11:50:55.293968 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=20860): Terminating (SIGTERM)
11:50:55.338967 run   osmo-mgw_10.42.42.4(pid=20861): Terminating (SIGTERM)
11:50:55.383870 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=20862): Terminating (SIGTERM)
11:50:55.427258 run   osmo-bsc_10.42.42.7(pid=20863): Terminating (SIGTERM)
11:50:55.469026 run        osmo-bts-sysmo(pid=20875): Terminating (SIGTERM)
11:50:55.479106 ---      ParallelTerminationStrategy: PID 20852 died...
11:50:55.535612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=20852): Terminated: ok {rc=0}
11:50:55.546228 ---      ParallelTerminationStrategy: PID 20853 died...
11:50:55.602150 run   osmo-hlr_10.42.42.2(pid=20853): Terminated: ok {rc=0}
11:50:55.612594 ---      ParallelTerminationStrategy: PID 20854 died...
11:50:55.670120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=20854): Terminated: ok {rc=0}
11:50:55.680681 ---      ParallelTerminationStrategy: PID 20855 died...
11:50:55.737984 run   osmo-stp_10.42.42.5(pid=20855): Terminated: ok {rc=0}
11:50:55.748381 ---      ParallelTerminationStrategy: PID 20856 died...
11:50:55.804962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=20856): Terminated: ok {rc=0}
11:50:55.815472 ---      ParallelTerminationStrategy: PID 20857 died...
11:50:55.871786 run   osmo-msc_10.42.42.6(pid=20857): Terminated: ok {rc=0}
11:50:55.881877 ---      ParallelTerminationStrategy: PID 20858 died...
11:50:55.937476 run pcap-recorder_any(filters='host 10.42.42.3 and port not 22')(pid=20858): Terminated: ok {rc=0}
11:50:55.947576 ---      ParallelTerminationStrategy: PID 20859 died...
11:50:56.003269 run   osmo-mgw_10.42.42.3(pid=20859): Terminated {rc=15}
11:50:56.013436 ---      ParallelTerminationStrategy: PID 20860 died...
11:50:56.068852 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=20860): Terminated: ok {rc=0}
11:50:56.078966 ---      ParallelTerminationStrategy: PID 20861 died...
11:50:56.134421 run   osmo-mgw_10.42.42.4(pid=20861): Terminated {rc=15}
11:50:56.144426 ---      ParallelTerminationStrategy: PID 20862 died...
11:50:56.200323 run pcap-recorder_any(filters='host 10.42.42.7 and port not 22')(pid=20862): Terminated: ok {rc=0}
11:50:56.210487 ---      ParallelTerminationStrategy: PID 20863 died...
11:50:56.266240 run   osmo-bsc_10.42.42.7(pid=20863): Terminated: ok {rc=0}
11:50:56.276310 ---      ParallelTerminationStrategy: PID 20875 died...
11:50:56.332219 run        osmo-bts-sysmo(pid=20875): Terminated: ok {rc=0}
11:50:56.437453 bus                        /sierra_2: Setting Online False
11:50:57.524500 bus                        /sierra_2: Setting Powered False
11:51:02.960538 bus                        /sierra_2: Setting Powered False
11:51:04.063056 bus                        /sierra_2: Setting Powered False
11:51:05.196711 bus                        /sierra_1: Setting Online False
11:51:06.281120 bus                        /sierra_1: Setting Powered False
11:51:11.955890 bus                        /sierra_1: Setting Powered False

Standard Error

Traceback (most recent call last):
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/test.py", line 76, in run
    self.path)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/util.py", line 414, in run_python_file
    spec.loader.exec_module( importlib.util.module_from_spec(spec) )
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/sysmocom/suites/emergency/emergency_mo_mt_call.py", line 31, in <module>
    hlr.subscriber_add(ms_mt)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/hlr_osmo.py", line 121, in subscriber_add
    self.log('Add subscriber', msisdn=msisdn, imsi=modem.imsi(), subscriber_id=subscriber_id,
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 467, in imsi
    MainLoop.wait(lambda: simmgr.GetProperties().get('SubscriberIdentity', None) is not None, timeout=10)
  File "/home/jenkins/workspace/osmo-gsm-tester_run-rnd/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 109, in wait
    raise log.Error('Wait timeout', condition=condition, timeout=timeout, timestep=timestep)
osmo_gsm_tester.core.log.Error: /sierra_2: Wait timeout {condition=<function Modem.imsi.<locals>.<lambda> at 0x7f2fd0362268>, timeout=10, timestep=1} [trial-826↪emergency:sysmo↪emergency_mo_mt_call.py:31↪emergency_mo_mt_call.py↪/sierra_2]