Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9243 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9113 originally caused by: Started by upstream project "master-libosmo-netif" build number 6958 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8702 originally caused by: Started by upstream project "master-osmo-hlr" build number 8836 originally caused by: Started by upstream project "master-libosmo-netif" build number 6958 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30050 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37204 originally caused by: Started by upstream project "master-libosmo-netif" build number 6958 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37205 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9113 originally caused by: Started by upstream project "master-libosmo-netif" build number 6958 Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17661 originally caused by: Started by upstream project "master-osmo-bsc" build number 20116 originally caused by: Started by upstream project "master-osmo-mgw" build number 9180 originally caused by: Started by upstream project "master-libosmo-netif" build number 6958 originally caused by: Started by timer Started by upstream project "master-libosmo-sccp" build number 9113 originally caused by: Started by upstream project "master-libosmo-netif" build number 6958 Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29272 originally caused by: Started by upstream project "master-osmo-msc" build number 34220 originally caused by: Started by upstream project "master-osmo-mgw" build number 9180 originally caused by: Started by upstream project "master-libosmo-netif" build number 6958 originally caused by: Started by timer Started by upstream project "master-libosmo-sccp" build number 9113 originally caused by: Started by upstream project "master-libosmo-netif" build number 6958 Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12972 originally caused by: Started by upstream project "master-openbsc" build number 13168 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9113 originally caused by: Started by upstream project "master-libosmo-netif" build number 6958 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30051 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37206 originally caused by: Started by upstream project "master-osmo-iuh" build number 12855 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9113 originally caused by: Started by upstream project "master-libosmo-netif" build number 6958 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29273 originally caused by: Started by upstream project "master-osmo-msc" build number 34221 originally caused by: Started by upstream project "master-osmo-iuh" build number 12855 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9113 originally caused by: Started by upstream project "master-libosmo-netif" build number 6958 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8703 originally caused by: Started by upstream project "master-osmo-hlr" build number 8837 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12973 originally caused by: Started by upstream project "master-openbsc" build number 13169 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6682 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6677 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30052 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37207 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6677 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9244 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9114 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17662 originally caused by: Started by upstream project "master-osmo-bsc" build number 20117 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9114 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29274 originally caused by: Started by upstream project "master-osmo-msc" build number 34222 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9114 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30053 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37208 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9114 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12974 originally caused by: Started by upstream project "master-openbsc" build number 13170 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9114 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29275 originally caused by: Started by upstream project "master-osmo-msc" build number 34223 originally caused by: Started by upstream project "master-osmo-iuh" build number 12856 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9114 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30054 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37209 originally caused by: Started by upstream project "master-osmo-iuh" build number 12856 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9114 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29276 originally caused by: Started by upstream project "master-osmo-msc" build number 34224 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6683 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6678 originally caused by: Started by upstream project "master-libosmocore" build number 3068 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8949 originally caused by: Started by upstream project "master-osmo-mgw" build number 9181 originally caused by: Started by upstream project "master-libosmo-netif" build number 6959 originally caused by: Started by upstream project "master-libosmo-abis" build number 4955 originally caused by: Started by upstream project "master-libosmocore" build number 3068 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29277 originally caused by: Started by upstream project "master-osmo-msc" build number 34225 originally caused by: Started by upstream project "master-libsmpp34" build number 1814 originally caused by: Started by timer Started by timer Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8704 originally caused by: Started by upstream project "master-osmo-hlr" build number 8838 originally caused by: Started by upstream project "master-libosmo-netif" build number 6959 originally caused by: Started by upstream project "master-libosmo-abis" build number 4955 originally caused by: Started by upstream project "master-libosmocore" build number 3068 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9245 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9115 originally caused by: Started by upstream project "master-libosmo-netif" build number 6959 originally caused by: Started by upstream project "master-libosmo-abis" build number 4955 originally caused by: Started by upstream project "master-libosmocore" build number 3068 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30055 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37210 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6678 originally caused by: Started by upstream project "master-libosmocore" build number 3068 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37211 originally caused by: Started by upstream project "master-libosmo-netif" build number 6959 originally caused by: Started by upstream project "master-libosmo-abis" build number 4955 originally caused by: Started by upstream project "master-libosmocore" build number 3068 Started by upstream project "master-osmo-sgsn" build number 37212 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9115 originally caused by: Started by upstream project "master-libosmo-netif" build number 6959 Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12975 originally caused by: Started by upstream project "master-openbsc" build number 13171 originally caused by: Started by upstream project "master-libsmpp34" build number 1814 originally caused by: Started by timer Started by upstream project "master-openbsc" build number 13172 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9115 originally caused by: Started by upstream project "master-libosmo-netif" build number 6959 originally caused by: Started by upstream project "master-libosmo-abis" build number 4955 originally caused by: Started by upstream project "master-libosmocore" build number 3068 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17663 originally caused by: Started by upstream project "master-osmo-bsc" build number 20118 originally caused by: Started by upstream project "master-osmo-mgw" build number 9181 originally caused by: Started by upstream project "master-libosmo-netif" build number 6959 originally caused by: Started by upstream project "master-libosmo-abis" build number 4955 originally caused by: Started by upstream project "master-libosmocore" build number 3068 originally caused by: Started by timer Started by upstream project "master-osmo-bsc" build number 20119 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9115 originally caused by: Started by upstream project "master-libosmo-netif" build number 6959 Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29278 originally caused by: Started by upstream project "master-osmo-msc" build number 34226 originally caused by: Started by upstream project "master-osmo-mgw" build number 9181 originally caused by: Started by upstream project "master-libosmo-netif" build number 6959 originally caused by: Started by upstream project "master-libosmo-abis" build number 4955 originally caused by: Started by upstream project "master-libosmocore" build number 3068 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34227 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9115 originally caused by: Started by upstream project "master-libosmo-netif" build number 6959 Started by upstream project "master-osmo-msc" build number 34228 originally caused by: Started by upstream project "master-osmo-iuh" build number 12857 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9115 Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30056 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37213 originally caused by: Started by upstream project "master-osmo-iuh" build number 12857 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9115 originally caused by: Started by upstream project "master-libosmo-netif" build number 6959 originally caused by: Started by upstream project "master-libosmo-abis" build number 4955 originally caused by: Started by upstream project "master-libosmocore" build number 3068 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9246 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9116 originally caused by: Started by upstream project "master-libosmo-netif" build number 6960 originally caused by: Started by upstream project "master-libosmo-abis" build number 4956 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8705 originally caused by: Started by upstream project "master-osmo-hlr" build number 8839 originally caused by: Started by upstream project "master-libosmo-netif" build number 6960 originally caused by: Started by upstream project "master-libosmo-abis" build number 4956 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8950 originally caused by: Started by upstream project "master-osmo-mgw" build number 9182 originally caused by: Started by upstream project "master-libosmo-netif" build number 6960 originally caused by: Started by upstream project "master-libosmo-abis" build number 4956 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30057 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37214 originally caused by: Started by upstream project "master-libosmo-netif" build number 6960 originally caused by: Started by upstream project "master-libosmo-abis" build number 4956 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37215 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9116 originally caused by: Started by upstream project "master-libosmo-netif" build number 6960 Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17664 originally caused by: Started by upstream project "master-osmo-bsc" build number 20120 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9116 originally caused by: Started by upstream project "master-libosmo-netif" build number 6960 originally caused by: Started by upstream project "master-libosmo-abis" build number 4956 originally caused by: Started by timer Started by upstream project "master-osmo-bsc" build number 20121 originally caused by: Started by upstream project "master-osmo-mgw" build number 9182 originally caused by: Started by upstream project "master-libosmo-netif" build number 6960 Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29279 originally caused by: Started by upstream project "master-osmo-msc" build number 34229 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9116 originally caused by: Started by upstream project "master-libosmo-netif" build number 6960 originally caused by: Started by upstream project "master-libosmo-abis" build number 4956 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34230 originally caused by: Started by upstream project "master-osmo-mgw" build number 9182 originally caused by: Started by upstream project "master-libosmo-netif" build number 6960 Started by upstream project "master-osmo-msc" build number 34231 originally caused by: Started by upstream project "master-osmo-iuh" build number 12858 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9116 Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12976 originally caused by: Started by upstream project "master-openbsc" build number 13173 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9116 originally caused by: Started by upstream project "master-libosmo-netif" build number 6960 originally caused by: Started by upstream project "master-libosmo-abis" build number 4956 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30058 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37216 originally caused by: Started by upstream project "master-osmo-iuh" build number 12858 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9116 originally caused by: Started by upstream project "master-libosmo-netif" build number 6960 originally caused by: Started by upstream project "master-libosmo-abis" build number 4956 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9247 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9117 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30059 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37217 originally caused by: Started by upstream project "master-osmo-iuh" build number 12859 originally caused by: Started by upstream project "master-libasn1c" build number 1807 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29280 originally caused by: Started by upstream project "master-osmo-msc" build number 34232 originally caused by: Started by upstream project "master-osmo-iuh" build number 12859 originally caused by: Started by upstream project "master-libasn1c" build number 1807 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34233 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9117 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17665 originally caused by: Started by upstream project "master-osmo-bsc" build number 20122 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9117 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30060 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37218 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9117 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37219 originally caused by: Started by upstream project "master-osmo-iuh" build number 12860 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9117 Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12977 originally caused by: Started by upstream project "master-openbsc" build number 13174 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9117 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17666 originally caused by: Started by upstream project "master-osmo-bsc" build number 20123 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29281 originally caused by: Started by upstream project "master-osmo-msc" build number 34234 originally caused by: Started by upstream project "master-osmo-iuh" build number 12860 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9117 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6684 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6679 originally caused by: Started by upstream project "master-libgtpnl" build number 1811 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30061 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37220 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30062 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37221 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6679 originally caused by: Started by upstream project "master-libgtpnl" build number 1811 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8951 originally caused by: Started by upstream project "master-osmo-mgw" build number 9183 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17667 originally caused by: Started by upstream project "master-osmo-bsc" build number 20124 originally caused by: Started by upstream project "master-osmo-mgw" build number 9183 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29282 originally caused by: Started by upstream project "master-osmo-msc" build number 34235 originally caused by: Started by upstream project "master-osmo-mgw" build number 9183 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30063 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37222 originally caused by: Started by upstream project "master-osmo-iuh" build number 12861 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29283 originally caused by: Started by upstream project "master-osmo-msc" build number 34236 originally caused by: Started by upstream project "master-osmo-iuh" build number 12861 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8952 originally caused by: Started by upstream project "master-osmo-mgw" build number 9184 originally caused by: Started by upstream project "master-libosmo-netif" build number 6961 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9248 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9118 originally caused by: Started by upstream project "master-libosmo-netif" build number 6961 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8706 originally caused by: Started by upstream project "master-osmo-hlr" build number 8840 originally caused by: Started by upstream project "master-libosmo-netif" build number 6961 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30064 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37223 originally caused by: Started by upstream project "master-libosmo-netif" build number 6961 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37224 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9118 originally caused by: Started by upstream project "master-libosmo-netif" build number 6961 Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17668 originally caused by: Started by upstream project "master-osmo-bsc" build number 20125 originally caused by: Started by upstream project "master-osmo-mgw" build number 9184 originally caused by: Started by upstream project "master-libosmo-netif" build number 6961 originally caused by: Started by timer Started by upstream project "master-libosmo-sccp" build number 9118 originally caused by: Started by upstream project "master-libosmo-netif" build number 6961 Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29284 originally caused by: Started by upstream project "master-osmo-msc" build number 34237 originally caused by: Started by upstream project "master-osmo-mgw" build number 9184 originally caused by: Started by upstream project "master-libosmo-netif" build number 6961 originally caused by: Started by timer Started by upstream project "master-libosmo-sccp" build number 9118 originally caused by: Started by upstream project "master-libosmo-netif" build number 6961 Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12978 originally caused by: Started by upstream project "master-openbsc" build number 13175 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9118 originally caused by: Started by upstream project "master-libosmo-netif" build number 6961 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30065 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37225 originally caused by: Started by upstream project "master-osmo-iuh" build number 12862 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9118 originally caused by: Started by upstream project "master-libosmo-netif" build number 6961 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29285 originally caused by: Started by upstream project "master-osmo-msc" build number 34238 originally caused by: Started by upstream project "master-osmo-iuh" build number 12862 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9118 originally caused by: Started by upstream project "master-libosmo-netif" build number 6961 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8707 originally caused by: Started by upstream project "master-osmo-hlr" build number 8841 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12979 originally caused by: Started by upstream project "master-openbsc" build number 13176 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6685 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6680 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30066 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37226 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6680 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29286 originally caused by: Started by upstream project "master-osmo-msc" build number 34239 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6686 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6681 originally caused by: Started by upstream project "master-libosmocore" build number 3069 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29287 originally caused by: Started by upstream project "master-osmo-msc" build number 34240 originally caused by: Started by upstream project "master-libsmpp34" build number 1815 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8953 originally caused by: Started by upstream project "master-osmo-mgw" build number 9185 originally caused by: Started by upstream project "master-libosmo-netif" build number 6962 originally caused by: Started by upstream project "master-libosmo-abis" build number 4957 originally caused by: Started by upstream project "master-libosmocore" build number 3069 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8708 originally caused by: Started by upstream project "master-osmo-hlr" build number 8842 originally caused by: Started by upstream project "master-libosmo-netif" build number 6962 originally caused by: Started by upstream project "master-libosmo-abis" build number 4957 originally caused by: Started by upstream project "master-libosmocore" build number 3069 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9249 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9119 originally caused by: Started by upstream project "master-libosmo-netif" build number 6962 originally caused by: Started by upstream project "master-libosmo-abis" build number 4957 originally caused by: Started by upstream project "master-libosmocore" build number 3069 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12980 originally caused by: Started by upstream project "master-openbsc" build number 13177 originally caused by: Started by upstream project "master-libsmpp34" build number 1815 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30067 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37227 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6681 originally caused by: Started by upstream project "master-libosmocore" build number 3069 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37228 originally caused by: Started by upstream project "master-libosmo-netif" build number 6962 originally caused by: Started by upstream project "master-libosmo-abis" build number 4957 originally caused by: Started by upstream project "master-libosmocore" build number 3069 Started by upstream project "master-osmo-sgsn" build number 37229 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9119 originally caused by: Started by upstream project "master-libosmo-netif" build number 6962 Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17669 originally caused by: Started by upstream project "master-osmo-bsc" build number 20126 originally caused by: Started by upstream project "master-osmo-mgw" build number 9185 originally caused by: Started by upstream project "master-libosmo-netif" build number 6962 originally caused by: Started by upstream project "master-libosmo-abis" build number 4957 originally caused by: Started by upstream project "master-libosmocore" build number 3069 originally caused by: Started by timer Started by upstream project "master-osmo-bsc" build number 20127 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9119 originally caused by: Started by upstream project "master-libosmo-netif" build number 6962 Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12981 originally caused by: Started by upstream project "master-openbsc" build number 13178 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9119 originally caused by: Started by upstream project "master-libosmo-netif" build number 6962 originally caused by: Started by upstream project "master-libosmo-abis" build number 4957 originally caused by: Started by upstream project "master-libosmocore" build number 3069 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29288 originally caused by: Started by upstream project "master-osmo-msc" build number 34241 originally caused by: Started by upstream project "master-osmo-mgw" build number 9185 originally caused by: Started by upstream project "master-libosmo-netif" build number 6962 originally caused by: Started by upstream project "master-libosmo-abis" build number 4957 originally caused by: Started by upstream project "master-libosmocore" build number 3069 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34242 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9119 originally caused by: Started by upstream project "master-libosmo-netif" build number 6962 Started by upstream project "master-osmo-msc" build number 34243 originally caused by: Started by upstream project "master-osmo-iuh" build number 12863 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9119 Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30068 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37230 originally caused by: Started by upstream project "master-osmo-iuh" build number 12863 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9119 originally caused by: Started by upstream project "master-libosmo-netif" build number 6962 originally caused by: Started by upstream project "master-libosmo-abis" build number 4957 originally caused by: Started by upstream project "master-libosmocore" build number 3069 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8954 originally caused by: Started by upstream project "master-osmo-mgw" build number 9186 originally caused by: Started by upstream project "master-libosmo-netif" build number 6963 originally caused by: Started by upstream project "master-libosmo-abis" build number 4958 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9250 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9120 originally caused by: Started by upstream project "master-libosmo-netif" build number 6963 originally caused by: Started by upstream project "master-libosmo-abis" build number 4958 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8709 originally caused by: Started by upstream project "master-osmo-hlr" build number 8843 originally caused by: Started by upstream project "master-libosmo-netif" build number 6963 originally caused by: Started by upstream project "master-libosmo-abis" build number 4958 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30069 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37231 originally caused by: Started by upstream project "master-libosmo-netif" build number 6963 originally caused by: Started by upstream project "master-libosmo-abis" build number 4958 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17670 originally caused by: Started by upstream project "master-osmo-bsc" build number 20128 originally caused by: Started by upstream project "master-osmo-mgw" build number 9186 originally caused by: Started by upstream project "master-libosmo-netif" build number 6963 originally caused by: Started by upstream project "master-libosmo-abis" build number 4958 originally caused by: Started by timer Started by upstream project "master-osmo-bsc" build number 20129 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9120 originally caused by: Started by upstream project "master-libosmo-netif" build number 6963 Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29289 originally caused by: Started by upstream project "master-osmo-msc" build number 34245 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9120 originally caused by: Started by upstream project "master-libosmo-netif" build number 6963 originally caused by: Started by upstream project "master-libosmo-abis" build number 4958 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34244 originally caused by: Started by upstream project "master-osmo-mgw" build number 9186 originally caused by: Started by upstream project "master-libosmo-netif" build number 6963 Started by upstream project "master-osmo-msc" build number 34246 originally caused by: Started by upstream project "master-osmo-iuh" build number 12864 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9120 Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12982 originally caused by: Started by upstream project "master-openbsc" build number 13179 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9120 originally caused by: Started by upstream project "master-libosmo-netif" build number 6963 originally caused by: Started by upstream project "master-libosmo-abis" build number 4958 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30070 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37232 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9120 originally caused by: Started by upstream project "master-libosmo-netif" build number 6963 originally caused by: Started by upstream project "master-libosmo-abis" build number 4958 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37233 originally caused by: Started by upstream project "master-osmo-iuh" build number 12864 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9120 Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9251 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9121 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30071 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37234 originally caused by: Started by upstream project "master-osmo-iuh" build number 12865 originally caused by: Started by upstream project "master-libasn1c" build number 1808 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29290 originally caused by: Started by upstream project "master-osmo-msc" build number 34247 originally caused by: Started by upstream project "master-osmo-iuh" build number 12865 originally caused by: Started by upstream project "master-libasn1c" build number 1808 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34248 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9121 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17671 originally caused by: Started by upstream project "master-osmo-bsc" build number 20130 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9121 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30072 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37235 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9121 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37236 originally caused by: Started by upstream project "master-osmo-iuh" build number 12866 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9121 Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12983 originally caused by: Started by upstream project "master-openbsc" build number 13180 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9121 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17672 originally caused by: Started by upstream project "master-osmo-bsc" build number 20131 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29291 originally caused by: Started by upstream project "master-osmo-msc" build number 34249 originally caused by: Started by upstream project "master-osmo-iuh" build number 12866 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9121 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6687 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6682 originally caused by: Started by upstream project "master-libgtpnl" build number 1812 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30073 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37237 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30074 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37238 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6682 originally caused by: Started by upstream project "master-libgtpnl" build number 1812 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8955 originally caused by: Started by upstream project "master-osmo-mgw" build number 9187 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17673 originally caused by: Started by upstream project "master-osmo-bsc" build number 20132 originally caused by: Started by upstream project "master-osmo-mgw" build number 9187 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29292 originally caused by: Started by upstream project "master-osmo-msc" build number 34250 originally caused by: Started by upstream project "master-osmo-mgw" build number 9187 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30075 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37239 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30076 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37240 originally caused by: Started by upstream project "master-osmo-iuh" build number 12867 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29293 originally caused by: Started by upstream project "master-osmo-msc" build number 34251 originally caused by: Started by upstream project "master-osmo-iuh" build number 12867 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17673 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7507 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6687 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8709 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8955 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2977 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29293 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5152 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30076 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4678 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12983 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9251 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4707 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5191 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3909 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins12576255231115906942.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-12 15:29:49 + trial_dir_prefix=trial- + rm -rf trial-2377 + trial_dir=trial-2378 + mkdir -p trial-2378 + mv open5gs.build-8.tgz osmo-bsc.build-17673.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6687.tgz osmo-hlr.build-8709.tgz osmo-hnbgw.build-2977.tgz osmo-mgw.build-8955.tgz osmo-msc.build-29293.tgz osmo-nitb.build-12983.tgz osmo-pcu-oc2g.build-3909.tgz osmo-pcu-sysmo.build-5191.tgz osmo-pcu.build-5152.tgz osmo-sgsn.build-30076.tgz osmo-stp.build-9251.tgz osmo-trx.build-4678.tgz osmocom-bb.build-4707.tgz srslte.build-19.tgz trial-2378 + cat open5gs.build-8.md5 osmo-bsc.build-17673.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6687.md5 osmo-hlr.build-8709.md5 osmo-hnbgw.build-2977.md5 osmo-mgw.build-8955.md5 osmo-msc.build-29293.md5 osmo-nitb.build-12983.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30076.md5 osmo-stp.build-9251.md5 osmo-trx.build-4678.md5 osmocom-bb.build-4707.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17673.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6687.md5 osmo-hlr.build-8709.md5 osmo-hnbgw.build-2977.md5 osmo-mgw.build-8955.md5 osmo-msc.build-29293.md5 osmo-nitb.build-12983.md5 osmo-pcu-oc2g.build-3909.md5 osmo-pcu-sysmo.build-5191.md5 osmo-pcu.build-5152.md5 osmo-sgsn.build-30076.md5 osmo-stp.build-9251.md5 osmo-trx.build-4678.md5 osmocom-bb.build-4707.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2378 combinations: None trial: 'trial-2378' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2378 -------------------------------------------------------------------------------------------- 15:30:01.173513 tst trial-2378: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/log --------------------------------------------------------------------- trial-2378 nitb_sms:sysmo --------------------------------------------------------------------- 15:32:06.550770 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:32:06.555290 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 15:32:06.576006 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 15:32:06.583181 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 15:32:06.637466 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 15:32:06.658140 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 15:32:06.664835 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 15:32:07.199755 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 15:32:07.204676 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 15:32:07.215486 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 15:32:07.585656 tst mo_mt_sms.py: using LAC 29814 15:32:07.818701 tst mo_mt_sms.py: using RAC 234 15:32:07.934000 tst mo_mt_sms.py: using CellId 29814 15:32:08.050694 tst mo_mt_sms.py: using BVCI 29815 15:32:08.158291 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 15:32:08.341579 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 15:32:08.457337 tst mo_mt_sms.py:9: start nitb and bts... 15:32:08.658134 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:32:10.919058 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23491): Launched 15:32:11.242164 run osmo-nitb_10.42.42.2(pid=23492): Launched 15:32:11.406121 run osmo-nitb_10.42.42.2(pid=23492): ERR: Terminated: ERROR {rc=2} [trial-2378↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23492)] 15:32:11.529584 run osmo-nitb_10.42.42.2(pid=23492): stdout: | (launched: 2022-12-12_15:32:11.183511) 15:32:11.654683 run osmo-nitb_10.42.42.2(pid=23492): stderr: | (launched: 2022-12-12_15:32:11.228263) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:32:11.779952 run osmo-nitb_10.42.42.2(pid=23492): stdout: | (launched: 2022-12-12_15:32:11.183511) 15:32:11.899069 run osmo-nitb_10.42.42.2(pid=23492): stderr: | (launched: 2022-12-12_15:32:11.228263) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:32:12.041757 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=23492): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23492) [trial-2378↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23492)] [trial-2378↪nitb_sms:sysmo↪mo_mt_sms.py:11] 15:32:12.050038 tst mo_mt_sms.py:11: Test FAILED (4.8 sec) 15:32:12.056477 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23491): Terminating (SIGTERM) 15:32:12.265240 --- ParallelTerminationStrategy: PID 23491 died... 15:32:12.285517 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23491): Terminated: ok {rc=0} 15:32:12.369577 bus /sierra_3: Setting Powered False 15:32:13.469923 bus /sierra_3: Setting Powered False 15:32:14.588931 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 sms:sysmo --------------------------------------------------------------------- 15:32:15.770582 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:32:15.775021 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 15:32:15.796269 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 15:32:15.827138 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 15:32:15.880528 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 15:32:15.901713 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 15:32:15.929463 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 15:32:16.493622 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 sms:sysmo mo_mt_sms.py ---------------------------------------------- 15:32:16.500829 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:32:16.515468 tst sms:sysmo: Using 1 x bts (candidates: 1) 15:32:16.556082 tst mo_mt_sms.py: using LAC 29815 15:32:16.686763 tst mo_mt_sms.py: using RAC 235 15:32:16.845298 tst mo_mt_sms.py: using CellId 29815 15:32:16.988703 tst mo_mt_sms.py: using BVCI 29816 15:32:17.101204 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:32:17.112689 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:32:17.124431 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:32:17.136492 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:32:17.148604 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 15:32:17.160541 tst sms:sysmo: Using 1 x modem (candidates: 2) 15:32:17.276457 tst sms:sysmo: Using 1 x modem (candidates: 2) 15:32:17.397141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:32:19.172829 run create_hlr_db(pid=23496): Launched 15:32:19.297831 bus /sierra_2: Setting Powered False 15:32:20.361711 run create_hlr_db(pid=23496): Terminated: ok {rc=0} 15:32:20.817882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23498): Launched 15:32:21.145855 run osmo-hlr_10.42.42.2(pid=23499): Launched 15:32:21.269840 run osmo-stp_10.42.42.5: Starting osmo-stp 15:32:23.858220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23501): Launched 15:32:24.171007 run osmo-stp_10.42.42.5(pid=23502): Launched 15:32:24.286267 run osmo-msc_10.42.42.6: Starting osmo-msc 15:32:29.549856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23504): Launched 15:32:29.855250 run osmo-msc_10.42.42.6(pid=23505): Launched 15:32:30.023084 run osmo-stp_10.42.42.5(pid=23502): ERR: Terminated: ERROR {rc=1} [trial-2378↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23502)] 15:32:30.149484 run osmo-stp_10.42.42.5(pid=23502): stdout: | (launched: 2022-12-12_15:32:24.112113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:32:30.275998 run osmo-stp_10.42.42.5(pid=23502): stderr: | 20221212153224284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153224285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153224285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153224285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153224286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153224286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153224286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:32:30.401415 run osmo-stp_10.42.42.5(pid=23502): stdout: | (launched: 2022-12-12_15:32:24.112113) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:32:30.520409 run osmo-stp_10.42.42.5(pid=23502): stderr: | 20221212153224284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153224285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153224285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153224285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153224286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153224286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153224286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:32:30.664208 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=23502): Process ended prematurely: osmo-stp_10.42.42.5(pid=23502) [trial-2378↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23502)] [trial-2378↪sms:sysmo↪mo_mt_sms.py:16] 15:32:30.673024 tst mo_mt_sms.py:16: Test FAILED (14.2 sec) 15:32:30.700771 run osmo-hlr_10.42.42.2(pid=23499): ERR: Terminated: ERROR {rc=237} [trial-2378↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23499)] 15:32:30.751339 run osmo-hlr_10.42.42.2(pid=23499): stdout: | (launched: 2022-12-12_15:32:21.083827) 15:32:30.803569 run osmo-hlr_10.42.42.2(pid=23499): stderr: | 20221212153221278 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153221278 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153221279 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153221279 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153221279 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153221279 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153221291 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153221300 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153221301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153221301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:32:30.876384 run osmo-msc_10.42.42.6(pid=23505): ERR: Terminated: ERROR {rc=2} [trial-2378↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23505)] 15:32:30.926982 run osmo-msc_10.42.42.6(pid=23505): stdout: | (launched: 2022-12-12_15:32:29.796505) 15:32:30.982718 run osmo-msc_10.42.42.6(pid=23505): stderr: | 20221212153230073 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153230073 DLGLOBAL DEBUG validating counter group 0x7f45ab63ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153230073 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153230073 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153230073 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153230074 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153230075 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153230076 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153230076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153230076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:32:31.055575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23498): Terminating (SIGTERM) 15:32:31.110964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23501): Terminating (SIGTERM) 15:32:31.157058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23504): Terminating (SIGTERM) 15:32:31.221135 --- ParallelTerminationStrategy: PID 23498 died... 15:32:31.251525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23498): Terminated: ok {rc=0} 15:32:31.314734 --- ParallelTerminationStrategy: PID 23501 died... 15:32:31.340374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23501): Terminated: ok {rc=0} 15:32:31.397699 --- ParallelTerminationStrategy: PID 23504 died... 15:32:31.424927 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23504): Terminated: ok {rc=0} 15:32:31.522773 bus /sierra_3: Setting Powered False 15:32:32.623664 bus /sierra_3: Setting Powered False 15:32:33.741379 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 nitb_ussd:sysmo --------------------------------------------------------------------- 15:32:34.963615 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:32:34.967549 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 15:32:34.988307 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 15:32:34.994989 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 15:32:35.029245 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 15:32:35.050395 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 15:32:35.057063 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 15:32:35.577626 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2378 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 15:32:35.582553 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 15:32:35.593299 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 15:32:35.629459 tst assert_extension.py: using LAC 29816 15:32:35.749133 tst assert_extension.py: using RAC 236 15:32:35.868645 tst assert_extension.py: using CellId 29816 15:32:35.986377 tst assert_extension.py: using BVCI 29817 15:32:36.096843 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 15:32:36.215180 tst assert_extension.py:10: start nitb and bts... 15:32:36.433995 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:32:37.101161 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23510): Launched 15:32:37.439340 run osmo-nitb_10.42.42.2(pid=23511): Launched 15:32:37.619712 run osmo-nitb_10.42.42.2(pid=23511): ERR: Terminated: ERROR {rc=2} [trial-2378↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23511)] 15:32:37.764893 run osmo-nitb_10.42.42.2(pid=23511): stdout: | (launched: 2022-12-12_15:32:37.376901) 15:32:37.911825 run osmo-nitb_10.42.42.2(pid=23511): stderr: | (launched: 2022-12-12_15:32:37.424780) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:32:38.058207 run osmo-nitb_10.42.42.2(pid=23511): stdout: | (launched: 2022-12-12_15:32:37.376901) 15:32:38.197699 run osmo-nitb_10.42.42.2(pid=23511): stderr: | (launched: 2022-12-12_15:32:37.424780) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=23511): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23511) [trial-2378↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23511)] 15:32:38.562599 tst osmo-nitb_10.42.42.2(pid=23511): stdout: | (launched: 2022-12-12_15:32:37.376901) 15:32:38.692898 tst osmo-nitb_10.42.42.2(pid=23511): stderr: | (launched: 2022-12-12_15:32:37.424780) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:32:38.847398 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=23511): Process ended prematurely: osmo-nitb_10.42.42.2(pid=23511) [trial-2378↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=23511)] [trial-2378↪nitb_ussd:sysmo↪assert_extension.py:12] 15:32:38.856326 tst assert_extension.py:12: Test FAILED (3.3 sec) 15:32:38.863537 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23510): Terminating (SIGTERM) 15:32:39.075038 --- ParallelTerminationStrategy: PID 23510 died... 15:32:39.096492 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=23510): Terminated: ok {rc=0} 15:32:39.184822 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 ussd:sysmo --------------------------------------------------------------------- 15:32:40.422677 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:32:40.426992 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 15:32:40.447695 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 15:32:40.474034 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 15:32:40.507803 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 15:32:40.528301 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 15:32:40.554389 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 15:32:41.089812 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2378 ussd:sysmo assert_extension.py ---------------------------------------------- 15:32:41.096296 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:32:41.109332 tst ussd:sysmo: Using 1 x bts (candidates: 1) 15:32:41.148119 tst assert_extension.py: using LAC 29817 15:32:41.271017 tst assert_extension.py: using RAC 237 15:32:41.391493 tst assert_extension.py: using CellId 29817 15:32:41.508201 tst assert_extension.py: using BVCI 29818 15:32:41.616487 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:32:41.627064 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:32:41.637570 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:32:41.647966 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:32:41.658372 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 15:32:41.668635 tst ussd:sysmo: Using 1 x modem (candidates: 1) 15:32:41.784914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:32:42.292811 run create_hlr_db(pid=23516): Launched 15:32:42.419361 bus /sierra_2: Setting Powered False 15:32:43.483095 run create_hlr_db(pid=23516): Terminated: ok {rc=0} 15:32:43.939953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23518): Launched 15:32:44.267821 run osmo-hlr_10.42.42.2(pid=23519): Launched 15:32:44.391894 run osmo-stp_10.42.42.5: Starting osmo-stp 15:32:44.952643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23521): Launched 15:32:45.281076 run osmo-stp_10.42.42.5(pid=23522): Launched 15:32:45.405963 run osmo-msc_10.42.42.6: Starting osmo-msc 15:32:45.990982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23524): Launched 15:32:46.341542 run osmo-msc_10.42.42.6(pid=23525): Launched 15:32:46.755929 run osmo-stp_10.42.42.5(pid=23522): ERR: Terminated: ERROR {rc=1} [trial-2378↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23522)] 15:32:46.992890 run osmo-stp_10.42.42.5(pid=23522): stdout: | (launched: 2022-12-12_15:32:45.218461) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:32:47.123628 run osmo-stp_10.42.42.5(pid=23522): stderr: | 20221212153245409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153245409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153245409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153245410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153245410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153245410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153245410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:32:47.253415 run osmo-stp_10.42.42.5(pid=23522): stdout: | (launched: 2022-12-12_15:32:45.218461) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:32:47.377165 run osmo-stp_10.42.42.5(pid=23522): stderr: | 20221212153245409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153245409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153245409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153245410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153245410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153245410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153245410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:32:47.530228 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=23522): Process ended prematurely: osmo-stp_10.42.42.5(pid=23522) [trial-2378↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23522)] [trial-2378↪ussd:sysmo↪assert_extension.py:17] 15:32:47.538568 tst assert_extension.py:17: Test FAILED (6.4 sec) 15:32:47.564854 run osmo-hlr_10.42.42.2(pid=23519): ERR: Terminated: ERROR {rc=237} [trial-2378↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23519)] 15:32:47.613143 run osmo-hlr_10.42.42.2(pid=23519): stdout: | (launched: 2022-12-12_15:32:44.205443) 15:32:47.663127 run osmo-hlr_10.42.42.2(pid=23519): stderr: | 20221212153244403 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153244403 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153244403 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153244403 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153244403 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153244403 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153244465 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153244475 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153244475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153244475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:32:47.733330 run osmo-msc_10.42.42.6(pid=23525): ERR: Terminated: ERROR {rc=2} [trial-2378↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23525)] 15:32:47.781523 run osmo-msc_10.42.42.6(pid=23525): stdout: | (launched: 2022-12-12_15:32:46.277948) 15:32:47.831499 run osmo-msc_10.42.42.6(pid=23525): stderr: | 20221212153246641 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153246641 DLGLOBAL DEBUG validating counter group 0x7f1b71e95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153246641 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153246641 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153246641 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153246642 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153246643 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153246644 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153246644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153246644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:32:47.881738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23518): Terminating (SIGTERM) 15:32:47.922215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23521): Terminating (SIGTERM) 15:32:47.962343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23524): Terminating (SIGTERM) 15:32:48.002662 --- ParallelTerminationStrategy: PID 23518 died... 15:32:48.022147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23518): Terminated: ok {rc=0} 15:32:48.066504 --- ParallelTerminationStrategy: PID 23521 died... 15:32:48.085426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23521): Terminated: ok {rc=0} 15:32:48.130092 --- ParallelTerminationStrategy: PID 23524 died... 15:32:48.152674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23524): Terminated: ok {rc=0} 15:32:48.245252 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 15:32:49.444282 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:32:49.452048 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 15:32:49.476600 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 15:32:49.503164 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 15:32:49.555976 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 15:32:49.577679 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 15:32:49.603954 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 15:32:50.151549 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 15:32:50.204877 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:32:50.216258 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:32:50.274097 tst mo_mt_call.py: using LAC 29818 15:32:50.398033 tst mo_mt_call.py: using RAC 238 15:32:50.528011 tst mo_mt_call.py: using CellId 29818 15:32:50.660812 tst mo_mt_call.py: using BVCI 29819 15:32:50.774581 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:32:50.785793 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:32:50.796655 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:32:50.807582 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:32:50.818619 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:32:50.829621 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:32:50.949272 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:32:51.066214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:32:51.547400 run create_hlr_db(pid=23530): Launched 15:32:51.675223 bus /sierra_2: Setting Powered False 15:32:52.736159 run create_hlr_db(pid=23530): Terminated: ok {rc=0} 15:32:53.168316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23532): Launched 15:32:53.481970 run osmo-hlr_10.42.42.2(pid=23533): Launched 15:32:53.597259 run osmo-stp_10.42.42.5: Starting osmo-stp 15:32:54.129343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23535): Launched 15:32:54.439027 run osmo-stp_10.42.42.5(pid=23536): Launched 15:32:54.558664 run osmo-msc_10.42.42.6: Starting osmo-msc 15:32:55.115432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23538): Launched 15:32:55.426660 run osmo-msc_10.42.42.6(pid=23539): Launched 15:32:55.596327 run osmo-stp_10.42.42.5(pid=23536): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23536)] 15:32:55.725420 run osmo-stp_10.42.42.5(pid=23536): stdout: | (launched: 2022-12-12_15:32:54.379439) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:32:55.855220 run osmo-stp_10.42.42.5(pid=23536): stderr: | 20221212153254550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153254551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153254551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153254551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153254552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153254552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153254552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:32:55.982882 run osmo-stp_10.42.42.5(pid=23536): stdout: | (launched: 2022-12-12_15:32:54.379439) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:32:56.104007 run osmo-stp_10.42.42.5(pid=23536): stderr: | 20221212153254550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153254551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153254551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153254551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153254552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153254552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153254552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:32:56.249936 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23536): Process ended prematurely: osmo-stp_10.42.42.5(pid=23536) [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23536)] [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 15:32:56.258934 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 15:32:56.284916 run osmo-hlr_10.42.42.2(pid=23533): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23533)] 15:32:56.332279 run osmo-hlr_10.42.42.2(pid=23533): stdout: | (launched: 2022-12-12_15:32:53.422049) 15:32:56.381284 run osmo-hlr_10.42.42.2(pid=23533): stderr: | 20221212153253601 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153253601 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153253601 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153253601 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153253601 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153253601 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153253613 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153253622 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153253622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153253622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:32:56.449670 run osmo-msc_10.42.42.6(pid=23539): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23539)] 15:32:56.497470 run osmo-msc_10.42.42.6(pid=23539): stdout: | (launched: 2022-12-12_15:32:55.367041) 15:32:56.546515 run osmo-msc_10.42.42.6(pid=23539): stderr: | 20221212153255642 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153255643 DLGLOBAL DEBUG validating counter group 0x7fe4806e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153255643 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153255643 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153255643 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153255643 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153255645 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153255645 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153255645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153255646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:32:56.595873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23532): Terminating (SIGTERM) 15:32:56.635271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23535): Terminating (SIGTERM) 15:32:56.674559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23538): Terminating (SIGTERM) 15:32:56.714266 --- ParallelTerminationStrategy: PID 23532 died... 15:32:56.733194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23532): Terminated: ok {rc=0} 15:32:56.776775 --- ParallelTerminationStrategy: PID 23535 died... 15:32:56.795270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23535): Terminated: ok {rc=0} 15:32:56.838920 --- ParallelTerminationStrategy: PID 23538 died... 15:32:56.857386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23538): Terminated: ok {rc=0} 15:32:56.943097 bus /sierra_3: Setting Powered False 15:32:58.043205 bus /sierra_3: Setting Powered False 15:32:59.157144 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 15:33:00.304248 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:33:00.316197 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:33:00.373509 tst mo_mt_call_osmux.py: using LAC 29819 15:33:00.495411 tst mo_mt_call_osmux.py: using RAC 239 15:33:00.619434 tst mo_mt_call_osmux.py: using CellId 29819 15:33:00.741300 tst mo_mt_call_osmux.py: using BVCI 29820 15:33:00.853836 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:33:00.864751 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:33:00.875667 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:33:00.886535 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:33:00.897475 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:33:00.908263 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:33:01.023492 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:33:01.144714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:33:01.649666 run create_hlr_db(pid=23542): Launched 15:33:01.830462 bus /sierra_2: Setting Powered False 15:33:02.892557 run create_hlr_db(pid=23542): Terminated: ok {rc=0} 15:33:03.406885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23544): Launched 15:33:03.743511 run osmo-hlr_10.42.42.2(pid=23545): Launched 15:33:03.871260 run osmo-stp_10.42.42.5: Starting osmo-stp 15:33:04.447007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23547): Launched 15:33:04.783828 run osmo-stp_10.42.42.5(pid=23548): Launched 15:33:04.910279 run osmo-msc_10.42.42.6: Starting osmo-msc 15:33:05.510038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23550): Launched 15:33:05.844224 run osmo-msc_10.42.42.6(pid=23551): Launched 15:33:06.029250 run osmo-stp_10.42.42.5(pid=23548): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23548)] 15:33:06.168396 run osmo-stp_10.42.42.5(pid=23548): stdout: | (launched: 2022-12-12_15:33:04.719740) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:33:06.309388 run osmo-stp_10.42.42.5(pid=23548): stderr: | 20221212153304912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153304912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153304912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153304913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153304913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153304913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153304913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:33:06.448598 run osmo-stp_10.42.42.5(pid=23548): stdout: | (launched: 2022-12-12_15:33:04.719740) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:33:06.579918 run osmo-stp_10.42.42.5(pid=23548): stderr: | 20221212153304912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153304912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153304912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153304913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153304913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153304913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153304913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:33:06.737157 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23548): Process ended prematurely: osmo-stp_10.42.42.5(pid=23548) [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23548)] [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 15:33:06.747237 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 15:33:06.775722 run osmo-hlr_10.42.42.2(pid=23545): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23545)] 15:33:06.826567 run osmo-hlr_10.42.42.2(pid=23545): stdout: | (launched: 2022-12-12_15:33:03.679649) 15:33:06.879060 run osmo-hlr_10.42.42.2(pid=23545): stderr: | 20221212153303875 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153303876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153303876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153303876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153303876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153303876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153303887 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153303895 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153303895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153303897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:33:06.951890 run osmo-msc_10.42.42.6(pid=23551): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23551)] 15:33:07.002723 run osmo-msc_10.42.42.6(pid=23551): stdout: | (launched: 2022-12-12_15:33:05.780457) 15:33:07.055673 run osmo-msc_10.42.42.6(pid=23551): stderr: | 20221212153306102 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153306102 DLGLOBAL DEBUG validating counter group 0x7f0626bf3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153306102 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153306102 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153306103 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153306103 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153306104 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153306105 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153306105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153306105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:33:07.108514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23544): Terminating (SIGTERM) 15:33:07.150797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23547): Terminating (SIGTERM) 15:33:07.193732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23550): Terminating (SIGTERM) 15:33:07.236182 --- ParallelTerminationStrategy: PID 23544 died... 15:33:07.256506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23544): Terminated: ok {rc=0} 15:33:07.303551 --- ParallelTerminationStrategy: PID 23547 died... 15:33:07.323440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23547): Terminated: ok {rc=0} 15:33:07.370971 --- ParallelTerminationStrategy: PID 23550 died... 15:33:07.390628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23550): Terminated: ok {rc=0} 15:33:07.479501 bus /sierra_3: Setting Powered False 15:33:08.580332 bus /sierra_3: Setting Powered False 15:33:09.697950 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 15:33:10.935881 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:33:10.943308 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 15:33:10.965219 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 15:33:10.992853 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 15:33:11.047888 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 15:33:11.069442 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 15:33:11.096873 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 15:33:11.650392 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 15:33:11.703440 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:33:11.714930 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:33:11.773394 tst mo_mt_call.py: using LAC 29820 15:33:11.904642 tst mo_mt_call.py: using RAC 240 15:33:12.027512 tst mo_mt_call.py: using CellId 29820 15:33:12.150709 tst mo_mt_call.py: using BVCI 29821 15:33:12.263421 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:33:12.277847 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:33:12.289825 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:33:12.303556 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:33:12.315154 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:33:12.326888 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:33:12.444805 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:33:12.560512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:33:13.040221 run create_hlr_db(pid=23556): Launched 15:33:13.169293 bus /sierra_2: Setting Powered False 15:33:14.230453 run create_hlr_db(pid=23556): Terminated: ok {rc=0} 15:33:14.684730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23558): Launched 15:33:15.020106 run osmo-hlr_10.42.42.2(pid=23559): Launched 15:33:15.145831 run osmo-stp_10.42.42.5: Starting osmo-stp 15:33:15.718557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23561): Launched 15:33:16.071702 run osmo-stp_10.42.42.5(pid=23562): Launched 15:33:16.318112 run osmo-msc_10.42.42.6: Starting osmo-msc 15:33:16.970100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23564): Launched 15:33:17.323180 run osmo-msc_10.42.42.6(pid=23565): Launched 15:33:17.633233 run osmo-stp_10.42.42.5(pid=23562): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23562)] 15:33:17.773880 run osmo-stp_10.42.42.5(pid=23562): stdout: | (launched: 2022-12-12_15:33:15.991044) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:33:17.914448 run osmo-stp_10.42.42.5(pid=23562): stderr: | 20221212153316287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153316287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153316287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153316287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153316288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153316288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153316288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:33:18.053183 run osmo-stp_10.42.42.5(pid=23562): stdout: | (launched: 2022-12-12_15:33:15.991044) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:33:18.184711 run osmo-stp_10.42.42.5(pid=23562): stderr: | 20221212153316287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153316287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153316287 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153316287 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153316288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153316288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153316288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:33:18.342452 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23562): Process ended prematurely: osmo-stp_10.42.42.5(pid=23562) [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23562)] [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 15:33:18.352060 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 15:33:18.380549 run osmo-hlr_10.42.42.2(pid=23559): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23559)] 15:33:18.431671 run osmo-hlr_10.42.42.2(pid=23559): stdout: | (launched: 2022-12-12_15:33:14.956608) 15:33:18.484597 run osmo-hlr_10.42.42.2(pid=23559): stderr: | 20221212153315153 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153315154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153315154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153315154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153315154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153315154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153315167 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153315177 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153315177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153315177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:33:18.558135 run osmo-msc_10.42.42.6(pid=23565): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23565)] 15:33:18.609159 run osmo-msc_10.42.42.6(pid=23565): stdout: | (launched: 2022-12-12_15:33:17.259250) 15:33:18.662034 run osmo-msc_10.42.42.6(pid=23565): stderr: | 20221212153317722 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153317722 DLGLOBAL DEBUG validating counter group 0x7f32b5359c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153317722 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153317722 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153317722 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153317722 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153317724 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153317724 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153317725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153317725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:33:18.714900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23558): Terminating (SIGTERM) 15:33:18.757548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23561): Terminating (SIGTERM) 15:33:18.800125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23564): Terminating (SIGTERM) 15:33:18.842760 --- ParallelTerminationStrategy: PID 23558 died... 15:33:18.862994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23558): Terminated: ok {rc=0} 15:33:18.910449 --- ParallelTerminationStrategy: PID 23561 died... 15:33:18.930069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23561): Terminated: ok {rc=0} 15:33:18.977324 --- ParallelTerminationStrategy: PID 23564 died... 15:33:18.997201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23564): Terminated: ok {rc=0} 15:33:19.086717 bus /sierra_3: Setting Powered False 15:33:20.183310 bus /sierra_3: Setting Powered False 15:33:21.298838 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 15:33:22.447604 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:33:22.459536 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:33:22.515519 tst mo_mt_call_osmux.py: using LAC 29821 15:33:22.637644 tst mo_mt_call_osmux.py: using RAC 241 15:33:22.758841 tst mo_mt_call_osmux.py: using CellId 29821 15:33:22.881074 tst mo_mt_call_osmux.py: using BVCI 29822 15:33:22.994924 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:33:23.006163 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:33:23.017007 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:33:23.027841 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:33:23.038765 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:33:23.049728 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:33:23.166860 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:33:23.286739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:33:23.804206 run create_hlr_db(pid=23567): Launched 15:33:23.932069 bus /sierra_2: Setting Powered False 15:33:24.996535 run create_hlr_db(pid=23567): Terminated: ok {rc=0} 15:33:25.440783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23569): Launched 15:33:25.754156 run osmo-hlr_10.42.42.2(pid=23570): Launched 15:33:25.872466 run osmo-stp_10.42.42.5: Starting osmo-stp 15:33:26.421402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23572): Launched 15:33:26.733572 run osmo-stp_10.42.42.5(pid=23573): Launched 15:33:26.850096 run osmo-msc_10.42.42.6: Starting osmo-msc 15:33:27.410294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23575): Launched 15:33:27.724580 run osmo-msc_10.42.42.6(pid=23576): Launched 15:33:27.897512 run osmo-stp_10.42.42.5(pid=23573): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23573)] 15:33:28.027001 run osmo-stp_10.42.42.5(pid=23573): stdout: | (launched: 2022-12-12_15:33:26.672892) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:33:28.156838 run osmo-stp_10.42.42.5(pid=23573): stderr: | 20221212153326846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153326846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153326846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153326846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153326847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153326847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153326847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:33:28.284936 run osmo-stp_10.42.42.5(pid=23573): stdout: | (launched: 2022-12-12_15:33:26.672892) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:33:28.406979 run osmo-stp_10.42.42.5(pid=23573): stderr: | 20221212153326846 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153326846 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153326846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153326846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153326847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153326847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153326847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:33:28.553567 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23573): Process ended prematurely: osmo-stp_10.42.42.5(pid=23573) [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23573)] [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 15:33:28.562392 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:33:28.588660 run osmo-hlr_10.42.42.2(pid=23570): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23570)] 15:33:28.636512 run osmo-hlr_10.42.42.2(pid=23570): stdout: | (launched: 2022-12-12_15:33:25.694329) 15:33:28.685894 run osmo-hlr_10.42.42.2(pid=23570): stderr: | 20221212153325871 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153325871 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153325872 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153325872 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153325872 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153325872 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153325884 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153325892 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153325892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153325892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:33:28.755396 run osmo-msc_10.42.42.6(pid=23576): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23576)] 15:33:28.803208 run osmo-msc_10.42.42.6(pid=23576): stdout: | (launched: 2022-12-12_15:33:27.664510) 15:33:28.852645 run osmo-msc_10.42.42.6(pid=23576): stderr: | 20221212153327939 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153327939 DLGLOBAL DEBUG validating counter group 0x7f98c6429c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153327939 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153327939 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153327939 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153327940 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153327941 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153327942 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153327942 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153327942 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:33:28.902339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23569): Terminating (SIGTERM) 15:33:28.942302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23572): Terminating (SIGTERM) 15:33:28.982217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23575): Terminating (SIGTERM) 15:33:29.022239 --- ParallelTerminationStrategy: PID 23569 died... 15:33:29.041472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23569): Terminated: ok {rc=0} 15:33:29.085490 --- ParallelTerminationStrategy: PID 23572 died... 15:33:29.104031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23572): Terminated: ok {rc=0} 15:33:29.147986 --- ParallelTerminationStrategy: PID 23575 died... 15:33:29.166670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23575): Terminated: ok {rc=0} 15:33:29.251766 bus /sierra_3: Setting Powered False 15:33:30.351635 bus /sierra_3: Setting Powered False 15:33:31.472117 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 15:33:32.716771 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:33:32.723976 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 15:33:32.746413 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 15:33:32.775046 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 15:33:32.829897 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 15:33:32.851588 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 15:33:32.879135 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 15:33:33.429047 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 15:33:33.482225 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:33:33.493678 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:33:33.550415 tst mo_mt_call.py: using LAC 29822 15:33:33.683311 tst mo_mt_call.py: using RAC 242 15:33:33.814695 tst mo_mt_call.py: using CellId 29822 15:33:33.943331 tst mo_mt_call.py: using BVCI 29823 15:33:34.065041 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:33:34.076641 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:33:34.088001 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:33:34.099652 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:33:34.111225 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:33:34.123035 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:33:34.240589 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:33:34.356358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:33:34.839436 run create_hlr_db(pid=23581): Launched 15:33:34.966284 bus /sierra_2: Setting Powered False 15:33:36.027507 run create_hlr_db(pid=23581): Terminated: ok {rc=0} 15:33:36.481604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23583): Launched 15:33:36.818290 run osmo-hlr_10.42.42.2(pid=23584): Launched 15:33:36.945441 run osmo-stp_10.42.42.5: Starting osmo-stp 15:33:37.524167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23587): Launched 15:33:37.862524 run osmo-stp_10.42.42.5(pid=23588): Launched 15:33:37.988482 run osmo-msc_10.42.42.6: Starting osmo-msc 15:33:38.587088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23590): Launched 15:33:38.924114 run osmo-msc_10.42.42.6(pid=23591): Launched 15:33:39.109315 run osmo-stp_10.42.42.5(pid=23588): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23588)] 15:33:39.248241 run osmo-stp_10.42.42.5(pid=23588): stdout: | (launched: 2022-12-12_15:33:37.798484) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:33:39.388258 run osmo-stp_10.42.42.5(pid=23588): stderr: | 20221212153337992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153337992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153337992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153337992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153337993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153337993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153337993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:33:39.526520 run osmo-stp_10.42.42.5(pid=23588): stdout: | (launched: 2022-12-12_15:33:37.798484) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:33:39.658211 run osmo-stp_10.42.42.5(pid=23588): stderr: | 20221212153337992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153337992 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153337992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153337992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153337993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153337993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153337993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:33:39.816246 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23588): Process ended prematurely: osmo-stp_10.42.42.5(pid=23588) [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23588)] [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 15:33:39.825793 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 15:33:39.854155 run osmo-hlr_10.42.42.2(pid=23584): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23584)] 15:33:39.904852 run osmo-hlr_10.42.42.2(pid=23584): stdout: | (launched: 2022-12-12_15:33:36.753996) 15:33:39.957286 run osmo-hlr_10.42.42.2(pid=23584): stderr: | 20221212153336952 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153336952 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153336952 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153336952 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153336952 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153336952 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153336964 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153336973 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153336973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153336973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:33:40.029623 run osmo-msc_10.42.42.6(pid=23591): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23591)] 15:33:40.080312 run osmo-msc_10.42.42.6(pid=23591): stdout: | (launched: 2022-12-12_15:33:38.859821) 15:33:40.132422 run osmo-msc_10.42.42.6(pid=23591): stderr: | 20221212153339183 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153339183 DLGLOBAL DEBUG validating counter group 0x7ff1abf34c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153339183 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153339183 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153339183 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153339183 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153339185 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153339186 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153339186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153339186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:33:40.185198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23583): Terminating (SIGTERM) 15:33:40.227335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23587): Terminating (SIGTERM) 15:33:40.269661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23590): Terminating (SIGTERM) 15:33:40.312021 --- ParallelTerminationStrategy: PID 23583 died... 15:33:40.332154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23583): Terminated: ok {rc=0} 15:33:40.379040 --- ParallelTerminationStrategy: PID 23587 died... 15:33:40.398587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23587): Terminated: ok {rc=0} 15:33:40.445287 --- ParallelTerminationStrategy: PID 23590 died... 15:33:40.464887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23590): Terminated: ok {rc=0} 15:33:40.553254 bus /sierra_3: Setting Powered False 15:33:41.652660 bus /sierra_3: Setting Powered False 15:33:42.771016 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 15:33:43.919787 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:33:43.931810 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:33:43.986435 tst mo_mt_call_osmux.py: using LAC 29823 15:33:44.109843 tst mo_mt_call_osmux.py: using RAC 243 15:33:44.230553 tst mo_mt_call_osmux.py: using CellId 29823 15:33:44.351128 tst mo_mt_call_osmux.py: using BVCI 29824 15:33:44.464297 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:33:44.475399 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:33:44.486415 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:33:44.497255 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:33:44.508029 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:33:44.518871 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:33:44.638278 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:33:44.756274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:33:45.238921 run create_hlr_db(pid=23593): Launched 15:33:45.365927 bus /sierra_2: Setting Powered False 15:33:46.433315 run create_hlr_db(pid=23593): Terminated: ok {rc=0} 15:33:46.940627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23595): Launched 15:33:47.292357 run osmo-hlr_10.42.42.2(pid=23596): Launched 15:33:47.517525 run osmo-stp_10.42.42.5: Starting osmo-stp 15:33:48.089615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23598): Launched 15:33:48.425302 run osmo-stp_10.42.42.5(pid=23599): Launched 15:33:48.553296 run osmo-msc_10.42.42.6: Starting osmo-msc 15:33:49.155107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23601): Launched 15:33:49.492637 run osmo-msc_10.42.42.6(pid=23602): Launched 15:33:49.676799 run osmo-stp_10.42.42.5(pid=23599): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23599)] 15:33:49.816129 run osmo-stp_10.42.42.5(pid=23599): stdout: | (launched: 2022-12-12_15:33:48.361417) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:33:49.956044 run osmo-stp_10.42.42.5(pid=23599): stderr: | 20221212153348552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153348552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153348553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153348553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153348553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153348554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153348554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:33:50.094255 run osmo-stp_10.42.42.5(pid=23599): stdout: | (launched: 2022-12-12_15:33:48.361417) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:33:50.225571 run osmo-stp_10.42.42.5(pid=23599): stderr: | 20221212153348552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153348552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153348553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153348553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153348553 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153348554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153348554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:33:50.383221 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23599): Process ended prematurely: osmo-stp_10.42.42.5(pid=23599) [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23599)] [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 15:33:50.393192 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 15:33:50.421742 run osmo-hlr_10.42.42.2(pid=23596): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23596)] 15:33:50.471928 run osmo-hlr_10.42.42.2(pid=23596): stdout: | (launched: 2022-12-12_15:33:47.229151) 15:33:50.523934 run osmo-hlr_10.42.42.2(pid=23596): stderr: | 20221212153347453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153347453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153347453 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153347453 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153347453 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153347453 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153347465 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153347474 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153347474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153347474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:33:50.596185 run osmo-msc_10.42.42.6(pid=23602): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23602)] 15:33:50.646586 run osmo-msc_10.42.42.6(pid=23602): stdout: | (launched: 2022-12-12_15:33:49.428638) 15:33:50.698645 run osmo-msc_10.42.42.6(pid=23602): stderr: | 20221212153349751 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153349751 DLGLOBAL DEBUG validating counter group 0x7fd2367aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153349751 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153349751 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153349752 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153349752 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153349753 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153349754 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153349754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153349754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:33:50.751213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23595): Terminating (SIGTERM) 15:33:50.793978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23598): Terminating (SIGTERM) 15:33:50.836068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23601): Terminating (SIGTERM) 15:33:50.878499 --- ParallelTerminationStrategy: PID 23595 died... 15:33:50.898636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23595): Terminated: ok {rc=0} 15:33:50.945580 --- ParallelTerminationStrategy: PID 23598 died... 15:33:50.965190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23598): Terminated: ok {rc=0} 15:33:51.011810 --- ParallelTerminationStrategy: PID 23601 died... 15:33:51.031412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23601): Terminated: ok {rc=0} 15:33:51.120235 bus /sierra_3: Setting Powered False 15:33:52.218752 bus /sierra_3: Setting Powered False 15:33:53.335494 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 15:33:54.576506 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:33:54.584087 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 15:33:54.605882 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 15:33:54.633153 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 15:33:54.690750 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 15:33:54.712303 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 15:33:54.739775 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 15:33:55.285665 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 15:33:55.338384 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:33:55.349950 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:33:55.405357 tst mo_mt_call.py: using LAC 29824 15:33:55.534727 tst mo_mt_call.py: using RAC 244 15:33:55.663706 tst mo_mt_call.py: using CellId 29824 15:33:55.791825 tst mo_mt_call.py: using BVCI 29825 15:33:55.913712 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:33:55.925673 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:33:55.936815 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:33:55.948462 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:33:55.959986 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:33:55.971493 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:33:56.087660 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:33:56.209901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:33:56.725282 run create_hlr_db(pid=23607): Launched 15:33:56.852356 bus /sierra_2: Setting Powered False 15:33:57.918086 run create_hlr_db(pid=23607): Terminated: ok {rc=0} 15:33:58.362374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23609): Launched 15:33:58.676430 run osmo-hlr_10.42.42.2(pid=23610): Launched 15:33:58.795734 run osmo-stp_10.42.42.5: Starting osmo-stp 15:33:59.330443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23612): Launched 15:33:59.644084 run osmo-stp_10.42.42.5(pid=23613): Launched 15:33:59.763116 run osmo-msc_10.42.42.6: Starting osmo-msc 15:34:00.324046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23615): Launched 15:34:00.637379 run osmo-msc_10.42.42.6(pid=23616): Launched 15:34:00.809218 run osmo-stp_10.42.42.5(pid=23613): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23613)] 15:34:00.938964 run osmo-stp_10.42.42.5(pid=23613): stdout: | (launched: 2022-12-12_15:33:59.584103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:34:01.078453 run osmo-stp_10.42.42.5(pid=23613): stderr: | 20221212153359756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153359756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153359756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153359757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153359757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153359757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153359757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:34:01.222671 run osmo-stp_10.42.42.5(pid=23613): stdout: | (launched: 2022-12-12_15:33:59.584103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:34:01.359319 run osmo-stp_10.42.42.5(pid=23613): stderr: | 20221212153359756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153359756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153359756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153359757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153359757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153359757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153359757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:34:01.522540 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23613): Process ended prematurely: osmo-stp_10.42.42.5(pid=23613) [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23613)] [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 15:34:01.533298 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:34:01.565233 run osmo-hlr_10.42.42.2(pid=23610): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23610)] 15:34:01.618373 run osmo-hlr_10.42.42.2(pid=23610): stdout: | (launched: 2022-12-12_15:33:58.616665) 15:34:01.673584 run osmo-hlr_10.42.42.2(pid=23610): stderr: | 20221212153358796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153358796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153358796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153358796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153358796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153358796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153358813 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153358823 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153358823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153358823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:34:01.750737 run osmo-msc_10.42.42.6(pid=23616): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23616)] 15:34:01.804262 run osmo-msc_10.42.42.6(pid=23616): stdout: | (launched: 2022-12-12_15:34:00.577417) 15:34:01.859506 run osmo-msc_10.42.42.6(pid=23616): stderr: | 20221212153400852 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153400852 DLGLOBAL DEBUG validating counter group 0x7fe6a42a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153400853 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153400853 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153400853 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153400853 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153400855 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153400855 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153400855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153400855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:34:01.916168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23609): Terminating (SIGTERM) 15:34:01.956515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23612): Terminating (SIGTERM) 15:34:01.996479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23615): Terminating (SIGTERM) 15:34:02.037926 --- ParallelTerminationStrategy: PID 23609 died... 15:34:02.057650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23609): Terminated: ok {rc=0} 15:34:02.102747 --- ParallelTerminationStrategy: PID 23612 died... 15:34:02.122533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23612): Terminated: ok {rc=0} 15:34:02.167696 --- ParallelTerminationStrategy: PID 23615 died... 15:34:02.187411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23615): Terminated: ok {rc=0} 15:34:02.332029 bus /sierra_3: Setting Powered False 15:34:03.430779 bus /sierra_3: Setting Powered False 15:34:04.548593 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 15:34:05.696328 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:34:05.708246 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:34:05.765440 tst mo_mt_call_osmux.py: using LAC 29825 15:34:05.887445 tst mo_mt_call_osmux.py: using RAC 245 15:34:06.008301 tst mo_mt_call_osmux.py: using CellId 29825 15:34:06.129397 tst mo_mt_call_osmux.py: using BVCI 29826 15:34:06.240414 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:34:06.251651 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:34:06.262575 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:34:06.273416 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:34:06.284218 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:34:06.295081 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:34:06.412133 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:34:06.533346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:34:07.051761 run create_hlr_db(pid=23618): Launched 15:34:07.178875 bus /sierra_2: Setting Powered False 15:34:08.243767 run create_hlr_db(pid=23618): Terminated: ok {rc=0} 15:34:08.688809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23620): Launched 15:34:09.002984 run osmo-hlr_10.42.42.2(pid=23621): Launched 15:34:09.122869 run osmo-stp_10.42.42.5: Starting osmo-stp 15:34:09.670760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23623): Launched 15:34:09.983207 run osmo-stp_10.42.42.5(pid=23624): Launched 15:34:10.100030 run osmo-msc_10.42.42.6: Starting osmo-msc 15:34:10.660736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23626): Launched 15:34:10.972703 run osmo-msc_10.42.42.6(pid=23627): Launched 15:34:11.145960 run osmo-stp_10.42.42.5(pid=23624): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23624)] 15:34:11.277078 run osmo-stp_10.42.42.5(pid=23624): stdout: | (launched: 2022-12-12_15:34:09.923161) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:34:11.407373 run osmo-stp_10.42.42.5(pid=23624): stderr: | 20221212153410094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153410094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153410094 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153410095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153410095 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153410095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153410095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:34:11.536071 run osmo-stp_10.42.42.5(pid=23624): stdout: | (launched: 2022-12-12_15:34:09.923161) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:34:11.658683 run osmo-stp_10.42.42.5(pid=23624): stderr: | 20221212153410094 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153410094 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153410094 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153410095 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153410095 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153410095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153410095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:34:11.805247 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23624): Process ended prematurely: osmo-stp_10.42.42.5(pid=23624) [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23624)] [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 15:34:11.814211 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:34:11.840620 run osmo-hlr_10.42.42.2(pid=23621): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23621)] 15:34:11.888812 run osmo-hlr_10.42.42.2(pid=23621): stdout: | (launched: 2022-12-12_15:34:08.942944) 15:34:11.939150 run osmo-hlr_10.42.42.2(pid=23621): stderr: | 20221212153409120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153409120 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153409120 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153409120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153409120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153409120 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153409132 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153409141 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153409141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153409141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:34:12.008353 run osmo-msc_10.42.42.6(pid=23627): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23627)] 15:34:12.056371 run osmo-msc_10.42.42.6(pid=23627): stdout: | (launched: 2022-12-12_15:34:10.912715) 15:34:12.106034 run osmo-msc_10.42.42.6(pid=23627): stderr: | 20221212153411187 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153411187 DLGLOBAL DEBUG validating counter group 0x7f1b46d65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153411187 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153411187 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153411188 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153411188 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153411190 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153411190 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153411190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153411190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:34:12.156366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23620): Terminating (SIGTERM) 15:34:12.196122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23623): Terminating (SIGTERM) 15:34:12.236046 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23626): Terminating (SIGTERM) 15:34:12.276145 --- ParallelTerminationStrategy: PID 23620 died... 15:34:12.295293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23620): Terminated: ok {rc=0} 15:34:12.339741 --- ParallelTerminationStrategy: PID 23623 died... 15:34:12.358425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23623): Terminated: ok {rc=0} 15:34:12.402219 --- ParallelTerminationStrategy: PID 23626 died... 15:34:12.420740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23626): Terminated: ok {rc=0} 15:34:12.505127 bus /sierra_3: Setting Powered False 15:34:13.603058 bus /sierra_3: Setting Powered False 15:34:14.720416 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 15:34:15.955444 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:34:15.962490 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 15:34:15.984484 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 15:34:16.015095 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 15:34:16.077815 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 15:34:16.110745 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 15:34:16.148535 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 15:34:16.706372 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 15:34:16.765197 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:34:16.776781 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:34:16.833242 tst mo_mt_call.py: using LAC 29826 15:34:16.969031 tst mo_mt_call.py: using RAC 246 15:34:17.128788 tst mo_mt_call.py: using CellId 29826 15:34:17.260123 tst mo_mt_call.py: using BVCI 29827 15:34:17.385239 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:34:17.398094 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:34:17.410707 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:34:17.423799 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:34:17.437309 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:34:17.450661 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:34:17.578067 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:34:17.698036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:34:18.179230 run create_hlr_db(pid=23632): Launched 15:34:18.307187 bus /sierra_2: Setting Powered False 15:34:19.371457 run create_hlr_db(pid=23632): Terminated: ok {rc=0} 15:34:19.835935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23634): Launched 15:34:20.172106 run osmo-hlr_10.42.42.2(pid=23635): Launched 15:34:20.297562 run osmo-stp_10.42.42.5: Starting osmo-stp 15:34:20.870456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23637): Launched 15:34:21.206043 run osmo-stp_10.42.42.5(pid=23638): Launched 15:34:21.332721 run osmo-msc_10.42.42.6: Starting osmo-msc 15:34:21.935745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23640): Launched 15:34:22.272525 run osmo-msc_10.42.42.6(pid=23641): Launched 15:34:22.455488 run osmo-stp_10.42.42.5(pid=23638): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23638)] 15:34:22.595496 run osmo-stp_10.42.42.5(pid=23638): stdout: | (launched: 2022-12-12_15:34:21.141814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:34:22.737151 run osmo-stp_10.42.42.5(pid=23638): stderr: | 20221212153421333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153421334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153421334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153421334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153421335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153421335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153421335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:34:22.876078 run osmo-stp_10.42.42.5(pid=23638): stdout: | (launched: 2022-12-12_15:34:21.141814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:34:23.007630 run osmo-stp_10.42.42.5(pid=23638): stderr: | 20221212153421333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153421334 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153421334 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153421334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153421335 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153421335 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153421335 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:34:23.165921 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23638): Process ended prematurely: osmo-stp_10.42.42.5(pid=23638) [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23638)] [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 15:34:23.175570 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 15:34:23.203843 run osmo-hlr_10.42.42.2(pid=23635): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23635)] 15:34:23.254164 run osmo-hlr_10.42.42.2(pid=23635): stdout: | (launched: 2022-12-12_15:34:20.108485) 15:34:23.306285 run osmo-hlr_10.42.42.2(pid=23635): stderr: | 20221212153420305 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153420305 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153420305 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153420305 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153420305 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153420305 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153420318 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153420327 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153420327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153420327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:34:23.378619 run osmo-msc_10.42.42.6(pid=23641): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23641)] 15:34:23.428933 run osmo-msc_10.42.42.6(pid=23641): stdout: | (launched: 2022-12-12_15:34:22.208441) 15:34:23.481231 run osmo-msc_10.42.42.6(pid=23641): stderr: | 20221212153422532 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153422532 DLGLOBAL DEBUG validating counter group 0x7fe54ac92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153422532 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153422532 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153422533 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153422533 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153422534 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153422535 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153422535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153422535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:34:23.533812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23634): Terminating (SIGTERM) 15:34:23.576269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23637): Terminating (SIGTERM) 15:34:23.618705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23640): Terminating (SIGTERM) 15:34:23.661594 --- ParallelTerminationStrategy: PID 23634 died... 15:34:23.681778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23634): Terminated: ok {rc=0} 15:34:23.728756 --- ParallelTerminationStrategy: PID 23637 died... 15:34:23.748499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23637): Terminated: ok {rc=0} 15:34:23.795976 --- ParallelTerminationStrategy: PID 23640 died... 15:34:23.815710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23640): Terminated: ok {rc=0} 15:34:23.904600 bus /sierra_3: Setting Powered False 15:34:25.004359 bus /sierra_3: Setting Powered False 15:34:26.120920 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 15:34:27.272565 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:34:27.285220 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:34:27.343990 tst mo_mt_call_osmux.py: using LAC 29827 15:34:27.473108 tst mo_mt_call_osmux.py: using RAC 247 15:34:27.594915 tst mo_mt_call_osmux.py: using CellId 29827 15:34:27.717172 tst mo_mt_call_osmux.py: using BVCI 29828 15:34:27.829586 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:34:27.840694 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:34:27.851817 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:34:27.862807 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:34:27.873686 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:34:27.884537 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:34:28.004515 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:34:28.126775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:34:28.644371 run create_hlr_db(pid=23643): Launched 15:34:28.770902 bus /sierra_2: Setting Powered False 15:34:29.836145 run create_hlr_db(pid=23643): Terminated: ok {rc=0} 15:34:30.277521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23645): Launched 15:34:30.589157 run osmo-hlr_10.42.42.2(pid=23646): Launched 15:34:30.706875 run osmo-stp_10.42.42.5: Starting osmo-stp 15:34:31.288089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23648): Launched 15:34:31.685112 run osmo-stp_10.42.42.5(pid=23649): Launched 15:34:31.908151 run osmo-msc_10.42.42.6: Starting osmo-msc 15:34:32.567331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23651): Launched 15:34:32.904007 run osmo-msc_10.42.42.6(pid=23652): Launched 15:34:33.087889 run osmo-stp_10.42.42.5(pid=23649): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23649)] 15:34:33.226787 run osmo-stp_10.42.42.5(pid=23649): stdout: | (launched: 2022-12-12_15:34:31.620433) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:34:33.367651 run osmo-stp_10.42.42.5(pid=23649): stderr: | 20221212153431841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153431841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153431842 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153431842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153431842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153431843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153431843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:34:33.505728 run osmo-stp_10.42.42.5(pid=23649): stdout: | (launched: 2022-12-12_15:34:31.620433) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:34:33.637178 run osmo-stp_10.42.42.5(pid=23649): stderr: | 20221212153431841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153431841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153431842 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153431842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153431842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153431843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153431843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:34:33.795071 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23649): Process ended prematurely: osmo-stp_10.42.42.5(pid=23649) [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23649)] [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 15:34:33.804641 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 15:34:33.832841 run osmo-hlr_10.42.42.2(pid=23646): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23646)] 15:34:33.882965 run osmo-hlr_10.42.42.2(pid=23646): stdout: | (launched: 2022-12-12_15:34:30.528853) 15:34:33.934624 run osmo-hlr_10.42.42.2(pid=23646): stderr: | 20221212153430705 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153430705 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153430705 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153430705 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153430705 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153430705 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153430718 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153430727 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153430727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153430727 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:34:34.006410 run osmo-msc_10.42.42.6(pid=23652): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23652)] 15:34:34.056294 run osmo-msc_10.42.42.6(pid=23652): stdout: | (launched: 2022-12-12_15:34:32.840261) 15:34:34.108016 run osmo-msc_10.42.42.6(pid=23652): stderr: | 20221212153433163 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153433163 DLGLOBAL DEBUG validating counter group 0x7f341fa39c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153433163 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153433163 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153433164 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153433164 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153433166 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153433166 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153433166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153433166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:34:34.160042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23645): Terminating (SIGTERM) 15:34:34.201816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23648): Terminating (SIGTERM) 15:34:34.243697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23651): Terminating (SIGTERM) 15:34:34.285698 --- ParallelTerminationStrategy: PID 23645 died... 15:34:34.305621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23645): Terminated: ok {rc=0} 15:34:34.352576 --- ParallelTerminationStrategy: PID 23648 died... 15:34:34.372140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23648): Terminated: ok {rc=0} 15:34:34.418445 --- ParallelTerminationStrategy: PID 23651 died... 15:34:34.437981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23651): Terminated: ok {rc=0} 15:34:34.525760 bus /sierra_3: Setting Powered False 15:34:35.624151 bus /sierra_3: Setting Powered False 15:34:36.738984 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:34:37.978448 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:34:37.985444 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:34:38.007133 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 15:34:38.034759 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:34:38.087661 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:34:38.108836 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 15:34:38.135974 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:34:38.689283 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 15:34:38.742709 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:34:38.754323 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:34:38.813312 tst mo_mt_call.py: using LAC 29828 15:34:38.943951 tst mo_mt_call.py: using RAC 248 15:34:39.074461 tst mo_mt_call.py: using CellId 29828 15:34:39.203127 tst mo_mt_call.py: using BVCI 29829 15:34:39.325356 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:34:39.336834 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:34:39.348247 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:34:39.359919 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:34:39.371513 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:34:39.383319 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:34:39.499614 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:34:39.614341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:34:40.131551 run create_hlr_db(pid=23657): Launched 15:34:40.257438 bus /sierra_2: Setting Powered False 15:34:41.323240 run create_hlr_db(pid=23657): Terminated: ok {rc=0} 15:34:41.787120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23659): Launched 15:34:42.124014 run osmo-hlr_10.42.42.2(pid=23660): Launched 15:34:42.250439 run osmo-stp_10.42.42.5: Starting osmo-stp 15:34:42.829401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23662): Launched 15:34:43.164644 run osmo-stp_10.42.42.5(pid=23663): Launched 15:34:43.291207 run osmo-msc_10.42.42.6: Starting osmo-msc 15:34:43.894259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23665): Launched 15:34:44.231369 run osmo-msc_10.42.42.6(pid=23666): Launched 15:34:44.416807 run osmo-stp_10.42.42.5(pid=23663): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23663)] 15:34:44.556008 run osmo-stp_10.42.42.5(pid=23663): stdout: | (launched: 2022-12-12_15:34:43.100648) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:34:44.696234 run osmo-stp_10.42.42.5(pid=23663): stderr: | 20221212153443291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153443291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153443292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153443292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153443293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153443293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153443293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:34:44.834791 run osmo-stp_10.42.42.5(pid=23663): stdout: | (launched: 2022-12-12_15:34:43.100648) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:34:44.966545 run osmo-stp_10.42.42.5(pid=23663): stderr: | 20221212153443291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153443291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153443292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153443292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153443293 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153443293 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153443293 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:34:45.124082 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23663): Process ended prematurely: osmo-stp_10.42.42.5(pid=23663) [trial-2378↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23663)] [trial-2378↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 15:34:45.133902 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 15:34:45.161995 run osmo-hlr_10.42.42.2(pid=23660): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23660)] 15:34:45.212777 run osmo-hlr_10.42.42.2(pid=23660): stdout: | (launched: 2022-12-12_15:34:42.060114) 15:34:45.265225 run osmo-hlr_10.42.42.2(pid=23660): stderr: | 20221212153442258 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153442258 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153442258 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153442258 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153442258 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153442258 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153442305 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153442322 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153442322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153442322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:34:45.338158 run osmo-msc_10.42.42.6(pid=23666): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23666)] 15:34:45.389102 run osmo-msc_10.42.42.6(pid=23666): stdout: | (launched: 2022-12-12_15:34:44.167450) 15:34:45.441324 run osmo-msc_10.42.42.6(pid=23666): stderr: | 20221212153444489 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153444489 DLGLOBAL DEBUG validating counter group 0x7fa123586c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153444490 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153444490 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153444490 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153444490 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153444492 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153444492 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153444492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153444492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:34:45.493914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23659): Terminating (SIGTERM) 15:34:45.536431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23662): Terminating (SIGTERM) 15:34:45.578953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23665): Terminating (SIGTERM) 15:34:45.621750 --- ParallelTerminationStrategy: PID 23659 died... 15:34:45.641886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23659): Terminated: ok {rc=0} 15:34:45.689193 --- ParallelTerminationStrategy: PID 23662 died... 15:34:45.708936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23662): Terminated: ok {rc=0} 15:34:45.756343 --- ParallelTerminationStrategy: PID 23665 died... 15:34:45.776170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23665): Terminated: ok {rc=0} 15:34:45.864549 bus /sierra_3: Setting Powered False 15:34:46.964809 bus /sierra_3: Setting Powered False 15:34:48.085679 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 15:34:49.233326 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:34:49.245103 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:34:49.302455 tst mo_mt_call_osmux.py: using LAC 29829 15:34:49.435228 tst mo_mt_call_osmux.py: using RAC 249 15:34:49.566624 tst mo_mt_call_osmux.py: using CellId 29829 15:34:49.696413 tst mo_mt_call_osmux.py: using BVCI 29830 15:34:49.819184 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:34:49.830894 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:34:49.842443 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:34:49.854724 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:34:49.867027 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:34:49.879722 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:34:50.000107 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:34:50.116905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:34:50.598537 run create_hlr_db(pid=23668): Launched 15:34:50.726955 bus /sierra_2: Setting Powered False 15:34:51.787571 run create_hlr_db(pid=23668): Terminated: ok {rc=0} 15:34:52.243262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23670): Launched 15:34:52.579855 run osmo-hlr_10.42.42.2(pid=23671): Launched 15:34:52.707895 run osmo-stp_10.42.42.5: Starting osmo-stp 15:34:53.279642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23673): Launched 15:34:53.615437 run osmo-stp_10.42.42.5(pid=23675): Launched 15:34:53.742945 run osmo-msc_10.42.42.6: Starting osmo-msc 15:34:54.341572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23677): Launched 15:34:54.678277 run osmo-msc_10.42.42.6(pid=23678): Launched 15:34:54.862351 run osmo-stp_10.42.42.5(pid=23675): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23675)] 15:34:55.001279 run osmo-stp_10.42.42.5(pid=23675): stdout: | (launched: 2022-12-12_15:34:53.551537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:34:55.141324 run osmo-stp_10.42.42.5(pid=23675): stderr: | 20221212153453743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153453744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153453744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153453744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153453745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153453745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153453745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:34:55.278870 run osmo-stp_10.42.42.5(pid=23675): stdout: | (launched: 2022-12-12_15:34:53.551537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:34:55.409755 run osmo-stp_10.42.42.5(pid=23675): stderr: | 20221212153453743 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153453744 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153453744 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153453744 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153453745 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153453745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153453745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:34:55.567091 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23675): Process ended prematurely: osmo-stp_10.42.42.5(pid=23675) [trial-2378↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23675)] [trial-2378↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 15:34:55.576748 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 15:34:55.604994 run osmo-hlr_10.42.42.2(pid=23671): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23671)] 15:34:55.654888 run osmo-hlr_10.42.42.2(pid=23671): stdout: | (launched: 2022-12-12_15:34:52.515770) 15:34:55.706649 run osmo-hlr_10.42.42.2(pid=23671): stderr: | 20221212153452713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153452713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153452713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153452713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153452713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153452713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153452726 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153452735 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153452735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153452735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:34:55.779504 run osmo-msc_10.42.42.6(pid=23678): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23678)] 15:34:55.829859 run osmo-msc_10.42.42.6(pid=23678): stdout: | (launched: 2022-12-12_15:34:54.613935) 15:34:55.881538 run osmo-msc_10.42.42.6(pid=23678): stderr: | 20221212153454937 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153454937 DLGLOBAL DEBUG validating counter group 0x7f4d68e65c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153454937 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153454937 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153454937 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153454937 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153454939 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153454939 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153454940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153454940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:34:55.933607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23670): Terminating (SIGTERM) 15:34:55.975290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23673): Terminating (SIGTERM) 15:34:56.017088 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23677): Terminating (SIGTERM) 15:34:56.058974 --- ParallelTerminationStrategy: PID 23670 died... 15:34:56.078950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23670): Terminated: ok {rc=0} 15:34:56.125432 --- ParallelTerminationStrategy: PID 23673 died... 15:34:56.144637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23673): Terminated: ok {rc=0} 15:34:56.190864 --- ParallelTerminationStrategy: PID 23677 died... 15:34:56.210208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23677): Terminated: ok {rc=0} 15:34:56.297582 bus /sierra_3: Setting Powered False 15:34:57.395818 bus /sierra_3: Setting Powered False 15:34:58.513251 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:34:59.746299 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:34:59.752403 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:34:59.773464 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 15:34:59.799785 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 15:34:59.851401 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:34:59.871785 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 15:34:59.897818 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 15:35:00.446713 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 15:35:00.495579 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:35:00.506419 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:35:00.562744 tst mo_mt_call.py: using LAC 29830 15:35:00.683780 tst mo_mt_call.py: using RAC 250 15:35:00.803941 tst mo_mt_call.py: using CellId 29830 15:35:00.935168 tst mo_mt_call.py: using BVCI 29831 15:35:01.086925 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:35:01.099060 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:35:01.110892 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:35:01.124267 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:35:01.143058 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:35:01.157266 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:35:01.285206 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:35:01.414468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:35:01.953372 run create_hlr_db(pid=23686): Launched 15:35:02.115513 bus /sierra_2: Setting Powered False 15:35:03.176494 run create_hlr_db(pid=23686): Terminated: ok {rc=0} 15:35:03.609164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23688): Launched 15:35:03.920571 run osmo-hlr_10.42.42.2(pid=23689): Launched 15:35:04.038094 run osmo-stp_10.42.42.5: Starting osmo-stp 15:35:04.585648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23691): Launched 15:35:04.899035 run osmo-stp_10.42.42.5(pid=23692): Launched 15:35:05.018399 run osmo-msc_10.42.42.6: Starting osmo-msc 15:35:05.579747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23694): Launched 15:35:05.893539 run osmo-msc_10.42.42.6(pid=23695): Launched 15:35:06.064167 run osmo-stp_10.42.42.5(pid=23692): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23692)] 15:35:06.193510 run osmo-stp_10.42.42.5(pid=23692): stdout: | (launched: 2022-12-12_15:35:04.838564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:35:06.323222 run osmo-stp_10.42.42.5(pid=23692): stderr: | 20221212153505011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153505011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153505011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153505011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153505012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153505012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153505012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:35:06.451533 run osmo-stp_10.42.42.5(pid=23692): stdout: | (launched: 2022-12-12_15:35:04.838564) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:35:06.572923 run osmo-stp_10.42.42.5(pid=23692): stderr: | 20221212153505011 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153505011 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153505011 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153505011 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153505012 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153505012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153505012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:35:06.719000 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23692): Process ended prematurely: osmo-stp_10.42.42.5(pid=23692) [trial-2378↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23692)] [trial-2378↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 15:35:06.727831 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 15:35:06.753895 run osmo-hlr_10.42.42.2(pid=23689): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23689)] 15:35:06.801265 run osmo-hlr_10.42.42.2(pid=23689): stdout: | (launched: 2022-12-12_15:35:03.861515) 15:35:06.850356 run osmo-hlr_10.42.42.2(pid=23689): stderr: | 20221212153504036 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153504036 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153504036 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153504036 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153504036 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153504036 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153504049 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153504059 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153504059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153504059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:35:06.918903 run osmo-msc_10.42.42.6(pid=23695): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23695)] 15:35:06.966123 run osmo-msc_10.42.42.6(pid=23695): stdout: | (launched: 2022-12-12_15:35:05.833771) 15:35:07.015136 run osmo-msc_10.42.42.6(pid=23695): stderr: | 20221212153506107 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153506108 DLGLOBAL DEBUG validating counter group 0x7f7942c78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153506108 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153506108 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153506108 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153506108 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153506110 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153506110 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153506110 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153506111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:35:07.064299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23688): Terminating (SIGTERM) 15:35:07.104444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23691): Terminating (SIGTERM) 15:35:07.144026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23694): Terminating (SIGTERM) 15:35:07.183843 --- ParallelTerminationStrategy: PID 23688 died... 15:35:07.202899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23688): Terminated: ok {rc=0} 15:35:07.246887 --- ParallelTerminationStrategy: PID 23691 died... 15:35:07.265469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23691): Terminated: ok {rc=0} 15:35:07.309143 --- ParallelTerminationStrategy: PID 23694 died... 15:35:07.327488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23694): Terminated: ok {rc=0} 15:35:07.411118 bus /sierra_3: Setting Powered False 15:35:08.508635 bus /sierra_3: Setting Powered False 15:35:09.627537 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 15:35:10.775193 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:35:10.786815 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:35:10.844681 tst mo_mt_call_osmux.py: using LAC 29831 15:35:10.968542 tst mo_mt_call_osmux.py: using RAC 251 15:35:11.093701 tst mo_mt_call_osmux.py: using CellId 29831 15:35:11.217177 tst mo_mt_call_osmux.py: using BVCI 29832 15:35:11.330017 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:35:11.340898 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:35:11.351668 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:35:11.362378 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:35:11.373072 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:35:11.383834 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:35:11.503480 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:35:11.624443 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:35:12.141268 run create_hlr_db(pid=23699): Launched 15:35:12.268530 bus /sierra_2: Setting Powered False 15:35:13.333869 run create_hlr_db(pid=23699): Terminated: ok {rc=0} 15:35:13.777312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23701): Launched 15:35:14.089899 run osmo-hlr_10.42.42.2(pid=23702): Launched 15:35:14.208527 run osmo-stp_10.42.42.5: Starting osmo-stp 15:35:14.741071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23704): Launched 15:35:15.051306 run osmo-stp_10.42.42.5(pid=23705): Launched 15:35:15.167983 run osmo-msc_10.42.42.6: Starting osmo-msc 15:35:15.726305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23707): Launched 15:35:16.053264 run osmo-msc_10.42.42.6(pid=23708): Launched 15:35:16.531642 run osmo-stp_10.42.42.5(pid=23705): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23705)] 15:35:16.684853 run osmo-stp_10.42.42.5(pid=23705): stdout: | (launched: 2022-12-12_15:35:14.991682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:35:16.828439 run osmo-stp_10.42.42.5(pid=23705): stderr: | 20221212153515163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153515163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153515163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153515164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153515164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153515164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153515164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:35:16.972126 run osmo-stp_10.42.42.5(pid=23705): stdout: | (launched: 2022-12-12_15:35:14.991682) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:35:17.107587 run osmo-stp_10.42.42.5(pid=23705): stderr: | 20221212153515163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153515163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153515163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153515164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153515164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153515164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153515164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:35:17.269962 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23705): Process ended prematurely: osmo-stp_10.42.42.5(pid=23705) [trial-2378↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23705)] [trial-2378↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 15:35:17.280702 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 15:35:17.312774 run osmo-hlr_10.42.42.2(pid=23702): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23702)] 15:35:17.367380 run osmo-hlr_10.42.42.2(pid=23702): stdout: | (launched: 2022-12-12_15:35:14.029932) 15:35:17.422130 run osmo-hlr_10.42.42.2(pid=23702): stderr: | 20221212153514208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153514208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153514208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153514208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153514208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153514208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153514220 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153514228 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153514229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153514229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:35:17.497244 run osmo-msc_10.42.42.6(pid=23708): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23708)] 15:35:17.549128 run osmo-msc_10.42.42.6(pid=23708): stdout: | (launched: 2022-12-12_15:35:15.979746) 15:35:17.601750 run osmo-msc_10.42.42.6(pid=23708): stderr: | 20221212153516365 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153516365 DLGLOBAL DEBUG validating counter group 0x7f1bfda97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153516366 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153516366 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153516366 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153516367 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153516370 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153516372 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153516372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153516372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:35:17.654680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23701): Terminating (SIGTERM) 15:35:17.697852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23704): Terminating (SIGTERM) 15:35:17.740525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23707): Terminating (SIGTERM) 15:35:17.783619 --- ParallelTerminationStrategy: PID 23701 died... 15:35:17.803640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23701): Terminated: ok {rc=0} 15:35:17.851933 --- ParallelTerminationStrategy: PID 23704 died... 15:35:17.871682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23704): Terminated: ok {rc=0} 15:35:17.919864 --- ParallelTerminationStrategy: PID 23707 died... 15:35:17.939742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23707): Terminated: ok {rc=0} 15:35:18.030662 bus /sierra_3: Setting Powered False 15:35:19.129760 bus /sierra_3: Setting Powered False 15:35:20.247014 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 emergency:sysmo --------------------------------------------------------------------- 15:35:21.482174 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:35:21.486723 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 15:35:21.507985 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 15:35:21.536129 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 15:35:21.622365 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 15:35:21.643577 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 15:35:21.671177 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 15:35:22.251167 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2378 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 15:35:22.257462 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:35:22.268187 tst emergency:sysmo: Using 1 x bts (candidates: 1) 15:35:22.305802 tst emergency_mo_mt_call.py: using LAC 29832 15:35:22.433428 tst emergency_mo_mt_call.py: using RAC 252 15:35:22.554850 tst emergency_mo_mt_call.py: using CellId 29832 15:35:22.674572 tst emergency_mo_mt_call.py: using BVCI 29833 15:35:22.785849 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:35:22.796369 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:35:22.806976 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:35:22.817435 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:35:22.828895 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:35:22.840004 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:35:22.956168 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:35:23.070723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:35:23.543357 run create_hlr_db(pid=23713): Launched 15:35:23.667619 bus /sierra_2: Setting Powered False 15:35:24.727928 run create_hlr_db(pid=23713): Terminated: ok {rc=0} 15:35:25.154862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23715): Launched 15:35:25.461289 run osmo-hlr_10.42.42.2(pid=23716): Launched 15:35:25.576680 run osmo-stp_10.42.42.5: Starting osmo-stp 15:35:26.101646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23718): Launched 15:35:26.407509 run osmo-stp_10.42.42.5(pid=23719): Launched 15:35:26.532287 tst emergency_mo_mt_call.py: using MSISDN 7852 15:35:26.685968 run osmo-msc_10.42.42.6: Starting osmo-msc 15:35:27.233202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23721): Launched 15:35:27.540679 run osmo-msc_10.42.42.6(pid=23722): Launched 15:35:27.711709 run osmo-stp_10.42.42.5(pid=23719): ERR: Terminated: ERROR {rc=1} [trial-2378↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23719)] 15:35:27.838906 run osmo-stp_10.42.42.5(pid=23719): stdout: | (launched: 2022-12-12_15:35:26.348327) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:35:27.966760 run osmo-stp_10.42.42.5(pid=23719): stderr: | 20221212153526518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153526519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153526519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153526519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153526520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153526520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153526520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:35:28.092566 run osmo-stp_10.42.42.5(pid=23719): stdout: | (launched: 2022-12-12_15:35:26.348327) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:35:28.212878 run osmo-stp_10.42.42.5(pid=23719): stderr: | 20221212153526518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153526519 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153526519 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153526519 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153526520 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153526520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153526520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:35:28.356443 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=23719): Process ended prematurely: osmo-stp_10.42.42.5(pid=23719) [trial-2378↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23719)] [trial-2378↪emergency:sysmo↪emergency_mo_mt_call.py:19] 15:35:28.364896 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 15:35:28.390993 run osmo-hlr_10.42.42.2(pid=23716): ERR: Terminated: ERROR {rc=237} [trial-2378↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23716)] 15:35:28.438971 run osmo-hlr_10.42.42.2(pid=23716): stdout: | (launched: 2022-12-12_15:35:25.402044) 15:35:28.488771 run osmo-hlr_10.42.42.2(pid=23716): stderr: | 20221212153525580 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153525580 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153525580 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153525580 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153525580 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153525580 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153525592 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153525601 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153525601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153525601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:35:28.557963 run osmo-msc_10.42.42.6(pid=23722): ERR: Terminated: ERROR {rc=2} [trial-2378↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23722)] 15:35:28.605853 run osmo-msc_10.42.42.6(pid=23722): stdout: | (launched: 2022-12-12_15:35:27.481125) 15:35:28.654990 run osmo-msc_10.42.42.6(pid=23722): stderr: | 20221212153527757 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153527757 DLGLOBAL DEBUG validating counter group 0x7f73b7646c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153527757 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153527757 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153527757 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153527758 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153527759 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153527760 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153527760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153527760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:35:28.704600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23715): Terminating (SIGTERM) 15:35:28.744423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23718): Terminating (SIGTERM) 15:35:28.784438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23721): Terminating (SIGTERM) 15:35:28.824811 --- ParallelTerminationStrategy: PID 23715 died... 15:35:28.843689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23715): Terminated: ok {rc=0} 15:35:28.887966 --- ParallelTerminationStrategy: PID 23718 died... 15:35:28.906571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23718): Terminated: ok {rc=0} 15:35:28.950980 --- ParallelTerminationStrategy: PID 23721 died... 15:35:28.969779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23721): Terminated: ok {rc=0} 15:35:29.056135 bus /sierra_3: Setting Powered False 15:35:30.156275 bus /sierra_3: Setting Powered False 15:35:31.269414 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 15:35:32.361491 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:35:32.373941 tst emergency:sysmo: Using 1 x bts (candidates: 1) 15:35:32.410397 tst emergency_preemptive_call.py: using LAC 29833 15:35:32.529537 tst emergency_preemptive_call.py: using RAC 253 15:35:32.648685 tst emergency_preemptive_call.py: using CellId 29833 15:35:32.765319 tst emergency_preemptive_call.py: using BVCI 29834 15:35:32.874877 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:35:32.885670 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:35:32.896244 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:35:32.906732 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:35:32.917199 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 15:35:32.927592 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:35:33.045650 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:35:33.167753 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:35:33.288192 tst emergency:sysmo: Using 1 x modem (candidates: 4) 15:35:33.404191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:35:33.912036 run create_hlr_db(pid=23724): Launched 15:35:34.037501 bus /sierra_2: Setting Powered False 15:35:35.101629 run create_hlr_db(pid=23724): Terminated: ok {rc=0} 15:35:35.557501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23726): Launched 15:35:35.889792 run osmo-hlr_10.42.42.2(pid=23727): Launched 15:35:36.015398 run osmo-stp_10.42.42.5: Starting osmo-stp 15:35:36.578926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23729): Launched 15:35:36.909811 run osmo-stp_10.42.42.5(pid=23730): Launched 15:35:37.049420 tst emergency_preemptive_call.py: using MSISDN 7853 15:35:37.216504 run osmo-msc_10.42.42.6: Starting osmo-msc 15:35:37.803912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23732): Launched 15:35:38.134309 run osmo-msc_10.42.42.6(pid=23733): Launched 15:35:38.323189 run osmo-stp_10.42.42.5(pid=23730): ERR: Terminated: ERROR {rc=1} [trial-2378↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23730)] 15:35:38.459776 run osmo-stp_10.42.42.5(pid=23730): stdout: | (launched: 2022-12-12_15:35:36.847423) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:35:38.597228 run osmo-stp_10.42.42.5(pid=23730): stderr: | 20221212153537037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153537037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153537038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153537039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153537039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153537039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153537040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:35:38.732328 run osmo-stp_10.42.42.5(pid=23730): stdout: | (launched: 2022-12-12_15:35:36.847423) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:35:38.861910 run osmo-stp_10.42.42.5(pid=23730): stderr: | 20221212153537037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153537037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153537038 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153537039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153537039 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153537039 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153537040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:35:39.016630 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=23730): Process ended prematurely: osmo-stp_10.42.42.5(pid=23730) [trial-2378↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23730)] [trial-2378↪emergency:sysmo↪emergency_preemptive_call.py:32] 15:35:39.025661 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 15:35:39.053319 run osmo-hlr_10.42.42.2(pid=23727): ERR: Terminated: ERROR {rc=237} [trial-2378↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23727)] 15:35:39.103530 run osmo-hlr_10.42.42.2(pid=23727): stdout: | (launched: 2022-12-12_15:35:35.826419) 15:35:39.154971 run osmo-hlr_10.42.42.2(pid=23727): stderr: | 20221212153536025 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153536025 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153536025 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153536025 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153536025 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153536025 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153536038 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153536046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153536047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153536047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:35:39.227123 run osmo-msc_10.42.42.6(pid=23733): ERR: Terminated: ERROR {rc=2} [trial-2378↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=23733)] 15:35:39.277112 run osmo-msc_10.42.42.6(pid=23733): stdout: | (launched: 2022-12-12_15:35:38.071485) 15:35:39.328545 run osmo-msc_10.42.42.6(pid=23733): stderr: | 20221212153538392 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212153538392 DLGLOBAL DEBUG validating counter group 0x7faea13ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212153538392 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212153538393 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212153538393 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212153538393 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212153538395 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212153538395 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212153538395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212153538395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:35:39.380426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23726): Terminating (SIGTERM) 15:35:39.422223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23729): Terminating (SIGTERM) 15:35:39.463776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23732): Terminating (SIGTERM) 15:35:39.505553 --- ParallelTerminationStrategy: PID 23726 died... 15:35:39.525525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23726): Terminated: ok {rc=0} 15:35:39.571891 --- ParallelTerminationStrategy: PID 23729 died... 15:35:39.591324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23729): Terminated: ok {rc=0} 15:35:39.637586 --- ParallelTerminationStrategy: PID 23732 died... 15:35:39.656865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=23732): Terminated: ok {rc=0} 15:35:39.744479 bus /sierra_9: Setting Powered False 15:35:40.844252 bus /sierra_9: Setting Powered False 15:35:41.959924 bus /sierra_8: Setting Powered False 15:35:43.058472 bus /sierra_8: Setting Powered False 15:35:44.170702 bus /sierra_3: Setting Powered False 15:35:45.265238 bus /sierra_3: Setting Powered False 15:35:46.392166 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 gprs:sysmo --------------------------------------------------------------------- 15:35:47.653301 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:35:47.658104 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 15:35:47.680460 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 15:35:47.720071 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 15:35:47.808607 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 15:35:47.830265 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 15:35:47.869990 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 15:35:48.460019 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2378 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 15:35:48.515675 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:35:48.526731 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:35:48.563040 tst cs_paging_gprs_active.py: using LAC 29834 15:35:48.687117 tst cs_paging_gprs_active.py: using RAC 254 15:35:48.810384 tst cs_paging_gprs_active.py: using CellId 29834 15:35:48.933602 tst cs_paging_gprs_active.py: using BVCI 29835 15:35:49.046429 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:35:49.057196 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:35:49.067596 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:35:49.078232 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:35:49.092449 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:35:49.103630 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:35:49.114897 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:35:49.126126 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:35:49.137479 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:35:49.258058 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:35:49.375461 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:35:49.585024 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:35:49.901962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23738): Launched 15:35:50.176617 run iperf3-srv_10.42.42.10(pid=23739): Launched 15:35:50.294751 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:35:50.501214 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:35:50.814194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23740): Launched 15:35:51.087578 run iperf3-srv_10.42.42.10(pid=23741): Launched 15:35:51.203113 tst cs_paging_gprs_active.py:38: start network... 15:35:51.410249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:35:51.892934 run create_hlr_db(pid=23742): Launched 15:35:52.020239 bus /sierra_2: Setting Powered False 15:35:53.081653 run create_hlr_db(pid=23742): Terminated: ok {rc=0} 15:35:53.537642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23744): Launched 15:35:53.875668 run osmo-hlr_10.42.42.2(pid=23745): Launched 15:35:54.003632 run osmo-stp_10.42.42.5: Starting osmo-stp 15:35:54.576539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23747): Launched 15:35:54.912381 run osmo-stp_10.42.42.5(pid=23748): Launched 15:35:55.038504 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:35:56.626444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23750): Launched 15:35:56.755552 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:35:57.040786 run patchelf(pid=23751): Launched 15:35:57.227607 run osmo-stp_10.42.42.5(pid=23748): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23748)] 15:35:57.368159 run osmo-stp_10.42.42.5(pid=23748): stdout: | (launched: 2022-12-12_15:35:54.848791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:35:57.510538 run osmo-stp_10.42.42.5(pid=23748): stderr: | 20221212153555039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153555039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153555040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153555040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153555041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153555041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153555041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:35:57.652814 run osmo-stp_10.42.42.5(pid=23748): stdout: | (launched: 2022-12-12_15:35:54.848791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:35:57.789212 run osmo-stp_10.42.42.5(pid=23748): stderr: | 20221212153555039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153555039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153555040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153555040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153555041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153555041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153555041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:35:57.951214 run patchelf(pid=23751): Terminating (SIGINT) 15:35:58.137485 run patchelf(pid=23751): Terminated: ok {rc=0} 15:35:58.271716 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23748): Process ended prematurely: osmo-stp_10.42.42.5(pid=23748) [trial-2378↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23748)] [trial-2378↪gprs:sysmo↪cs_paging_gprs_active.py:38] 15:35:58.281868 tst cs_paging_gprs_active.py:38: Test FAILED (9.8 sec) 15:35:58.311129 run osmo-hlr_10.42.42.2(pid=23745): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23745)] 15:35:58.361882 run osmo-hlr_10.42.42.2(pid=23745): stdout: | (launched: 2022-12-12_15:35:53.811265) 15:35:58.414333 run osmo-hlr_10.42.42.2(pid=23745): stderr: | 20221212153554009 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153554009 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153554009 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153554009 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153554009 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153554009 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153554023 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153554033 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153554033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153554033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:35:58.467422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23738): Terminating (SIGTERM) 15:35:58.510062 run iperf3-srv_10.42.42.10(pid=23739): Terminating (SIGTERM) 15:35:58.552725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23740): Terminating (SIGTERM) 15:35:58.595599 run iperf3-srv_10.42.42.10(pid=23741): Terminating (SIGTERM) 15:35:58.638203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23744): Terminating (SIGTERM) 15:35:58.681109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23747): Terminating (SIGTERM) 15:35:58.723755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23750): Terminating (SIGTERM) 15:35:58.766624 --- ParallelTerminationStrategy: PID 23738 died... 15:35:58.787035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23738): Terminated: ok {rc=0} 15:35:58.835013 --- ParallelTerminationStrategy: PID 23739 died... 15:35:58.854817 run iperf3-srv_10.42.42.10(pid=23739): Terminated {rc=256} 15:35:58.902226 --- ParallelTerminationStrategy: PID 23740 died... 15:35:58.922215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23740): Terminated: ok {rc=0} 15:35:58.969634 --- ParallelTerminationStrategy: PID 23741 died... 15:35:58.989707 run iperf3-srv_10.42.42.10(pid=23741): Terminated {rc=256} 15:35:59.037077 --- ParallelTerminationStrategy: PID 23744 died... 15:35:59.057309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23744): Terminated: ok {rc=0} 15:35:59.104709 --- ParallelTerminationStrategy: PID 23747 died... 15:35:59.124267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23747): Terminated: ok {rc=0} 15:35:59.171471 --- ParallelTerminationStrategy: PID 23750 died... 15:35:59.191416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23750): Terminated: ok {rc=0} 15:35:59.280387 bus /gobi_0: Setting Powered False 15:36:00.380296 bus /gobi_0: Setting Powered False 15:36:01.525640 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:sysmo iperf3.py ---------------------------------------------- 15:36:02.688497 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:02.700430 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:36:02.738133 tst iperf3.py: using LAC 29835 15:36:02.869436 tst iperf3.py: using RAC 255 15:36:03.004630 tst iperf3.py: using CellId 29835 15:36:03.133847 tst iperf3.py: using BVCI 29836 15:36:03.256030 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:03.267217 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:03.278153 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:03.289674 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:03.300822 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:03.311974 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:03.323239 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:03.334568 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:03.346036 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:36:03.463916 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:36:03.671817 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:36:03.985636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Launched 15:36:04.260353 run iperf3-srv_10.42.42.10(pid=23753): Launched 15:36:04.376938 tst iperf3.py:8: start network... 15:36:04.583397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:36:05.064305 run create_hlr_db(pid=23754): Launched 15:36:05.192027 bus /gobi_6: Setting Powered False 15:36:06.252941 run create_hlr_db(pid=23754): Terminated: ok {rc=0} 15:36:06.688937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23756): Launched 15:36:07.001569 run osmo-hlr_10.42.42.2(pid=23757): Launched 15:36:07.117796 run osmo-stp_10.42.42.5: Starting osmo-stp 15:36:07.653653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23759): Launched 15:36:07.965679 run osmo-stp_10.42.42.5(pid=23760): Launched 15:36:08.084251 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:36:08.619172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23762): Launched 15:36:08.737512 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:36:09.002159 run patchelf(pid=23763): Launched 15:36:09.173290 run osmo-stp_10.42.42.5(pid=23760): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23760)] 15:36:09.303358 run osmo-stp_10.42.42.5(pid=23760): stdout: | (launched: 2022-12-12_15:36:07.905711) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:36:09.435325 run osmo-stp_10.42.42.5(pid=23760): stderr: | 20221212153608077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153608077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153608078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153608078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153608079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153608079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153608079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:36:09.567089 run osmo-stp_10.42.42.5(pid=23760): stdout: | (launched: 2022-12-12_15:36:07.905711) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:36:09.692465 run osmo-stp_10.42.42.5(pid=23760): stderr: | 20221212153608077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153608077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153608078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153608078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153608079 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153608079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153608079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:36:09.842852 run patchelf(pid=23763): Terminating (SIGINT) 15:36:10.016037 run patchelf(pid=23763): Terminated: ok {rc=0} 15:36:10.140529 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23760): Process ended prematurely: osmo-stp_10.42.42.5(pid=23760) [trial-2378↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23760)] [trial-2378↪gprs:sysmo↪iperf3.py:8] 15:36:10.150060 tst iperf3.py:8: Test FAILED (7.5 sec) 15:36:10.176864 run osmo-hlr_10.42.42.2(pid=23757): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23757)] 15:36:10.224514 run osmo-hlr_10.42.42.2(pid=23757): stdout: | (launched: 2022-12-12_15:36:06.941405) 15:36:10.273753 run osmo-hlr_10.42.42.2(pid=23757): stderr: | 20221212153607120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153607120 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153607120 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153607120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153607121 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153607121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153607133 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153607142 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153607142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153607142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:36:10.323306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Terminating (SIGTERM) 15:36:10.363040 run iperf3-srv_10.42.42.10(pid=23753): Terminating (SIGTERM) 15:36:10.402643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23756): Terminating (SIGTERM) 15:36:10.442394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23759): Terminating (SIGTERM) 15:36:10.482009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23762): Terminating (SIGTERM) 15:36:10.522073 --- ParallelTerminationStrategy: PID 23752 died... 15:36:10.540726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23752): Terminated: ok {rc=0} 15:36:10.584504 --- ParallelTerminationStrategy: PID 23753 died... 15:36:10.603131 run iperf3-srv_10.42.42.10(pid=23753): Terminated {rc=256} 15:36:10.646669 --- ParallelTerminationStrategy: PID 23756 died... 15:36:10.665170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23756): Terminated: ok {rc=0} 15:36:10.708811 --- ParallelTerminationStrategy: PID 23759 died... 15:36:10.727409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23759): Terminated: ok {rc=0} 15:36:10.771325 --- ParallelTerminationStrategy: PID 23762 died... 15:36:10.789965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23762): Terminated: ok {rc=0} 15:36:10.876424 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:sysmo iperf3m4.py ---------------------------------------------- 15:36:12.027849 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:12.039403 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:36:12.076227 tst iperf3m4.py: using LAC 29836 15:36:12.206996 tst iperf3m4.py: using RAC 1 15:36:12.338063 tst iperf3m4.py: using CellId 29836 15:36:12.467140 tst iperf3m4.py: using BVCI 29837 15:36:12.589741 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:12.600815 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:12.611901 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:12.623208 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:12.634293 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:12.645400 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:12.656711 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:12.667900 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:12.679179 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:36:12.796356 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:36:12.920053 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:36:13.036605 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:36:13.153715 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:36:13.361371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:36:13.676356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23764): Launched 15:36:13.951332 run iperf3-srv_10.42.42.10(pid=23765): Launched 15:36:14.069141 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:36:14.276589 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:36:14.590825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23766): Launched 15:36:14.863935 run iperf3-srv_10.42.42.10(pid=23767): Launched 15:36:14.981536 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:36:15.188586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:36:15.501691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23768): Launched 15:36:15.773880 run iperf3-srv_10.42.42.10(pid=23769): Launched 15:36:15.891480 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:36:16.135858 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:36:16.457079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23770): Launched 15:36:16.759326 run iperf3-srv_10.42.42.10(pid=23771): Launched 15:36:16.891242 tst iperf3m4.py:8: start network... 15:36:17.101109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:36:17.592178 run create_hlr_db(pid=23772): Launched 15:36:17.718440 bus /gobi_6: Setting Powered False 15:36:18.779350 run create_hlr_db(pid=23772): Terminated: ok {rc=0} 15:36:19.235354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23774): Launched 15:36:19.572251 run osmo-hlr_10.42.42.2(pid=23775): Launched 15:36:19.699351 run osmo-stp_10.42.42.5: Starting osmo-stp 15:36:20.276684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23777): Launched 15:36:20.611982 run osmo-stp_10.42.42.5(pid=23778): Launched 15:36:20.738357 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:36:21.313169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23780): Launched 15:36:21.442178 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:36:21.727828 run patchelf(pid=23781): Launched 15:36:21.918113 run osmo-stp_10.42.42.5(pid=23778): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23778)] 15:36:22.059625 run osmo-stp_10.42.42.5(pid=23778): stdout: | (launched: 2022-12-12_15:36:20.547729) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:36:22.201638 run osmo-stp_10.42.42.5(pid=23778): stderr: | 20221212153620741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153620741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153620741 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153620742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153620742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153620742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153620742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:36:22.343297 run osmo-stp_10.42.42.5(pid=23778): stdout: | (launched: 2022-12-12_15:36:20.547729) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:36:22.478956 run osmo-stp_10.42.42.5(pid=23778): stderr: | 20221212153620741 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153620741 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153620741 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153620742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153620742 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153620742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153620742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:36:22.640210 run patchelf(pid=23781): Terminating (SIGINT) 15:36:22.825733 run patchelf(pid=23781): Terminated: ok {rc=0} 15:36:22.959964 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23778): Process ended prematurely: osmo-stp_10.42.42.5(pid=23778) [trial-2378↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23778)] [trial-2378↪gprs:sysmo↪iperf3m4.py:8] 15:36:22.970294 tst iperf3m4.py:8: Test FAILED (11.0 sec) 15:36:22.999934 run osmo-hlr_10.42.42.2(pid=23775): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23775)] 15:36:23.050642 run osmo-hlr_10.42.42.2(pid=23775): stdout: | (launched: 2022-12-12_15:36:19.508116) 15:36:23.102960 run osmo-hlr_10.42.42.2(pid=23775): stderr: | 20221212153619705 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153619705 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153619705 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153619705 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153619705 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153619706 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153619720 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153619729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153619729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153619729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:36:23.155839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23764): Terminating (SIGTERM) 15:36:23.198101 run iperf3-srv_10.42.42.10(pid=23765): Terminating (SIGTERM) 15:36:23.240397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23766): Terminating (SIGTERM) 15:36:23.282893 run iperf3-srv_10.42.42.10(pid=23767): Terminating (SIGTERM) 15:36:23.325096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23768): Terminating (SIGTERM) 15:36:23.367480 run iperf3-srv_10.42.42.10(pid=23769): Terminating (SIGTERM) 15:36:23.409822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23770): Terminating (SIGTERM) 15:36:23.452089 run iperf3-srv_10.42.42.10(pid=23771): Terminating (SIGTERM) 15:36:23.494247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23774): Terminating (SIGTERM) 15:36:23.536655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23777): Terminating (SIGTERM) 15:36:23.579031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23780): Terminating (SIGTERM) 15:36:23.621487 --- ParallelTerminationStrategy: PID 23764 died... 15:36:23.641616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23764): Terminated: ok {rc=0} 15:36:23.688563 --- ParallelTerminationStrategy: PID 23765 died... 15:36:23.708247 run iperf3-srv_10.42.42.10(pid=23765): Terminated {rc=256} 15:36:23.755390 --- ParallelTerminationStrategy: PID 23766 died... 15:36:23.774954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23766): Terminated: ok {rc=0} 15:36:23.821825 --- ParallelTerminationStrategy: PID 23767 died... 15:36:23.841293 run iperf3-srv_10.42.42.10(pid=23767): Terminated {rc=256} 15:36:23.888598 --- ParallelTerminationStrategy: PID 23768 died... 15:36:23.908500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23768): Terminated: ok {rc=0} 15:36:23.955701 --- ParallelTerminationStrategy: PID 23769 died... 15:36:23.975324 run iperf3-srv_10.42.42.10(pid=23769): Terminated {rc=256} 15:36:24.022006 --- ParallelTerminationStrategy: PID 23770 died... 15:36:24.041577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23770): Terminated: ok {rc=0} 15:36:24.088328 --- ParallelTerminationStrategy: PID 23771 died... 15:36:24.107977 run iperf3-srv_10.42.42.10(pid=23771): Terminated {rc=256} 15:36:24.155554 --- ParallelTerminationStrategy: PID 23774 died... 15:36:24.175292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23774): Terminated: ok {rc=0} 15:36:24.222175 --- ParallelTerminationStrategy: PID 23777 died... 15:36:24.241948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23777): Terminated: ok {rc=0} 15:36:24.289200 --- ParallelTerminationStrategy: PID 23780 died... 15:36:24.308740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23780): Terminated: ok {rc=0} 15:36:24.398181 bus /gobi_4: Setting Powered False 15:36:25.497497 bus /gobi_4: Setting Powered False 15:36:26.613431 bus /gobi_1: Setting Powered False 15:36:27.711902 bus /gobi_1: Setting Powered False 15:36:28.829487 bus /gobi_0: Setting Powered False 15:36:29.927670 bus /gobi_0: Setting Powered False 15:36:31.068167 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:sysmo ping.py ---------------------------------------------- 15:36:32.180138 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:32.196353 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:36:32.238988 tst ping.py: using LAC 29837 15:36:32.369482 tst ping.py: using RAC 2 15:36:32.489250 tst ping.py: using CellId 29837 15:36:32.607443 tst ping.py: using BVCI 29838 15:36:32.718246 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:32.728724 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:32.739318 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:32.749858 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:32.760060 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:32.770313 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:32.780720 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:32.791110 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:36:32.910569 tst ping.py:19: start network... 15:36:33.131124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:36:33.640120 run create_hlr_db(pid=23782): Launched 15:36:33.764463 bus /gobi_6: Setting Powered False 15:36:34.825216 run create_hlr_db(pid=23782): Terminated: ok {rc=0} 15:36:35.285179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23784): Launched 15:36:35.592134 run osmo-hlr_10.42.42.2(pid=23785): Launched 15:36:35.708462 run osmo-stp_10.42.42.5: Starting osmo-stp 15:36:36.249503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23787): Launched 15:36:36.554420 run osmo-stp_10.42.42.5(pid=23788): Launched 15:36:36.669154 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:36:37.193215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23790): Launched 15:36:37.310021 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:36:37.568888 run patchelf(pid=23791): Launched 15:36:37.739225 run osmo-stp_10.42.42.5(pid=23788): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23788)] 15:36:37.867554 run osmo-stp_10.42.42.5(pid=23788): stdout: | (launched: 2022-12-12_15:36:36.495647) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:36:37.998231 run osmo-stp_10.42.42.5(pid=23788): stderr: | 20221212153636667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153636667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153636667 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153636668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153636668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153636668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153636668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:36:38.128284 run osmo-stp_10.42.42.5(pid=23788): stdout: | (launched: 2022-12-12_15:36:36.495647) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:36:38.253134 run osmo-stp_10.42.42.5(pid=23788): stderr: | 20221212153636667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153636667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153636667 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153636668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153636668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153636668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153636668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:36:38.399469 run patchelf(pid=23791): Terminating (SIGINT) 15:36:38.568141 run patchelf(pid=23791): Terminated: ok {rc=0} 15:36:38.690303 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23788): Process ended prematurely: osmo-stp_10.42.42.5(pid=23788) [trial-2378↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23788)] [trial-2378↪gprs:sysmo↪ping.py:22] 15:36:38.699041 tst ping.py:22: Test FAILED (6.5 sec) 15:36:38.725586 run osmo-hlr_10.42.42.2(pid=23785): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23785)] 15:36:38.773208 run osmo-hlr_10.42.42.2(pid=23785): stdout: | (launched: 2022-12-12_15:36:35.533221) 15:36:38.822629 run osmo-hlr_10.42.42.2(pid=23785): stderr: | 20221212153635709 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153635709 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153635709 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153635709 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153635709 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153635709 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153635722 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153635730 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153635730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153635730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:36:38.872203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23784): Terminating (SIGTERM) 15:36:38.912434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23787): Terminating (SIGTERM) 15:36:38.952340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23790): Terminating (SIGTERM) 15:36:38.992150 --- ParallelTerminationStrategy: PID 23784 died... 15:36:39.011569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23784): Terminated: ok {rc=0} 15:36:39.055929 --- ParallelTerminationStrategy: PID 23787 died... 15:36:39.074629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23787): Terminated: ok {rc=0} 15:36:39.118820 --- ParallelTerminationStrategy: PID 23790 died... 15:36:39.137673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23790): Terminated: ok {rc=0} 15:36:39.223980 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 15:36:40.313859 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:40.325772 tst gprs:sysmo: Using 1 x bts (candidates: 1) 15:36:40.367778 tst ping_idle_ping.py: using LAC 29838 15:36:40.491365 tst ping_idle_ping.py: using RAC 3 15:36:40.609421 tst ping_idle_ping.py: using CellId 29838 15:36:40.728307 tst ping_idle_ping.py: using BVCI 29839 15:36:40.838373 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:40.848844 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:40.859464 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:40.870621 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:40.881599 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:40.892320 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:40.903517 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 15:36:40.914654 tst gprs:sysmo: Using 1 x modem (candidates: 4) 15:36:41.036585 tst ping_idle_ping.py:24: start network... 15:36:41.239813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:36:41.711624 run create_hlr_db(pid=23792): Launched 15:36:41.834962 bus /gobi_6: Setting Powered False 15:36:42.895688 run create_hlr_db(pid=23792): Terminated: ok {rc=0} 15:36:43.324001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23794): Launched 15:36:43.631077 run osmo-hlr_10.42.42.2(pid=23795): Launched 15:36:43.745834 run osmo-stp_10.42.42.5: Starting osmo-stp 15:36:44.274431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23797): Launched 15:36:44.582516 run osmo-stp_10.42.42.5(pid=23798): Launched 15:36:44.697221 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:36:45.225232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23800): Launched 15:36:45.341299 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:36:45.601189 run patchelf(pid=23801): Launched 15:36:45.770499 run osmo-stp_10.42.42.5(pid=23798): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23798)] 15:36:45.898925 run osmo-stp_10.42.42.5(pid=23798): stdout: | (launched: 2022-12-12_15:36:44.523142) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:36:46.044725 run osmo-stp_10.42.42.5(pid=23798): stderr: | 20221212153644695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153644695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153644696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153644696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153644696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153644697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153644697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:36:46.176811 run osmo-stp_10.42.42.5(pid=23798): stdout: | (launched: 2022-12-12_15:36:44.523142) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:36:46.303508 run osmo-stp_10.42.42.5(pid=23798): stderr: | 20221212153644695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153644695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153644696 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153644696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153644696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153644697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153644697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:36:46.453474 run patchelf(pid=23801): Terminating (SIGINT) 15:36:46.627344 run patchelf(pid=23801): Terminated: ok {rc=0} 15:36:46.752833 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23798): Process ended prematurely: osmo-stp_10.42.42.5(pid=23798) [trial-2378↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23798)] [trial-2378↪gprs:sysmo↪ping_idle_ping.py:27] 15:36:46.762946 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 15:36:46.790999 run osmo-hlr_10.42.42.2(pid=23795): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23795)] 15:36:46.839565 run osmo-hlr_10.42.42.2(pid=23795): stdout: | (launched: 2022-12-12_15:36:43.571882) 15:36:46.889839 run osmo-hlr_10.42.42.2(pid=23795): stderr: | 20221212153643751 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153643751 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153643751 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153643751 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153643751 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153643751 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153643764 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153643773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153643773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153643773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:36:46.940343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23794): Terminating (SIGTERM) 15:36:46.980888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23797): Terminating (SIGTERM) 15:36:47.021739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23800): Terminating (SIGTERM) 15:36:47.062676 --- ParallelTerminationStrategy: PID 23794 died... 15:36:47.081922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23794): Terminated: ok {rc=0} 15:36:47.126967 --- ParallelTerminationStrategy: PID 23797 died... 15:36:47.146481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23797): Terminated: ok {rc=0} 15:36:47.191659 --- ParallelTerminationStrategy: PID 23800 died... 15:36:47.210983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23800): Terminated: ok {rc=0} 15:36:47.300312 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2378 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 15:36:48.594307 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:36:48.600480 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 15:36:48.624050 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 15:36:48.664802 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 15:36:48.753903 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 15:36:48.774996 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 15:36:48.815791 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 15:36:49.407781 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 15:36:49.462470 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:36:49.473708 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:36:49.520354 tst cs_paging_gprs_active.py: using LAC 29839 15:36:49.652290 tst cs_paging_gprs_active.py: using RAC 4 15:36:49.780840 tst cs_paging_gprs_active.py: using CellId 29839 15:36:49.911676 tst cs_paging_gprs_active.py: using BVCI 29840 15:36:50.032396 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:36:50.043754 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:36:50.054856 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:36:50.066271 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:36:50.077567 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:36:50.088748 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:36:50.100233 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:36:50.111369 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:36:50.122900 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:36:50.243661 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:36:50.362424 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:36:50.571306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:36:50.885894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23806): Launched 15:36:51.160728 run iperf3-srv_10.42.42.10(pid=23807): Launched 15:36:51.278634 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:36:51.486027 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:36:51.800927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23808): Launched 15:36:52.075827 run iperf3-srv_10.42.42.10(pid=23809): Launched 15:36:52.192302 tst cs_paging_gprs_active.py:38: start network... 15:36:52.401364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:36:52.884699 run create_hlr_db(pid=23810): Launched 15:36:53.013280 bus /gobi_6: Setting Powered False 15:36:54.074948 run create_hlr_db(pid=23810): Terminated: ok {rc=0} 15:36:54.531114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23812): Launched 15:36:54.868094 run osmo-hlr_10.42.42.2(pid=23813): Launched 15:36:54.995196 run osmo-stp_10.42.42.5: Starting osmo-stp 15:36:55.570804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23815): Launched 15:36:55.908044 run osmo-stp_10.42.42.5(pid=23816): Launched 15:36:56.036205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:36:56.612054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23818): Launched 15:36:56.741738 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:36:57.026427 run patchelf(pid=23819): Launched 15:36:57.211943 run osmo-stp_10.42.42.5(pid=23816): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23816)] 15:36:57.352457 run osmo-stp_10.42.42.5(pid=23816): stdout: | (launched: 2022-12-12_15:36:55.843883) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:36:57.494341 run osmo-stp_10.42.42.5(pid=23816): stderr: | 20221212153656034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153656034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153656035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153656035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153656035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153656036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153656036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:36:57.636447 run osmo-stp_10.42.42.5(pid=23816): stdout: | (launched: 2022-12-12_15:36:55.843883) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:36:57.772391 run osmo-stp_10.42.42.5(pid=23816): stderr: | 20221212153656034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153656034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153656035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153656035 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153656035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153656036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153656036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:36:57.934224 run patchelf(pid=23819): Terminating (SIGINT) 15:36:58.119710 run patchelf(pid=23819): Terminated: ok {rc=0} 15:36:58.253643 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23816): Process ended prematurely: osmo-stp_10.42.42.5(pid=23816) [trial-2378↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23816)] [trial-2378↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 15:36:58.263994 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 15:36:58.293741 run osmo-hlr_10.42.42.2(pid=23813): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23813)] 15:36:58.344443 run osmo-hlr_10.42.42.2(pid=23813): stdout: | (launched: 2022-12-12_15:36:54.803867) 15:36:58.396777 run osmo-hlr_10.42.42.2(pid=23813): stderr: | 20221212153655000 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153655000 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153655000 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153655000 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153655000 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153655000 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153655013 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153655022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153655022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153655022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:36:58.449835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23806): Terminating (SIGTERM) 15:36:58.492369 run iperf3-srv_10.42.42.10(pid=23807): Terminating (SIGTERM) 15:36:58.534807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23808): Terminating (SIGTERM) 15:36:58.577432 run iperf3-srv_10.42.42.10(pid=23809): Terminating (SIGTERM) 15:36:58.619687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23812): Terminating (SIGTERM) 15:36:58.662301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23815): Terminating (SIGTERM) 15:36:58.704617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23818): Terminating (SIGTERM) 15:36:58.747784 --- ParallelTerminationStrategy: PID 23806 died... 15:36:58.768064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23806): Terminated: ok {rc=0} 15:36:58.815285 --- ParallelTerminationStrategy: PID 23807 died... 15:36:58.834845 run iperf3-srv_10.42.42.10(pid=23807): Terminated {rc=256} 15:36:58.881982 --- ParallelTerminationStrategy: PID 23808 died... 15:36:58.901769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23808): Terminated: ok {rc=0} 15:36:58.948699 --- ParallelTerminationStrategy: PID 23809 died... 15:36:58.968323 run iperf3-srv_10.42.42.10(pid=23809): Terminated {rc=256} 15:36:59.015220 --- ParallelTerminationStrategy: PID 23812 died... 15:36:59.034870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23812): Terminated: ok {rc=0} 15:36:59.081840 --- ParallelTerminationStrategy: PID 23815 died... 15:36:59.101427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23815): Terminated: ok {rc=0} 15:36:59.148469 --- ParallelTerminationStrategy: PID 23818 died... 15:36:59.168197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23818): Terminated: ok {rc=0} 15:36:59.256423 bus /gobi_0: Setting Powered False 15:37:00.355176 bus /gobi_0: Setting Powered False 15:37:01.488787 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 15:37:02.657033 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:02.669125 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:37:02.707349 tst iperf3.py: using LAC 29840 15:37:02.837920 tst iperf3.py: using RAC 5 15:37:02.969445 tst iperf3.py: using CellId 29840 15:37:03.101218 tst iperf3.py: using BVCI 29841 15:37:03.214147 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:03.225137 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:03.236329 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:03.247489 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:03.258499 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:03.269467 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:03.281466 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:03.292357 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:03.303211 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:37:03.424904 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:37:03.649150 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:37:03.985144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23820): Launched 15:37:04.278115 run iperf3-srv_10.42.42.10(pid=23821): Launched 15:37:04.403859 tst iperf3.py:8: start network... 15:37:04.627156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:37:05.143810 run create_hlr_db(pid=23822): Launched 15:37:05.271887 bus /gobi_6: Setting Powered False 15:37:06.337548 run create_hlr_db(pid=23822): Terminated: ok {rc=0} 15:37:06.782774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23824): Launched 15:37:07.095721 run osmo-hlr_10.42.42.2(pid=23825): Launched 15:37:07.214603 run osmo-stp_10.42.42.5: Starting osmo-stp 15:37:07.748598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23827): Launched 15:37:08.061989 run osmo-stp_10.42.42.5(pid=23828): Launched 15:37:08.179028 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:37:08.715209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23830): Launched 15:37:08.834035 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:37:09.098643 run patchelf(pid=23831): Launched 15:37:09.271340 run osmo-stp_10.42.42.5(pid=23828): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23828)] 15:37:09.401399 run osmo-stp_10.42.42.5(pid=23828): stdout: | (launched: 2022-12-12_15:37:08.002016) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:37:09.533467 run osmo-stp_10.42.42.5(pid=23828): stderr: | 20221212153708174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153708174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153708174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153708174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153708175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153708175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153708175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:37:09.676438 run osmo-stp_10.42.42.5(pid=23828): stdout: | (launched: 2022-12-12_15:37:08.002016) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:37:09.812183 run osmo-stp_10.42.42.5(pid=23828): stderr: | 20221212153708174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153708174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153708174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153708174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153708175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153708175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153708175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:37:09.973497 run patchelf(pid=23831): Terminating (SIGINT) 15:37:10.159259 run patchelf(pid=23831): Terminated: ok {rc=0} 15:37:10.293155 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23828): Process ended prematurely: osmo-stp_10.42.42.5(pid=23828) [trial-2378↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23828)] [trial-2378↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 15:37:10.303475 tst iperf3.py:8: Test FAILED (7.7 sec) 15:37:10.333228 run osmo-hlr_10.42.42.2(pid=23825): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23825)] 15:37:10.383827 run osmo-hlr_10.42.42.2(pid=23825): stdout: | (launched: 2022-12-12_15:37:07.035628) 15:37:10.436213 run osmo-hlr_10.42.42.2(pid=23825): stderr: | 20221212153707213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153707213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153707213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153707213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153707214 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153707214 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153707241 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153707250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153707251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153707251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:37:10.489386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23820): Terminating (SIGTERM) 15:37:10.532363 run iperf3-srv_10.42.42.10(pid=23821): Terminating (SIGTERM) 15:37:10.574989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23824): Terminating (SIGTERM) 15:37:10.617839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23827): Terminating (SIGTERM) 15:37:10.660734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23830): Terminating (SIGTERM) 15:37:10.703829 --- ParallelTerminationStrategy: PID 23820 died... 15:37:10.724304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23820): Terminated: ok {rc=0} 15:37:10.772026 --- ParallelTerminationStrategy: PID 23821 died... 15:37:10.791882 run iperf3-srv_10.42.42.10(pid=23821): Terminated {rc=256} 15:37:10.839023 --- ParallelTerminationStrategy: PID 23824 died... 15:37:10.858913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23824): Terminated: ok {rc=0} 15:37:10.906633 --- ParallelTerminationStrategy: PID 23827 died... 15:37:10.926793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23827): Terminated: ok {rc=0} 15:37:10.973927 --- ParallelTerminationStrategy: PID 23830 died... 15:37:10.993728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23830): Terminated: ok {rc=0} 15:37:11.082967 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 15:37:12.237566 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:12.249749 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:37:12.286810 tst iperf3m4.py: using LAC 29841 15:37:12.416663 tst iperf3m4.py: using RAC 6 15:37:12.548207 tst iperf3m4.py: using CellId 29841 15:37:12.678040 tst iperf3m4.py: using BVCI 29842 15:37:12.798399 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:12.809776 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:12.821098 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:12.832480 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:12.843785 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:12.855112 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:12.867138 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:12.878863 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:12.890653 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:37:13.007396 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:37:13.131801 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:37:13.251606 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:37:13.372020 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:37:13.596058 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:37:13.933685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23832): Launched 15:37:14.227884 run iperf3-srv_10.42.42.10(pid=23833): Launched 15:37:14.352707 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:37:14.576940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:37:14.913885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23834): Launched 15:37:15.207137 run iperf3-srv_10.42.42.10(pid=23835): Launched 15:37:15.334036 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:37:15.558076 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:37:15.895153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23836): Launched 15:37:16.257190 run iperf3-srv_10.42.42.10(pid=23837): Launched 15:37:16.402348 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:37:16.617249 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:37:16.942148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23838): Launched 15:37:17.233115 run iperf3-srv_10.42.42.10(pid=23839): Launched 15:37:17.367675 tst iperf3m4.py:8: start network... 15:37:17.576309 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:37:18.057813 run create_hlr_db(pid=23840): Launched 15:37:18.185530 bus /gobi_6: Setting Powered False 15:37:19.247082 run create_hlr_db(pid=23840): Terminated: ok {rc=0} 15:37:19.680251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23843): Launched 15:37:19.992406 run osmo-hlr_10.42.42.2(pid=23844): Launched 15:37:20.109782 run osmo-stp_10.42.42.5: Starting osmo-stp 15:37:20.647697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23846): Launched 15:37:20.961564 run osmo-stp_10.42.42.5(pid=23847): Launched 15:37:21.079827 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:37:21.614075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23849): Launched 15:37:21.733664 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:37:21.997548 run patchelf(pid=23850): Launched 15:37:22.168938 run osmo-stp_10.42.42.5(pid=23847): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23847)] 15:37:22.299530 run osmo-stp_10.42.42.5(pid=23847): stdout: | (launched: 2022-12-12_15:37:20.900768) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:37:22.431497 run osmo-stp_10.42.42.5(pid=23847): stderr: | 20221212153721073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153721073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153721073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153721074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153721074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153721074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153721074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:37:22.563564 run osmo-stp_10.42.42.5(pid=23847): stdout: | (launched: 2022-12-12_15:37:20.900768) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:37:22.690679 run osmo-stp_10.42.42.5(pid=23847): stderr: | 20221212153721073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153721073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153721073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153721074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153721074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153721074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153721074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:37:22.839879 run patchelf(pid=23850): Terminating (SIGINT) 15:37:23.012695 run patchelf(pid=23850): Terminated: ok {rc=0} 15:37:23.137243 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23847): Process ended prematurely: osmo-stp_10.42.42.5(pid=23847) [trial-2378↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23847)] [trial-2378↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 15:37:23.146728 tst iperf3m4.py:8: Test FAILED (11.0 sec) 15:37:23.174200 run osmo-hlr_10.42.42.2(pid=23844): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23844)] 15:37:23.221732 run osmo-hlr_10.42.42.2(pid=23844): stdout: | (launched: 2022-12-12_15:37:19.931923) 15:37:23.270907 run osmo-hlr_10.42.42.2(pid=23844): stderr: | 20221212153720110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153720110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153720110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153720110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153720110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153720110 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153720123 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153720132 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153720132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153720132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:37:23.320746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23832): Terminating (SIGTERM) 15:37:23.360559 run iperf3-srv_10.42.42.10(pid=23833): Terminating (SIGTERM) 15:37:23.400255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23834): Terminating (SIGTERM) 15:37:23.439938 run iperf3-srv_10.42.42.10(pid=23835): Terminating (SIGTERM) 15:37:23.479506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23836): Terminating (SIGTERM) 15:37:23.519135 run iperf3-srv_10.42.42.10(pid=23837): Terminating (SIGTERM) 15:37:23.559227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23838): Terminating (SIGTERM) 15:37:23.599359 run iperf3-srv_10.42.42.10(pid=23839): Terminating (SIGTERM) 15:37:23.638923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23843): Terminating (SIGTERM) 15:37:23.678770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23846): Terminating (SIGTERM) 15:37:23.718402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23849): Terminating (SIGTERM) 15:37:23.758303 --- ParallelTerminationStrategy: PID 23832 died... 15:37:23.777408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23832): Terminated: ok {rc=0} 15:37:23.821438 --- ParallelTerminationStrategy: PID 23833 died... 15:37:23.839864 run iperf3-srv_10.42.42.10(pid=23833): Terminated {rc=256} 15:37:23.883719 --- ParallelTerminationStrategy: PID 23834 died... 15:37:23.902506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23834): Terminated: ok {rc=0} 15:37:23.946363 --- ParallelTerminationStrategy: PID 23835 died... 15:37:23.965175 run iperf3-srv_10.42.42.10(pid=23835): Terminated {rc=256} 15:37:24.008758 --- ParallelTerminationStrategy: PID 23836 died... 15:37:24.031861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23836): Terminated: ok {rc=0} 15:37:24.080216 --- ParallelTerminationStrategy: PID 23837 died... 15:37:24.099795 run iperf3-srv_10.42.42.10(pid=23837): Terminated {rc=256} 15:37:24.149176 --- ParallelTerminationStrategy: PID 23838 died... 15:37:24.168886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23838): Terminated: ok {rc=0} 15:37:24.217159 --- ParallelTerminationStrategy: PID 23839 died... 15:37:24.237062 run iperf3-srv_10.42.42.10(pid=23839): Terminated {rc=256} 15:37:24.285303 --- ParallelTerminationStrategy: PID 23843 died... 15:37:24.305043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23843): Terminated: ok {rc=0} 15:37:24.354271 --- ParallelTerminationStrategy: PID 23846 died... 15:37:24.374050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23846): Terminated: ok {rc=0} 15:37:24.422237 --- ParallelTerminationStrategy: PID 23849 died... 15:37:24.442046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23849): Terminated: ok {rc=0} 15:37:24.532505 bus /gobi_4: Setting Powered False 15:37:25.633358 bus /gobi_4: Setting Powered False 15:37:26.751024 bus /gobi_1: Setting Powered False 15:37:27.846622 bus /gobi_1: Setting Powered False 15:37:28.964262 bus /gobi_0: Setting Powered False 15:37:30.062648 bus /gobi_0: Setting Powered False 15:37:31.176754 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 15:37:32.295923 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:32.311821 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:37:32.349421 tst ping.py: using LAC 29842 15:37:32.478218 tst ping.py: using RAC 7 15:37:32.607555 tst ping.py: using CellId 29842 15:37:32.739730 tst ping.py: using BVCI 29843 15:37:32.858777 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:32.870049 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:32.881672 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:32.893183 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:32.904426 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:32.915715 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:32.927285 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:32.938881 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:37:33.057942 tst ping.py:19: start network... 15:37:33.263127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:37:33.737568 run create_hlr_db(pid=23851): Launched 15:37:33.862745 bus /gobi_6: Setting Powered False 15:37:34.923202 run create_hlr_db(pid=23851): Terminated: ok {rc=0} 15:37:35.372239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23853): Launched 15:37:35.701277 run osmo-hlr_10.42.42.2(pid=23854): Launched 15:37:35.825253 run osmo-stp_10.42.42.5: Starting osmo-stp 15:37:36.387248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23856): Launched 15:37:36.718201 run osmo-stp_10.42.42.5(pid=23857): Launched 15:37:36.833527 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:37:37.360564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23859): Launched 15:37:37.477068 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:37:37.737465 run patchelf(pid=23860): Launched 15:37:37.907011 run osmo-stp_10.42.42.5(pid=23857): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23857)] 15:37:38.035489 run osmo-stp_10.42.42.5(pid=23857): stdout: | (launched: 2022-12-12_15:37:36.655086) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:37:38.165202 run osmo-stp_10.42.42.5(pid=23857): stderr: | 20221212153736831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153736831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153736831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153736832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153736832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153736832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153736832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:37:38.295240 run osmo-stp_10.42.42.5(pid=23857): stdout: | (launched: 2022-12-12_15:37:36.655086) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:37:38.418999 run osmo-stp_10.42.42.5(pid=23857): stderr: | 20221212153736831 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153736831 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153736831 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153736832 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153736832 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153736832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153736832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:37:38.565841 run patchelf(pid=23860): Terminating (SIGINT) 15:37:38.735834 run patchelf(pid=23860): Terminated: ok {rc=0} 15:37:38.857895 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23857): Process ended prematurely: osmo-stp_10.42.42.5(pid=23857) [trial-2378↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23857)] [trial-2378↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 15:37:38.866783 tst ping.py:22: Test FAILED (6.6 sec) 15:37:38.893721 run osmo-hlr_10.42.42.2(pid=23854): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23854)] 15:37:38.941387 run osmo-hlr_10.42.42.2(pid=23854): stdout: | (launched: 2022-12-12_15:37:35.638087) 15:37:38.990662 run osmo-hlr_10.42.42.2(pid=23854): stderr: | 20221212153735835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153735835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153735835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153735835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153735835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153735835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153735885 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153735894 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153735894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153735894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:37:39.040432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23853): Terminating (SIGTERM) 15:37:39.080280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23856): Terminating (SIGTERM) 15:37:39.120054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23859): Terminating (SIGTERM) 15:37:39.160257 --- ParallelTerminationStrategy: PID 23853 died... 15:37:39.179591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23853): Terminated: ok {rc=0} 15:37:39.224431 --- ParallelTerminationStrategy: PID 23856 died... 15:37:39.243294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23856): Terminated: ok {rc=0} 15:37:39.287519 --- ParallelTerminationStrategy: PID 23859 died... 15:37:39.306450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23859): Terminated: ok {rc=0} 15:37:39.391583 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 15:37:40.479129 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:40.491768 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:37:40.532445 tst ping_idle_ping.py: using LAC 29843 15:37:40.663640 tst ping_idle_ping.py: using RAC 8 15:37:40.790248 tst ping_idle_ping.py: using CellId 29843 15:37:40.915739 tst ping_idle_ping.py: using BVCI 29844 15:37:41.037410 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:41.049682 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:41.060884 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:41.072434 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:41.083946 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:41.095267 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:41.106852 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:37:41.118378 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:37:41.242139 tst ping_idle_ping.py:24: start network... 15:37:41.445191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:37:41.917168 run create_hlr_db(pid=23863): Launched 15:37:42.043361 bus /gobi_6: Setting Powered False 15:37:43.103810 run create_hlr_db(pid=23863): Terminated: ok {rc=0} 15:37:43.552836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23865): Launched 15:37:43.883714 run osmo-hlr_10.42.42.2(pid=23866): Launched 15:37:44.008446 run osmo-stp_10.42.42.5: Starting osmo-stp 15:37:44.570828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23868): Launched 15:37:44.901880 run osmo-stp_10.42.42.5(pid=23869): Launched 15:37:45.027142 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:37:45.593849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23871): Launched 15:37:45.720008 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:37:46.028406 run patchelf(pid=23872): Launched 15:37:46.240652 run osmo-stp_10.42.42.5(pid=23869): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23869)] 15:37:46.382731 run osmo-stp_10.42.42.5(pid=23869): stdout: | (launched: 2022-12-12_15:37:44.838406) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:37:46.525094 run osmo-stp_10.42.42.5(pid=23869): stderr: | 20221212153745028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153745028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153745028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153745029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153745029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153745030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153745030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:37:46.667826 run osmo-stp_10.42.42.5(pid=23869): stdout: | (launched: 2022-12-12_15:37:44.838406) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:37:46.803858 run osmo-stp_10.42.42.5(pid=23869): stderr: | 20221212153745028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153745028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153745028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153745029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153745029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153745030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153745030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:37:46.966300 run patchelf(pid=23872): Terminating (SIGINT) 15:37:47.151633 run patchelf(pid=23872): Terminated: ok {rc=0} 15:37:47.285506 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23869): Process ended prematurely: osmo-stp_10.42.42.5(pid=23869) [trial-2378↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23869)] [trial-2378↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 15:37:47.295281 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 15:37:47.324104 run osmo-hlr_10.42.42.2(pid=23866): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23866)] 15:37:47.374250 run osmo-hlr_10.42.42.2(pid=23866): stdout: | (launched: 2022-12-12_15:37:43.820672) 15:37:47.425883 run osmo-hlr_10.42.42.2(pid=23866): stderr: | 20221212153744017 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153744017 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153744018 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153744018 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153744018 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153744018 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153744030 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153744041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153744042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153744042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:37:47.478216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23865): Terminating (SIGTERM) 15:37:47.519650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23868): Terminating (SIGTERM) 15:37:47.561772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23871): Terminating (SIGTERM) 15:37:47.603704 --- ParallelTerminationStrategy: PID 23865 died... 15:37:47.623809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23865): Terminated: ok {rc=0} 15:37:47.670545 --- ParallelTerminationStrategy: PID 23868 died... 15:37:47.689993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23868): Terminated: ok {rc=0} 15:37:47.736376 --- ParallelTerminationStrategy: PID 23871 died... 15:37:47.755835 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23871): Terminated: ok {rc=0} 15:37:47.843516 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 15:37:49.135155 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:37:49.142272 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 15:37:49.164779 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 15:37:49.204757 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 15:37:49.294225 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 15:37:49.315463 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 15:37:49.355112 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 15:37:49.946034 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 15:37:50.001607 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:37:50.012750 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:37:50.070133 tst cs_paging_gprs_active.py: using LAC 29844 15:37:50.198813 tst cs_paging_gprs_active.py: using RAC 9 15:37:50.330036 tst cs_paging_gprs_active.py: using CellId 29844 15:37:50.451603 tst cs_paging_gprs_active.py: using BVCI 29845 15:37:50.563358 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:37:50.574576 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:37:50.585608 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:37:50.596436 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:37:50.607281 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:37:50.617917 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:37:50.628606 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:37:50.639116 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:37:50.649919 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:37:50.770042 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:37:50.891641 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:37:51.116455 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:37:51.452215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23876): Launched 15:37:51.744645 run iperf3-srv_10.42.42.10(pid=23877): Launched 15:37:51.868832 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:37:52.094221 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:37:52.431378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23878): Launched 15:37:52.725165 run iperf3-srv_10.42.42.10(pid=23879): Launched 15:37:52.850124 tst cs_paging_gprs_active.py:38: start network... 15:37:53.075195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:37:53.593306 run create_hlr_db(pid=23880): Launched 15:37:53.722189 bus /gobi_6: Setting Powered False 15:37:54.787325 run create_hlr_db(pid=23880): Terminated: ok {rc=0} 15:37:55.235037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23882): Launched 15:37:55.550929 run osmo-hlr_10.42.42.2(pid=23883): Launched 15:37:55.669506 run osmo-stp_10.42.42.5: Starting osmo-stp 15:37:56.205686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23885): Launched 15:37:56.519101 run osmo-stp_10.42.42.5(pid=23886): Launched 15:37:56.639024 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:37:57.177179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23888): Launched 15:37:57.296359 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:37:57.562585 run patchelf(pid=23889): Launched 15:37:57.734922 run osmo-stp_10.42.42.5(pid=23886): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23886)] 15:37:57.866593 run osmo-stp_10.42.42.5(pid=23886): stdout: | (launched: 2022-12-12_15:37:56.457931) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:37:57.999605 run osmo-stp_10.42.42.5(pid=23886): stderr: | 20221212153756631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153756631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153756631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153756631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153756632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153756632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153756632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:37:58.132543 run osmo-stp_10.42.42.5(pid=23886): stdout: | (launched: 2022-12-12_15:37:56.457931) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:37:58.259125 run osmo-stp_10.42.42.5(pid=23886): stderr: | 20221212153756631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153756631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153756631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153756631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153756632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153756632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153756632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:37:58.409516 run patchelf(pid=23889): Terminating (SIGINT) 15:37:58.582903 run patchelf(pid=23889): Terminated: ok {rc=0} 15:37:58.708444 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=23886): Process ended prematurely: osmo-stp_10.42.42.5(pid=23886) [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23886)] [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 15:37:58.717919 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 15:37:58.744826 run osmo-hlr_10.42.42.2(pid=23883): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23883)] 15:37:58.792321 run osmo-hlr_10.42.42.2(pid=23883): stdout: | (launched: 2022-12-12_15:37:55.490422) 15:37:58.841517 run osmo-hlr_10.42.42.2(pid=23883): stderr: | 20221212153755669 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153755669 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153755669 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153755669 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153755669 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153755669 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153755680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153755688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153755688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153755689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:37:58.891729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23876): Terminating (SIGTERM) 15:37:58.931638 run iperf3-srv_10.42.42.10(pid=23877): Terminating (SIGTERM) 15:37:58.971263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23878): Terminating (SIGTERM) 15:37:59.011022 run iperf3-srv_10.42.42.10(pid=23879): Terminating (SIGTERM) 15:37:59.050689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23882): Terminating (SIGTERM) 15:37:59.090478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23885): Terminating (SIGTERM) 15:37:59.130249 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23888): Terminating (SIGTERM) 15:37:59.170046 --- ParallelTerminationStrategy: PID 23876 died... 15:37:59.189067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23876): Terminated: ok {rc=0} 15:37:59.232815 --- ParallelTerminationStrategy: PID 23877 died... 15:37:59.251364 run iperf3-srv_10.42.42.10(pid=23877): Terminated {rc=256} 15:37:59.294877 --- ParallelTerminationStrategy: PID 23878 died... 15:37:59.313340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23878): Terminated: ok {rc=0} 15:37:59.356896 --- ParallelTerminationStrategy: PID 23879 died... 15:37:59.375387 run iperf3-srv_10.42.42.10(pid=23879): Terminated {rc=256} 15:37:59.418990 --- ParallelTerminationStrategy: PID 23882 died... 15:37:59.437609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23882): Terminated: ok {rc=0} 15:37:59.481219 --- ParallelTerminationStrategy: PID 23885 died... 15:37:59.499651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23885): Terminated: ok {rc=0} 15:37:59.544177 --- ParallelTerminationStrategy: PID 23888 died... 15:37:59.562891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23888): Terminated: ok {rc=0} 15:37:59.648280 bus /gobi_0: Setting Powered False 15:38:00.748432 bus /gobi_0: Setting Powered False 15:38:01.862034 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 15:38:03.015771 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:03.027984 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:38:03.088868 tst iperf3.py: using LAC 29845 15:38:03.219349 tst iperf3.py: using RAC 10 15:38:03.350812 tst iperf3.py: using CellId 29845 15:38:03.484892 tst iperf3.py: using BVCI 29846 15:38:03.606922 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:03.618477 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:03.629712 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:03.641236 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:03.652469 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:03.663998 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:03.675597 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:03.687004 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:03.698653 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:38:03.817041 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:38:04.025510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:38:04.339812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23890): Launched 15:38:04.615321 run iperf3-srv_10.42.42.10(pid=23891): Launched 15:38:04.733113 tst iperf3.py:8: start network... 15:38:04.941413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:38:05.424800 run create_hlr_db(pid=23892): Launched 15:38:05.552657 bus /gobi_6: Setting Powered False 15:38:06.614364 run create_hlr_db(pid=23892): Terminated: ok {rc=0} 15:38:07.070245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23894): Launched 15:38:07.407713 run osmo-hlr_10.42.42.2(pid=23895): Launched 15:38:07.535574 run osmo-stp_10.42.42.5: Starting osmo-stp 15:38:08.109238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23897): Launched 15:38:08.443959 run osmo-stp_10.42.42.5(pid=23898): Launched 15:38:08.571931 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:38:09.147929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23900): Launched 15:38:09.276055 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:38:09.559552 run patchelf(pid=23901): Launched 15:38:09.745562 run osmo-stp_10.42.42.5(pid=23898): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23898)] 15:38:09.885425 run osmo-stp_10.42.42.5(pid=23898): stdout: | (launched: 2022-12-12_15:38:08.379780) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:38:10.027904 run osmo-stp_10.42.42.5(pid=23898): stderr: | 20221212153808572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153808572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153808572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153808572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153808573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153808573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153808573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:38:10.169432 run osmo-stp_10.42.42.5(pid=23898): stdout: | (launched: 2022-12-12_15:38:08.379780) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:38:10.305074 run osmo-stp_10.42.42.5(pid=23898): stderr: | 20221212153808572 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153808572 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153808572 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153808572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153808573 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153808573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153808573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:38:10.466087 run patchelf(pid=23901): Terminating (SIGINT) 15:38:10.651344 run patchelf(pid=23901): Terminated: ok {rc=0} 15:38:10.785178 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23898): Process ended prematurely: osmo-stp_10.42.42.5(pid=23898) [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23898)] [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 15:38:10.795371 tst iperf3.py:8: Test FAILED (7.8 sec) 15:38:10.824515 run osmo-hlr_10.42.42.2(pid=23895): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23895)] 15:38:10.874715 run osmo-hlr_10.42.42.2(pid=23895): stdout: | (launched: 2022-12-12_15:38:07.343534) 15:38:10.927197 run osmo-hlr_10.42.42.2(pid=23895): stderr: | 20221212153807541 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153807541 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153807541 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153807541 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153807542 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153807542 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153807554 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153807563 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153807563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153807563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:38:10.979930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23890): Terminating (SIGTERM) 15:38:11.022353 run iperf3-srv_10.42.42.10(pid=23891): Terminating (SIGTERM) 15:38:11.064565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23894): Terminating (SIGTERM) 15:38:11.106824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23897): Terminating (SIGTERM) 15:38:11.148707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23900): Terminating (SIGTERM) 15:38:11.191285 --- ParallelTerminationStrategy: PID 23890 died... 15:38:11.211568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23890): Terminated: ok {rc=0} 15:38:11.258672 --- ParallelTerminationStrategy: PID 23891 died... 15:38:11.278520 run iperf3-srv_10.42.42.10(pid=23891): Terminated {rc=256} 15:38:11.325265 --- ParallelTerminationStrategy: PID 23894 died... 15:38:11.344915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23894): Terminated: ok {rc=0} 15:38:11.391551 --- ParallelTerminationStrategy: PID 23897 died... 15:38:11.411011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23897): Terminated: ok {rc=0} 15:38:11.457872 --- ParallelTerminationStrategy: PID 23900 died... 15:38:11.477633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23900): Terminated: ok {rc=0} 15:38:11.566298 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 15:38:12.718445 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:12.730957 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:38:12.787882 tst iperf3m4.py: using LAC 29846 15:38:12.914618 tst iperf3m4.py: using RAC 11 15:38:13.042233 tst iperf3m4.py: using CellId 29846 15:38:13.170141 tst iperf3m4.py: using BVCI 29847 15:38:13.292218 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:13.303903 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:13.315068 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:13.326680 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:13.338076 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:13.349546 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:13.361143 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:13.372683 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:13.384543 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:38:13.502305 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:38:13.627832 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:38:13.748495 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:38:13.867861 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:38:14.076796 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:38:14.391633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23902): Launched 15:38:14.666724 run iperf3-srv_10.42.42.10(pid=23903): Launched 15:38:14.785386 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:38:14.993038 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:38:15.308367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23904): Launched 15:38:15.582702 run iperf3-srv_10.42.42.10(pid=23905): Launched 15:38:15.698339 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:38:15.904413 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:38:16.267761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23906): Launched 15:38:16.546874 run iperf3-srv_10.42.42.10(pid=23907): Launched 15:38:16.679104 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:38:16.888839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:38:17.209223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23908): Launched 15:38:17.495830 run iperf3-srv_10.42.42.10(pid=23909): Launched 15:38:17.611468 tst iperf3m4.py:8: start network... 15:38:17.817623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:38:18.302400 run create_hlr_db(pid=23910): Launched 15:38:18.429789 bus /gobi_6: Setting Powered False 15:38:19.491089 run create_hlr_db(pid=23910): Terminated: ok {rc=0} 15:38:19.945351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23912): Launched 15:38:20.281206 run osmo-hlr_10.42.42.2(pid=23913): Launched 15:38:20.410572 run osmo-stp_10.42.42.5: Starting osmo-stp 15:38:20.985784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23915): Launched 15:38:21.322353 run osmo-stp_10.42.42.5(pid=23916): Launched 15:38:21.449254 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:38:22.024304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23918): Launched 15:38:22.152913 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:38:22.435826 run patchelf(pid=23919): Launched 15:38:22.620872 run osmo-stp_10.42.42.5(pid=23916): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23916)] 15:38:22.760808 run osmo-stp_10.42.42.5(pid=23916): stdout: | (launched: 2022-12-12_15:38:21.258348) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:38:22.902519 run osmo-stp_10.42.42.5(pid=23916): stderr: | 20221212153821450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153821450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153821450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153821450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153821451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153821451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153821451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:38:23.044099 run osmo-stp_10.42.42.5(pid=23916): stdout: | (launched: 2022-12-12_15:38:21.258348) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:38:23.179491 run osmo-stp_10.42.42.5(pid=23916): stderr: | 20221212153821450 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153821450 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153821450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153821450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153821451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153821451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153821451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:38:23.340101 run patchelf(pid=23919): Terminating (SIGINT) 15:38:23.525387 run patchelf(pid=23919): Terminated: ok {rc=0} 15:38:23.658946 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=23916): Process ended prematurely: osmo-stp_10.42.42.5(pid=23916) [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23916)] [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 15:38:23.669149 tst iperf3m4.py:8: Test FAILED (11.0 sec) 15:38:23.698460 run osmo-hlr_10.42.42.2(pid=23913): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23913)] 15:38:23.748787 run osmo-hlr_10.42.42.2(pid=23913): stdout: | (launched: 2022-12-12_15:38:20.217718) 15:38:23.800662 run osmo-hlr_10.42.42.2(pid=23913): stderr: | 20221212153820417 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153820417 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153820417 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153820417 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153820417 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153820417 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153820429 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153820438 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153820438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153820438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:38:23.853097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23902): Terminating (SIGTERM) 15:38:23.895305 run iperf3-srv_10.42.42.10(pid=23903): Terminating (SIGTERM) 15:38:23.939231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23904): Terminating (SIGTERM) 15:38:23.981756 run iperf3-srv_10.42.42.10(pid=23905): Terminating (SIGTERM) 15:38:24.023873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23906): Terminating (SIGTERM) 15:38:24.065872 run iperf3-srv_10.42.42.10(pid=23907): Terminating (SIGTERM) 15:38:24.107866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23908): Terminating (SIGTERM) 15:38:24.149935 run iperf3-srv_10.42.42.10(pid=23909): Terminating (SIGTERM) 15:38:24.191702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23912): Terminating (SIGTERM) 15:38:24.233737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23915): Terminating (SIGTERM) 15:38:24.275660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23918): Terminating (SIGTERM) 15:38:24.317873 --- ParallelTerminationStrategy: PID 23902 died... 15:38:24.338119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23902): Terminated: ok {rc=0} 15:38:24.384739 --- ParallelTerminationStrategy: PID 23903 died... 15:38:24.404269 run iperf3-srv_10.42.42.10(pid=23903): Terminated {rc=256} 15:38:24.450499 --- ParallelTerminationStrategy: PID 23904 died... 15:38:24.470079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23904): Terminated: ok {rc=0} 15:38:24.516703 --- ParallelTerminationStrategy: PID 23905 died... 15:38:24.536246 run iperf3-srv_10.42.42.10(pid=23905): Terminated {rc=256} 15:38:24.582758 --- ParallelTerminationStrategy: PID 23906 died... 15:38:24.602251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23906): Terminated: ok {rc=0} 15:38:24.648817 --- ParallelTerminationStrategy: PID 23907 died... 15:38:24.668707 run iperf3-srv_10.42.42.10(pid=23907): Terminated {rc=256} 15:38:24.715123 --- ParallelTerminationStrategy: PID 23908 died... 15:38:24.735153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=23908): Terminated: ok {rc=0} 15:38:24.781725 --- ParallelTerminationStrategy: PID 23909 died... 15:38:24.801314 run iperf3-srv_10.42.42.10(pid=23909): Terminated {rc=256} 15:38:24.847696 --- ParallelTerminationStrategy: PID 23912 died... 15:38:24.867512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23912): Terminated: ok {rc=0} 15:38:24.914703 --- ParallelTerminationStrategy: PID 23915 died... 15:38:24.934214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23915): Terminated: ok {rc=0} 15:38:24.981125 --- ParallelTerminationStrategy: PID 23918 died... 15:38:25.000662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23918): Terminated: ok {rc=0} 15:38:25.089086 bus /gobi_4: Setting Powered False 15:38:26.190056 bus /gobi_4: Setting Powered False 15:38:27.306409 bus /gobi_1: Setting Powered False 15:38:28.406088 bus /gobi_1: Setting Powered False 15:38:29.522596 bus /gobi_0: Setting Powered False 15:38:30.618695 bus /gobi_0: Setting Powered False 15:38:31.735919 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 15:38:32.836207 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:32.847697 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:38:32.904300 tst ping.py: using LAC 29847 15:38:33.024848 tst ping.py: using RAC 12 15:38:33.145830 tst ping.py: using CellId 29847 15:38:33.265559 tst ping.py: using BVCI 29848 15:38:33.385962 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:33.397651 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:33.409037 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:33.420731 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:33.432133 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:33.443728 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:33.455295 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:33.466854 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:38:33.583886 tst ping.py:19: start network... 15:38:33.787274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:38:34.260663 run create_hlr_db(pid=23920): Launched 15:38:34.386371 bus /gobi_6: Setting Powered False 15:38:35.450588 run create_hlr_db(pid=23920): Terminated: ok {rc=0} 15:38:35.908482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23922): Launched 15:38:36.239508 run osmo-hlr_10.42.42.2(pid=23923): Launched 15:38:36.364250 run osmo-stp_10.42.42.5: Starting osmo-stp 15:38:36.936203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23925): Launched 15:38:37.266802 run osmo-stp_10.42.42.5(pid=23926): Launched 15:38:37.392351 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:38:37.957870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23928): Launched 15:38:38.083676 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:38:38.361701 run patchelf(pid=23929): Launched 15:38:38.549662 run osmo-stp_10.42.42.5(pid=23926): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23926)] 15:38:38.686965 run osmo-stp_10.42.42.5(pid=23926): stdout: | (launched: 2022-12-12_15:38:37.203683) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:38:38.826473 run osmo-stp_10.42.42.5(pid=23926): stderr: | 20221212153837395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153837395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153837395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153837396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153837396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153837396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153837396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:38:38.965775 run osmo-stp_10.42.42.5(pid=23926): stdout: | (launched: 2022-12-12_15:38:37.203683) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:38:39.098584 run osmo-stp_10.42.42.5(pid=23926): stderr: | 20221212153837395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153837395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153837395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153837396 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153837396 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153837396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153837396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:38:39.256233 run patchelf(pid=23929): Terminating (SIGINT) 15:38:39.439097 run patchelf(pid=23929): Terminated: ok {rc=0} 15:38:39.569877 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=23926): Process ended prematurely: osmo-stp_10.42.42.5(pid=23926) [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23926)] [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 15:38:39.579344 tst ping.py:22: Test FAILED (6.7 sec) 15:38:39.607864 run osmo-hlr_10.42.42.2(pid=23923): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23923)] 15:38:39.657725 run osmo-hlr_10.42.42.2(pid=23923): stdout: | (launched: 2022-12-12_15:38:36.176291) 15:38:39.709303 run osmo-hlr_10.42.42.2(pid=23923): stderr: | 20221212153836374 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153836374 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153836374 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153836374 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153836374 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153836374 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153836387 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153836398 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153836398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153836398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:38:39.761744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23922): Terminating (SIGTERM) 15:38:39.803536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23925): Terminating (SIGTERM) 15:38:39.845297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23928): Terminating (SIGTERM) 15:38:39.887289 --- ParallelTerminationStrategy: PID 23922 died... 15:38:39.907211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23922): Terminated: ok {rc=0} 15:38:39.953973 --- ParallelTerminationStrategy: PID 23925 died... 15:38:39.973613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23925): Terminated: ok {rc=0} 15:38:40.019730 --- ParallelTerminationStrategy: PID 23928 died... 15:38:40.039107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23928): Terminated: ok {rc=0} 15:38:40.127269 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 15:38:41.212733 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:41.224888 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:38:41.284295 tst ping_idle_ping.py: using LAC 29848 15:38:41.412345 tst ping_idle_ping.py: using RAC 13 15:38:41.538135 tst ping_idle_ping.py: using CellId 29848 15:38:41.664347 tst ping_idle_ping.py: using BVCI 29849 15:38:41.782127 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:41.793529 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:41.804672 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:41.816064 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:41.827499 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:41.838847 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:41.850459 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:38:41.861848 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:38:41.979523 tst ping_idle_ping.py:24: start network... 15:38:42.183793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:38:42.660137 run create_hlr_db(pid=23930): Launched 15:38:42.786693 bus /gobi_6: Setting Powered False 15:38:43.847204 run create_hlr_db(pid=23930): Terminated: ok {rc=0} 15:38:44.296616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23932): Launched 15:38:44.630506 run osmo-hlr_10.42.42.2(pid=23933): Launched 15:38:44.755971 run osmo-stp_10.42.42.5: Starting osmo-stp 15:38:45.329352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23935): Launched 15:38:45.660260 run osmo-stp_10.42.42.5(pid=23936): Launched 15:38:45.784889 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:38:46.448064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23974): Launched 15:38:46.604001 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:38:46.905024 run patchelf(pid=23985): Launched 15:38:47.116259 run osmo-stp_10.42.42.5(pid=23936): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23936)] 15:38:47.258291 run osmo-stp_10.42.42.5(pid=23936): stdout: | (launched: 2022-12-12_15:38:45.597224) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:38:47.428221 run osmo-stp_10.42.42.5(pid=23936): stderr: | 20221212153845790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153845790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153845790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153845790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153845791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153845791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153845791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:38:47.586832 run osmo-stp_10.42.42.5(pid=23936): stdout: | (launched: 2022-12-12_15:38:45.597224) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:38:47.732881 run osmo-stp_10.42.42.5(pid=23936): stderr: | 20221212153845790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153845790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153845790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153845790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153845791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153845791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153845791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:38:47.906062 run patchelf(pid=23985): Terminating (SIGINT) 15:38:48.110133 run patchelf(pid=23985): Terminated: ok {rc=0} 15:38:48.275884 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=23936): Process ended prematurely: osmo-stp_10.42.42.5(pid=23936) [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=23936)] [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 15:38:48.286742 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 15:38:48.321857 run osmo-hlr_10.42.42.2(pid=23933): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=23933)] 15:38:48.386374 run osmo-hlr_10.42.42.2(pid=23933): stdout: | (launched: 2022-12-12_15:38:44.567280) 15:38:48.449759 run osmo-hlr_10.42.42.2(pid=23933): stderr: | 20221212153844765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153844765 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153844765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153844765 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153844765 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153844765 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153844781 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153844791 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153844791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153844791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:38:48.517419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23932): Terminating (SIGTERM) 15:38:48.571890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23935): Terminating (SIGTERM) 15:38:48.628550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23974): Terminating (SIGTERM) 15:38:48.679082 --- ParallelTerminationStrategy: PID 23932 died... 15:38:48.706490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=23932): Terminated: ok {rc=0} 15:38:48.768288 --- ParallelTerminationStrategy: PID 23935 died... 15:38:48.790288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=23935): Terminated: ok {rc=0} 15:38:48.854410 --- ParallelTerminationStrategy: PID 23974 died... 15:38:48.876512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=23974): Terminated: ok {rc=0} 15:38:48.994269 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:38:50.316156 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:38:50.324269 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:38:50.346765 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 15:38:50.387899 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 15:38:50.474381 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:38:50.496547 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 15:38:50.537485 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 15:38:51.135417 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 15:38:51.187727 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:38:51.199774 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:38:51.255733 tst cs_paging_gprs_active.py: using LAC 29849 15:38:51.380233 tst cs_paging_gprs_active.py: using RAC 14 15:38:51.505278 tst cs_paging_gprs_active.py: using CellId 29849 15:38:51.634724 tst cs_paging_gprs_active.py: using BVCI 29850 15:38:51.757755 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:38:51.770184 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:38:51.782560 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:38:51.797094 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:38:51.809260 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:38:51.823907 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:38:51.836389 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:38:51.849030 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:38:51.863612 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:38:51.989161 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:38:52.114550 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:38:52.345199 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:38:52.684807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24214): Launched 15:38:52.990296 run iperf3-srv_10.42.42.10(pid=24215): Launched 15:38:53.130319 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:38:53.357745 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:38:53.696089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24216): Launched 15:38:54.000379 run iperf3-srv_10.42.42.10(pid=24217): Launched 15:38:54.140082 tst cs_paging_gprs_active.py:38: start network... 15:38:54.367392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:38:54.892158 run create_hlr_db(pid=24218): Launched 15:38:55.060183 bus /gobi_6: Setting Powered False 15:38:56.127772 run create_hlr_db(pid=24218): Terminated: ok {rc=0} 15:38:56.605546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24220): Launched 15:38:56.962757 run osmo-hlr_10.42.42.2(pid=24221): Launched 15:38:57.219434 run osmo-stp_10.42.42.5: Starting osmo-stp 15:38:57.911760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24223): Launched 15:38:58.267796 run osmo-stp_10.42.42.5(pid=24224): Launched 15:38:58.520253 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:38:59.192368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24226): Launched 15:38:59.334826 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:38:59.628520 run patchelf(pid=24227): Launched 15:38:59.832704 run osmo-stp_10.42.42.5(pid=24224): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24224)] 15:38:59.980519 run osmo-stp_10.42.42.5(pid=24224): stdout: | (launched: 2022-12-12_15:38:58.203468) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:00.128921 run osmo-stp_10.42.42.5(pid=24224): stderr: | 20221212153858504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153858504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153858504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153858505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153858505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153858506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153858506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:00.277206 run osmo-stp_10.42.42.5(pid=24224): stdout: | (launched: 2022-12-12_15:38:58.203468) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:00.420528 run osmo-stp_10.42.42.5(pid=24224): stderr: | 20221212153858504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153858504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153858504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153858505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153858505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153858506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153858506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:00.587436 run patchelf(pid=24227): Terminating (SIGINT) 15:39:00.782549 run patchelf(pid=24227): Terminated: ok {rc=0} 15:39:00.921899 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24224): Process ended prematurely: osmo-stp_10.42.42.5(pid=24224) [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24224)] [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 15:39:00.936491 tst cs_paging_gprs_active.py:38: Test FAILED (9.8 sec) 15:39:00.969877 run osmo-hlr_10.42.42.2(pid=24221): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24221)] 15:39:01.023510 run osmo-hlr_10.42.42.2(pid=24221): stdout: | (launched: 2022-12-12_15:38:56.896805) 15:39:01.084136 run osmo-hlr_10.42.42.2(pid=24221): stderr: | 20221212153857212 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153857212 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153857212 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153857212 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153857213 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153857213 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153857228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153857244 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153857244 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153857244 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:39:01.140926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24214): Terminating (SIGTERM) 15:39:01.186211 run iperf3-srv_10.42.42.10(pid=24215): Terminating (SIGTERM) 15:39:01.233641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24216): Terminating (SIGTERM) 15:39:01.279672 run iperf3-srv_10.42.42.10(pid=24217): Terminating (SIGTERM) 15:39:01.328248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24220): Terminating (SIGTERM) 15:39:01.373278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24223): Terminating (SIGTERM) 15:39:01.425247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24226): Terminating (SIGTERM) 15:39:01.480761 --- ParallelTerminationStrategy: PID 24214 died... 15:39:01.506216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24214): Terminated: ok {rc=0} 15:39:01.565405 --- ParallelTerminationStrategy: PID 24215 died... 15:39:01.588889 run iperf3-srv_10.42.42.10(pid=24215): Terminated {rc=256} 15:39:01.648104 --- ParallelTerminationStrategy: PID 24216 died... 15:39:01.672319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24216): Terminated: ok {rc=0} 15:39:01.731947 --- ParallelTerminationStrategy: PID 24217 died... 15:39:01.755460 run iperf3-srv_10.42.42.10(pid=24217): Terminated {rc=256} 15:39:01.813724 --- ParallelTerminationStrategy: PID 24220 died... 15:39:01.838215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24220): Terminated: ok {rc=0} 15:39:01.897242 --- ParallelTerminationStrategy: PID 24223 died... 15:39:01.921824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24223): Terminated: ok {rc=0} 15:39:01.981169 --- ParallelTerminationStrategy: PID 24226 died... 15:39:02.006170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24226): Terminated: ok {rc=0} 15:39:02.128902 bus /gobi_0: Setting Powered False 15:39:03.244154 bus /gobi_0: Setting Powered False 15:39:04.365653 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 15:39:05.526051 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:05.539315 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:39:05.604495 tst iperf3.py: using LAC 29850 15:39:05.740167 tst iperf3.py: using RAC 15 15:39:05.874684 tst iperf3.py: using CellId 29850 15:39:06.010091 tst iperf3.py: using BVCI 29851 15:39:06.136361 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:06.149443 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:06.161848 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:06.174894 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:06.188610 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:06.203757 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:06.217474 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:06.230337 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:06.244045 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:39:06.371831 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:39:06.605823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:39:06.955117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24228): Launched 15:39:07.268683 run iperf3-srv_10.42.42.10(pid=24229): Launched 15:39:07.413487 tst iperf3.py:8: start network... 15:39:07.647604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:39:08.184041 run create_hlr_db(pid=24230): Launched 15:39:08.354814 bus /gobi_6: Setting Powered False 15:39:09.422880 run create_hlr_db(pid=24230): Terminated: ok {rc=0} 15:39:09.904568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24232): Launched 15:39:10.262949 run osmo-hlr_10.42.42.2(pid=24233): Launched 15:39:10.522906 run osmo-stp_10.42.42.5: Starting osmo-stp 15:39:11.224504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24235): Launched 15:39:11.540082 run osmo-stp_10.42.42.5(pid=24236): Launched 15:39:11.658167 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:39:12.195230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24238): Launched 15:39:12.315314 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:39:12.579988 run patchelf(pid=24239): Launched 15:39:12.752091 run osmo-stp_10.42.42.5(pid=24236): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24236)] 15:39:12.883022 run osmo-stp_10.42.42.5(pid=24236): stdout: | (launched: 2022-12-12_15:39:11.479678) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:13.015789 run osmo-stp_10.42.42.5(pid=24236): stderr: | 20221212153911652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153911652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153911652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153911653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153911653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153911653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153911653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:13.148034 run osmo-stp_10.42.42.5(pid=24236): stdout: | (launched: 2022-12-12_15:39:11.479678) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:13.274386 run osmo-stp_10.42.42.5(pid=24236): stderr: | 20221212153911652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153911652 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153911652 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153911653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153911653 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153911653 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153911653 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:13.424137 run patchelf(pid=24239): Terminating (SIGINT) 15:39:13.598701 run patchelf(pid=24239): Terminated: ok {rc=0} 15:39:13.723614 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24236): Process ended prematurely: osmo-stp_10.42.42.5(pid=24236) [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24236)] [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 15:39:13.733723 tst iperf3.py:8: Test FAILED (8.3 sec) 15:39:13.760560 run osmo-hlr_10.42.42.2(pid=24233): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24233)] 15:39:13.808152 run osmo-hlr_10.42.42.2(pid=24233): stdout: | (launched: 2022-12-12_15:39:10.197386) 15:39:13.857452 run osmo-hlr_10.42.42.2(pid=24233): stderr: | 20221212153910508 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153910508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153910508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153910508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153910508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153910508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153910530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153910539 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153910539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153910539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:39:13.906884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24228): Terminating (SIGTERM) 15:39:13.946696 run iperf3-srv_10.42.42.10(pid=24229): Terminating (SIGTERM) 15:39:13.986245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24232): Terminating (SIGTERM) 15:39:14.026116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24235): Terminating (SIGTERM) 15:39:14.065734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24238): Terminating (SIGTERM) 15:39:14.105745 --- ParallelTerminationStrategy: PID 24228 died... 15:39:14.124853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24228): Terminated: ok {rc=0} 15:39:14.169346 --- ParallelTerminationStrategy: PID 24229 died... 15:39:14.187883 run iperf3-srv_10.42.42.10(pid=24229): Terminated {rc=256} 15:39:14.231427 --- ParallelTerminationStrategy: PID 24232 died... 15:39:14.250049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24232): Terminated: ok {rc=0} 15:39:14.293689 --- ParallelTerminationStrategy: PID 24235 died... 15:39:14.312314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24235): Terminated: ok {rc=0} 15:39:14.356044 --- ParallelTerminationStrategy: PID 24238 died... 15:39:14.374837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24238): Terminated: ok {rc=0} 15:39:14.458140 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 15:39:15.608641 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:15.621050 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:39:15.681413 tst iperf3m4.py: using LAC 29851 15:39:15.812422 tst iperf3m4.py: using RAC 16 15:39:15.954744 tst iperf3m4.py: using CellId 29851 15:39:16.093337 tst iperf3m4.py: using BVCI 29852 15:39:16.216194 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:16.228477 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:16.241734 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:16.254645 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:16.267558 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:16.279443 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:16.292240 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:16.305911 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:16.318035 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:39:16.444084 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:39:16.572450 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:39:16.698310 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:39:16.845851 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:39:17.105771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:39:17.447921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24240): Launched 15:39:17.723584 run iperf3-srv_10.42.42.10(pid=24241): Launched 15:39:17.838788 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:39:18.045377 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:39:18.358223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24242): Launched 15:39:18.632188 run iperf3-srv_10.42.42.10(pid=24243): Launched 15:39:18.749072 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:39:18.955387 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:39:19.268610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24244): Launched 15:39:19.541691 run iperf3-srv_10.42.42.10(pid=24245): Launched 15:39:19.657387 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:39:19.863086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:39:20.176037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24246): Launched 15:39:20.448094 run iperf3-srv_10.42.42.10(pid=24247): Launched 15:39:20.565171 tst iperf3m4.py:8: start network... 15:39:20.770863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:39:21.253677 run create_hlr_db(pid=24248): Launched 15:39:21.380683 bus /gobi_6: Setting Powered False 15:39:22.442264 run create_hlr_db(pid=24248): Terminated: ok {rc=0} 15:39:22.878485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24250): Launched 15:39:23.191714 run osmo-hlr_10.42.42.2(pid=24251): Launched 15:39:23.308414 run osmo-stp_10.42.42.5: Starting osmo-stp 15:39:23.848890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24253): Launched 15:39:24.162479 run osmo-stp_10.42.42.5(pid=24254): Launched 15:39:24.279936 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:39:24.816734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24256): Launched 15:39:24.935243 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:39:25.200629 run patchelf(pid=24257): Launched 15:39:25.374290 run osmo-stp_10.42.42.5(pid=24254): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24254)] 15:39:25.504798 run osmo-stp_10.42.42.5(pid=24254): stdout: | (launched: 2022-12-12_15:39:24.102042) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:25.638024 run osmo-stp_10.42.42.5(pid=24254): stderr: | 20221212153924275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153924275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153924276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153924276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153924277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153924277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153924277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:25.770765 run osmo-stp_10.42.42.5(pid=24254): stdout: | (launched: 2022-12-12_15:39:24.102042) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:25.897146 run osmo-stp_10.42.42.5(pid=24254): stderr: | 20221212153924275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153924275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153924276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153924276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153924277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153924277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153924277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:26.047195 run patchelf(pid=24257): Terminating (SIGINT) 15:39:26.220530 run patchelf(pid=24257): Terminated: ok {rc=0} 15:39:26.345567 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24254): Process ended prematurely: osmo-stp_10.42.42.5(pid=24254) [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24254)] [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 15:39:26.355100 tst iperf3m4.py:8: Test FAILED (10.8 sec) 15:39:26.382677 run osmo-hlr_10.42.42.2(pid=24251): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24251)] 15:39:26.430735 run osmo-hlr_10.42.42.2(pid=24251): stdout: | (launched: 2022-12-12_15:39:23.130916) 15:39:26.479986 run osmo-hlr_10.42.42.2(pid=24251): stderr: | 20221212153923309 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153923309 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153923309 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153923309 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153923310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153923310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153923328 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153923338 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153923338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153923338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:39:26.529748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24240): Terminating (SIGTERM) 15:39:26.569736 run iperf3-srv_10.42.42.10(pid=24241): Terminating (SIGTERM) 15:39:26.609565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24242): Terminating (SIGTERM) 15:39:26.649694 run iperf3-srv_10.42.42.10(pid=24243): Terminating (SIGTERM) 15:39:26.689671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24244): Terminating (SIGTERM) 15:39:26.729658 run iperf3-srv_10.42.42.10(pid=24245): Terminating (SIGTERM) 15:39:26.769464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24246): Terminating (SIGTERM) 15:39:26.809469 run iperf3-srv_10.42.42.10(pid=24247): Terminating (SIGTERM) 15:39:26.849485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24250): Terminating (SIGTERM) 15:39:26.889497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24253): Terminating (SIGTERM) 15:39:26.929546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24256): Terminating (SIGTERM) 15:39:26.969899 --- ParallelTerminationStrategy: PID 24240 died... 15:39:26.989283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24240): Terminated: ok {rc=0} 15:39:27.033497 --- ParallelTerminationStrategy: PID 24241 died... 15:39:27.052335 run iperf3-srv_10.42.42.10(pid=24241): Terminated {rc=256} 15:39:27.096616 --- ParallelTerminationStrategy: PID 24242 died... 15:39:27.115314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24242): Terminated: ok {rc=0} 15:39:27.159160 --- ParallelTerminationStrategy: PID 24243 died... 15:39:27.177809 run iperf3-srv_10.42.42.10(pid=24243): Terminated {rc=256} 15:39:27.221598 --- ParallelTerminationStrategy: PID 24244 died... 15:39:27.240366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24244): Terminated: ok {rc=0} 15:39:27.284361 --- ParallelTerminationStrategy: PID 24245 died... 15:39:27.303208 run iperf3-srv_10.42.42.10(pid=24245): Terminated {rc=256} 15:39:27.347056 --- ParallelTerminationStrategy: PID 24246 died... 15:39:27.365685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24246): Terminated: ok {rc=0} 15:39:27.410781 --- ParallelTerminationStrategy: PID 24247 died... 15:39:27.429493 run iperf3-srv_10.42.42.10(pid=24247): Terminated {rc=256} 15:39:27.473290 --- ParallelTerminationStrategy: PID 24250 died... 15:39:27.492034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24250): Terminated: ok {rc=0} 15:39:27.536104 --- ParallelTerminationStrategy: PID 24253 died... 15:39:27.554733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24253): Terminated: ok {rc=0} 15:39:27.599234 --- ParallelTerminationStrategy: PID 24256 died... 15:39:27.617870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24256): Terminated: ok {rc=0} 15:39:27.704004 bus /gobi_4: Setting Powered False 15:39:28.804718 bus /gobi_4: Setting Powered False 15:39:29.920688 bus /gobi_1: Setting Powered False 15:39:31.029411 bus /gobi_1: Setting Powered False 15:39:32.155999 bus /gobi_0: Setting Powered False 15:39:33.266232 bus /gobi_0: Setting Powered False 15:39:34.382179 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 15:39:35.485525 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:35.497775 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:39:35.557063 tst ping.py: using LAC 29852 15:39:35.686382 tst ping.py: using RAC 17 15:39:35.815832 tst ping.py: using CellId 29852 15:39:35.943995 tst ping.py: using BVCI 29853 15:39:36.063633 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:36.075316 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:36.086696 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:36.098309 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:36.109772 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:36.121178 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:36.132930 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:36.144501 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:39:36.263554 tst ping.py:19: start network... 15:39:36.483852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:39:36.991980 run create_hlr_db(pid=24259): Launched 15:39:37.117485 bus /gobi_6: Setting Powered False 15:39:38.182503 run create_hlr_db(pid=24259): Terminated: ok {rc=0} 15:39:38.640251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24261): Launched 15:39:38.972872 run osmo-hlr_10.42.42.2(pid=24262): Launched 15:39:39.098784 run osmo-stp_10.42.42.5: Starting osmo-stp 15:39:39.666148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24264): Launched 15:39:39.997226 run osmo-stp_10.42.42.5(pid=24265): Launched 15:39:40.122602 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:39:40.688700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24267): Launched 15:39:40.814832 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:39:41.094062 run patchelf(pid=24268): Launched 15:39:41.277433 run osmo-stp_10.42.42.5(pid=24265): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24265)] 15:39:41.415980 run osmo-stp_10.42.42.5(pid=24265): stdout: | (launched: 2022-12-12_15:39:39.933502) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:41.555979 run osmo-stp_10.42.42.5(pid=24265): stderr: | 20221212153940124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153940124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153940124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153940125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153940126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153940126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153940126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:41.695860 run osmo-stp_10.42.42.5(pid=24265): stdout: | (launched: 2022-12-12_15:39:39.933502) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:41.830021 run osmo-stp_10.42.42.5(pid=24265): stderr: | 20221212153940124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153940124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153940124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153940125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153940126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153940126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153940126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:41.989389 run patchelf(pid=24268): Terminating (SIGINT) 15:39:42.171919 run patchelf(pid=24268): Terminated: ok {rc=0} 15:39:42.303853 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24265): Process ended prematurely: osmo-stp_10.42.42.5(pid=24265) [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24265)] [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 15:39:42.313691 tst ping.py:22: Test FAILED (6.8 sec) 15:39:42.342734 run osmo-hlr_10.42.42.2(pid=24262): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24262)] 15:39:42.393461 run osmo-hlr_10.42.42.2(pid=24262): stdout: | (launched: 2022-12-12_15:39:38.908917) 15:39:42.446133 run osmo-hlr_10.42.42.2(pid=24262): stderr: | 20221212153939105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153939105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153939105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153939105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153939105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153939105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153939117 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153939126 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153939127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153939127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:39:42.499137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24261): Terminating (SIGTERM) 15:39:42.542013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24264): Terminating (SIGTERM) 15:39:42.584648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24267): Terminating (SIGTERM) 15:39:42.627970 --- ParallelTerminationStrategy: PID 24261 died... 15:39:42.648001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24261): Terminated: ok {rc=0} 15:39:42.695307 --- ParallelTerminationStrategy: PID 24264 died... 15:39:42.715174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24264): Terminated: ok {rc=0} 15:39:42.762114 --- ParallelTerminationStrategy: PID 24267 died... 15:39:42.781782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24267): Terminated: ok {rc=0} 15:39:42.870873 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 15:39:43.958899 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:43.971261 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:39:44.031562 tst ping_idle_ping.py: using LAC 29853 15:39:44.161472 tst ping_idle_ping.py: using RAC 18 15:39:44.281385 tst ping_idle_ping.py: using CellId 29853 15:39:44.400051 tst ping_idle_ping.py: using BVCI 29854 15:39:44.522236 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:44.533840 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:44.545098 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:44.557180 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:44.569061 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:44.580843 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:44.593312 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:39:44.605266 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:39:44.726722 tst ping_idle_ping.py:24: start network... 15:39:44.949201 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:39:45.462687 run create_hlr_db(pid=24269): Launched 15:39:45.588390 bus /gobi_6: Setting Powered False 15:39:46.652121 run create_hlr_db(pid=24269): Terminated: ok {rc=0} 15:39:47.121484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24271): Launched 15:39:47.467138 run osmo-hlr_10.42.42.2(pid=24272): Launched 15:39:47.594672 run osmo-stp_10.42.42.5: Starting osmo-stp 15:39:48.167130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24274): Launched 15:39:48.500829 run osmo-stp_10.42.42.5(pid=24275): Launched 15:39:48.626205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:39:49.194169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24277): Launched 15:39:49.320507 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:39:49.601208 run patchelf(pid=24278): Launched 15:39:49.784609 run osmo-stp_10.42.42.5(pid=24275): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24275)] 15:39:49.923584 run osmo-stp_10.42.42.5(pid=24275): stdout: | (launched: 2022-12-12_15:39:48.437262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:50.064169 run osmo-stp_10.42.42.5(pid=24275): stderr: | 20221212153948628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153948628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153948628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153948629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153948629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153948630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153948630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:50.204573 run osmo-stp_10.42.42.5(pid=24275): stdout: | (launched: 2022-12-12_15:39:48.437262) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:50.338963 run osmo-stp_10.42.42.5(pid=24275): stderr: | 20221212153948628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153948628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153948628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153948629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153948629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153948630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153948630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:50.498059 run patchelf(pid=24278): Terminating (SIGINT) 15:39:50.681335 run patchelf(pid=24278): Terminated: ok {rc=0} 15:39:50.813642 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24275): Process ended prematurely: osmo-stp_10.42.42.5(pid=24275) [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24275)] [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 15:39:50.823340 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 15:39:50.852131 run osmo-hlr_10.42.42.2(pid=24272): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24272)] 15:39:50.902636 run osmo-hlr_10.42.42.2(pid=24272): stdout: | (launched: 2022-12-12_15:39:47.403643) 15:39:50.955396 run osmo-hlr_10.42.42.2(pid=24272): stderr: | 20221212153947599 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153947599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153947599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153947599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153947599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153947599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153947611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153947620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153947620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153947620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:39:51.008641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24271): Terminating (SIGTERM) 15:39:51.051122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24274): Terminating (SIGTERM) 15:39:51.093697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24277): Terminating (SIGTERM) 15:39:51.136746 --- ParallelTerminationStrategy: PID 24271 died... 15:39:51.157152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24271): Terminated: ok {rc=0} 15:39:51.204460 --- ParallelTerminationStrategy: PID 24274 died... 15:39:51.224334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24274): Terminated: ok {rc=0} 15:39:51.271615 --- ParallelTerminationStrategy: PID 24277 died... 15:39:51.291568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24277): Terminated: ok {rc=0} 15:39:51.380735 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2378 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:39:52.665348 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:39:52.671852 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:39:52.692609 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 15:39:52.727442 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:39:52.780468 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:39:52.801317 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 15:39:52.835644 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:39:53.392605 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2378 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 15:39:53.397720 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:39:53.408881 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:39:53.465063 tst switch_tch_pdch.py: using LAC 29854 15:39:53.588629 tst switch_tch_pdch.py: using RAC 19 15:39:53.708552 tst switch_tch_pdch.py: using CellId 29854 15:39:53.829120 tst switch_tch_pdch.py: using BVCI 29855 15:39:53.938383 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:39:53.949739 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:39:53.960764 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:39:53.971808 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:39:53.982873 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:39:53.994005 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:39:54.005133 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:39:54.016067 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:39:54.136134 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:39:54.256862 tst switch_tch_pdch.py:51: start network... 15:39:54.477912 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:39:54.986832 run create_hlr_db(pid=24283): Launched 15:39:55.114285 bus /gobi_6: Setting Powered False 15:39:56.174725 run create_hlr_db(pid=24283): Terminated: ok {rc=0} 15:39:56.615811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24285): Launched 15:39:56.925233 run osmo-hlr_10.42.42.2(pid=24286): Launched 15:39:57.041741 run osmo-stp_10.42.42.5: Starting osmo-stp 15:39:57.569538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24288): Launched 15:39:57.877306 run osmo-stp_10.42.42.5(pid=24289): Launched 15:39:57.993220 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:39:58.522114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24291): Launched 15:39:58.640630 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:39:58.900569 run patchelf(pid=24292): Launched 15:39:59.070569 run osmo-stp_10.42.42.5(pid=24289): ERR: Terminated: ERROR {rc=1} [trial-2378↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24289)] 15:39:59.199333 run osmo-stp_10.42.42.5(pid=24289): stdout: | (launched: 2022-12-12_15:39:57.817557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:59.329372 run osmo-stp_10.42.42.5(pid=24289): stderr: | 20221212153957992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153957993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153957993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153957993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153957994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153957994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153957994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:59.459446 run osmo-stp_10.42.42.5(pid=24289): stdout: | (launched: 2022-12-12_15:39:57.817557) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:39:59.583551 run osmo-stp_10.42.42.5(pid=24289): stderr: | 20221212153957992 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212153957993 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212153957993 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212153957993 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212153957994 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212153957994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212153957994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:39:59.730692 run patchelf(pid=24292): Terminating (SIGINT) 15:39:59.901682 run patchelf(pid=24292): Terminated: ok {rc=0} 15:40:00.024540 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24289): Process ended prematurely: osmo-stp_10.42.42.5(pid=24289) [trial-2378↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24289)] [trial-2378↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 15:40:00.033540 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 15:40:00.060473 run osmo-hlr_10.42.42.2(pid=24286): ERR: Terminated: ERROR {rc=237} [trial-2378↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24286)] 15:40:00.108577 run osmo-hlr_10.42.42.2(pid=24286): stdout: | (launched: 2022-12-12_15:39:56.865487) 15:40:00.158403 run osmo-hlr_10.42.42.2(pid=24286): stderr: | 20221212153957044 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212153957044 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212153957044 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212153957044 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212153957044 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212153957044 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212153957056 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212153957065 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212153957065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212153957065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:00.208515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24285): Terminating (SIGTERM) 15:40:00.248588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24288): Terminating (SIGTERM) 15:40:00.288784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24291): Terminating (SIGTERM) 15:40:00.329077 --- ParallelTerminationStrategy: PID 24285 died... 15:40:00.348352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24285): Terminated: ok {rc=0} 15:40:00.392488 --- ParallelTerminationStrategy: PID 24288 died... 15:40:00.411025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24288): Terminated: ok {rc=0} 15:40:00.455036 --- ParallelTerminationStrategy: PID 24291 died... 15:40:00.473667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24291): Terminated: ok {rc=0} 15:40:00.559070 bus /gobi_0: Setting Powered False 15:40:01.659858 bus /gobi_0: Setting Powered False 15:40:02.780468 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2378 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 15:40:04.017545 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:04.023350 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 15:40:04.044042 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 15:40:04.078321 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 15:40:04.130937 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 15:40:04.151547 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 15:40:04.185478 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 15:40:04.742746 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2378 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 15:40:04.748124 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:40:04.759496 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 15:40:04.816605 tst switch_tch_pdch.py: using LAC 29855 15:40:04.943210 tst switch_tch_pdch.py: using RAC 20 15:40:05.072581 tst switch_tch_pdch.py: using CellId 29855 15:40:05.202581 tst switch_tch_pdch.py: using BVCI 29856 15:40:05.323087 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:40:05.334558 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:40:05.345950 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:40:05.357554 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:40:05.368794 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:40:05.380159 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:40:05.391829 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:40:05.403378 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 15:40:05.520534 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 15:40:05.636661 tst switch_tch_pdch.py:51: start network... 15:40:05.840852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:06.289510 run create_hlr_db(pid=24299): Launched 15:40:06.415716 bus /gobi_6: Setting Powered False 15:40:07.475950 run create_hlr_db(pid=24299): Terminated: ok {rc=0} 15:40:07.878489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24301): Launched 15:40:08.186840 run osmo-hlr_10.42.42.2(pid=24303): Launched 15:40:08.302728 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:08.814001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24305): Launched 15:40:09.121850 run osmo-stp_10.42.42.5(pid=24306): Launched 15:40:09.235854 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:40:09.737734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24308): Launched 15:40:09.853716 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:40:10.114474 run patchelf(pid=24309): Launched 15:40:10.282832 run osmo-stp_10.42.42.5(pid=24306): ERR: Terminated: ERROR {rc=1} [trial-2378↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24306)] 15:40:10.412008 run osmo-stp_10.42.42.5(pid=24306): stdout: | (launched: 2022-12-12_15:40:09.062266) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:10.542243 run osmo-stp_10.42.42.5(pid=24306): stderr: | 20221212154009235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154009235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154009235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154009236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154009236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154009236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154009236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:10.672388 run osmo-stp_10.42.42.5(pid=24306): stdout: | (launched: 2022-12-12_15:40:09.062266) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:10.796444 run osmo-stp_10.42.42.5(pid=24306): stderr: | 20221212154009235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154009235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154009235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154009236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154009236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154009236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154009236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:10.943892 run patchelf(pid=24309): Terminating (SIGINT) 15:40:11.114488 run patchelf(pid=24309): Terminated: ok {rc=0} 15:40:11.237211 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24306): Process ended prematurely: osmo-stp_10.42.42.5(pid=24306) [trial-2378↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24306)] [trial-2378↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 15:40:11.246177 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 15:40:11.272665 run osmo-hlr_10.42.42.2(pid=24303): ERR: Terminated: ERROR {rc=237} [trial-2378↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24303)] 15:40:11.320370 run osmo-hlr_10.42.42.2(pid=24303): stdout: | (launched: 2022-12-12_15:40:08.127284) 15:40:11.369975 run osmo-hlr_10.42.42.2(pid=24303): stderr: | 20221212154008305 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154008305 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154008305 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154008305 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154008305 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154008305 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154008317 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154008327 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154008327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154008327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:11.419537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24301): Terminating (SIGTERM) 15:40:11.459583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24305): Terminating (SIGTERM) 15:40:11.499310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24308): Terminating (SIGTERM) 15:40:11.539251 --- ParallelTerminationStrategy: PID 24301 died... 15:40:11.558633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24301): Terminated: ok {rc=0} 15:40:11.602837 --- ParallelTerminationStrategy: PID 24305 died... 15:40:11.621517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24305): Terminated: ok {rc=0} 15:40:11.665409 --- ParallelTerminationStrategy: PID 24308 died... 15:40:11.683983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24308): Terminated: ok {rc=0} 15:40:11.770217 bus /gobi_0: Setting Powered False 15:40:12.871340 bus /gobi_0: Setting Powered False 15:40:13.987234 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2378 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 nitb_sms:oc2g --------------------------------------------------------------------- 15:40:15.228129 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:15.232222 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 15:40:15.252548 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 15:40:15.259304 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 15:40:15.310638 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 15:40:15.330879 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 15:40:15.337525 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 15:40:15.874826 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 15:40:15.879658 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 15:40:15.890317 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 15:40:15.926064 tst mo_mt_sms.py: using LAC 29856 15:40:16.079016 tst mo_mt_sms.py: using RAC 21 15:40:16.212139 tst mo_mt_sms.py: using CellId 29856 15:40:16.346518 tst mo_mt_sms.py: using BVCI 29857 15:40:16.471921 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 15:40:16.596799 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 15:40:16.719834 tst mo_mt_sms.py:9: start nitb and bts... 15:40:16.962810 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:40:17.666659 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24313): Launched 15:40:18.001853 run osmo-nitb_10.42.42.2(pid=24314): Launched 15:40:18.184803 run osmo-nitb_10.42.42.2(pid=24314): ERR: Terminated: ERROR {rc=2} [trial-2378↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24314)] 15:40:18.331862 run osmo-nitb_10.42.42.2(pid=24314): stdout: | (launched: 2022-12-12_15:40:17.937701) 15:40:18.480429 run osmo-nitb_10.42.42.2(pid=24314): stderr: | (launched: 2022-12-12_15:40:17.987137) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:40:18.628631 run osmo-nitb_10.42.42.2(pid=24314): stdout: | (launched: 2022-12-12_15:40:17.937701) 15:40:18.770767 run osmo-nitb_10.42.42.2(pid=24314): stderr: | (launched: 2022-12-12_15:40:17.987137) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24314): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24314) [trial-2378↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24314)] 15:40:19.127192 tst osmo-nitb_10.42.42.2(pid=24314): stdout: | (launched: 2022-12-12_15:40:17.937701) 15:40:19.258929 tst osmo-nitb_10.42.42.2(pid=24314): stderr: | (launched: 2022-12-12_15:40:17.987137) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:40:19.413824 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=24314): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24314) [trial-2378↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24314)] [trial-2378↪nitb_sms:oc2g↪mo_mt_sms.py:11] 15:40:19.423244 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 15:40:19.430589 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24313): Terminating (SIGTERM) 15:40:19.642038 --- ParallelTerminationStrategy: PID 24313 died... 15:40:19.663930 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24313): Terminated: ok {rc=0} 15:40:19.751626 bus /sierra_3: Setting Powered False 15:40:20.852300 bus /sierra_3: Setting Powered False 15:40:21.970025 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 sms:oc2g --------------------------------------------------------------------- 15:40:23.151391 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:23.155822 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 15:40:23.177433 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 15:40:23.205510 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 15:40:23.259975 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 15:40:23.281358 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 15:40:23.309290 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 15:40:23.853981 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 sms:oc2g mo_mt_sms.py ---------------------------------------------- 15:40:23.859156 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:40:23.870166 tst sms:oc2g: Using 1 x bts (candidates: 1) 15:40:23.904437 tst mo_mt_sms.py: using LAC 29857 15:40:24.025505 tst mo_mt_sms.py: using RAC 22 15:40:24.147386 tst mo_mt_sms.py: using CellId 29857 15:40:24.266612 tst mo_mt_sms.py: using BVCI 29858 15:40:24.377194 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:40:24.387866 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:40:24.398574 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:40:24.409923 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:40:24.420796 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 15:40:24.431760 tst sms:oc2g: Using 1 x modem (candidates: 2) 15:40:24.550312 tst sms:oc2g: Using 1 x modem (candidates: 2) 15:40:24.667749 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:25.142914 run create_hlr_db(pid=24319): Launched 15:40:25.268573 bus /sierra_2: Setting Powered False 15:40:26.329765 run create_hlr_db(pid=24319): Terminated: ok {rc=0} 15:40:26.757416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24321): Launched 15:40:27.065733 run osmo-hlr_10.42.42.2(pid=24322): Launched 15:40:27.181407 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:27.720889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24324): Launched 15:40:28.030174 run osmo-stp_10.42.42.5(pid=24325): Launched 15:40:28.146498 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:28.699451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24327): Launched 15:40:29.008124 run osmo-msc_10.42.42.6(pid=24328): Launched 15:40:29.176639 run osmo-stp_10.42.42.5(pid=24325): ERR: Terminated: ERROR {rc=1} [trial-2378↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24325)] 15:40:29.304256 run osmo-stp_10.42.42.5(pid=24325): stdout: | (launched: 2022-12-12_15:40:27.970327) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:29.432115 run osmo-stp_10.42.42.5(pid=24325): stderr: | 20221212154028145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154028145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154028146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154028146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154028147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154028147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154028147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:29.558253 run osmo-stp_10.42.42.5(pid=24325): stdout: | (launched: 2022-12-12_15:40:27.970327) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:29.678188 run osmo-stp_10.42.42.5(pid=24325): stderr: | 20221212154028145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154028145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154028146 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154028146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154028147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154028147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154028147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:29.822109 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=24325): Process ended prematurely: osmo-stp_10.42.42.5(pid=24325) [trial-2378↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24325)] [trial-2378↪sms:oc2g↪mo_mt_sms.py:16] 15:40:29.830566 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 15:40:29.856525 run osmo-hlr_10.42.42.2(pid=24322): ERR: Terminated: ERROR {rc=237} [trial-2378↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24322)] 15:40:29.904342 run osmo-hlr_10.42.42.2(pid=24322): stdout: | (launched: 2022-12-12_15:40:27.006219) 15:40:29.953559 run osmo-hlr_10.42.42.2(pid=24322): stderr: | 20221212154027185 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154027185 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154027185 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154027185 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154027185 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154027185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154027197 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154027206 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154027206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154027207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:30.022360 run osmo-msc_10.42.42.6(pid=24328): ERR: Terminated: ERROR {rc=2} [trial-2378↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24328)] 15:40:30.070199 run osmo-msc_10.42.42.6(pid=24328): stdout: | (launched: 2022-12-12_15:40:28.948389) 15:40:30.119599 run osmo-msc_10.42.42.6(pid=24328): stderr: | 20221212154029222 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154029223 DLGLOBAL DEBUG validating counter group 0x7fb0fcc2dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154029223 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154029223 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154029223 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154029223 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154029225 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154029225 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154029225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154029226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:30.169160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24321): Terminating (SIGTERM) 15:40:30.208698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24324): Terminating (SIGTERM) 15:40:30.248208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24327): Terminating (SIGTERM) 15:40:30.288172 --- ParallelTerminationStrategy: PID 24321 died... 15:40:30.307453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24321): Terminated: ok {rc=0} 15:40:30.351613 --- ParallelTerminationStrategy: PID 24324 died... 15:40:30.370433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24324): Terminated: ok {rc=0} 15:40:30.415187 --- ParallelTerminationStrategy: PID 24327 died... 15:40:30.434021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24327): Terminated: ok {rc=0} 15:40:30.520081 bus /sierra_3: Setting Powered False 15:40:31.630719 bus /sierra_3: Setting Powered False 15:40:32.766882 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 nitb_ussd:oc2g --------------------------------------------------------------------- 15:40:33.990969 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:33.995910 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 15:40:34.017233 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 15:40:34.023953 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 15:40:34.064485 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 15:40:34.085230 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 15:40:34.092207 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 15:40:34.606876 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2378 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 15:40:34.612857 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 15:40:34.624510 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 15:40:34.659111 tst assert_extension.py: using LAC 29858 15:40:34.778340 tst assert_extension.py: using RAC 23 15:40:34.899621 tst assert_extension.py: using CellId 29858 15:40:35.021072 tst assert_extension.py: using BVCI 29859 15:40:35.131834 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 15:40:35.251152 tst assert_extension.py:10: start nitb and bts... 15:40:35.472668 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:40:36.141229 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24333): Launched 15:40:36.472812 run osmo-nitb_10.42.42.2(pid=24334): Launched 15:40:36.653266 run osmo-nitb_10.42.42.2(pid=24334): ERR: Terminated: ERROR {rc=2} [trial-2378↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24334)] 15:40:36.799998 run osmo-nitb_10.42.42.2(pid=24334): stdout: | (launched: 2022-12-12_15:40:36.409450) 15:40:36.948162 run osmo-nitb_10.42.42.2(pid=24334): stderr: | (launched: 2022-12-12_15:40:36.457926) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:40:37.097218 run osmo-nitb_10.42.42.2(pid=24334): stdout: | (launched: 2022-12-12_15:40:36.409450) 15:40:37.239275 run osmo-nitb_10.42.42.2(pid=24334): stderr: | (launched: 2022-12-12_15:40:36.457926) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24334): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24334) [trial-2378↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24334)] 15:40:37.595839 tst osmo-nitb_10.42.42.2(pid=24334): stdout: | (launched: 2022-12-12_15:40:36.409450) 15:40:37.727155 tst osmo-nitb_10.42.42.2(pid=24334): stderr: | (launched: 2022-12-12_15:40:36.457926) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:40:37.882193 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=24334): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24334) [trial-2378↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24334)] [trial-2378↪nitb_ussd:oc2g↪assert_extension.py:12] 15:40:37.891489 tst assert_extension.py:12: Test FAILED (3.3 sec) 15:40:37.898748 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24333): Terminating (SIGTERM) 15:40:38.110658 --- ParallelTerminationStrategy: PID 24333 died... 15:40:38.132822 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24333): Terminated: ok {rc=0} 15:40:38.222594 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 ussd:oc2g --------------------------------------------------------------------- 15:40:39.387694 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:39.392078 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 15:40:39.414571 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 15:40:39.441902 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 15:40:39.478312 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 15:40:39.499301 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 15:40:39.526657 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 15:40:40.054920 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2378 ussd:oc2g assert_extension.py ---------------------------------------------- 15:40:40.061267 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:40:40.072786 tst ussd:oc2g: Using 1 x bts (candidates: 1) 15:40:40.108846 tst assert_extension.py: using LAC 29859 15:40:40.235828 tst assert_extension.py: using RAC 24 15:40:40.362189 tst assert_extension.py: using CellId 29859 15:40:40.489078 tst assert_extension.py: using BVCI 29860 15:40:40.600343 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:40:40.611072 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:40:40.621545 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:40:40.631859 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:40:40.642389 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 15:40:40.652838 tst ussd:oc2g: Using 1 x modem (candidates: 1) 15:40:40.770658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:41.247441 run create_hlr_db(pid=24338): Launched 15:40:41.373504 bus /sierra_2: Setting Powered False 15:40:42.433986 run create_hlr_db(pid=24338): Terminated: ok {rc=0} 15:40:42.883598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24340): Launched 15:40:43.216043 run osmo-hlr_10.42.42.2(pid=24341): Launched 15:40:43.342249 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:43.915068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24343): Launched 15:40:44.250176 run osmo-stp_10.42.42.5(pid=24344): Launched 15:40:44.376473 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:44.969990 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24346): Launched 15:40:45.302017 run osmo-msc_10.42.42.6(pid=24347): Launched 15:40:45.485724 run osmo-stp_10.42.42.5(pid=24344): ERR: Terminated: ERROR {rc=1} [trial-2378↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24344)] 15:40:45.623163 run osmo-stp_10.42.42.5(pid=24344): stdout: | (launched: 2022-12-12_15:40:44.185462) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:45.761654 run osmo-stp_10.42.42.5(pid=24344): stderr: | 20221212154044379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154044379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154044379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154044380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154044380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154044380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154044380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:45.897763 run osmo-stp_10.42.42.5(pid=24344): stdout: | (launched: 2022-12-12_15:40:44.185462) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:46.046294 run osmo-stp_10.42.42.5(pid=24344): stderr: | 20221212154044379 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154044379 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154044379 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154044380 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154044380 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154044380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154044380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:46.205495 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24344): Process ended prematurely: osmo-stp_10.42.42.5(pid=24344) [trial-2378↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24344)] [trial-2378↪ussd:oc2g↪assert_extension.py:17] 15:40:46.215782 tst assert_extension.py:17: Test FAILED (6.1 sec) 15:40:46.246285 run osmo-hlr_10.42.42.2(pid=24341): ERR: Terminated: ERROR {rc=237} [trial-2378↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24341)] 15:40:46.298758 run osmo-hlr_10.42.42.2(pid=24341): stdout: | (launched: 2022-12-12_15:40:43.152670) 15:40:46.353204 run osmo-hlr_10.42.42.2(pid=24341): stderr: | 20221212154043349 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154043349 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154043349 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154043349 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154043349 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154043349 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154043362 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154043370 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154043371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154043371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:46.428422 run osmo-msc_10.42.42.6(pid=24347): ERR: Terminated: ERROR {rc=2} [trial-2378↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24347)] 15:40:46.481063 run osmo-msc_10.42.42.6(pid=24347): stdout: | (launched: 2022-12-12_15:40:45.238917) 15:40:46.535257 run osmo-msc_10.42.42.6(pid=24347): stderr: | 20221212154045562 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154045562 DLGLOBAL DEBUG validating counter group 0x7fca7e961c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154045562 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154045562 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154045562 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154045562 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154045564 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154045564 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154045565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154045565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:46.590209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24340): Terminating (SIGTERM) 15:40:46.637946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24343): Terminating (SIGTERM) 15:40:46.692636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24346): Terminating (SIGTERM) 15:40:46.741227 --- ParallelTerminationStrategy: PID 24340 died... 15:40:46.762080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24340): Terminated: ok {rc=0} 15:40:46.811152 --- ParallelTerminationStrategy: PID 24343 died... 15:40:46.831777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24343): Terminated: ok {rc=0} 15:40:46.880685 --- ParallelTerminationStrategy: PID 24346 died... 15:40:46.901342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24346): Terminated: ok {rc=0} 15:40:46.992525 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 15:40:48.191394 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:40:48.198936 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 15:40:48.221763 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 15:40:48.249862 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 15:40:48.305718 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 15:40:48.327547 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 15:40:48.354977 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 15:40:48.903600 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 15:40:48.958077 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:48.969928 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:40:49.026919 tst mo_mt_call.py: using LAC 29860 15:40:49.161819 tst mo_mt_call.py: using RAC 25 15:40:49.291830 tst mo_mt_call.py: using CellId 29860 15:40:49.420016 tst mo_mt_call.py: using BVCI 29861 15:40:49.540599 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:49.552243 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:49.563620 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:49.575340 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:49.587229 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:49.598970 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:40:49.719649 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:40:49.841334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:40:50.360738 run create_hlr_db(pid=24352): Launched 15:40:50.487413 bus /sierra_2: Setting Powered False 15:40:51.552802 run create_hlr_db(pid=24352): Terminated: ok {rc=0} 15:40:51.999272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24354): Launched 15:40:52.315146 run osmo-hlr_10.42.42.2(pid=24355): Launched 15:40:52.432927 run osmo-stp_10.42.42.5: Starting osmo-stp 15:40:52.980583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24357): Launched 15:40:53.294115 run osmo-stp_10.42.42.5(pid=24358): Launched 15:40:53.411919 run osmo-msc_10.42.42.6: Starting osmo-msc 15:40:53.975723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24360): Launched 15:40:54.289637 run osmo-msc_10.42.42.6(pid=24361): Launched 15:40:54.462731 run osmo-stp_10.42.42.5(pid=24358): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24358)] 15:40:54.592574 run osmo-stp_10.42.42.5(pid=24358): stdout: | (launched: 2022-12-12_15:40:53.233536) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:54.723074 run osmo-stp_10.42.42.5(pid=24358): stderr: | 20221212154053406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154053406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154053406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154053407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154053407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154053407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154053407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:54.851829 run osmo-stp_10.42.42.5(pid=24358): stdout: | (launched: 2022-12-12_15:40:53.233536) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:40:54.975560 run osmo-stp_10.42.42.5(pid=24358): stderr: | 20221212154053406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154053406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154053406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154053407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154053407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154053407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154053407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:40:55.122953 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24358): Process ended prematurely: osmo-stp_10.42.42.5(pid=24358) [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24358)] [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 15:40:55.131797 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:40:55.158271 run osmo-hlr_10.42.42.2(pid=24355): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24355)] 15:40:55.206109 run osmo-hlr_10.42.42.2(pid=24355): stdout: | (launched: 2022-12-12_15:40:52.254900) 15:40:55.255460 run osmo-hlr_10.42.42.2(pid=24355): stderr: | 20221212154052433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154052433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154052433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154052433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154052433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154052433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154052446 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154052454 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154052454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154052454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:40:55.324311 run osmo-msc_10.42.42.6(pid=24361): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24361)] 15:40:55.371877 run osmo-msc_10.42.42.6(pid=24361): stdout: | (launched: 2022-12-12_15:40:54.228496) 15:40:55.421258 run osmo-msc_10.42.42.6(pid=24361): stderr: | 20221212154054505 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154054505 DLGLOBAL DEBUG validating counter group 0x7f051d4bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154054505 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154054505 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154054505 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154054506 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154054507 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154054508 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154054508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154054508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:40:55.471006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24354): Terminating (SIGTERM) 15:40:55.510562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24357): Terminating (SIGTERM) 15:40:55.550153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24360): Terminating (SIGTERM) 15:40:55.590123 --- ParallelTerminationStrategy: PID 24354 died... 15:40:55.609323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24354): Terminated: ok {rc=0} 15:40:55.653372 --- ParallelTerminationStrategy: PID 24357 died... 15:40:55.671910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24357): Terminated: ok {rc=0} 15:40:55.715913 --- ParallelTerminationStrategy: PID 24360 died... 15:40:55.734759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24360): Terminated: ok {rc=0} 15:40:55.818630 bus /sierra_3: Setting Powered False 15:40:56.915014 bus /sierra_3: Setting Powered False 15:40:58.028044 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 15:40:59.178959 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:59.191183 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:40:59.249185 tst mo_mt_call_osmux.py: using LAC 29861 15:40:59.385638 tst mo_mt_call_osmux.py: using RAC 26 15:40:59.515687 tst mo_mt_call_osmux.py: using CellId 29861 15:40:59.638163 tst mo_mt_call_osmux.py: using BVCI 29862 15:40:59.752547 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:59.763899 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:59.775092 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:59.786161 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:59.797368 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:40:59.808222 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:40:59.925350 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:41:00.046982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:00.566725 run create_hlr_db(pid=24363): Launched 15:41:00.696590 bus /sierra_2: Setting Powered False 15:41:01.770780 run create_hlr_db(pid=24363): Terminated: ok {rc=0} 15:41:02.256402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24365): Launched 15:41:02.571245 run osmo-hlr_10.42.42.2(pid=24366): Launched 15:41:02.688644 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:03.236914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24368): Launched 15:41:03.550929 run osmo-stp_10.42.42.5(pid=24369): Launched 15:41:03.667194 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:04.229523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24371): Launched 15:41:04.543498 run osmo-msc_10.42.42.6(pid=24372): Launched 15:41:04.717873 run osmo-stp_10.42.42.5(pid=24369): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24369)] 15:41:04.848536 run osmo-stp_10.42.42.5(pid=24369): stdout: | (launched: 2022-12-12_15:41:03.490526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:04.979399 run osmo-stp_10.42.42.5(pid=24369): stderr: | 20221212154103665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154103665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154103665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154103665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154103666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154103666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154103666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:05.108536 run osmo-stp_10.42.42.5(pid=24369): stdout: | (launched: 2022-12-12_15:41:03.490526) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:05.231952 run osmo-stp_10.42.42.5(pid=24369): stderr: | 20221212154103665 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154103665 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154103665 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154103665 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154103666 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154103666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154103666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:05.379145 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24369): Process ended prematurely: osmo-stp_10.42.42.5(pid=24369) [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24369)] [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 15:41:05.387902 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 15:41:05.415126 run osmo-hlr_10.42.42.2(pid=24366): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24366)] 15:41:05.463164 run osmo-hlr_10.42.42.2(pid=24366): stdout: | (launched: 2022-12-12_15:41:02.511137) 15:41:05.512257 run osmo-hlr_10.42.42.2(pid=24366): stderr: | 20221212154102690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154102690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154102690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154102690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154102690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154102690 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154102702 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154102710 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154102711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154102711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:05.580931 run osmo-msc_10.42.42.6(pid=24372): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24372)] 15:41:05.628645 run osmo-msc_10.42.42.6(pid=24372): stdout: | (launched: 2022-12-12_15:41:04.482638) 15:41:05.677832 run osmo-msc_10.42.42.6(pid=24372): stderr: | 20221212154104758 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154104758 DLGLOBAL DEBUG validating counter group 0x7f3089245c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154104758 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154104759 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154104759 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154104759 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154104761 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154104761 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154104761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154104761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:05.727506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24365): Terminating (SIGTERM) 15:41:05.767247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24368): Terminating (SIGTERM) 15:41:05.807013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24371): Terminating (SIGTERM) 15:41:05.847037 --- ParallelTerminationStrategy: PID 24365 died... 15:41:05.866106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24365): Terminated: ok {rc=0} 15:41:05.910363 --- ParallelTerminationStrategy: PID 24368 died... 15:41:05.929226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24368): Terminated: ok {rc=0} 15:41:05.973457 --- ParallelTerminationStrategy: PID 24371 died... 15:41:05.992197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24371): Terminated: ok {rc=0} 15:41:06.077503 bus /sierra_3: Setting Powered False 15:41:07.178241 bus /sierra_3: Setting Powered False 15:41:08.291487 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 15:41:09.527275 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:41:09.535792 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 15:41:09.557687 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 15:41:09.586046 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 15:41:09.639738 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 15:41:09.660761 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 15:41:09.688295 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 15:41:10.239037 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 15:41:10.292492 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:10.304112 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:41:10.360092 tst mo_mt_call.py: using LAC 29862 15:41:10.490123 tst mo_mt_call.py: using RAC 27 15:41:10.621631 tst mo_mt_call.py: using CellId 29862 15:41:10.751510 tst mo_mt_call.py: using BVCI 29863 15:41:10.872082 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:10.883732 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:10.895201 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:10.906852 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:10.918507 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:10.930214 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:41:11.050048 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:41:11.166271 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:11.653111 run create_hlr_db(pid=24377): Launched 15:41:11.782201 bus /sierra_2: Setting Powered False 15:41:12.845242 run create_hlr_db(pid=24377): Terminated: ok {rc=0} 15:41:13.304097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24379): Launched 15:41:13.642883 run osmo-hlr_10.42.42.2(pid=24380): Launched 15:41:13.773457 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:14.352904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24382): Launched 15:41:14.691178 run osmo-stp_10.42.42.5(pid=24383): Launched 15:41:14.817993 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:15.422462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24385): Launched 15:41:15.760556 run osmo-msc_10.42.42.6(pid=24386): Launched 15:41:15.956152 run osmo-stp_10.42.42.5(pid=24383): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24383)] 15:41:16.191738 run osmo-stp_10.42.42.5(pid=24383): stdout: | (launched: 2022-12-12_15:41:14.627049) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:16.530346 run osmo-stp_10.42.42.5(pid=24383): stderr: | 20221212154114820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154114820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154114820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154114821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154114821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154114821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154114821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:16.733677 run osmo-stp_10.42.42.5(pid=24383): stdout: | (launched: 2022-12-12_15:41:14.627049) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:16.869492 run osmo-stp_10.42.42.5(pid=24383): stderr: | 20221212154114820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154114820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154114820 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154114821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154114821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154114821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154114821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:17.025610 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24383): Process ended prematurely: osmo-stp_10.42.42.5(pid=24383) [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24383)] [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 15:41:17.035448 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 15:41:17.064470 run osmo-hlr_10.42.42.2(pid=24380): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24380)] 15:41:17.114543 run osmo-hlr_10.42.42.2(pid=24380): stdout: | (launched: 2022-12-12_15:41:13.578776) 15:41:17.165988 run osmo-hlr_10.42.42.2(pid=24380): stderr: | 20221212154113798 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154113798 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154113798 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154113798 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154113798 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154113798 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154113814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154113824 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154113824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154113824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:17.238379 run osmo-msc_10.42.42.6(pid=24386): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24386)] 15:41:17.288153 run osmo-msc_10.42.42.6(pid=24386): stdout: | (launched: 2022-12-12_15:41:15.695776) 15:41:17.340007 run osmo-msc_10.42.42.6(pid=24386): stderr: | 20221212154116154 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154116154 DLGLOBAL DEBUG validating counter group 0x7f2f71022c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154116154 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154116155 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154116155 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154116155 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154116161 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154116162 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154116162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154116162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:17.391594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24379): Terminating (SIGTERM) 15:41:17.433279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24382): Terminating (SIGTERM) 15:41:17.474657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24385): Terminating (SIGTERM) 15:41:17.515048 --- ParallelTerminationStrategy: PID 24379 died... 15:41:17.534503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24379): Terminated: ok {rc=0} 15:41:17.579514 --- ParallelTerminationStrategy: PID 24382 died... 15:41:17.598277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24382): Terminated: ok {rc=0} 15:41:17.642143 --- ParallelTerminationStrategy: PID 24385 died... 15:41:17.660839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24385): Terminated: ok {rc=0} 15:41:17.746178 bus /sierra_3: Setting Powered False 15:41:18.845541 bus /sierra_3: Setting Powered False 15:41:19.959434 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 15:41:21.108778 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:21.121170 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:41:21.178750 tst mo_mt_call_osmux.py: using LAC 29863 15:41:21.309756 tst mo_mt_call_osmux.py: using RAC 28 15:41:21.441389 tst mo_mt_call_osmux.py: using CellId 29863 15:41:21.571633 tst mo_mt_call_osmux.py: using BVCI 29864 15:41:21.685240 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:21.696351 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:21.707471 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:21.718402 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:21.729596 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:41:21.740693 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:41:21.857285 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:41:21.978110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:22.462847 run create_hlr_db(pid=24388): Launched 15:41:22.590475 bus /sierra_2: Setting Powered False 15:41:23.652334 run create_hlr_db(pid=24388): Terminated: ok {rc=0} 15:41:24.109632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24390): Launched 15:41:24.448872 run osmo-hlr_10.42.42.2(pid=24391): Launched 15:41:24.576899 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:25.156799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24393): Launched 15:41:25.496399 run osmo-stp_10.42.42.5(pid=24394): Launched 15:41:25.625932 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:26.232521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24396): Launched 15:41:26.571100 run osmo-msc_10.42.42.6(pid=24397): Launched 15:41:26.757149 run osmo-stp_10.42.42.5(pid=24394): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24394)] 15:41:26.896843 run osmo-stp_10.42.42.5(pid=24394): stdout: | (launched: 2022-12-12_15:41:25.431806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:27.038621 run osmo-stp_10.42.42.5(pid=24394): stderr: | 20221212154125624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154125624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154125624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154125625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154125625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154125625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154125625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:27.177396 run osmo-stp_10.42.42.5(pid=24394): stdout: | (launched: 2022-12-12_15:41:25.431806) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:27.309773 run osmo-stp_10.42.42.5(pid=24394): stderr: | 20221212154125624 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154125624 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154125624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154125625 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154125625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154125625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154125625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:27.467544 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24394): Process ended prematurely: osmo-stp_10.42.42.5(pid=24394) [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24394)] [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 15:41:27.477293 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 15:41:27.506176 run osmo-hlr_10.42.42.2(pid=24391): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24391)] 15:41:27.557455 run osmo-hlr_10.42.42.2(pid=24391): stdout: | (launched: 2022-12-12_15:41:24.384718) 15:41:27.610165 run osmo-hlr_10.42.42.2(pid=24391): stderr: | 20221212154124582 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154124583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154124583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154124583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154124583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154124583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154124595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154124603 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154124603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154124603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:27.683505 run osmo-msc_10.42.42.6(pid=24397): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24397)] 15:41:27.734222 run osmo-msc_10.42.42.6(pid=24397): stdout: | (launched: 2022-12-12_15:41:26.506346) 15:41:27.786281 run osmo-msc_10.42.42.6(pid=24397): stderr: | 20221212154126828 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154126828 DLGLOBAL DEBUG validating counter group 0x7f807d628c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154126829 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154126829 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154126829 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154126829 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154126831 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154126831 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154126831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154126831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:27.838854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24390): Terminating (SIGTERM) 15:41:27.881086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24393): Terminating (SIGTERM) 15:41:27.923280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24396): Terminating (SIGTERM) 15:41:27.965926 --- ParallelTerminationStrategy: PID 24390 died... 15:41:27.985753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24390): Terminated: ok {rc=0} 15:41:28.033093 --- ParallelTerminationStrategy: PID 24393 died... 15:41:28.052659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24393): Terminated: ok {rc=0} 15:41:28.099641 --- ParallelTerminationStrategy: PID 24396 died... 15:41:28.119228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24396): Terminated: ok {rc=0} 15:41:28.207079 bus /sierra_3: Setting Powered False 15:41:29.304894 bus /sierra_3: Setting Powered False 15:41:30.419670 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 15:41:31.665624 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:41:31.676586 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 15:41:31.705703 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 15:41:31.740229 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 15:41:31.804143 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 15:41:31.830070 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 15:41:31.864571 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 15:41:32.405362 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 15:41:32.461140 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:32.472573 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:41:32.529499 tst mo_mt_call.py: using LAC 29864 15:41:32.662017 tst mo_mt_call.py: using RAC 29 15:41:32.791980 tst mo_mt_call.py: using CellId 29864 15:41:32.921681 tst mo_mt_call.py: using BVCI 29865 15:41:33.045069 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:33.056596 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:33.067983 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:33.079536 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:33.091211 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:33.102978 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:41:33.219710 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:41:33.338771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:33.824562 run create_hlr_db(pid=24402): Launched 15:41:33.953419 bus /sierra_2: Setting Powered False 15:41:35.015115 run create_hlr_db(pid=24402): Terminated: ok {rc=0} 15:41:35.473905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24404): Launched 15:41:35.812740 run osmo-hlr_10.42.42.2(pid=24405): Launched 15:41:35.938435 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:36.517458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24407): Launched 15:41:36.857196 run osmo-stp_10.42.42.5(pid=24408): Launched 15:41:36.984326 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:37.589630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24410): Launched 15:41:37.927560 run osmo-msc_10.42.42.6(pid=24411): Launched 15:41:38.114287 run osmo-stp_10.42.42.5(pid=24408): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24408)] 15:41:38.254015 run osmo-stp_10.42.42.5(pid=24408): stdout: | (launched: 2022-12-12_15:41:36.792424) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:38.395075 run osmo-stp_10.42.42.5(pid=24408): stderr: | 20221212154136984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154136984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154136984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154136985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154136985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154136985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154136985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:38.533749 run osmo-stp_10.42.42.5(pid=24408): stdout: | (launched: 2022-12-12_15:41:36.792424) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:38.666114 run osmo-stp_10.42.42.5(pid=24408): stderr: | 20221212154136984 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154136984 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154136984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154136985 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154136985 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154136985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154136985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:38.824221 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24408): Process ended prematurely: osmo-stp_10.42.42.5(pid=24408) [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24408)] [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 15:41:38.833997 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 15:41:38.862603 run osmo-hlr_10.42.42.2(pid=24405): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24405)] 15:41:38.913226 run osmo-hlr_10.42.42.2(pid=24405): stdout: | (launched: 2022-12-12_15:41:35.748105) 15:41:38.965659 run osmo-hlr_10.42.42.2(pid=24405): stderr: | 20221212154135948 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154135948 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154135948 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154135948 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154135948 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154135948 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154135959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154135967 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154135967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154135968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:39.039064 run osmo-msc_10.42.42.6(pid=24411): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24411)] 15:41:39.090145 run osmo-msc_10.42.42.6(pid=24411): stdout: | (launched: 2022-12-12_15:41:37.862932) 15:41:39.142303 run osmo-msc_10.42.42.6(pid=24411): stderr: | 20221212154138186 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154138186 DLGLOBAL DEBUG validating counter group 0x7fdda92e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154138186 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154138186 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154138186 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154138187 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154138188 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154138189 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154138189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154138189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:39.194950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24404): Terminating (SIGTERM) 15:41:39.237346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24407): Terminating (SIGTERM) 15:41:39.279548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24410): Terminating (SIGTERM) 15:41:39.322072 --- ParallelTerminationStrategy: PID 24404 died... 15:41:39.342262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24404): Terminated: ok {rc=0} 15:41:39.389188 --- ParallelTerminationStrategy: PID 24407 died... 15:41:39.408830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24407): Terminated: ok {rc=0} 15:41:39.455745 --- ParallelTerminationStrategy: PID 24410 died... 15:41:39.475425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24410): Terminated: ok {rc=0} 15:41:39.564843 bus /sierra_3: Setting Powered False 15:41:40.665942 bus /sierra_3: Setting Powered False 15:41:41.782769 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 15:41:42.928282 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:42.940382 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:41:42.997562 tst mo_mt_call_osmux.py: using LAC 29865 15:41:43.119650 tst mo_mt_call_osmux.py: using RAC 30 15:41:43.240739 tst mo_mt_call_osmux.py: using CellId 29865 15:41:43.365277 tst mo_mt_call_osmux.py: using BVCI 29866 15:41:43.479588 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:43.491009 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:43.502165 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:43.513291 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:43.524333 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:41:43.535902 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:41:43.654562 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:41:43.777923 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:44.299937 run create_hlr_db(pid=24413): Launched 15:41:44.430078 bus /sierra_2: Setting Powered False 15:41:45.496153 run create_hlr_db(pid=24413): Terminated: ok {rc=0} 15:41:45.962898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24415): Launched 15:41:46.304115 run osmo-hlr_10.42.42.2(pid=24416): Launched 15:41:46.542373 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:47.292851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24418): Launched 15:41:47.623344 run osmo-stp_10.42.42.5(pid=24419): Launched 15:41:47.743084 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:48.307886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24421): Launched 15:41:48.623470 run osmo-msc_10.42.42.6(pid=24422): Launched 15:41:48.798638 run osmo-stp_10.42.42.5(pid=24419): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24419)] 15:41:48.929682 run osmo-stp_10.42.42.5(pid=24419): stdout: | (launched: 2022-12-12_15:41:47.562515) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:49.061106 run osmo-stp_10.42.42.5(pid=24419): stderr: | 20221212154147738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154147738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154147738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154147739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154147739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154147739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154147739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:49.190485 run osmo-stp_10.42.42.5(pid=24419): stdout: | (launched: 2022-12-12_15:41:47.562515) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:41:49.313645 run osmo-stp_10.42.42.5(pid=24419): stderr: | 20221212154147738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154147738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154147738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154147739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154147739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154147739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154147739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:41:49.461075 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24419): Process ended prematurely: osmo-stp_10.42.42.5(pid=24419) [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24419)] [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 15:41:49.469804 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 15:41:49.496541 run osmo-hlr_10.42.42.2(pid=24416): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24416)] 15:41:49.544355 run osmo-hlr_10.42.42.2(pid=24416): stdout: | (launched: 2022-12-12_15:41:46.242296) 15:41:49.593921 run osmo-hlr_10.42.42.2(pid=24416): stderr: | 20221212154146529 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154146529 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154146529 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154146529 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154146529 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154146529 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154146544 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154146570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154146570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154146570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:41:49.663144 run osmo-msc_10.42.42.6(pid=24422): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24422)] 15:41:49.710860 run osmo-msc_10.42.42.6(pid=24422): stdout: | (launched: 2022-12-12_15:41:48.562737) 15:41:49.760482 run osmo-msc_10.42.42.6(pid=24422): stderr: | 20221212154148838 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154148838 DLGLOBAL DEBUG validating counter group 0x7f7a9a8f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154148838 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154148838 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154148838 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154148838 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154148840 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154148840 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154148841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154148841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:41:49.810677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24415): Terminating (SIGTERM) 15:41:49.850326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24418): Terminating (SIGTERM) 15:41:49.889991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24421): Terminating (SIGTERM) 15:41:49.930232 --- ParallelTerminationStrategy: PID 24415 died... 15:41:49.949645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24415): Terminated: ok {rc=0} 15:41:49.994049 --- ParallelTerminationStrategy: PID 24418 died... 15:41:50.012784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24418): Terminated: ok {rc=0} 15:41:50.057272 --- ParallelTerminationStrategy: PID 24421 died... 15:41:50.076072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24421): Terminated: ok {rc=0} 15:41:50.164100 bus /sierra_3: Setting Powered False 15:41:51.264569 bus /sierra_3: Setting Powered False 15:41:52.380873 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 15:41:53.617857 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:41:53.626134 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 15:41:53.647103 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 15:41:53.673541 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 15:41:53.724077 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 15:41:53.744432 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 15:41:53.770460 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 15:41:54.321804 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 15:41:54.371237 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:54.382396 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:41:54.436400 tst mo_mt_call.py: using LAC 29866 15:41:54.556380 tst mo_mt_call.py: using RAC 31 15:41:54.676750 tst mo_mt_call.py: using CellId 29866 15:41:54.797571 tst mo_mt_call.py: using BVCI 29867 15:41:54.910171 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:54.921397 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:54.932222 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:54.943050 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:54.953916 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:41:54.964789 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:41:55.085449 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:41:55.210951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:41:55.731958 run create_hlr_db(pid=24427): Launched 15:41:55.861657 bus /sierra_2: Setting Powered False 15:41:56.926561 run create_hlr_db(pid=24427): Terminated: ok {rc=0} 15:41:57.376022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24429): Launched 15:41:57.692478 run osmo-hlr_10.42.42.2(pid=24430): Launched 15:41:57.811970 run osmo-stp_10.42.42.5: Starting osmo-stp 15:41:58.367867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24432): Launched 15:41:58.683607 run osmo-stp_10.42.42.5(pid=24433): Launched 15:41:58.800934 run osmo-msc_10.42.42.6: Starting osmo-msc 15:41:59.377429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24435): Launched 15:41:59.692575 run osmo-msc_10.42.42.6(pid=24436): Launched 15:41:59.866208 run osmo-stp_10.42.42.5(pid=24433): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24433)] 15:41:59.997620 run osmo-stp_10.42.42.5(pid=24433): stdout: | (launched: 2022-12-12_15:41:58.622865) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:00.129068 run osmo-stp_10.42.42.5(pid=24433): stderr: | 20221212154158800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154158800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154158801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154158801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154158802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154158802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154158802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:00.258316 run osmo-stp_10.42.42.5(pid=24433): stdout: | (launched: 2022-12-12_15:41:58.622865) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:00.381293 run osmo-stp_10.42.42.5(pid=24433): stderr: | 20221212154158800 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154158800 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154158801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154158801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154158802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154158802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154158802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:00.529254 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24433): Process ended prematurely: osmo-stp_10.42.42.5(pid=24433) [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24433)] [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 15:42:00.538125 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:42:00.564843 run osmo-hlr_10.42.42.2(pid=24430): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24430)] 15:42:00.613158 run osmo-hlr_10.42.42.2(pid=24430): stdout: | (launched: 2022-12-12_15:41:57.631824) 15:42:00.662968 run osmo-hlr_10.42.42.2(pid=24430): stderr: | 20221212154157811 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154157812 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154157812 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154157812 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154157812 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154157812 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154157824 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154157832 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154157832 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154157832 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:00.732301 run osmo-msc_10.42.42.6(pid=24436): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24436)] 15:42:00.780761 run osmo-msc_10.42.42.6(pid=24436): stdout: | (launched: 2022-12-12_15:41:59.631695) 15:42:00.830549 run osmo-msc_10.42.42.6(pid=24436): stderr: | 20221212154159908 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154159908 DLGLOBAL DEBUG validating counter group 0x7f55562dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154159908 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154159908 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154159909 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154159909 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154159910 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154159911 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154159911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154159911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:00.880685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24429): Terminating (SIGTERM) 15:42:00.923465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24432): Terminating (SIGTERM) 15:42:00.982995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24435): Terminating (SIGTERM) 15:42:01.029780 --- ParallelTerminationStrategy: PID 24429 died... 15:42:01.093776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24429): Terminated: ok {rc=0} 15:42:01.249189 --- ParallelTerminationStrategy: PID 24432 died... 15:42:01.305558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24432): Terminated: ok {rc=0} 15:42:01.367470 --- ParallelTerminationStrategy: PID 24435 died... 15:42:01.388639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24435): Terminated: ok {rc=0} 15:42:01.482565 bus /sierra_3: Setting Powered False 15:42:02.585175 bus /sierra_3: Setting Powered False 15:42:03.703049 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 15:42:04.848016 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:42:04.860108 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:42:04.916243 tst mo_mt_call_osmux.py: using LAC 29867 15:42:05.039597 tst mo_mt_call_osmux.py: using RAC 32 15:42:05.162235 tst mo_mt_call_osmux.py: using CellId 29867 15:42:05.285505 tst mo_mt_call_osmux.py: using BVCI 29868 15:42:05.397617 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:42:05.408667 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:42:05.419621 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:42:05.430630 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:42:05.441553 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:42:05.452423 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:42:05.571729 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:42:05.688574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:06.172810 run create_hlr_db(pid=24447): Launched 15:42:06.301262 bus /sierra_2: Setting Powered False 15:42:07.363156 run create_hlr_db(pid=24447): Terminated: ok {rc=0} 15:42:07.820657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24449): Launched 15:42:08.161493 run osmo-hlr_10.42.42.2(pid=24450): Launched 15:42:08.289401 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:08.869994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24452): Launched 15:42:09.210372 run osmo-stp_10.42.42.5(pid=24453): Launched 15:42:09.338223 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:09.945319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24455): Launched 15:42:10.284161 run osmo-msc_10.42.42.6(pid=24456): Launched 15:42:10.471680 run osmo-stp_10.42.42.5(pid=24453): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24453)] 15:42:10.612303 run osmo-stp_10.42.42.5(pid=24453): stdout: | (launched: 2022-12-12_15:42:09.145717) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:10.753592 run osmo-stp_10.42.42.5(pid=24453): stderr: | 20221212154209340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154209340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154209340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154209340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154209341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154209341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154209341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:10.893693 run osmo-stp_10.42.42.5(pid=24453): stdout: | (launched: 2022-12-12_15:42:09.145717) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:11.026270 run osmo-stp_10.42.42.5(pid=24453): stderr: | 20221212154209340 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154209340 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154209340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154209340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154209341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154209341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154209341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:11.184878 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24453): Process ended prematurely: osmo-stp_10.42.42.5(pid=24453) [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24453)] [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 15:42:11.194635 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 15:42:11.223172 run osmo-hlr_10.42.42.2(pid=24450): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24450)] 15:42:11.274095 run osmo-hlr_10.42.42.2(pid=24450): stdout: | (launched: 2022-12-12_15:42:08.097209) 15:42:11.326261 run osmo-hlr_10.42.42.2(pid=24450): stderr: | 20221212154208296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154208296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154208296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154208296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154208296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154208296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154208308 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154208317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154208317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154208317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:11.399229 run osmo-msc_10.42.42.6(pid=24456): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24456)] 15:42:11.449959 run osmo-msc_10.42.42.6(pid=24456): stdout: | (launched: 2022-12-12_15:42:10.219631) 15:42:11.501927 run osmo-msc_10.42.42.6(pid=24456): stderr: | 20221212154210541 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154210541 DLGLOBAL DEBUG validating counter group 0x7fbe9d0b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154210541 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154210541 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154210541 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154210541 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154210543 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154210543 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154210544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154210544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:11.554414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24449): Terminating (SIGTERM) 15:42:11.596690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24452): Terminating (SIGTERM) 15:42:11.638752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24455): Terminating (SIGTERM) 15:42:11.681311 --- ParallelTerminationStrategy: PID 24449 died... 15:42:11.701529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24449): Terminated: ok {rc=0} 15:42:11.748595 --- ParallelTerminationStrategy: PID 24452 died... 15:42:11.768231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24452): Terminated: ok {rc=0} 15:42:11.815291 --- ParallelTerminationStrategy: PID 24455 died... 15:42:11.835408 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24455): Terminated: ok {rc=0} 15:42:11.924723 bus /sierra_3: Setting Powered False 15:42:13.024295 bus /sierra_3: Setting Powered False 15:42:14.140760 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 15:42:15.377817 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:42:15.385336 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 15:42:15.407670 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 15:42:15.435590 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 15:42:15.489137 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 15:42:15.510211 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 15:42:15.537914 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 15:42:16.101974 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 15:42:16.157779 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:16.169956 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:42:16.227406 tst mo_mt_call.py: using LAC 29868 15:42:16.362977 tst mo_mt_call.py: using RAC 33 15:42:16.523347 tst mo_mt_call.py: using CellId 29868 15:42:16.656639 tst mo_mt_call.py: using BVCI 29869 15:42:16.780563 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:16.792856 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:16.805176 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:16.817433 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:16.830018 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:16.843126 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:42:16.996568 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:42:17.146606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:17.642295 run create_hlr_db(pid=24461): Launched 15:42:17.771938 bus /sierra_2: Setting Powered False 15:42:18.834055 run create_hlr_db(pid=24461): Terminated: ok {rc=0} 15:42:19.293631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24463): Launched 15:42:19.634557 run osmo-hlr_10.42.42.2(pid=24464): Launched 15:42:19.762739 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:20.339477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24466): Launched 15:42:20.677614 run osmo-stp_10.42.42.5(pid=24467): Launched 15:42:20.805021 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:21.410964 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24469): Launched 15:42:21.750378 run osmo-msc_10.42.42.6(pid=24470): Launched 15:42:21.937402 run osmo-stp_10.42.42.5(pid=24467): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24467)] 15:42:22.079405 run osmo-stp_10.42.42.5(pid=24467): stdout: | (launched: 2022-12-12_15:42:20.613638) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:22.221845 run osmo-stp_10.42.42.5(pid=24467): stderr: | 20221212154220806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154220806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154220806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154220807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154220807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154220807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154220807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:22.361188 run osmo-stp_10.42.42.5(pid=24467): stdout: | (launched: 2022-12-12_15:42:20.613638) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:22.493694 run osmo-stp_10.42.42.5(pid=24467): stderr: | 20221212154220806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154220806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154220806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154220807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154220807 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154220807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154220807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:22.652782 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24467): Process ended prematurely: osmo-stp_10.42.42.5(pid=24467) [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24467)] [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 15:42:22.662945 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 15:42:22.691970 run osmo-hlr_10.42.42.2(pid=24464): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24464)] 15:42:22.742647 run osmo-hlr_10.42.42.2(pid=24464): stdout: | (launched: 2022-12-12_15:42:19.569999) 15:42:22.794861 run osmo-hlr_10.42.42.2(pid=24464): stderr: | 20221212154219769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154219769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154219770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154219770 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154219770 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154219770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154219782 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154219793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154219793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154219793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:22.867169 run osmo-msc_10.42.42.6(pid=24470): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24470)] 15:42:22.917588 run osmo-msc_10.42.42.6(pid=24470): stdout: | (launched: 2022-12-12_15:42:21.685603) 15:42:22.969895 run osmo-msc_10.42.42.6(pid=24470): stderr: | 20221212154222008 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154222008 DLGLOBAL DEBUG validating counter group 0x7faf1c373c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154222008 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154222008 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154222008 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154222009 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154222010 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154222011 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154222011 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154222011 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:23.022878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24463): Terminating (SIGTERM) 15:42:23.065234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24466): Terminating (SIGTERM) 15:42:23.107678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24469): Terminating (SIGTERM) 15:42:23.152477 --- ParallelTerminationStrategy: PID 24463 died... 15:42:23.173147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24463): Terminated: ok {rc=0} 15:42:23.220655 --- ParallelTerminationStrategy: PID 24466 died... 15:42:23.240363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24466): Terminated: ok {rc=0} 15:42:23.286736 --- ParallelTerminationStrategy: PID 24469 died... 15:42:23.306256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24469): Terminated: ok {rc=0} 15:42:23.394163 bus /sierra_3: Setting Powered False 15:42:24.493219 bus /sierra_3: Setting Powered False 15:42:25.607213 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 15:42:26.760175 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:26.772682 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:42:26.830977 tst mo_mt_call_osmux.py: using LAC 29869 15:42:26.962395 tst mo_mt_call_osmux.py: using RAC 34 15:42:27.098183 tst mo_mt_call_osmux.py: using CellId 29869 15:42:27.239110 tst mo_mt_call_osmux.py: using BVCI 29870 15:42:27.362454 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:27.374290 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:27.385671 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:27.397328 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:27.408829 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:42:27.420856 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:42:27.543276 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:42:27.659676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:28.145271 run create_hlr_db(pid=24472): Launched 15:42:28.273889 bus /sierra_2: Setting Powered False 15:42:29.335778 run create_hlr_db(pid=24472): Terminated: ok {rc=0} 15:42:29.794392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24474): Launched 15:42:30.134058 run osmo-hlr_10.42.42.2(pid=24475): Launched 15:42:30.261672 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:30.844896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24477): Launched 15:42:31.221632 run osmo-stp_10.42.42.5(pid=24478): Launched 15:42:31.417097 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:32.097334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24480): Launched 15:42:32.453153 run osmo-msc_10.42.42.6(pid=24481): Launched 15:42:32.640153 run osmo-stp_10.42.42.5(pid=24478): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24478)] 15:42:32.780507 run osmo-stp_10.42.42.5(pid=24478): stdout: | (launched: 2022-12-12_15:42:31.153100) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:32.921866 run osmo-stp_10.42.42.5(pid=24478): stderr: | 20221212154231468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154231468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154231469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154231473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154231478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154231478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154231478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:33.062503 run osmo-stp_10.42.42.5(pid=24478): stdout: | (launched: 2022-12-12_15:42:31.153100) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:33.195379 run osmo-stp_10.42.42.5(pid=24478): stderr: | 20221212154231468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154231468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154231469 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154231473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154231478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154231478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154231478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:33.354584 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24478): Process ended prematurely: osmo-stp_10.42.42.5(pid=24478) [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24478)] [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 15:42:33.364451 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 15:42:33.393499 run osmo-hlr_10.42.42.2(pid=24475): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24475)] 15:42:33.444172 run osmo-hlr_10.42.42.2(pid=24475): stdout: | (launched: 2022-12-12_15:42:30.069392) 15:42:33.496661 run osmo-hlr_10.42.42.2(pid=24475): stderr: | 20221212154230269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154230269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154230269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154230269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154230269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154230269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154230281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154230290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154230290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154230290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:33.569974 run osmo-msc_10.42.42.6(pid=24481): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24481)] 15:42:33.620425 run osmo-msc_10.42.42.6(pid=24481): stdout: | (launched: 2022-12-12_15:42:32.387816) 15:42:33.672712 run osmo-msc_10.42.42.6(pid=24481): stderr: | 20221212154232712 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154232712 DLGLOBAL DEBUG validating counter group 0x7f39c9378c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154232712 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154232712 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154232712 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154232712 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154232714 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154232715 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154232715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154232715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:33.725654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24474): Terminating (SIGTERM) 15:42:33.768182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24477): Terminating (SIGTERM) 15:42:33.810684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24480): Terminating (SIGTERM) 15:42:33.853404 --- ParallelTerminationStrategy: PID 24474 died... 15:42:33.873804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24474): Terminated: ok {rc=0} 15:42:33.921083 --- ParallelTerminationStrategy: PID 24477 died... 15:42:33.940817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24477): Terminated: ok {rc=0} 15:42:33.987988 --- ParallelTerminationStrategy: PID 24480 died... 15:42:34.007738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24480): Terminated: ok {rc=0} 15:42:34.097287 bus /sierra_3: Setting Powered False 15:42:35.196505 bus /sierra_3: Setting Powered False 15:42:36.314564 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:42:37.550737 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:42:37.557244 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:42:37.577740 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 15:42:37.604738 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:42:37.656726 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:42:37.677138 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 15:42:37.703408 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:42:38.254806 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 15:42:38.304510 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:38.315841 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:42:38.377295 tst mo_mt_call.py: using LAC 29870 15:42:38.497839 tst mo_mt_call.py: using RAC 35 15:42:38.628519 tst mo_mt_call.py: using CellId 29870 15:42:38.762025 tst mo_mt_call.py: using BVCI 29871 15:42:38.883956 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:38.895649 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:38.907101 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:38.918683 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:38.930359 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:38.942043 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:42:39.059852 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:42:39.176012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:39.661212 run create_hlr_db(pid=24486): Launched 15:42:39.789321 bus /sierra_2: Setting Powered False 15:42:40.851290 run create_hlr_db(pid=24486): Terminated: ok {rc=0} 15:42:41.313628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24488): Launched 15:42:41.652333 run osmo-hlr_10.42.42.2(pid=24489): Launched 15:42:41.779634 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:42.359423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24491): Launched 15:42:42.699183 run osmo-stp_10.42.42.5(pid=24492): Launched 15:42:42.827151 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:43.434501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24494): Launched 15:42:43.775251 run osmo-msc_10.42.42.6(pid=24495): Launched 15:42:43.961437 run osmo-stp_10.42.42.5(pid=24492): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24492)] 15:42:44.102601 run osmo-stp_10.42.42.5(pid=24492): stdout: | (launched: 2022-12-12_15:42:42.634517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:44.244284 run osmo-stp_10.42.42.5(pid=24492): stderr: | 20221212154242828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154242828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154242828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154242829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154242829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154242829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154242830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:44.383347 run osmo-stp_10.42.42.5(pid=24492): stdout: | (launched: 2022-12-12_15:42:42.634517) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:44.515828 run osmo-stp_10.42.42.5(pid=24492): stderr: | 20221212154242828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154242828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154242828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154242829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154242829 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154242829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154242830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:44.674660 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24492): Process ended prematurely: osmo-stp_10.42.42.5(pid=24492) [trial-2378↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24492)] [trial-2378↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 15:42:44.684330 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 15:42:44.713049 run osmo-hlr_10.42.42.2(pid=24489): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24489)] 15:42:44.763655 run osmo-hlr_10.42.42.2(pid=24489): stdout: | (launched: 2022-12-12_15:42:41.587973) 15:42:44.816023 run osmo-hlr_10.42.42.2(pid=24489): stderr: | 20221212154241788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154241788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154241788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154241788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154241788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154241788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154241801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154241809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154241810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154241810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:44.888811 run osmo-msc_10.42.42.6(pid=24495): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24495)] 15:42:44.939571 run osmo-msc_10.42.42.6(pid=24495): stdout: | (launched: 2022-12-12_15:42:43.710404) 15:42:44.992339 run osmo-msc_10.42.42.6(pid=24495): stderr: | 20221212154244033 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154244033 DLGLOBAL DEBUG validating counter group 0x7fc9dab68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154244033 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154244033 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154244034 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154244034 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154244035 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154244036 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154244036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154244036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:45.045767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24488): Terminating (SIGTERM) 15:42:45.088216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24491): Terminating (SIGTERM) 15:42:45.130911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24494): Terminating (SIGTERM) 15:42:45.174297 --- ParallelTerminationStrategy: PID 24488 died... 15:42:45.194430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24488): Terminated: ok {rc=0} 15:42:45.241902 --- ParallelTerminationStrategy: PID 24491 died... 15:42:45.261731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24491): Terminated: ok {rc=0} 15:42:45.309205 --- ParallelTerminationStrategy: PID 24494 died... 15:42:45.328907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24494): Terminated: ok {rc=0} 15:42:45.416795 bus /sierra_3: Setting Powered False 15:42:46.522548 bus /sierra_3: Setting Powered False 15:42:47.650340 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 15:42:48.802145 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:48.814571 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:42:48.873835 tst mo_mt_call_osmux.py: using LAC 29871 15:42:49.005397 tst mo_mt_call_osmux.py: using RAC 36 15:42:49.138017 tst mo_mt_call_osmux.py: using CellId 29871 15:42:49.268714 tst mo_mt_call_osmux.py: using BVCI 29872 15:42:49.390565 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:49.402244 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:49.413684 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:49.425492 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:49.436879 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:42:49.448646 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:42:49.568291 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:42:49.690745 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:42:50.215089 run create_hlr_db(pid=24497): Launched 15:42:50.343931 bus /sierra_2: Setting Powered False 15:42:51.410236 run create_hlr_db(pid=24497): Terminated: ok {rc=0} 15:42:51.859049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24499): Launched 15:42:52.180665 run osmo-hlr_10.42.42.2(pid=24500): Launched 15:42:52.301308 run osmo-stp_10.42.42.5: Starting osmo-stp 15:42:52.855817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24502): Launched 15:42:53.172676 run osmo-stp_10.42.42.5(pid=24503): Launched 15:42:53.293173 run osmo-msc_10.42.42.6: Starting osmo-msc 15:42:53.857636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24505): Launched 15:42:54.173515 run osmo-msc_10.42.42.6(pid=24506): Launched 15:42:54.346739 run osmo-stp_10.42.42.5(pid=24503): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24503)] 15:42:54.476425 run osmo-stp_10.42.42.5(pid=24503): stdout: | (launched: 2022-12-12_15:42:53.112030) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:54.607775 run osmo-stp_10.42.42.5(pid=24503): stderr: | 20221212154253285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154253285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154253285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154253286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154253286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154253287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154253287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:54.737495 run osmo-stp_10.42.42.5(pid=24503): stdout: | (launched: 2022-12-12_15:42:53.112030) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:42:54.860323 run osmo-stp_10.42.42.5(pid=24503): stderr: | 20221212154253285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154253285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154253285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154253286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154253286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154253287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154253287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:42:55.007902 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24503): Process ended prematurely: osmo-stp_10.42.42.5(pid=24503) [trial-2378↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24503)] [trial-2378↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 15:42:55.016888 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 15:42:55.043270 run osmo-hlr_10.42.42.2(pid=24500): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24500)] 15:42:55.090426 run osmo-hlr_10.42.42.2(pid=24500): stdout: | (launched: 2022-12-12_15:42:52.119972) 15:42:55.139190 run osmo-hlr_10.42.42.2(pid=24500): stderr: | 20221212154252297 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154252297 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154252297 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154252297 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154252297 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154252297 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154252310 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154252318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154252318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154252318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:42:55.207870 run osmo-msc_10.42.42.6(pid=24506): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24506)] 15:42:55.255569 run osmo-msc_10.42.42.6(pid=24506): stdout: | (launched: 2022-12-12_15:42:54.113139) 15:42:55.304527 run osmo-msc_10.42.42.6(pid=24506): stderr: | 20221212154254387 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154254387 DLGLOBAL DEBUG validating counter group 0x7f116961fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154254387 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154254387 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154254387 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154254388 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154254389 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154254390 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154254390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154254390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:42:55.353708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24499): Terminating (SIGTERM) 15:42:55.393352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24502): Terminating (SIGTERM) 15:42:55.433066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24505): Terminating (SIGTERM) 15:42:55.472914 --- ParallelTerminationStrategy: PID 24499 died... 15:42:55.492107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24499): Terminated: ok {rc=0} 15:42:55.535817 --- ParallelTerminationStrategy: PID 24502 died... 15:42:55.554316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24502): Terminated: ok {rc=0} 15:42:55.597998 --- ParallelTerminationStrategy: PID 24505 died... 15:42:55.616472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24505): Terminated: ok {rc=0} 15:42:55.702288 bus /sierra_3: Setting Powered False 15:42:56.802619 bus /sierra_3: Setting Powered False 15:42:57.920116 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:42:59.152611 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:42:59.159621 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:42:59.181256 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 15:42:59.210324 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 15:42:59.264935 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:42:59.285632 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 15:42:59.312038 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 15:42:59.860601 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 15:42:59.910301 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:42:59.921299 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:42:59.977598 tst mo_mt_call.py: using LAC 29872 15:43:00.102318 tst mo_mt_call.py: using RAC 37 15:43:00.223351 tst mo_mt_call.py: using CellId 29872 15:43:00.345441 tst mo_mt_call.py: using BVCI 29873 15:43:00.459864 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:00.470906 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:00.481698 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:00.492266 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:00.503041 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:00.513882 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:43:00.631151 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:43:00.751299 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:01.315932 run create_hlr_db(pid=24511): Launched 15:43:01.475582 bus /sierra_2: Setting Powered False 15:43:02.542184 run create_hlr_db(pid=24511): Terminated: ok {rc=0} 15:43:03.009823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24513): Launched 15:43:03.349343 run osmo-hlr_10.42.42.2(pid=24514): Launched 15:43:03.476241 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:04.060013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24516): Launched 15:43:04.399690 run osmo-stp_10.42.42.5(pid=24517): Launched 15:43:04.528126 run osmo-msc_10.42.42.6: Starting osmo-msc 15:43:05.135013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24519): Launched 15:43:05.475449 run osmo-msc_10.42.42.6(pid=24520): Launched 15:43:05.662474 run osmo-stp_10.42.42.5(pid=24517): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24517)] 15:43:05.803014 run osmo-stp_10.42.42.5(pid=24517): stdout: | (launched: 2022-12-12_15:43:04.334918) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:05.944543 run osmo-stp_10.42.42.5(pid=24517): stderr: | 20221212154304526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154304526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154304526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154304526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154304527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154304527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154304527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:06.084257 run osmo-stp_10.42.42.5(pid=24517): stdout: | (launched: 2022-12-12_15:43:04.334918) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:06.217163 run osmo-stp_10.42.42.5(pid=24517): stderr: | 20221212154304526 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154304526 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154304526 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154304526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154304527 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154304527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154304527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:06.375993 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24517): Process ended prematurely: osmo-stp_10.42.42.5(pid=24517) [trial-2378↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24517)] [trial-2378↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 15:43:06.385771 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 15:43:06.414637 run osmo-hlr_10.42.42.2(pid=24514): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24514)] 15:43:06.465133 run osmo-hlr_10.42.42.2(pid=24514): stdout: | (launched: 2022-12-12_15:43:03.284581) 15:43:06.517335 run osmo-hlr_10.42.42.2(pid=24514): stderr: | 20221212154303483 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154303483 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154303483 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154303483 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154303483 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154303483 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154303495 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154303503 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154303504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154303504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:06.590282 run osmo-msc_10.42.42.6(pid=24520): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24520)] 15:43:06.640904 run osmo-msc_10.42.42.6(pid=24520): stdout: | (launched: 2022-12-12_15:43:05.410606) 15:43:06.693301 run osmo-msc_10.42.42.6(pid=24520): stderr: | 20221212154305736 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154305736 DLGLOBAL DEBUG validating counter group 0x7fe071f72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154305736 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154305736 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154305736 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154305736 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154305738 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154305739 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154305739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154305739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:43:06.745821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24513): Terminating (SIGTERM) 15:43:06.788095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24516): Terminating (SIGTERM) 15:43:06.830509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24519): Terminating (SIGTERM) 15:43:06.873120 --- ParallelTerminationStrategy: PID 24513 died... 15:43:06.893294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24513): Terminated: ok {rc=0} 15:43:06.940560 --- ParallelTerminationStrategy: PID 24516 died... 15:43:06.960500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24516): Terminated: ok {rc=0} 15:43:07.007486 --- ParallelTerminationStrategy: PID 24519 died... 15:43:07.027211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24519): Terminated: ok {rc=0} 15:43:07.115879 bus /sierra_3: Setting Powered False 15:43:08.214845 bus /sierra_3: Setting Powered False 15:43:09.328521 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 15:43:10.480849 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:10.493330 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:43:10.556231 tst mo_mt_call_osmux.py: using LAC 29873 15:43:10.687056 tst mo_mt_call_osmux.py: using RAC 38 15:43:10.809646 tst mo_mt_call_osmux.py: using CellId 29873 15:43:10.930075 tst mo_mt_call_osmux.py: using BVCI 29874 15:43:11.042259 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:11.053502 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:11.064196 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:11.074924 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:11.085607 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:43:11.096341 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:43:11.216663 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:43:11.334313 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:11.823410 run create_hlr_db(pid=24522): Launched 15:43:11.952368 bus /sierra_2: Setting Powered False 15:43:13.013191 run create_hlr_db(pid=24522): Terminated: ok {rc=0} 15:43:13.451738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24524): Launched 15:43:13.767241 run osmo-hlr_10.42.42.2(pid=24525): Launched 15:43:13.884487 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:14.426900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24527): Launched 15:43:14.741636 run osmo-stp_10.42.42.5(pid=24528): Launched 15:43:14.858663 run osmo-msc_10.42.42.6: Starting osmo-msc 15:43:15.427782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24530): Launched 15:43:15.745148 run osmo-msc_10.42.42.6(pid=24531): Launched 15:43:15.951068 run osmo-stp_10.42.42.5(pid=24528): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24528)] 15:43:16.150390 run osmo-stp_10.42.42.5(pid=24528): stdout: | (launched: 2022-12-12_15:43:14.681153) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:16.284222 run osmo-stp_10.42.42.5(pid=24528): stderr: | 20221212154314854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154314854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154314855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154314855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154314855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154314856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154314856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:16.434445 run osmo-stp_10.42.42.5(pid=24528): stdout: | (launched: 2022-12-12_15:43:14.681153) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:16.563944 run osmo-stp_10.42.42.5(pid=24528): stderr: | 20221212154314854 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154314854 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154314855 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154314855 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154314855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154314856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154314856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:16.716192 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24528): Process ended prematurely: osmo-stp_10.42.42.5(pid=24528) [trial-2378↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24528)] [trial-2378↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 15:43:16.725953 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 15:43:16.755094 run osmo-hlr_10.42.42.2(pid=24525): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24525)] 15:43:16.804706 run osmo-hlr_10.42.42.2(pid=24525): stdout: | (launched: 2022-12-12_15:43:13.706228) 15:43:16.855136 run osmo-hlr_10.42.42.2(pid=24525): stderr: | 20221212154313885 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154313885 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154313885 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154313885 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154313886 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154313886 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154313898 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154313906 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154313906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154313906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:16.925562 run osmo-msc_10.42.42.6(pid=24531): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24531)] 15:43:16.974336 run osmo-msc_10.42.42.6(pid=24531): stdout: | (launched: 2022-12-12_15:43:15.684348) 15:43:17.024656 run osmo-msc_10.42.42.6(pid=24531): stderr: | 20221212154316064 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154316065 DLGLOBAL DEBUG validating counter group 0x7f07da17bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154316065 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154316065 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154316065 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154316065 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154316067 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154316067 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154316067 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154316068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:43:17.075455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24524): Terminating (SIGTERM) 15:43:17.115999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24527): Terminating (SIGTERM) 15:43:17.156387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24530): Terminating (SIGTERM) 15:43:17.196811 --- ParallelTerminationStrategy: PID 24524 died... 15:43:17.216496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24524): Terminated: ok {rc=0} 15:43:17.260876 --- ParallelTerminationStrategy: PID 24527 died... 15:43:17.280652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24527): Terminated: ok {rc=0} 15:43:17.325220 --- ParallelTerminationStrategy: PID 24530 died... 15:43:17.345162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24530): Terminated: ok {rc=0} 15:43:17.431053 bus /sierra_3: Setting Powered False 15:43:18.528349 bus /sierra_3: Setting Powered False 15:43:19.643496 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 emergency:oc2g --------------------------------------------------------------------- 15:43:20.875273 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:43:20.879884 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 15:43:20.900249 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 15:43:20.926660 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 15:43:21.011166 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 15:43:21.031427 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 15:43:21.057848 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 15:43:21.641914 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2378 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 15:43:21.646819 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:43:21.657504 tst emergency:oc2g: Using 1 x bts (candidates: 1) 15:43:21.693067 tst emergency_mo_mt_call.py: using LAC 29874 15:43:21.810286 tst emergency_mo_mt_call.py: using RAC 39 15:43:21.928044 tst emergency_mo_mt_call.py: using CellId 29874 15:43:22.045405 tst emergency_mo_mt_call.py: using BVCI 29875 15:43:22.155753 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:43:22.166466 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:43:22.177001 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:43:22.187446 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:43:22.197932 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:43:22.208225 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:43:22.327089 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:43:22.443577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:22.922260 run create_hlr_db(pid=24536): Launched 15:43:23.048543 bus /sierra_2: Setting Powered False 15:43:24.110434 run create_hlr_db(pid=24536): Terminated: ok {rc=0} 15:43:24.563249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24538): Launched 15:43:24.896431 run osmo-hlr_10.42.42.2(pid=24539): Launched 15:43:25.022796 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:25.591630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24541): Launched 15:43:25.925507 run osmo-stp_10.42.42.5(pid=24542): Launched 15:43:26.060999 tst emergency_mo_mt_call.py: using MSISDN 7854 15:43:26.233416 run osmo-msc_10.42.42.6: Starting osmo-msc 15:43:26.827456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24544): Launched 15:43:27.163010 run osmo-msc_10.42.42.6(pid=24545): Launched 15:43:27.347234 run osmo-stp_10.42.42.5(pid=24542): ERR: Terminated: ERROR {rc=1} [trial-2378↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24542)] 15:43:27.485448 run osmo-stp_10.42.42.5(pid=24542): stdout: | (launched: 2022-12-12_15:43:25.861494) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:27.624262 run osmo-stp_10.42.42.5(pid=24542): stderr: | 20221212154326052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154326052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154326053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154326054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154326054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154326054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154326054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:27.761905 run osmo-stp_10.42.42.5(pid=24542): stdout: | (launched: 2022-12-12_15:43:25.861494) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:27.893184 run osmo-stp_10.42.42.5(pid=24542): stderr: | 20221212154326052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154326052 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154326053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154326054 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154326054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154326054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154326054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:28.049850 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=24542): Process ended prematurely: osmo-stp_10.42.42.5(pid=24542) [trial-2378↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24542)] [trial-2378↪emergency:oc2g↪emergency_mo_mt_call.py:19] 15:43:28.059236 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 15:43:28.087304 run osmo-hlr_10.42.42.2(pid=24539): ERR: Terminated: ERROR {rc=237} [trial-2378↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24539)] 15:43:28.138393 run osmo-hlr_10.42.42.2(pid=24539): stdout: | (launched: 2022-12-12_15:43:24.832758) 15:43:28.191278 run osmo-hlr_10.42.42.2(pid=24539): stderr: | 20221212154325029 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154325029 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154325030 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154325030 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154325030 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154325030 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154325042 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154325051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154325051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154325051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:28.264129 run osmo-msc_10.42.42.6(pid=24545): ERR: Terminated: ERROR {rc=2} [trial-2378↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24545)] 15:43:28.314784 run osmo-msc_10.42.42.6(pid=24545): stdout: | (launched: 2022-12-12_15:43:27.098574) 15:43:28.368085 run osmo-msc_10.42.42.6(pid=24545): stderr: | 20221212154327421 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154327421 DLGLOBAL DEBUG validating counter group 0x7f2dcbbd8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154327421 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154327421 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154327421 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154327422 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154327423 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154327424 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154327424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154327424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:43:28.420856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24538): Terminating (SIGTERM) 15:43:28.463123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24541): Terminating (SIGTERM) 15:43:28.505565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24544): Terminating (SIGTERM) 15:43:28.548423 --- ParallelTerminationStrategy: PID 24538 died... 15:43:28.571670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24538): Terminated: ok {rc=0} 15:43:28.617981 --- ParallelTerminationStrategy: PID 24541 died... 15:43:28.636887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24541): Terminated: ok {rc=0} 15:43:28.682787 --- ParallelTerminationStrategy: PID 24544 died... 15:43:28.701632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24544): Terminated: ok {rc=0} 15:43:28.788040 bus /sierra_3: Setting Powered False 15:43:29.886382 bus /sierra_3: Setting Powered False 15:43:31.014971 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 15:43:32.108331 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:43:32.120915 tst emergency:oc2g: Using 1 x bts (candidates: 1) 15:43:32.159080 tst emergency_preemptive_call.py: using LAC 29875 15:43:32.311078 tst emergency_preemptive_call.py: using RAC 40 15:43:32.435702 tst emergency_preemptive_call.py: using CellId 29875 15:43:32.557538 tst emergency_preemptive_call.py: using BVCI 29876 15:43:32.668357 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:43:32.679298 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:43:32.690160 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:43:32.701631 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:43:32.713020 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 15:43:32.724273 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:43:32.844262 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:43:32.967997 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:43:33.084742 tst emergency:oc2g: Using 1 x modem (candidates: 4) 15:43:33.202512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:33.682677 run create_hlr_db(pid=24547): Launched 15:43:33.812166 bus /sierra_2: Setting Powered False 15:43:34.877230 run create_hlr_db(pid=24547): Terminated: ok {rc=0} 15:43:35.320227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24549): Launched 15:43:35.654022 run osmo-hlr_10.42.42.2(pid=24550): Launched 15:43:35.783093 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:36.353221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24552): Launched 15:43:36.686778 run osmo-stp_10.42.42.5(pid=24553): Launched 15:43:36.821676 tst emergency_preemptive_call.py: using MSISDN 7855 15:43:36.990759 run osmo-msc_10.42.42.6: Starting osmo-msc 15:43:37.583273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24555): Launched 15:43:37.915056 run osmo-msc_10.42.42.6(pid=24556): Launched 15:43:38.098027 run osmo-stp_10.42.42.5(pid=24553): ERR: Terminated: ERROR {rc=1} [trial-2378↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24553)] 15:43:38.236294 run osmo-stp_10.42.42.5(pid=24553): stdout: | (launched: 2022-12-12_15:43:36.622741) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:38.375649 run osmo-stp_10.42.42.5(pid=24553): stderr: | 20221212154336815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154336816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154336816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154336816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154336817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154336817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154336817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:38.512502 run osmo-stp_10.42.42.5(pid=24553): stdout: | (launched: 2022-12-12_15:43:36.622741) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:38.643333 run osmo-stp_10.42.42.5(pid=24553): stderr: | 20221212154336815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154336816 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154336816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154336816 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154336817 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154336817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154336817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:38.799796 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=24553): Process ended prematurely: osmo-stp_10.42.42.5(pid=24553) [trial-2378↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24553)] [trial-2378↪emergency:oc2g↪emergency_preemptive_call.py:32] 15:43:38.808885 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 15:43:38.837143 run osmo-hlr_10.42.42.2(pid=24550): ERR: Terminated: ERROR {rc=237} [trial-2378↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24550)] 15:43:38.887927 run osmo-hlr_10.42.42.2(pid=24550): stdout: | (launched: 2022-12-12_15:43:35.590457) 15:43:38.939929 run osmo-hlr_10.42.42.2(pid=24550): stderr: | 20221212154335787 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154335788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154335788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154335788 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154335788 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154335788 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154335800 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154335809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154335809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154335810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:39.012682 run osmo-msc_10.42.42.6(pid=24556): ERR: Terminated: ERROR {rc=2} [trial-2378↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24556)] 15:43:39.063507 run osmo-msc_10.42.42.6(pid=24556): stdout: | (launched: 2022-12-12_15:43:37.851223) 15:43:39.115507 run osmo-msc_10.42.42.6(pid=24556): stderr: | 20221212154338173 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154338173 DLGLOBAL DEBUG validating counter group 0x7fd7bfb74c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154338173 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154338173 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154338173 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154338174 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154338175 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154338176 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154338176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154338176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:43:39.167908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24549): Terminating (SIGTERM) 15:43:39.209863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24552): Terminating (SIGTERM) 15:43:39.251659 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24555): Terminating (SIGTERM) 15:43:39.293976 --- ParallelTerminationStrategy: PID 24549 died... 15:43:39.314094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24549): Terminated: ok {rc=0} 15:43:39.360837 --- ParallelTerminationStrategy: PID 24552 died... 15:43:39.380625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24552): Terminated: ok {rc=0} 15:43:39.427355 --- ParallelTerminationStrategy: PID 24555 died... 15:43:39.447031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24555): Terminated: ok {rc=0} 15:43:39.535445 bus /sierra_9: Setting Powered False 15:43:40.635602 bus /sierra_9: Setting Powered False 15:43:41.751337 bus /sierra_8: Setting Powered False 15:43:42.849330 bus /sierra_8: Setting Powered False 15:43:43.967780 bus /sierra_3: Setting Powered False 15:43:45.066314 bus /sierra_3: Setting Powered False 15:43:46.179224 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 gprs:oc2g --------------------------------------------------------------------- 15:43:47.450530 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:43:47.455161 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 15:43:47.477187 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 15:43:47.517435 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 15:43:47.606823 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 15:43:47.628144 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 15:43:47.668190 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 15:43:48.256862 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2378 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 15:43:48.311722 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:43:48.322704 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:43:48.358789 tst cs_paging_gprs_active.py: using LAC 29876 15:43:48.491256 tst cs_paging_gprs_active.py: using RAC 41 15:43:48.622937 tst cs_paging_gprs_active.py: using CellId 29876 15:43:48.752689 tst cs_paging_gprs_active.py: using BVCI 29877 15:43:48.875949 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:43:48.886955 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:43:48.897817 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:43:48.909076 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:43:48.920233 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:43:48.931329 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:43:48.942645 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:43:48.953915 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:43:48.965230 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:43:49.084184 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:43:49.205138 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:43:49.431980 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:49.772489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24561): Launched 15:43:50.069322 run iperf3-srv_10.42.42.10(pid=24562): Launched 15:43:50.198017 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:43:50.424420 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:43:50.763683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24563): Launched 15:43:51.060594 run iperf3-srv_10.42.42.10(pid=24564): Launched 15:43:51.187463 tst cs_paging_gprs_active.py:38: start network... 15:43:51.413379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:43:51.935965 run create_hlr_db(pid=24565): Launched 15:43:52.065123 bus /sierra_2: Setting Powered False 15:43:53.130426 run create_hlr_db(pid=24565): Terminated: ok {rc=0} 15:43:53.577480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24567): Launched 15:43:53.893676 run osmo-hlr_10.42.42.2(pid=24568): Launched 15:43:54.012815 run osmo-stp_10.42.42.5: Starting osmo-stp 15:43:54.565802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24570): Launched 15:43:54.882578 run osmo-stp_10.42.42.5(pid=24571): Launched 15:43:55.001246 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:43:55.539492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24573): Launched 15:43:55.658435 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:43:55.924935 run patchelf(pid=24574): Launched 15:43:56.099402 run osmo-stp_10.42.42.5(pid=24571): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24571)] 15:43:56.230597 run osmo-stp_10.42.42.5(pid=24571): stdout: | (launched: 2022-12-12_15:43:54.821514) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:56.363358 run osmo-stp_10.42.42.5(pid=24571): stderr: | 20221212154354996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154354996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154354997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154354997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154354998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154354998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154354998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:56.495796 run osmo-stp_10.42.42.5(pid=24571): stdout: | (launched: 2022-12-12_15:43:54.821514) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:43:56.622731 run osmo-stp_10.42.42.5(pid=24571): stderr: | 20221212154354996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154354996 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154354997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154354997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154354998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154354998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154354998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:43:56.772590 run patchelf(pid=24574): Terminating (SIGINT) 15:43:56.946753 run patchelf(pid=24574): Terminated: ok {rc=0} 15:43:57.072224 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24571): Process ended prematurely: osmo-stp_10.42.42.5(pid=24571) [trial-2378↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24571)] [trial-2378↪gprs:oc2g↪cs_paging_gprs_active.py:38] 15:43:57.081739 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 15:43:57.108872 run osmo-hlr_10.42.42.2(pid=24568): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24568)] 15:43:57.156299 run osmo-hlr_10.42.42.2(pid=24568): stdout: | (launched: 2022-12-12_15:43:53.832845) 15:43:57.205350 run osmo-hlr_10.42.42.2(pid=24568): stderr: | 20221212154354013 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154354013 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154354013 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154354013 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154354013 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154354014 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154354025 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154354034 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154354034 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154354034 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:43:57.254872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24561): Terminating (SIGTERM) 15:43:57.294172 run iperf3-srv_10.42.42.10(pid=24562): Terminating (SIGTERM) 15:43:57.333558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24563): Terminating (SIGTERM) 15:43:57.372879 run iperf3-srv_10.42.42.10(pid=24564): Terminating (SIGTERM) 15:43:57.412121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24567): Terminating (SIGTERM) 15:43:57.451589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24570): Terminating (SIGTERM) 15:43:57.491110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24573): Terminating (SIGTERM) 15:43:57.530917 --- ParallelTerminationStrategy: PID 24561 died... 15:43:57.550052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24561): Terminated: ok {rc=0} 15:43:57.594387 --- ParallelTerminationStrategy: PID 24562 died... 15:43:57.612660 run iperf3-srv_10.42.42.10(pid=24562): Terminated {rc=256} 15:43:57.656231 --- ParallelTerminationStrategy: PID 24563 died... 15:43:57.674710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24563): Terminated: ok {rc=0} 15:43:57.718363 --- ParallelTerminationStrategy: PID 24564 died... 15:43:57.736861 run iperf3-srv_10.42.42.10(pid=24564): Terminated {rc=256} 15:43:57.780304 --- ParallelTerminationStrategy: PID 24567 died... 15:43:57.799321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24567): Terminated: ok {rc=0} 15:43:57.843098 --- ParallelTerminationStrategy: PID 24570 died... 15:43:57.861808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24570): Terminated: ok {rc=0} 15:43:57.905231 --- ParallelTerminationStrategy: PID 24573 died... 15:43:57.923617 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24573): Terminated: ok {rc=0} 15:43:58.008878 bus /gobi_0: Setting Powered False 15:43:59.109187 bus /gobi_0: Setting Powered False 15:44:00.221872 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:oc2g iperf3.py ---------------------------------------------- 15:44:01.402680 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:01.417821 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:44:01.459826 tst iperf3.py: using LAC 29877 15:44:01.593928 tst iperf3.py: using RAC 42 15:44:01.717367 tst iperf3.py: using CellId 29877 15:44:01.841879 tst iperf3.py: using BVCI 29878 15:44:01.958473 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:01.969783 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:01.980813 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:01.991806 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:02.002748 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:02.014471 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:02.025769 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:02.036750 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:02.048242 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:44:02.192068 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:44:02.421171 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:02.737090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24575): Launched 15:44:03.013200 run iperf3-srv_10.42.42.10(pid=24576): Launched 15:44:03.131302 tst iperf3.py:8: start network... 15:44:03.338930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:03.824780 run create_hlr_db(pid=24577): Launched 15:44:03.952681 bus /gobi_6: Setting Powered False 15:44:05.018518 run create_hlr_db(pid=24577): Terminated: ok {rc=0} 15:44:05.465926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24579): Launched 15:44:05.780681 run osmo-hlr_10.42.42.2(pid=24580): Launched 15:44:05.898994 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:06.452502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24582): Launched 15:44:06.767803 run osmo-stp_10.42.42.5(pid=24583): Launched 15:44:06.887347 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:07.428450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24585): Launched 15:44:07.549514 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:07.815851 run patchelf(pid=24586): Launched 15:44:07.988229 run osmo-stp_10.42.42.5(pid=24583): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24583)] 15:44:08.119558 run osmo-stp_10.42.42.5(pid=24583): stdout: | (launched: 2022-12-12_15:44:06.706961) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:08.252376 run osmo-stp_10.42.42.5(pid=24583): stderr: | 20221212154406881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154406881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154406881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154406881 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154406882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154406882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154406882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:08.385451 run osmo-stp_10.42.42.5(pid=24583): stdout: | (launched: 2022-12-12_15:44:06.706961) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:08.512372 run osmo-stp_10.42.42.5(pid=24583): stderr: | 20221212154406881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154406881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154406881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154406881 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154406882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154406882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154406882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:08.662787 run patchelf(pid=24586): Terminating (SIGINT) 15:44:08.836902 run patchelf(pid=24586): Terminated: ok {rc=0} 15:44:08.962438 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24583): Process ended prematurely: osmo-stp_10.42.42.5(pid=24583) [trial-2378↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24583)] [trial-2378↪gprs:oc2g↪iperf3.py:8] 15:44:08.971895 tst iperf3.py:8: Test FAILED (7.6 sec) 15:44:08.998862 run osmo-hlr_10.42.42.2(pid=24580): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24580)] 15:44:09.045798 run osmo-hlr_10.42.42.2(pid=24580): stdout: | (launched: 2022-12-12_15:44:05.719886) 15:44:09.094475 run osmo-hlr_10.42.42.2(pid=24580): stderr: | 20221212154405898 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154405898 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154405899 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154405899 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154405899 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154405899 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154405911 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154405919 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154405919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154405919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:09.143861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24575): Terminating (SIGTERM) 15:44:09.183106 run iperf3-srv_10.42.42.10(pid=24576): Terminating (SIGTERM) 15:44:09.222306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24579): Terminating (SIGTERM) 15:44:09.261596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24582): Terminating (SIGTERM) 15:44:09.300761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24585): Terminating (SIGTERM) 15:44:09.340255 --- ParallelTerminationStrategy: PID 24575 died... 15:44:09.359305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24575): Terminated: ok {rc=0} 15:44:09.402797 --- ParallelTerminationStrategy: PID 24576 died... 15:44:09.421237 run iperf3-srv_10.42.42.10(pid=24576): Terminated {rc=256} 15:44:09.464467 --- ParallelTerminationStrategy: PID 24579 died... 15:44:09.483060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24579): Terminated: ok {rc=0} 15:44:09.527491 --- ParallelTerminationStrategy: PID 24582 died... 15:44:09.546008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24582): Terminated: ok {rc=0} 15:44:09.589945 --- ParallelTerminationStrategy: PID 24585 died... 15:44:09.608202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24585): Terminated: ok {rc=0} 15:44:09.692154 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:oc2g iperf3m4.py ---------------------------------------------- 15:44:10.846527 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:10.858648 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:44:10.897363 tst iperf3m4.py: using LAC 29878 15:44:11.036018 tst iperf3m4.py: using RAC 43 15:44:11.171754 tst iperf3m4.py: using CellId 29878 15:44:11.301275 tst iperf3m4.py: using BVCI 29879 15:44:11.423513 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:11.434672 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:11.445856 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:11.457816 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:11.469391 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:11.481098 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:11.493251 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:11.504638 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:11.516676 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:44:11.638308 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:44:11.758906 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:44:11.880227 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:44:11.998881 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:44:12.207721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:12.525227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24587): Launched 15:44:12.803418 run iperf3-srv_10.42.42.10(pid=24588): Launched 15:44:12.919987 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:44:13.128503 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:13.444548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24589): Launched 15:44:13.719004 run iperf3-srv_10.42.42.10(pid=24590): Launched 15:44:13.837535 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:44:14.045816 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:14.361488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24591): Launched 15:44:14.635620 run iperf3-srv_10.42.42.10(pid=24592): Launched 15:44:14.753633 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:44:14.960565 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:15.275907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24593): Launched 15:44:15.552102 run iperf3-srv_10.42.42.10(pid=24594): Launched 15:44:15.668338 tst iperf3m4.py:8: start network... 15:44:15.876734 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:16.374584 run create_hlr_db(pid=24595): Launched 15:44:16.535090 bus /gobi_6: Setting Powered False 15:44:17.596683 run create_hlr_db(pid=24595): Terminated: ok {rc=0} 15:44:18.053865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24597): Launched 15:44:18.393889 run osmo-hlr_10.42.42.2(pid=24598): Launched 15:44:18.521597 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:19.100497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24600): Launched 15:44:19.439606 run osmo-stp_10.42.42.5(pid=24601): Launched 15:44:19.567239 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:20.146972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24603): Launched 15:44:20.277159 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:20.563665 run patchelf(pid=24604): Launched 15:44:20.750228 run osmo-stp_10.42.42.5(pid=24601): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24601)] 15:44:20.891381 run osmo-stp_10.42.42.5(pid=24601): stdout: | (launched: 2022-12-12_15:44:19.374955) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:21.034239 run osmo-stp_10.42.42.5(pid=24601): stderr: | 20221212154419568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154419568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154419568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154419568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154419569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154419569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154419569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:21.177269 run osmo-stp_10.42.42.5(pid=24601): stdout: | (launched: 2022-12-12_15:44:19.374955) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:21.313634 run osmo-stp_10.42.42.5(pid=24601): stderr: | 20221212154419568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154419568 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154419568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154419568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154419569 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154419569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154419569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:21.475315 run patchelf(pid=24604): Terminating (SIGINT) 15:44:21.662078 run patchelf(pid=24604): Terminated: ok {rc=0} 15:44:21.796608 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24601): Process ended prematurely: osmo-stp_10.42.42.5(pid=24601) [trial-2378↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24601)] [trial-2378↪gprs:oc2g↪iperf3m4.py:8] 15:44:21.806897 tst iperf3m4.py:8: Test FAILED (11.0 sec) 15:44:21.836214 run osmo-hlr_10.42.42.2(pid=24598): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24598)] 15:44:21.886063 run osmo-hlr_10.42.42.2(pid=24598): stdout: | (launched: 2022-12-12_15:44:18.328782) 15:44:21.937955 run osmo-hlr_10.42.42.2(pid=24598): stderr: | 20221212154418526 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154418526 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154418526 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154418526 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154418526 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154418526 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154418539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154418549 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154418549 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154418549 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:21.990137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24587): Terminating (SIGTERM) 15:44:22.032029 run iperf3-srv_10.42.42.10(pid=24588): Terminating (SIGTERM) 15:44:22.073868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24589): Terminating (SIGTERM) 15:44:22.116043 run iperf3-srv_10.42.42.10(pid=24590): Terminating (SIGTERM) 15:44:22.157725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24591): Terminating (SIGTERM) 15:44:22.199458 run iperf3-srv_10.42.42.10(pid=24592): Terminating (SIGTERM) 15:44:22.241060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24593): Terminating (SIGTERM) 15:44:22.282790 run iperf3-srv_10.42.42.10(pid=24594): Terminating (SIGTERM) 15:44:22.324264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24597): Terminating (SIGTERM) 15:44:22.366101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24600): Terminating (SIGTERM) 15:44:22.407750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24603): Terminating (SIGTERM) 15:44:22.449740 --- ParallelTerminationStrategy: PID 24587 died... 15:44:22.469714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24587): Terminated: ok {rc=0} 15:44:22.516314 --- ParallelTerminationStrategy: PID 24588 died... 15:44:22.535876 run iperf3-srv_10.42.42.10(pid=24588): Terminated {rc=256} 15:44:22.582191 --- ParallelTerminationStrategy: PID 24589 died... 15:44:22.601650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24589): Terminated: ok {rc=0} 15:44:22.647857 --- ParallelTerminationStrategy: PID 24590 died... 15:44:22.667385 run iperf3-srv_10.42.42.10(pid=24590): Terminated {rc=256} 15:44:22.713573 --- ParallelTerminationStrategy: PID 24591 died... 15:44:22.733059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24591): Terminated: ok {rc=0} 15:44:22.779356 --- ParallelTerminationStrategy: PID 24592 died... 15:44:22.798828 run iperf3-srv_10.42.42.10(pid=24592): Terminated {rc=256} 15:44:22.845230 --- ParallelTerminationStrategy: PID 24593 died... 15:44:22.864565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24593): Terminated: ok {rc=0} 15:44:22.910971 --- ParallelTerminationStrategy: PID 24594 died... 15:44:22.930648 run iperf3-srv_10.42.42.10(pid=24594): Terminated {rc=256} 15:44:22.977191 --- ParallelTerminationStrategy: PID 24597 died... 15:44:22.996616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24597): Terminated: ok {rc=0} 15:44:23.042943 --- ParallelTerminationStrategy: PID 24600 died... 15:44:23.062499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24600): Terminated: ok {rc=0} 15:44:23.109495 --- ParallelTerminationStrategy: PID 24603 died... 15:44:23.128912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24603): Terminated: ok {rc=0} 15:44:23.217365 bus /gobi_4: Setting Powered False 15:44:24.316002 bus /gobi_4: Setting Powered False 15:44:25.432421 bus /gobi_1: Setting Powered False 15:44:26.530635 bus /gobi_1: Setting Powered False 15:44:27.647160 bus /gobi_0: Setting Powered False 15:44:28.744896 bus /gobi_0: Setting Powered False 15:44:29.860995 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:oc2g ping.py ---------------------------------------------- 15:44:30.976845 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:30.992578 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:44:31.030513 tst ping.py: using LAC 29879 15:44:31.164334 tst ping.py: using RAC 44 15:44:31.316650 tst ping.py: using CellId 29879 15:44:31.440894 tst ping.py: using BVCI 29880 15:44:31.564589 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:31.576721 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:31.589876 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:31.601980 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:31.614609 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:31.627779 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:31.642141 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:31.654086 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:44:31.780889 tst ping.py:19: start network... 15:44:32.008789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:32.526570 run create_hlr_db(pid=24605): Launched 15:44:32.653686 bus /gobi_6: Setting Powered False 15:44:33.719197 run create_hlr_db(pid=24605): Terminated: ok {rc=0} 15:44:34.160455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24607): Launched 15:44:34.471483 run osmo-hlr_10.42.42.2(pid=24608): Launched 15:44:34.589913 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:35.122551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24610): Launched 15:44:35.432842 run osmo-stp_10.42.42.5(pid=24611): Launched 15:44:35.548017 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:36.077457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24613): Launched 15:44:36.195204 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:36.456143 run patchelf(pid=24614): Launched 15:44:36.627529 run osmo-stp_10.42.42.5(pid=24611): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24611)] 15:44:36.756825 run osmo-stp_10.42.42.5(pid=24611): stdout: | (launched: 2022-12-12_15:44:35.373328) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:36.887614 run osmo-stp_10.42.42.5(pid=24611): stderr: | 20221212154435545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154435545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154435545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154435546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154435546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154435546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154435546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:37.018268 run osmo-stp_10.42.42.5(pid=24611): stdout: | (launched: 2022-12-12_15:44:35.373328) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:37.143154 run osmo-stp_10.42.42.5(pid=24611): stderr: | 20221212154435545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154435545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154435545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154435546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154435546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154435546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154435546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:37.291150 run patchelf(pid=24614): Terminating (SIGINT) 15:44:37.461507 run patchelf(pid=24614): Terminated: ok {rc=0} 15:44:37.584595 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24611): Process ended prematurely: osmo-stp_10.42.42.5(pid=24611) [trial-2378↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24611)] [trial-2378↪gprs:oc2g↪ping.py:22] 15:44:37.593616 tst ping.py:22: Test FAILED (6.6 sec) 15:44:37.620546 run osmo-hlr_10.42.42.2(pid=24608): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24608)] 15:44:37.667907 run osmo-hlr_10.42.42.2(pid=24608): stdout: | (launched: 2022-12-12_15:44:34.411409) 15:44:37.717126 run osmo-hlr_10.42.42.2(pid=24608): stderr: | 20221212154434591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154434591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154434591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154434591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154434591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154434591 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154434608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154434618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154434619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154434619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:37.766523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24607): Terminating (SIGTERM) 15:44:37.806518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24610): Terminating (SIGTERM) 15:44:37.846204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24613): Terminating (SIGTERM) 15:44:37.886396 --- ParallelTerminationStrategy: PID 24607 died... 15:44:37.905687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24607): Terminated: ok {rc=0} 15:44:37.949858 --- ParallelTerminationStrategy: PID 24610 died... 15:44:37.968832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24610): Terminated: ok {rc=0} 15:44:38.013109 --- ParallelTerminationStrategy: PID 24613 died... 15:44:38.032339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24613): Terminated: ok {rc=0} 15:44:38.119155 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 15:44:39.210729 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:39.222346 tst gprs:oc2g: Using 1 x bts (candidates: 1) 15:44:39.258938 tst ping_idle_ping.py: using LAC 29880 15:44:39.380801 tst ping_idle_ping.py: using RAC 45 15:44:39.503106 tst ping_idle_ping.py: using CellId 29880 15:44:39.624878 tst ping_idle_ping.py: using BVCI 29881 15:44:39.736042 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:39.746656 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:39.757143 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:39.768083 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:39.779037 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:39.789992 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:39.801166 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 15:44:39.812042 tst gprs:oc2g: Using 1 x modem (candidates: 4) 15:44:39.932442 tst ping_idle_ping.py:24: start network... 15:44:40.156663 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:40.671875 run create_hlr_db(pid=24615): Launched 15:44:40.800098 bus /gobi_6: Setting Powered False 15:44:41.864496 run create_hlr_db(pid=24615): Terminated: ok {rc=0} 15:44:42.307918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24617): Launched 15:44:42.619071 run osmo-hlr_10.42.42.2(pid=24618): Launched 15:44:42.738509 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:43.269731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24620): Launched 15:44:43.580531 run osmo-stp_10.42.42.5(pid=24621): Launched 15:44:43.698821 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:44.232140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24623): Launched 15:44:44.350054 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:44.612042 run patchelf(pid=24624): Launched 15:44:44.783709 run osmo-stp_10.42.42.5(pid=24621): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24621)] 15:44:44.913230 run osmo-stp_10.42.42.5(pid=24621): stdout: | (launched: 2022-12-12_15:44:43.520537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:45.044205 run osmo-stp_10.42.42.5(pid=24621): stderr: | 20221212154443692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154443692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154443693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154443693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154443694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154443694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154443694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:45.175459 run osmo-stp_10.42.42.5(pid=24621): stdout: | (launched: 2022-12-12_15:44:43.520537) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:45.300329 run osmo-stp_10.42.42.5(pid=24621): stderr: | 20221212154443692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154443692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154443693 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154443693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154443694 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154443694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154443694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:45.448890 run patchelf(pid=24624): Terminating (SIGINT) 15:44:45.620529 run patchelf(pid=24624): Terminated: ok {rc=0} 15:44:45.744104 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24621): Process ended prematurely: osmo-stp_10.42.42.5(pid=24621) [trial-2378↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24621)] [trial-2378↪gprs:oc2g↪ping_idle_ping.py:27] 15:44:45.753891 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 15:44:45.780733 run osmo-hlr_10.42.42.2(pid=24618): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24618)] 15:44:45.828412 run osmo-hlr_10.42.42.2(pid=24618): stdout: | (launched: 2022-12-12_15:44:42.558607) 15:44:45.877596 run osmo-hlr_10.42.42.2(pid=24618): stderr: | 20221212154442736 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154442736 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154442737 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154442737 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154442737 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154442737 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154442749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154442758 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154442758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154442758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:45.940582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24617): Terminating (SIGTERM) 15:44:45.993939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24620): Terminating (SIGTERM) 15:44:46.034857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24623): Terminating (SIGTERM) 15:44:46.077470 --- ParallelTerminationStrategy: PID 24617 died... 15:44:46.098083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24617): Terminated: ok {rc=0} 15:44:46.145626 --- ParallelTerminationStrategy: PID 24620 died... 15:44:46.165121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24620): Terminated: ok {rc=0} 15:44:46.210007 --- ParallelTerminationStrategy: PID 24623 died... 15:44:46.229369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24623): Terminated: ok {rc=0} 15:44:46.315022 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2378 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 15:44:47.608255 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:44:47.613551 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 15:44:47.633920 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 15:44:47.673061 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 15:44:47.759100 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 15:44:47.779298 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 15:44:47.816890 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 15:44:48.410284 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 15:44:48.458963 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:48.469643 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:44:48.509321 tst cs_paging_gprs_active.py: using LAC 29881 15:44:48.627553 tst cs_paging_gprs_active.py: using RAC 46 15:44:48.756227 tst cs_paging_gprs_active.py: using CellId 29881 15:44:48.876560 tst cs_paging_gprs_active.py: using BVCI 29882 15:44:48.986950 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:48.997750 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:49.008268 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:49.018797 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:49.029235 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:49.039579 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:49.050202 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:49.060571 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:44:49.071159 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:49.192308 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:44:49.313095 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:44:49.535659 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:49.868855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24628): Launched 15:44:50.157959 run iperf3-srv_10.42.42.10(pid=24629): Launched 15:44:50.281037 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:44:50.501486 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:44:50.833342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24630): Launched 15:44:51.123605 run iperf3-srv_10.42.42.10(pid=24631): Launched 15:44:51.248087 tst cs_paging_gprs_active.py:38: start network... 15:44:51.469014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:44:51.981516 run create_hlr_db(pid=24632): Launched 15:44:52.111996 bus /gobi_6: Setting Powered False 15:44:53.172246 run create_hlr_db(pid=24632): Terminated: ok {rc=0} 15:44:53.623404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24634): Launched 15:44:53.956939 run osmo-hlr_10.42.42.2(pid=24635): Launched 15:44:54.082653 run osmo-stp_10.42.42.5: Starting osmo-stp 15:44:54.649754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24637): Launched 15:44:54.981996 run osmo-stp_10.42.42.5(pid=24638): Launched 15:44:55.108919 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:44:55.677563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24640): Launched 15:44:55.804381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:44:56.084411 run patchelf(pid=24641): Launched 15:44:56.267217 run osmo-stp_10.42.42.5(pid=24638): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24638)] 15:44:56.406211 run osmo-stp_10.42.42.5(pid=24638): stdout: | (launched: 2022-12-12_15:44:54.918921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:56.546677 run osmo-stp_10.42.42.5(pid=24638): stderr: | 20221212154455108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154455108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154455108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154455109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154455109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154455109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154455109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:56.687289 run osmo-stp_10.42.42.5(pid=24638): stdout: | (launched: 2022-12-12_15:44:54.918921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:44:56.821538 run osmo-stp_10.42.42.5(pid=24638): stderr: | 20221212154455108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154455108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154455108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154455109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154455109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154455109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154455109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:44:56.980281 run patchelf(pid=24641): Terminating (SIGINT) 15:44:57.164450 run patchelf(pid=24641): Terminated: ok {rc=0} 15:44:57.296891 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24638): Process ended prematurely: osmo-stp_10.42.42.5(pid=24638) [trial-2378↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24638)] [trial-2378↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 15:44:57.307480 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 15:44:57.336152 run osmo-hlr_10.42.42.2(pid=24635): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24635)] 15:44:57.387379 run osmo-hlr_10.42.42.2(pid=24635): stdout: | (launched: 2022-12-12_15:44:53.893478) 15:44:57.439902 run osmo-hlr_10.42.42.2(pid=24635): stderr: | 20221212154454090 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154454090 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154454090 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154454090 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154454090 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154454090 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154454105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154454114 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154454115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154454115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:44:57.493250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24628): Terminating (SIGTERM) 15:44:57.535941 run iperf3-srv_10.42.42.10(pid=24629): Terminating (SIGTERM) 15:44:57.578547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24630): Terminating (SIGTERM) 15:44:57.621089 run iperf3-srv_10.42.42.10(pid=24631): Terminating (SIGTERM) 15:44:57.663488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24634): Terminating (SIGTERM) 15:44:57.706107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24637): Terminating (SIGTERM) 15:44:57.748672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24640): Terminating (SIGTERM) 15:44:57.791315 --- ParallelTerminationStrategy: PID 24628 died... 15:44:57.811347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24628): Terminated: ok {rc=0} 15:44:57.858730 --- ParallelTerminationStrategy: PID 24629 died... 15:44:57.878456 run iperf3-srv_10.42.42.10(pid=24629): Terminated {rc=256} 15:44:57.925295 --- ParallelTerminationStrategy: PID 24630 died... 15:44:57.944891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24630): Terminated: ok {rc=0} 15:44:57.992229 --- ParallelTerminationStrategy: PID 24631 died... 15:44:58.011917 run iperf3-srv_10.42.42.10(pid=24631): Terminated {rc=256} 15:44:58.059117 --- ParallelTerminationStrategy: PID 24634 died... 15:44:58.078804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24634): Terminated: ok {rc=0} 15:44:58.126207 --- ParallelTerminationStrategy: PID 24637 died... 15:44:58.146044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24637): Terminated: ok {rc=0} 15:44:58.193472 --- ParallelTerminationStrategy: PID 24640 died... 15:44:58.213596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24640): Terminated: ok {rc=0} 15:44:58.303077 bus /gobi_0: Setting Powered False 15:44:59.402624 bus /gobi_0: Setting Powered False 15:45:00.519531 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 15:45:01.668866 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:01.682170 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:45:01.723544 tst iperf3.py: using LAC 29882 15:45:01.856934 tst iperf3.py: using RAC 47 15:45:02.003463 tst iperf3.py: using CellId 29882 15:45:02.141109 tst iperf3.py: using BVCI 29883 15:45:02.255874 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:02.267792 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:02.279218 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:02.291266 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:02.303103 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:02.314528 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:02.326022 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:02.337401 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:02.349365 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:45:02.470129 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:45:02.675926 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:02.987445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24645): Launched 15:45:03.259904 run iperf3-srv_10.42.42.10(pid=24646): Launched 15:45:03.376578 tst iperf3.py:8: start network... 15:45:03.581701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:04.059419 run create_hlr_db(pid=24647): Launched 15:45:04.185656 bus /gobi_6: Setting Powered False 15:45:05.246141 run create_hlr_db(pid=24647): Terminated: ok {rc=0} 15:45:05.674827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24649): Launched 15:45:05.984519 run osmo-hlr_10.42.42.2(pid=24650): Launched 15:45:06.101648 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:06.631655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24652): Launched 15:45:06.942464 run osmo-stp_10.42.42.5(pid=24653): Launched 15:45:07.060340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:07.591985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24655): Launched 15:45:07.709071 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:07.971396 run patchelf(pid=24656): Launched 15:45:08.142989 run osmo-stp_10.42.42.5(pid=24653): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24653)] 15:45:08.272792 run osmo-stp_10.42.42.5(pid=24653): stdout: | (launched: 2022-12-12_15:45:06.882397) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:08.404651 run osmo-stp_10.42.42.5(pid=24653): stderr: | 20221212154507056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154507056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154507056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154507056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154507057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154507057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154507057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:08.535858 run osmo-stp_10.42.42.5(pid=24653): stdout: | (launched: 2022-12-12_15:45:06.882397) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:08.661220 run osmo-stp_10.42.42.5(pid=24653): stderr: | 20221212154507056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154507056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154507056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154507056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154507057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154507057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154507057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:08.809385 run patchelf(pid=24656): Terminating (SIGINT) 15:45:08.980663 run patchelf(pid=24656): Terminated: ok {rc=0} 15:45:09.103845 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24653): Process ended prematurely: osmo-stp_10.42.42.5(pid=24653) [trial-2378↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24653)] [trial-2378↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 15:45:09.113521 tst iperf3.py:8: Test FAILED (7.5 sec) 15:45:09.140364 run osmo-hlr_10.42.42.2(pid=24650): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24650)] 15:45:09.187294 run osmo-hlr_10.42.42.2(pid=24650): stdout: | (launched: 2022-12-12_15:45:05.925106) 15:45:09.235950 run osmo-hlr_10.42.42.2(pid=24650): stderr: | 20221212154506103 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154506103 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154506103 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154506103 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154506103 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154506103 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154506116 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154506124 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154506125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154506125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:09.285286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24645): Terminating (SIGTERM) 15:45:09.324742 run iperf3-srv_10.42.42.10(pid=24646): Terminating (SIGTERM) 15:45:09.364166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24649): Terminating (SIGTERM) 15:45:09.403724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24652): Terminating (SIGTERM) 15:45:09.443327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24655): Terminating (SIGTERM) 15:45:09.483090 --- ParallelTerminationStrategy: PID 24645 died... 15:45:09.502156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24645): Terminated: ok {rc=0} 15:45:09.546150 --- ParallelTerminationStrategy: PID 24646 died... 15:45:09.564655 run iperf3-srv_10.42.42.10(pid=24646): Terminated {rc=256} 15:45:09.608575 --- ParallelTerminationStrategy: PID 24649 died... 15:45:09.627184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24649): Terminated: ok {rc=0} 15:45:09.671043 --- ParallelTerminationStrategy: PID 24652 died... 15:45:09.689780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24652): Terminated: ok {rc=0} 15:45:09.733698 --- ParallelTerminationStrategy: PID 24655 died... 15:45:09.752325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24655): Terminated: ok {rc=0} 15:45:09.836126 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 15:45:10.985820 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:10.997857 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:45:11.037294 tst iperf3m4.py: using LAC 29883 15:45:11.167204 tst iperf3m4.py: using RAC 48 15:45:11.297015 tst iperf3m4.py: using CellId 29883 15:45:11.417881 tst iperf3m4.py: using BVCI 29884 15:45:11.528833 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:11.539995 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:11.550972 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:11.562118 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:11.573148 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:11.584098 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:11.595366 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:11.606175 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:11.617124 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:45:11.738074 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:45:11.854265 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:45:11.974937 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:45:12.090496 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:45:12.295881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:12.608656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24657): Launched 15:45:12.880601 run iperf3-srv_10.42.42.10(pid=24658): Launched 15:45:12.997071 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:45:13.201885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:13.512673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24659): Launched 15:45:13.784743 run iperf3-srv_10.42.42.10(pid=24660): Launched 15:45:13.900876 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:45:14.105690 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:14.417856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24661): Launched 15:45:14.688786 run iperf3-srv_10.42.42.10(pid=24662): Launched 15:45:14.805097 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:45:15.009548 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:15.321275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24663): Launched 15:45:15.593236 run iperf3-srv_10.42.42.10(pid=24664): Launched 15:45:15.710171 tst iperf3m4.py:8: start network... 15:45:15.927585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:16.417415 run create_hlr_db(pid=24666): Launched 15:45:16.584427 bus /gobi_6: Setting Powered False 15:45:17.645752 run create_hlr_db(pid=24666): Terminated: ok {rc=0} 15:45:18.095855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24668): Launched 15:45:18.430646 run osmo-hlr_10.42.42.2(pid=24669): Launched 15:45:18.556396 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:19.124436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24671): Launched 15:45:19.457759 run osmo-stp_10.42.42.5(pid=24672): Launched 15:45:19.583641 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:20.151981 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24674): Launched 15:45:20.280591 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:20.562145 run patchelf(pid=24675): Launched 15:45:20.746406 run osmo-stp_10.42.42.5(pid=24672): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24672)] 15:45:20.884711 run osmo-stp_10.42.42.5(pid=24672): stdout: | (launched: 2022-12-12_15:45:19.394152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:21.024421 run osmo-stp_10.42.42.5(pid=24672): stderr: | 20221212154519587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154519587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154519587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154519587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154519588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154519588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154519588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:21.165162 run osmo-stp_10.42.42.5(pid=24672): stdout: | (launched: 2022-12-12_15:45:19.394152) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:21.299024 run osmo-stp_10.42.42.5(pid=24672): stderr: | 20221212154519587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154519587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154519587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154519587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154519588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154519588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154519588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:21.458032 run patchelf(pid=24675): Terminating (SIGINT) 15:45:21.641275 run patchelf(pid=24675): Terminated: ok {rc=0} 15:45:21.773067 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24672): Process ended prematurely: osmo-stp_10.42.42.5(pid=24672) [trial-2378↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24672)] [trial-2378↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 15:45:21.783394 tst iperf3m4.py:8: Test FAILED (10.8 sec) 15:45:21.812519 run osmo-hlr_10.42.42.2(pid=24669): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24669)] 15:45:21.862477 run osmo-hlr_10.42.42.2(pid=24669): stdout: | (launched: 2022-12-12_15:45:18.367128) 15:45:21.914573 run osmo-hlr_10.42.42.2(pid=24669): stderr: | 20221212154518565 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154518565 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154518566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154518566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154518566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154518566 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154518578 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154518587 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154518587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154518587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:21.966765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24657): Terminating (SIGTERM) 15:45:22.008822 run iperf3-srv_10.42.42.10(pid=24658): Terminating (SIGTERM) 15:45:22.051207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24659): Terminating (SIGTERM) 15:45:22.093748 run iperf3-srv_10.42.42.10(pid=24660): Terminating (SIGTERM) 15:45:22.136158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24661): Terminating (SIGTERM) 15:45:22.178263 run iperf3-srv_10.42.42.10(pid=24662): Terminating (SIGTERM) 15:45:22.220126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24663): Terminating (SIGTERM) 15:45:22.262153 run iperf3-srv_10.42.42.10(pid=24664): Terminating (SIGTERM) 15:45:22.303916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24668): Terminating (SIGTERM) 15:45:22.345859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24671): Terminating (SIGTERM) 15:45:22.387824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24674): Terminating (SIGTERM) 15:45:22.429973 --- ParallelTerminationStrategy: PID 24657 died... 15:45:22.449995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24657): Terminated: ok {rc=0} 15:45:22.496811 --- ParallelTerminationStrategy: PID 24658 died... 15:45:22.516302 run iperf3-srv_10.42.42.10(pid=24658): Terminated {rc=256} 15:45:22.562867 --- ParallelTerminationStrategy: PID 24659 died... 15:45:22.582403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24659): Terminated: ok {rc=0} 15:45:22.628933 --- ParallelTerminationStrategy: PID 24660 died... 15:45:22.648503 run iperf3-srv_10.42.42.10(pid=24660): Terminated {rc=256} 15:45:22.694904 --- ParallelTerminationStrategy: PID 24661 died... 15:45:22.714461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24661): Terminated: ok {rc=0} 15:45:22.761100 --- ParallelTerminationStrategy: PID 24662 died... 15:45:22.780616 run iperf3-srv_10.42.42.10(pid=24662): Terminated {rc=256} 15:45:22.826942 --- ParallelTerminationStrategy: PID 24663 died... 15:45:22.846396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24663): Terminated: ok {rc=0} 15:45:22.892747 --- ParallelTerminationStrategy: PID 24664 died... 15:45:22.912248 run iperf3-srv_10.42.42.10(pid=24664): Terminated {rc=256} 15:45:22.958580 --- ParallelTerminationStrategy: PID 24668 died... 15:45:22.978042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24668): Terminated: ok {rc=0} 15:45:23.024603 --- ParallelTerminationStrategy: PID 24671 died... 15:45:23.044107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24671): Terminated: ok {rc=0} 15:45:23.090487 --- ParallelTerminationStrategy: PID 24674 died... 15:45:23.110344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24674): Terminated: ok {rc=0} 15:45:23.198640 bus /gobi_4: Setting Powered False 15:45:24.297506 bus /gobi_4: Setting Powered False 15:45:25.412566 bus /gobi_1: Setting Powered False 15:45:26.510473 bus /gobi_1: Setting Powered False 15:45:27.628361 bus /gobi_0: Setting Powered False 15:45:28.725947 bus /gobi_0: Setting Powered False 15:45:29.840557 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 15:45:30.958960 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:30.972034 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:45:31.019758 tst ping.py: using LAC 29884 15:45:31.149956 tst ping.py: using RAC 49 15:45:31.296708 tst ping.py: using CellId 29884 15:45:31.425681 tst ping.py: using BVCI 29885 15:45:31.547877 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:31.560492 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:31.574298 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:31.587723 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:31.601240 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:31.613477 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:31.626621 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:31.641163 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:45:31.777086 tst ping.py:19: start network... 15:45:31.984632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:32.460808 run create_hlr_db(pid=24676): Launched 15:45:32.585356 bus /gobi_6: Setting Powered False 15:45:33.645408 run create_hlr_db(pid=24676): Terminated: ok {rc=0} 15:45:34.089345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24678): Launched 15:45:34.415217 run osmo-hlr_10.42.42.2(pid=24679): Launched 15:45:34.538674 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:35.097093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24681): Launched 15:45:35.423558 run osmo-stp_10.42.42.5(pid=24682): Launched 15:45:35.546448 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:36.104609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24684): Launched 15:45:36.227782 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:36.503424 run patchelf(pid=24685): Launched 15:45:36.684805 run osmo-stp_10.42.42.5(pid=24682): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24682)] 15:45:36.821519 run osmo-stp_10.42.42.5(pid=24682): stdout: | (launched: 2022-12-12_15:45:35.361302) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:36.959692 run osmo-stp_10.42.42.5(pid=24682): stderr: | 20221212154535551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154535551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154535551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154535552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154535552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154535552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154535552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:37.098120 run osmo-stp_10.42.42.5(pid=24682): stdout: | (launched: 2022-12-12_15:45:35.361302) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:37.230769 run osmo-stp_10.42.42.5(pid=24682): stderr: | 20221212154535551 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154535551 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154535551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154535552 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154535552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154535552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154535552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:37.387470 run patchelf(pid=24685): Terminating (SIGINT) 15:45:37.568410 run patchelf(pid=24685): Terminated: ok {rc=0} 15:45:37.698783 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24682): Process ended prematurely: osmo-stp_10.42.42.5(pid=24682) [trial-2378↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24682)] [trial-2378↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 15:45:37.708455 tst ping.py:22: Test FAILED (6.7 sec) 15:45:37.737046 run osmo-hlr_10.42.42.2(pid=24679): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24679)] 15:45:37.787135 run osmo-hlr_10.42.42.2(pid=24679): stdout: | (launched: 2022-12-12_15:45:34.353357) 15:45:37.838863 run osmo-hlr_10.42.42.2(pid=24679): stderr: | 20221212154534549 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154534549 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154534549 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154534549 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154534549 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154534549 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154534561 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154534570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154534570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154534570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:37.890964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24678): Terminating (SIGTERM) 15:45:37.933154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24681): Terminating (SIGTERM) 15:45:37.975426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24684): Terminating (SIGTERM) 15:45:38.017844 --- ParallelTerminationStrategy: PID 24678 died... 15:45:38.038022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24678): Terminated: ok {rc=0} 15:45:38.084720 --- ParallelTerminationStrategy: PID 24681 died... 15:45:38.104342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24681): Terminated: ok {rc=0} 15:45:38.151513 --- ParallelTerminationStrategy: PID 24684 died... 15:45:38.171115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24684): Terminated: ok {rc=0} 15:45:38.258854 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 15:45:39.344746 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:39.356898 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:45:39.395986 tst ping_idle_ping.py: using LAC 29885 15:45:39.522912 tst ping_idle_ping.py: using RAC 50 15:45:39.649087 tst ping_idle_ping.py: using CellId 29885 15:45:39.773834 tst ping_idle_ping.py: using BVCI 29886 15:45:39.891696 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:39.903051 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:39.914303 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:39.925913 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:39.937205 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:39.948450 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:39.959935 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:45:39.971415 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:45:40.086942 tst ping_idle_ping.py:24: start network... 15:45:40.290595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:40.768771 run create_hlr_db(pid=24686): Launched 15:45:40.893423 bus /gobi_6: Setting Powered False 15:45:41.953982 run create_hlr_db(pid=24686): Terminated: ok {rc=0} 15:45:42.402461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24688): Launched 15:45:42.732608 run osmo-hlr_10.42.42.2(pid=24689): Launched 15:45:42.856928 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:43.421906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24691): Launched 15:45:43.752209 run osmo-stp_10.42.42.5(pid=24692): Launched 15:45:43.876292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:44.439631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24694): Launched 15:45:44.565941 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:44.844052 run patchelf(pid=24695): Launched 15:45:45.025693 run osmo-stp_10.42.42.5(pid=24692): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24692)] 15:45:45.163500 run osmo-stp_10.42.42.5(pid=24692): stdout: | (launched: 2022-12-12_15:45:43.688655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:45.303526 run osmo-stp_10.42.42.5(pid=24692): stderr: | 20221212154543881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154543881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154543882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154543882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154543883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154543883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154543883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:45.443176 run osmo-stp_10.42.42.5(pid=24692): stdout: | (launched: 2022-12-12_15:45:43.688655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:45.576189 run osmo-stp_10.42.42.5(pid=24692): stderr: | 20221212154543881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154543881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154543882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154543882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154543883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154543883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154543883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:45.733868 run patchelf(pid=24695): Terminating (SIGINT) 15:45:45.941030 run patchelf(pid=24695): Terminated: ok {rc=0} 15:45:46.100189 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24692): Process ended prematurely: osmo-stp_10.42.42.5(pid=24692) [trial-2378↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24692)] [trial-2378↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 15:45:46.111228 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 15:45:46.143745 run osmo-hlr_10.42.42.2(pid=24689): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24689)] 15:45:46.197030 run osmo-hlr_10.42.42.2(pid=24689): stdout: | (launched: 2022-12-12_15:45:42.669765) 15:45:46.251427 run osmo-hlr_10.42.42.2(pid=24689): stderr: | 20221212154542868 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154542868 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154542868 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154542868 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154542868 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154542868 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154542881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154542889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154542889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154542890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:46.306849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24688): Terminating (SIGTERM) 15:45:46.351918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24691): Terminating (SIGTERM) 15:45:46.396698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24694): Terminating (SIGTERM) 15:45:46.441910 --- ParallelTerminationStrategy: PID 24688 died... 15:45:46.462868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24688): Terminated: ok {rc=0} 15:45:46.512907 --- ParallelTerminationStrategy: PID 24691 died... 15:45:46.533665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24691): Terminated: ok {rc=0} 15:45:46.583287 --- ParallelTerminationStrategy: PID 24694 died... 15:45:46.604180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24694): Terminated: ok {rc=0} 15:45:46.695906 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 15:45:47.998672 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:45:48.005217 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 15:45:48.025722 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 15:45:48.064191 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 15:45:48.150683 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 15:45:48.171099 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 15:45:48.208849 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 15:45:48.801228 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 15:45:48.850767 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:48.861631 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:45:48.917931 tst cs_paging_gprs_active.py: using LAC 29886 15:45:49.037785 tst cs_paging_gprs_active.py: using RAC 51 15:45:49.157240 tst cs_paging_gprs_active.py: using CellId 29886 15:45:49.276709 tst cs_paging_gprs_active.py: using BVCI 29887 15:45:49.389264 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:49.400075 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:49.410657 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:49.421236 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:49.431663 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:49.442246 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:49.452870 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:49.463381 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:45:49.474042 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:49.593971 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:45:49.713873 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:45:49.921215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:50.233305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24700): Launched 15:45:50.505300 run iperf3-srv_10.42.42.10(pid=24701): Launched 15:45:50.623067 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:45:50.829585 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:45:51.142048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24702): Launched 15:45:51.421594 run iperf3-srv_10.42.42.10(pid=24703): Launched 15:45:51.546838 tst cs_paging_gprs_active.py:38: start network... 15:45:51.770076 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:45:52.284936 run create_hlr_db(pid=24704): Launched 15:45:52.412653 bus /gobi_6: Setting Powered False 15:45:53.477872 run create_hlr_db(pid=24704): Terminated: ok {rc=0} 15:45:53.938878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24706): Launched 15:45:54.274162 run osmo-hlr_10.42.42.2(pid=24707): Launched 15:45:54.402183 run osmo-stp_10.42.42.5: Starting osmo-stp 15:45:54.972212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24709): Launched 15:45:55.306509 run osmo-stp_10.42.42.5(pid=24710): Launched 15:45:55.433717 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:45:56.003947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24712): Launched 15:45:56.132169 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:45:56.415088 run patchelf(pid=24713): Launched 15:45:56.599503 run osmo-stp_10.42.42.5(pid=24710): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24710)] 15:45:56.739876 run osmo-stp_10.42.42.5(pid=24710): stdout: | (launched: 2022-12-12_15:45:55.242656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:56.880637 run osmo-stp_10.42.42.5(pid=24710): stderr: | 20221212154555434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154555434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154555435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154555435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154555435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154555436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154555436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:57.022041 run osmo-stp_10.42.42.5(pid=24710): stdout: | (launched: 2022-12-12_15:45:55.242656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:45:57.157248 run osmo-stp_10.42.42.5(pid=24710): stderr: | 20221212154555434 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154555434 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154555435 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154555435 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154555435 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154555436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154555436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:45:57.317498 run patchelf(pid=24713): Terminating (SIGINT) 15:45:57.502095 run patchelf(pid=24713): Terminated: ok {rc=0} 15:45:57.635475 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24710): Process ended prematurely: osmo-stp_10.42.42.5(pid=24710) [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24710)] [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 15:45:57.645669 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 15:45:57.674344 run osmo-hlr_10.42.42.2(pid=24707): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24707)] 15:45:57.725105 run osmo-hlr_10.42.42.2(pid=24707): stdout: | (launched: 2022-12-12_15:45:54.210568) 15:45:57.776938 run osmo-hlr_10.42.42.2(pid=24707): stderr: | 20221212154554406 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154554407 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154554407 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154554407 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154554407 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154554407 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154554419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154554427 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154554427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154554428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:45:57.829666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24700): Terminating (SIGTERM) 15:45:57.871714 run iperf3-srv_10.42.42.10(pid=24701): Terminating (SIGTERM) 15:45:57.913731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24702): Terminating (SIGTERM) 15:45:57.955892 run iperf3-srv_10.42.42.10(pid=24703): Terminating (SIGTERM) 15:45:57.998001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24706): Terminating (SIGTERM) 15:45:58.040218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24709): Terminating (SIGTERM) 15:45:58.082348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24712): Terminating (SIGTERM) 15:45:58.124811 --- ParallelTerminationStrategy: PID 24700 died... 15:45:58.144756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24700): Terminated: ok {rc=0} 15:45:58.191791 --- ParallelTerminationStrategy: PID 24701 died... 15:45:58.211155 run iperf3-srv_10.42.42.10(pid=24701): Terminated {rc=256} 15:45:58.257405 --- ParallelTerminationStrategy: PID 24702 died... 15:45:58.276883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24702): Terminated: ok {rc=0} 15:45:58.323312 --- ParallelTerminationStrategy: PID 24703 died... 15:45:58.342744 run iperf3-srv_10.42.42.10(pid=24703): Terminated {rc=256} 15:45:58.389016 --- ParallelTerminationStrategy: PID 24706 died... 15:45:58.408499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24706): Terminated: ok {rc=0} 15:45:58.454895 --- ParallelTerminationStrategy: PID 24709 died... 15:45:58.474375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24709): Terminated: ok {rc=0} 15:45:58.520762 --- ParallelTerminationStrategy: PID 24712 died... 15:45:58.540329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24712): Terminated: ok {rc=0} 15:45:58.627935 bus /gobi_0: Setting Powered False 15:45:59.728249 bus /gobi_0: Setting Powered False 15:46:00.844314 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 15:46:02.003028 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:02.016177 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:46:02.078989 tst iperf3.py: using LAC 29887 15:46:02.202556 tst iperf3.py: using RAC 52 15:46:02.339946 tst iperf3.py: using CellId 29887 15:46:02.461338 tst iperf3.py: using BVCI 29888 15:46:02.572621 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:02.583702 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:02.594490 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:02.605218 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:02.615776 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:02.626484 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:02.637266 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:02.647886 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:02.658724 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:46:02.774333 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:46:02.980261 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:03.291713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24714): Launched 15:46:03.564528 run iperf3-srv_10.42.42.10(pid=24715): Launched 15:46:03.679631 tst iperf3.py:8: start network... 15:46:03.885862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:04.363885 run create_hlr_db(pid=24716): Launched 15:46:04.490446 bus /gobi_6: Setting Powered False 15:46:05.552237 run create_hlr_db(pid=24716): Terminated: ok {rc=0} 15:46:06.003161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24718): Launched 15:46:06.337690 run osmo-hlr_10.42.42.2(pid=24719): Launched 15:46:06.463738 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:07.031826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24721): Launched 15:46:07.365489 run osmo-stp_10.42.42.5(pid=24722): Launched 15:46:07.491113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:08.061714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24724): Launched 15:46:08.189305 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:08.470011 run patchelf(pid=24725): Launched 15:46:08.653260 run osmo-stp_10.42.42.5(pid=24722): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24722)] 15:46:08.792316 run osmo-stp_10.42.42.5(pid=24722): stdout: | (launched: 2022-12-12_15:46:07.301802) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:08.932476 run osmo-stp_10.42.42.5(pid=24722): stderr: | 20221212154607494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154607494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154607494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154607495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154607495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154607495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154607495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:09.073961 run osmo-stp_10.42.42.5(pid=24722): stdout: | (launched: 2022-12-12_15:46:07.301802) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:09.208469 run osmo-stp_10.42.42.5(pid=24722): stderr: | 20221212154607494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154607494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154607494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154607495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154607495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154607495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154607495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:09.368265 run patchelf(pid=24725): Terminating (SIGINT) 15:46:09.551611 run patchelf(pid=24725): Terminated: ok {rc=0} 15:46:09.683954 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24722): Process ended prematurely: osmo-stp_10.42.42.5(pid=24722) [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24722)] [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 15:46:09.694286 tst iperf3.py:8: Test FAILED (7.7 sec) 15:46:09.722738 run osmo-hlr_10.42.42.2(pid=24719): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24719)] 15:46:09.773207 run osmo-hlr_10.42.42.2(pid=24719): stdout: | (launched: 2022-12-12_15:46:06.274036) 15:46:09.825229 run osmo-hlr_10.42.42.2(pid=24719): stderr: | 20221212154606471 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154606471 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154606471 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154606471 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154606471 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154606471 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154606486 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154606497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154606498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154606498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:09.877778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24714): Terminating (SIGTERM) 15:46:09.919745 run iperf3-srv_10.42.42.10(pid=24715): Terminating (SIGTERM) 15:46:09.961748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24718): Terminating (SIGTERM) 15:46:10.003873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24721): Terminating (SIGTERM) 15:46:10.046022 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24724): Terminating (SIGTERM) 15:46:10.088230 --- ParallelTerminationStrategy: PID 24714 died... 15:46:10.108255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24714): Terminated: ok {rc=0} 15:46:10.155380 --- ParallelTerminationStrategy: PID 24715 died... 15:46:10.174769 run iperf3-srv_10.42.42.10(pid=24715): Terminated {rc=256} 15:46:10.221280 --- ParallelTerminationStrategy: PID 24718 died... 15:46:10.240886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24718): Terminated: ok {rc=0} 15:46:10.287404 --- ParallelTerminationStrategy: PID 24721 died... 15:46:10.306984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24721): Terminated: ok {rc=0} 15:46:10.353749 --- ParallelTerminationStrategy: PID 24724 died... 15:46:10.373562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24724): Terminated: ok {rc=0} 15:46:10.462760 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 15:46:11.615150 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:11.627101 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:46:11.685416 tst iperf3m4.py: using LAC 29888 15:46:11.813623 tst iperf3m4.py: using RAC 53 15:46:11.935592 tst iperf3m4.py: using CellId 29888 15:46:12.058440 tst iperf3m4.py: using BVCI 29889 15:46:12.171896 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:12.183130 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:12.194089 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:12.205821 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:12.217287 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:12.228607 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:12.240353 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:12.251913 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:12.263416 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:46:12.384213 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:46:12.504292 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:46:12.624607 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:46:12.744099 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:46:12.951166 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:13.264040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24726): Launched 15:46:13.536783 run iperf3-srv_10.42.42.10(pid=24727): Launched 15:46:13.653140 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:46:13.857789 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:14.169386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24728): Launched 15:46:14.442611 run iperf3-srv_10.42.42.10(pid=24729): Launched 15:46:14.557888 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:46:14.763091 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:15.076783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24730): Launched 15:46:15.351257 run iperf3-srv_10.42.42.10(pid=24731): Launched 15:46:15.466488 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:46:15.672072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:16.025707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24732): Launched 15:46:16.349671 run iperf3-srv_10.42.42.10(pid=24733): Launched 15:46:16.479288 tst iperf3m4.py:8: start network... 15:46:16.691505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:17.186100 run create_hlr_db(pid=24734): Launched 15:46:17.327502 bus /gobi_6: Setting Powered False 15:46:18.388367 run create_hlr_db(pid=24734): Terminated: ok {rc=0} 15:46:18.821399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24736): Launched 15:46:19.134457 run osmo-hlr_10.42.42.2(pid=24737): Launched 15:46:19.251289 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:19.789082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24739): Launched 15:46:20.100726 run osmo-stp_10.42.42.5(pid=24740): Launched 15:46:20.218573 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:20.750982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24742): Launched 15:46:20.871360 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:21.135717 run patchelf(pid=24743): Launched 15:46:21.308347 run osmo-stp_10.42.42.5(pid=24740): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24740)] 15:46:21.438595 run osmo-stp_10.42.42.5(pid=24740): stdout: | (launched: 2022-12-12_15:46:20.040415) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:21.570214 run osmo-stp_10.42.42.5(pid=24740): stderr: | 20221212154620215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154620215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154620215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154620216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154620216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154620216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154620216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:21.701635 run osmo-stp_10.42.42.5(pid=24740): stdout: | (launched: 2022-12-12_15:46:20.040415) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:21.827287 run osmo-stp_10.42.42.5(pid=24740): stderr: | 20221212154620215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154620215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154620215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154620216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154620216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154620216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154620216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:21.976222 run patchelf(pid=24743): Terminating (SIGINT) 15:46:22.149358 run patchelf(pid=24743): Terminated: ok {rc=0} 15:46:22.273527 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24740): Process ended prematurely: osmo-stp_10.42.42.5(pid=24740) [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24740)] [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 15:46:22.282976 tst iperf3m4.py:8: Test FAILED (10.7 sec) 15:46:22.310363 run osmo-hlr_10.42.42.2(pid=24737): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24737)] 15:46:22.357986 run osmo-hlr_10.42.42.2(pid=24737): stdout: | (launched: 2022-12-12_15:46:19.073874) 15:46:22.407008 run osmo-hlr_10.42.42.2(pid=24737): stderr: | 20221212154619254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154619254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154619254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154619254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154619254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154619255 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154619267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154619276 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154619276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154619276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:22.456488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24726): Terminating (SIGTERM) 15:46:22.496151 run iperf3-srv_10.42.42.10(pid=24727): Terminating (SIGTERM) 15:46:22.535789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24728): Terminating (SIGTERM) 15:46:22.575435 run iperf3-srv_10.42.42.10(pid=24729): Terminating (SIGTERM) 15:46:22.614863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24730): Terminating (SIGTERM) 15:46:22.654844 run iperf3-srv_10.42.42.10(pid=24731): Terminating (SIGTERM) 15:46:22.694953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24732): Terminating (SIGTERM) 15:46:22.734560 run iperf3-srv_10.42.42.10(pid=24733): Terminating (SIGTERM) 15:46:22.773980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24736): Terminating (SIGTERM) 15:46:22.813593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24739): Terminating (SIGTERM) 15:46:22.853145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24742): Terminating (SIGTERM) 15:46:22.893511 --- ParallelTerminationStrategy: PID 24726 died... 15:46:22.912517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24726): Terminated: ok {rc=0} 15:46:22.956308 --- ParallelTerminationStrategy: PID 24727 died... 15:46:22.974848 run iperf3-srv_10.42.42.10(pid=24727): Terminated {rc=256} 15:46:23.018316 --- ParallelTerminationStrategy: PID 24728 died... 15:46:23.036815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24728): Terminated: ok {rc=0} 15:46:23.081190 --- ParallelTerminationStrategy: PID 24729 died... 15:46:23.099702 run iperf3-srv_10.42.42.10(pid=24729): Terminated {rc=256} 15:46:23.143481 --- ParallelTerminationStrategy: PID 24730 died... 15:46:23.161982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24730): Terminated: ok {rc=0} 15:46:23.206779 --- ParallelTerminationStrategy: PID 24731 died... 15:46:23.225252 run iperf3-srv_10.42.42.10(pid=24731): Terminated {rc=256} 15:46:23.268810 --- ParallelTerminationStrategy: PID 24732 died... 15:46:23.287892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24732): Terminated: ok {rc=0} 15:46:23.331977 --- ParallelTerminationStrategy: PID 24733 died... 15:46:23.350631 run iperf3-srv_10.42.42.10(pid=24733): Terminated {rc=256} 15:46:23.394157 --- ParallelTerminationStrategy: PID 24736 died... 15:46:23.412695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24736): Terminated: ok {rc=0} 15:46:23.456452 --- ParallelTerminationStrategy: PID 24739 died... 15:46:23.475079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24739): Terminated: ok {rc=0} 15:46:23.518797 --- ParallelTerminationStrategy: PID 24742 died... 15:46:23.537544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24742): Terminated: ok {rc=0} 15:46:23.623448 bus /gobi_4: Setting Powered False 15:46:24.724718 bus /gobi_4: Setting Powered False 15:46:25.840906 bus /gobi_1: Setting Powered False 15:46:26.939355 bus /gobi_1: Setting Powered False 15:46:28.055647 bus /gobi_0: Setting Powered False 15:46:29.154069 bus /gobi_0: Setting Powered False 15:46:30.271258 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 15:46:31.380609 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:31.394550 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:46:31.468341 tst ping.py: using LAC 29889 15:46:31.614339 tst ping.py: using RAC 54 15:46:31.762623 tst ping.py: using CellId 29889 15:46:31.922725 tst ping.py: using BVCI 29890 15:46:32.035123 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:32.046371 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:32.057688 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:32.068497 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:32.079311 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:32.090742 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:32.102475 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:32.114640 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:46:32.230701 tst ping.py:19: start network... 15:46:32.435379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:32.905558 run create_hlr_db(pid=24745): Launched 15:46:33.029485 bus /gobi_6: Setting Powered False 15:46:34.089974 run create_hlr_db(pid=24745): Terminated: ok {rc=0} 15:46:34.514281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24747): Launched 15:46:34.820113 run osmo-hlr_10.42.42.2(pid=24748): Launched 15:46:34.934438 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:35.463405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24750): Launched 15:46:35.768805 run osmo-stp_10.42.42.5(pid=24751): Launched 15:46:35.883508 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:36.407463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24753): Launched 15:46:36.523321 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:36.782750 run patchelf(pid=24754): Launched 15:46:36.950789 run osmo-stp_10.42.42.5(pid=24751): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24751)] 15:46:37.079506 run osmo-stp_10.42.42.5(pid=24751): stdout: | (launched: 2022-12-12_15:46:35.709634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:37.209479 run osmo-stp_10.42.42.5(pid=24751): stderr: | 20221212154635883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154635883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154635883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154635884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154635884 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154635884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154635884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:37.338793 run osmo-stp_10.42.42.5(pid=24751): stdout: | (launched: 2022-12-12_15:46:35.709634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:37.462464 run osmo-stp_10.42.42.5(pid=24751): stderr: | 20221212154635883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154635883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154635883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154635884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154635884 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154635884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154635884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:37.609163 run patchelf(pid=24754): Terminating (SIGINT) 15:46:37.778511 run patchelf(pid=24754): Terminated: ok {rc=0} 15:46:37.900677 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24751): Process ended prematurely: osmo-stp_10.42.42.5(pid=24751) [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24751)] [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 15:46:37.909854 tst ping.py:22: Test FAILED (6.5 sec) 15:46:37.936469 run osmo-hlr_10.42.42.2(pid=24748): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24748)] 15:46:37.984163 run osmo-hlr_10.42.42.2(pid=24748): stdout: | (launched: 2022-12-12_15:46:34.760423) 15:46:38.034697 run osmo-hlr_10.42.42.2(pid=24748): stderr: | 20221212154634938 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154634938 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154634938 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154634938 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154634938 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154634938 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154634950 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154634960 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154634961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154634961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:38.084481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24747): Terminating (SIGTERM) 15:46:38.124644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24750): Terminating (SIGTERM) 15:46:38.164774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24753): Terminating (SIGTERM) 15:46:38.205202 --- ParallelTerminationStrategy: PID 24747 died... 15:46:38.223992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24747): Terminated: ok {rc=0} 15:46:38.268305 --- ParallelTerminationStrategy: PID 24750 died... 15:46:38.287129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24750): Terminated: ok {rc=0} 15:46:38.331331 --- ParallelTerminationStrategy: PID 24753 died... 15:46:38.350109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24753): Terminated: ok {rc=0} 15:46:38.436402 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 15:46:39.526450 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:39.538593 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 15:46:39.595787 tst ping_idle_ping.py: using LAC 29890 15:46:39.715721 tst ping_idle_ping.py: using RAC 55 15:46:39.835617 tst ping_idle_ping.py: using CellId 29890 15:46:39.954637 tst ping_idle_ping.py: using BVCI 29891 15:46:40.063156 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:40.074294 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:40.085038 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:40.095753 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:40.106489 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:40.117193 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:40.128091 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 15:46:40.138770 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 15:46:40.255965 tst ping_idle_ping.py:24: start network... 15:46:40.477536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:40.985480 run create_hlr_db(pid=24755): Launched 15:46:41.110672 bus /gobi_6: Setting Powered False 15:46:42.175221 run create_hlr_db(pid=24755): Terminated: ok {rc=0} 15:46:42.630639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24757): Launched 15:46:42.959357 run osmo-hlr_10.42.42.2(pid=24758): Launched 15:46:43.084024 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:43.647280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24760): Launched 15:46:43.976090 run osmo-stp_10.42.42.5(pid=24761): Launched 15:46:44.100824 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:44.664326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24763): Launched 15:46:44.790159 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:45.067589 run patchelf(pid=24764): Launched 15:46:45.249885 run osmo-stp_10.42.42.5(pid=24761): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24761)] 15:46:45.387683 run osmo-stp_10.42.42.5(pid=24761): stdout: | (launched: 2022-12-12_15:46:43.913315) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:45.526964 run osmo-stp_10.42.42.5(pid=24761): stderr: | 20221212154644102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154644102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154644102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154644103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154644103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154644103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154644103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:45.666531 run osmo-stp_10.42.42.5(pid=24761): stdout: | (launched: 2022-12-12_15:46:43.913315) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:45.799128 run osmo-stp_10.42.42.5(pid=24761): stderr: | 20221212154644102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154644102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154644102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154644103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154644103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154644103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154644103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:45.955754 run patchelf(pid=24764): Terminating (SIGINT) 15:46:46.133190 run patchelf(pid=24764): Terminated: ok {rc=0} 15:46:46.259328 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24761): Process ended prematurely: osmo-stp_10.42.42.5(pid=24761) [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24761)] [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 15:46:46.269683 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 15:46:46.298150 run osmo-hlr_10.42.42.2(pid=24758): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24758)] 15:46:46.348079 run osmo-hlr_10.42.42.2(pid=24758): stdout: | (launched: 2022-12-12_15:46:42.896361) 15:46:46.400059 run osmo-hlr_10.42.42.2(pid=24758): stderr: | 20221212154643092 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154643092 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154643092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154643092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154643092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154643092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154643108 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154643116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154643117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154643117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:46.451749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24757): Terminating (SIGTERM) 15:46:46.493774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24760): Terminating (SIGTERM) 15:46:46.538052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24763): Terminating (SIGTERM) 15:46:46.593787 --- ParallelTerminationStrategy: PID 24757 died... 15:46:46.621913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24757): Terminated: ok {rc=0} 15:46:46.684462 --- ParallelTerminationStrategy: PID 24760 died... 15:46:46.711477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24760): Terminated: ok {rc=0} 15:46:46.761196 --- ParallelTerminationStrategy: PID 24763 died... 15:46:46.781156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24763): Terminated: ok {rc=0} 15:46:46.873881 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:46:48.172288 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:46:48.178191 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:46:48.198605 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 15:46:48.237856 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 15:46:48.328872 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:46:48.349388 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 15:46:48.386958 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 15:46:48.976098 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 15:46:49.030457 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:49.042078 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:46:49.100437 tst cs_paging_gprs_active.py: using LAC 29891 15:46:49.230945 tst cs_paging_gprs_active.py: using RAC 56 15:46:49.360493 tst cs_paging_gprs_active.py: using CellId 29891 15:46:49.490286 tst cs_paging_gprs_active.py: using BVCI 29892 15:46:49.609453 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:49.620848 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:49.631984 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:49.643367 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:49.654716 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:49.666054 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:49.677635 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:49.688866 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:46:49.700600 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:49.820163 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:46:49.940172 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:46:50.163623 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:50.498340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24768): Launched 15:46:50.791060 run iperf3-srv_10.42.42.10(pid=24769): Launched 15:46:50.916501 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:46:51.140027 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:46:51.475114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24770): Launched 15:46:51.767640 run iperf3-srv_10.42.42.10(pid=24771): Launched 15:46:51.893297 tst cs_paging_gprs_active.py:38: start network... 15:46:52.116049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:46:52.631082 run create_hlr_db(pid=24772): Launched 15:46:52.758164 bus /gobi_6: Setting Powered False 15:46:53.822354 run create_hlr_db(pid=24772): Terminated: ok {rc=0} 15:46:54.265159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24774): Launched 15:46:54.579241 run osmo-hlr_10.42.42.2(pid=24775): Launched 15:46:54.695907 run osmo-stp_10.42.42.5: Starting osmo-stp 15:46:55.230539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24777): Launched 15:46:55.542012 run osmo-stp_10.42.42.5(pid=24778): Launched 15:46:55.659217 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:46:56.193086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24780): Launched 15:46:56.311026 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:46:56.574304 run patchelf(pid=24781): Launched 15:46:56.745410 run osmo-stp_10.42.42.5(pid=24778): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24778)] 15:46:56.875548 run osmo-stp_10.42.42.5(pid=24778): stdout: | (launched: 2022-12-12_15:46:55.481932) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:57.007419 run osmo-stp_10.42.42.5(pid=24778): stderr: | 20221212154655656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154655657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154655657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154655657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154655658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154655658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154655658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:57.139728 run osmo-stp_10.42.42.5(pid=24778): stdout: | (launched: 2022-12-12_15:46:55.481932) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:46:57.266361 run osmo-stp_10.42.42.5(pid=24778): stderr: | 20221212154655656 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154655657 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154655657 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154655657 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154655658 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154655658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154655658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:46:57.414958 run patchelf(pid=24781): Terminating (SIGINT) 15:46:57.586766 run patchelf(pid=24781): Terminated: ok {rc=0} 15:46:57.711031 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24778): Process ended prematurely: osmo-stp_10.42.42.5(pid=24778) [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24778)] [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 15:46:57.720580 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 15:46:57.747361 run osmo-hlr_10.42.42.2(pid=24775): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24775)] 15:46:57.794198 run osmo-hlr_10.42.42.2(pid=24775): stdout: | (launched: 2022-12-12_15:46:54.518731) 15:46:57.842567 run osmo-hlr_10.42.42.2(pid=24775): stderr: | 20221212154654697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154654697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154654697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154654697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154654697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154654697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154654710 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154654718 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154654718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154654718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:46:57.891660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24768): Terminating (SIGTERM) 15:46:57.930789 run iperf3-srv_10.42.42.10(pid=24769): Terminating (SIGTERM) 15:46:57.969815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24770): Terminating (SIGTERM) 15:46:58.008871 run iperf3-srv_10.42.42.10(pid=24771): Terminating (SIGTERM) 15:46:58.047803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24774): Terminating (SIGTERM) 15:46:58.086917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24777): Terminating (SIGTERM) 15:46:58.126350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24780): Terminating (SIGTERM) 15:46:58.165544 --- ParallelTerminationStrategy: PID 24768 died... 15:46:58.184400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24768): Terminated: ok {rc=0} 15:46:58.227438 --- ParallelTerminationStrategy: PID 24769 died... 15:46:58.245417 run iperf3-srv_10.42.42.10(pid=24769): Terminated {rc=256} 15:46:58.288141 --- ParallelTerminationStrategy: PID 24770 died... 15:46:58.306250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24770): Terminated: ok {rc=0} 15:46:58.348932 --- ParallelTerminationStrategy: PID 24771 died... 15:46:58.367814 run iperf3-srv_10.42.42.10(pid=24771): Terminated {rc=256} 15:46:58.410912 --- ParallelTerminationStrategy: PID 24774 died... 15:46:58.429073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24774): Terminated: ok {rc=0} 15:46:58.471979 --- ParallelTerminationStrategy: PID 24777 died... 15:46:58.490288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24777): Terminated: ok {rc=0} 15:46:58.533169 --- ParallelTerminationStrategy: PID 24780 died... 15:46:58.551407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24780): Terminated: ok {rc=0} 15:46:58.636561 bus /gobi_0: Setting Powered False 15:46:59.734727 bus /gobi_0: Setting Powered False 15:47:00.848876 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 15:47:02.015837 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:02.028148 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:47:02.089152 tst iperf3.py: using LAC 29892 15:47:02.218011 tst iperf3.py: using RAC 57 15:47:02.353294 tst iperf3.py: using CellId 29892 15:47:02.482870 tst iperf3.py: using BVCI 29893 15:47:02.602817 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:02.614528 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:02.626002 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:02.638270 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:02.650302 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:02.662755 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:02.676902 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:02.687593 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:02.698729 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:47:02.813793 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:47:03.023863 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:47:03.339243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24782): Launched 15:47:03.612149 run iperf3-srv_10.42.42.10(pid=24783): Launched 15:47:03.727491 tst iperf3.py:8: start network... 15:47:03.932306 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:04.411172 run create_hlr_db(pid=24784): Launched 15:47:04.537783 bus /gobi_6: Setting Powered False 15:47:05.599162 run create_hlr_db(pid=24784): Terminated: ok {rc=0} 15:47:06.051538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24786): Launched 15:47:06.386053 run osmo-hlr_10.42.42.2(pid=24787): Launched 15:47:06.511786 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:07.083050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24789): Launched 15:47:07.418414 run osmo-stp_10.42.42.5(pid=24790): Launched 15:47:07.545850 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:47:08.118934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24792): Launched 15:47:08.247286 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:47:08.529492 run patchelf(pid=24793): Launched 15:47:08.713169 run osmo-stp_10.42.42.5(pid=24790): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24790)] 15:47:08.852144 run osmo-stp_10.42.42.5(pid=24790): stdout: | (launched: 2022-12-12_15:47:07.354902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:08.992361 run osmo-stp_10.42.42.5(pid=24790): stderr: | 20221212154707547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154707547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154707547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154707547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154707548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154707548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154707548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:09.132688 run osmo-stp_10.42.42.5(pid=24790): stdout: | (launched: 2022-12-12_15:47:07.354902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:09.267800 run osmo-stp_10.42.42.5(pid=24790): stderr: | 20221212154707547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154707547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154707547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154707547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154707548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154707548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154707548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:09.427248 run patchelf(pid=24793): Terminating (SIGINT) 15:47:09.611177 run patchelf(pid=24793): Terminated: ok {rc=0} 15:47:09.743879 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24790): Process ended prematurely: osmo-stp_10.42.42.5(pid=24790) [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24790)] [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 15:47:09.754363 tst iperf3.py:8: Test FAILED (7.8 sec) 15:47:09.783197 run osmo-hlr_10.42.42.2(pid=24787): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24787)] 15:47:09.833576 run osmo-hlr_10.42.42.2(pid=24787): stdout: | (launched: 2022-12-12_15:47:06.322711) 15:47:09.885360 run osmo-hlr_10.42.42.2(pid=24787): stderr: | 20221212154706520 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154706520 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154706520 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154706520 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154706520 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154706520 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154706532 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154706542 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154706542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154706542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:09.937973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24782): Terminating (SIGTERM) 15:47:09.980071 run iperf3-srv_10.42.42.10(pid=24783): Terminating (SIGTERM) 15:47:10.022149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24786): Terminating (SIGTERM) 15:47:10.064004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24789): Terminating (SIGTERM) 15:47:10.106083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24792): Terminating (SIGTERM) 15:47:10.148195 --- ParallelTerminationStrategy: PID 24782 died... 15:47:10.168490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24782): Terminated: ok {rc=0} 15:47:10.215350 --- ParallelTerminationStrategy: PID 24783 died... 15:47:10.234951 run iperf3-srv_10.42.42.10(pid=24783): Terminated {rc=256} 15:47:10.281197 --- ParallelTerminationStrategy: PID 24786 died... 15:47:10.300674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24786): Terminated: ok {rc=0} 15:47:10.347049 --- ParallelTerminationStrategy: PID 24789 died... 15:47:10.366488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24789): Terminated: ok {rc=0} 15:47:10.413012 --- ParallelTerminationStrategy: PID 24792 died... 15:47:10.432489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24792): Terminated: ok {rc=0} 15:47:10.521445 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 15:47:11.673452 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:11.685492 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:47:11.744330 tst iperf3m4.py: using LAC 29893 15:47:11.874216 tst iperf3m4.py: using RAC 58 15:47:12.003521 tst iperf3m4.py: using CellId 29893 15:47:12.131591 tst iperf3m4.py: using BVCI 29894 15:47:12.251580 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:12.263250 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:12.274669 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:12.286351 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:12.297966 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:12.309698 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:12.321436 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:12.333082 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:12.344629 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:47:12.466502 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:47:12.588522 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:47:12.707842 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:47:12.829127 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:47:13.051559 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:47:13.387214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24794): Launched 15:47:13.677711 run iperf3-srv_10.42.42.10(pid=24795): Launched 15:47:13.802520 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:47:14.024856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:47:14.367727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24796): Launched 15:47:14.639393 run iperf3-srv_10.42.42.10(pid=24797): Launched 15:47:14.754251 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:47:14.959151 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:47:15.270556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24798): Launched 15:47:15.542690 run iperf3-srv_10.42.42.10(pid=24799): Launched 15:47:15.659038 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:47:15.864552 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:47:16.208367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24800): Launched 15:47:16.517682 run iperf3-srv_10.42.42.10(pid=24801): Launched 15:47:16.648405 tst iperf3m4.py:8: start network... 15:47:16.860087 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:17.369442 run create_hlr_db(pid=24802): Launched 15:47:17.496755 bus /gobi_6: Setting Powered False 15:47:18.562059 run create_hlr_db(pid=24802): Terminated: ok {rc=0} 15:47:19.022496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24804): Launched 15:47:19.357790 run osmo-hlr_10.42.42.2(pid=24805): Launched 15:47:19.483688 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:20.053997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24807): Launched 15:47:20.389090 run osmo-stp_10.42.42.5(pid=24808): Launched 15:47:20.515269 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:47:21.086801 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24810): Launched 15:47:21.214531 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:47:21.496073 run patchelf(pid=24811): Launched 15:47:21.679086 run osmo-stp_10.42.42.5(pid=24808): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24808)] 15:47:21.818211 run osmo-stp_10.42.42.5(pid=24808): stdout: | (launched: 2022-12-12_15:47:20.325096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:21.959005 run osmo-stp_10.42.42.5(pid=24808): stderr: | 20221212154720516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154720516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154720517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154720517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154720517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154720518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154720518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:22.099758 run osmo-stp_10.42.42.5(pid=24808): stdout: | (launched: 2022-12-12_15:47:20.325096) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:22.234660 run osmo-stp_10.42.42.5(pid=24808): stderr: | 20221212154720516 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154720516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154720517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154720517 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154720517 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154720518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154720518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:22.394119 run patchelf(pid=24811): Terminating (SIGINT) 15:47:22.578194 run patchelf(pid=24811): Terminated: ok {rc=0} 15:47:22.710871 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24808): Process ended prematurely: osmo-stp_10.42.42.5(pid=24808) [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24808)] [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 15:47:22.721158 tst iperf3m4.py:8: Test FAILED (11.1 sec) 15:47:22.750654 run osmo-hlr_10.42.42.2(pid=24805): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24805)] 15:47:22.801502 run osmo-hlr_10.42.42.2(pid=24805): stdout: | (launched: 2022-12-12_15:47:19.294077) 15:47:22.853915 run osmo-hlr_10.42.42.2(pid=24805): stderr: | 20221212154719491 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154719491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154719491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154719491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154719491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154719491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154719504 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154719512 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154719513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154719513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:22.906759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24794): Terminating (SIGTERM) 15:47:22.949191 run iperf3-srv_10.42.42.10(pid=24795): Terminating (SIGTERM) 15:47:22.991486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24796): Terminating (SIGTERM) 15:47:23.033978 run iperf3-srv_10.42.42.10(pid=24797): Terminating (SIGTERM) 15:47:23.076322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24798): Terminating (SIGTERM) 15:47:23.118853 run iperf3-srv_10.42.42.10(pid=24799): Terminating (SIGTERM) 15:47:23.161349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24800): Terminating (SIGTERM) 15:47:23.203737 run iperf3-srv_10.42.42.10(pid=24801): Terminating (SIGTERM) 15:47:23.246121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24804): Terminating (SIGTERM) 15:47:23.288530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24807): Terminating (SIGTERM) 15:47:23.330769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24810): Terminating (SIGTERM) 15:47:23.373345 --- ParallelTerminationStrategy: PID 24794 died... 15:47:23.393540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24794): Terminated: ok {rc=0} 15:47:23.440703 --- ParallelTerminationStrategy: PID 24795 died... 15:47:23.460218 run iperf3-srv_10.42.42.10(pid=24795): Terminated {rc=256} 15:47:23.507490 --- ParallelTerminationStrategy: PID 24796 died... 15:47:23.527282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24796): Terminated: ok {rc=0} 15:47:23.574104 --- ParallelTerminationStrategy: PID 24797 died... 15:47:23.593652 run iperf3-srv_10.42.42.10(pid=24797): Terminated {rc=256} 15:47:23.640294 --- ParallelTerminationStrategy: PID 24798 died... 15:47:23.659841 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24798): Terminated: ok {rc=0} 15:47:23.706529 --- ParallelTerminationStrategy: PID 24799 died... 15:47:23.726043 run iperf3-srv_10.42.42.10(pid=24799): Terminated {rc=256} 15:47:23.772678 --- ParallelTerminationStrategy: PID 24800 died... 15:47:23.792271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24800): Terminated: ok {rc=0} 15:47:23.839000 --- ParallelTerminationStrategy: PID 24801 died... 15:47:23.858599 run iperf3-srv_10.42.42.10(pid=24801): Terminated {rc=256} 15:47:23.905272 --- ParallelTerminationStrategy: PID 24804 died... 15:47:23.925085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24804): Terminated: ok {rc=0} 15:47:23.972116 --- ParallelTerminationStrategy: PID 24807 died... 15:47:23.991873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24807): Terminated: ok {rc=0} 15:47:24.038910 --- ParallelTerminationStrategy: PID 24810 died... 15:47:24.058682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24810): Terminated: ok {rc=0} 15:47:24.148356 bus /gobi_4: Setting Powered False 15:47:25.248901 bus /gobi_4: Setting Powered False 15:47:26.367059 bus /gobi_1: Setting Powered False 15:47:27.466625 bus /gobi_1: Setting Powered False 15:47:28.584425 bus /gobi_0: Setting Powered False 15:47:29.682560 bus /gobi_0: Setting Powered False 15:47:30.801598 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 15:47:31.903700 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:31.916493 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:47:31.976115 tst ping.py: using LAC 29894 15:47:32.134143 tst ping.py: using RAC 59 15:47:32.254030 tst ping.py: using CellId 29894 15:47:32.375988 tst ping.py: using BVCI 29895 15:47:32.487310 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:32.498592 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:32.509641 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:32.520330 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:32.531234 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:32.542161 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:32.553090 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:32.564222 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:47:32.680158 tst ping.py:19: start network... 15:47:32.899895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:33.404584 run create_hlr_db(pid=24812): Launched 15:47:33.530327 bus /gobi_6: Setting Powered False 15:47:34.594334 run create_hlr_db(pid=24812): Terminated: ok {rc=0} 15:47:35.048132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24814): Launched 15:47:35.377237 run osmo-hlr_10.42.42.2(pid=24815): Launched 15:47:35.501069 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:36.061606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24817): Launched 15:47:36.389820 run osmo-stp_10.42.42.5(pid=24818): Launched 15:47:36.513621 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:47:37.074012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24820): Launched 15:47:37.199594 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:47:37.475890 run patchelf(pid=24821): Launched 15:47:37.657696 run osmo-stp_10.42.42.5(pid=24818): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24818)] 15:47:37.794628 run osmo-stp_10.42.42.5(pid=24818): stdout: | (launched: 2022-12-12_15:47:36.327116) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:37.932768 run osmo-stp_10.42.42.5(pid=24818): stderr: | 20221212154736517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154736517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154736517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154736518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154736518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154736518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154736518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:38.071450 run osmo-stp_10.42.42.5(pid=24818): stdout: | (launched: 2022-12-12_15:47:36.327116) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:38.203900 run osmo-stp_10.42.42.5(pid=24818): stderr: | 20221212154736517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154736517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154736517 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154736518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154736518 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154736518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154736518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:38.360884 run patchelf(pid=24821): Terminating (SIGINT) 15:47:38.540609 run patchelf(pid=24821): Terminated: ok {rc=0} 15:47:38.670473 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24818): Process ended prematurely: osmo-stp_10.42.42.5(pid=24818) [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24818)] [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 15:47:38.680161 tst ping.py:22: Test FAILED (6.8 sec) 15:47:38.708909 run osmo-hlr_10.42.42.2(pid=24815): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24815)] 15:47:38.759119 run osmo-hlr_10.42.42.2(pid=24815): stdout: | (launched: 2022-12-12_15:47:35.314668) 15:47:38.811093 run osmo-hlr_10.42.42.2(pid=24815): stderr: | 20221212154735510 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154735510 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154735510 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154735510 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154735510 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154735510 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154735523 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154735531 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154735532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154735532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:38.863580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24814): Terminating (SIGTERM) 15:47:38.905815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24817): Terminating (SIGTERM) 15:47:38.948036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24820): Terminating (SIGTERM) 15:47:38.990427 --- ParallelTerminationStrategy: PID 24814 died... 15:47:39.010548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24814): Terminated: ok {rc=0} 15:47:39.057379 --- ParallelTerminationStrategy: PID 24817 died... 15:47:39.076998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24817): Terminated: ok {rc=0} 15:47:39.123918 --- ParallelTerminationStrategy: PID 24820 died... 15:47:39.143679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24820): Terminated: ok {rc=0} 15:47:39.232316 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 15:47:40.319964 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:40.332206 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:47:40.392880 tst ping_idle_ping.py: using LAC 29895 15:47:40.521388 tst ping_idle_ping.py: using RAC 60 15:47:40.642485 tst ping_idle_ping.py: using CellId 29895 15:47:40.762642 tst ping_idle_ping.py: using BVCI 29896 15:47:40.883633 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:40.895211 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:40.906558 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:40.921637 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:40.933402 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:40.944733 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:40.956676 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 15:47:40.968632 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 15:47:41.088541 tst ping_idle_ping.py:24: start network... 15:47:41.308239 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:41.821576 run create_hlr_db(pid=24827): Launched 15:47:41.946933 bus /gobi_6: Setting Powered False 15:47:43.010855 run create_hlr_db(pid=24827): Terminated: ok {rc=0} 15:47:43.466164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24829): Launched 15:47:43.796422 run osmo-hlr_10.42.42.2(pid=24830): Launched 15:47:43.921902 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:44.484712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24832): Launched 15:47:44.813844 run osmo-stp_10.42.42.5(pid=24833): Launched 15:47:44.938633 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:47:45.502428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24835): Launched 15:47:45.629377 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:47:45.930015 run patchelf(pid=24836): Launched 15:47:46.114183 run osmo-stp_10.42.42.5(pid=24833): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24833)] 15:47:46.246467 run osmo-stp_10.42.42.5(pid=24833): stdout: | (launched: 2022-12-12_15:47:44.750993) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:46.381833 run osmo-stp_10.42.42.5(pid=24833): stderr: | 20221212154744942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154744942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154744943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154744943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154744943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154744944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154744944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:46.516316 run osmo-stp_10.42.42.5(pid=24833): stdout: | (launched: 2022-12-12_15:47:44.750993) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:46.645430 run osmo-stp_10.42.42.5(pid=24833): stderr: | 20221212154744942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154744942 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154744943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154744943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154744943 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154744944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154744944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:46.798269 run patchelf(pid=24836): Terminating (SIGINT) 15:47:46.974252 run patchelf(pid=24836): Terminated: ok {rc=0} 15:47:47.100471 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24833): Process ended prematurely: osmo-stp_10.42.42.5(pid=24833) [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24833)] [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 15:47:47.110378 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 15:47:47.138524 run osmo-hlr_10.42.42.2(pid=24830): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24830)] 15:47:47.187918 run osmo-hlr_10.42.42.2(pid=24830): stdout: | (launched: 2022-12-12_15:47:43.733528) 15:47:47.238268 run osmo-hlr_10.42.42.2(pid=24830): stderr: | 20221212154743930 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154743930 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154743930 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154743930 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154743930 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154743930 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154743942 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154743951 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154743951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154743951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:47.289528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24829): Terminating (SIGTERM) 15:47:47.329679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24832): Terminating (SIGTERM) 15:47:47.370465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24835): Terminating (SIGTERM) 15:47:47.410390 --- ParallelTerminationStrategy: PID 24829 died... 15:47:47.429520 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24829): Terminated: ok {rc=0} 15:47:47.473441 --- ParallelTerminationStrategy: PID 24832 died... 15:47:47.491887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24832): Terminated: ok {rc=0} 15:47:47.536000 --- ParallelTerminationStrategy: PID 24835 died... 15:47:47.554716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24835): Terminated: ok {rc=0} 15:47:47.641869 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2378 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:47:48.929983 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:47:48.937084 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:47:48.957916 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 15:47:48.992068 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:47:49.044917 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:47:49.065435 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 15:47:49.099641 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:47:49.657347 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2378 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 15:47:49.662426 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:47:49.674254 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:47:49.729774 tst switch_tch_pdch.py: using LAC 29896 15:47:49.850463 tst switch_tch_pdch.py: using RAC 61 15:47:49.971322 tst switch_tch_pdch.py: using CellId 29896 15:47:50.089206 tst switch_tch_pdch.py: using BVCI 29897 15:47:50.198155 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:47:50.209501 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:47:50.220374 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:47:50.231345 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:47:50.242151 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:47:50.253077 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:47:50.264156 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 15:47:50.275067 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:47:50.394804 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:47:50.512176 tst switch_tch_pdch.py:51: start network... 15:47:50.715504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:47:51.188125 run create_hlr_db(pid=24840): Launched 15:47:51.313483 bus /gobi_6: Setting Powered False 15:47:52.374332 run create_hlr_db(pid=24840): Terminated: ok {rc=0} 15:47:52.820708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24842): Launched 15:47:53.148246 run osmo-hlr_10.42.42.2(pid=24843): Launched 15:47:53.272726 run osmo-stp_10.42.42.5: Starting osmo-stp 15:47:53.834664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24845): Launched 15:47:54.161682 run osmo-stp_10.42.42.5(pid=24846): Launched 15:47:54.285857 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:47:54.845219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24848): Launched 15:47:54.970036 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:47:55.246586 run patchelf(pid=24849): Launched 15:47:55.427348 run osmo-stp_10.42.42.5(pid=24846): ERR: Terminated: ERROR {rc=1} [trial-2378↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24846)] 15:47:55.564070 run osmo-stp_10.42.42.5(pid=24846): stdout: | (launched: 2022-12-12_15:47:54.099310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:55.702962 run osmo-stp_10.42.42.5(pid=24846): stderr: | 20221212154754289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154754289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154754289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154754290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154754290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154754290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154754290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:55.841207 run osmo-stp_10.42.42.5(pid=24846): stdout: | (launched: 2022-12-12_15:47:54.099310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:47:55.973087 run osmo-stp_10.42.42.5(pid=24846): stderr: | 20221212154754289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154754289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154754289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154754290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154754290 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154754290 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154754290 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:47:56.129754 run patchelf(pid=24849): Terminating (SIGINT) 15:47:56.310874 run patchelf(pid=24849): Terminated: ok {rc=0} 15:47:56.441167 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24846): Process ended prematurely: osmo-stp_10.42.42.5(pid=24846) [trial-2378↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24846)] [trial-2378↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 15:47:56.450688 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 15:47:56.479164 run osmo-hlr_10.42.42.2(pid=24843): ERR: Terminated: ERROR {rc=237} [trial-2378↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24843)] 15:47:56.529323 run osmo-hlr_10.42.42.2(pid=24843): stdout: | (launched: 2022-12-12_15:47:53.085846) 15:47:56.581413 run osmo-hlr_10.42.42.2(pid=24843): stderr: | 20221212154753282 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154753282 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154753282 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154753282 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154753282 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154753282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154753294 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154753303 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154753303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154753303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:47:56.633833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24842): Terminating (SIGTERM) 15:47:56.675863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24845): Terminating (SIGTERM) 15:47:56.718798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24848): Terminating (SIGTERM) 15:47:56.761112 --- ParallelTerminationStrategy: PID 24842 died... 15:47:56.781231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24842): Terminated: ok {rc=0} 15:47:56.827758 --- ParallelTerminationStrategy: PID 24845 died... 15:47:56.847300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24845): Terminated: ok {rc=0} 15:47:56.893831 --- ParallelTerminationStrategy: PID 24848 died... 15:47:56.913452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24848): Terminated: ok {rc=0} 15:47:57.002239 bus /gobi_0: Setting Powered False 15:47:58.101465 bus /gobi_0: Setting Powered False 15:47:59.219612 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2378 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 15:48:00.455286 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:00.461434 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 15:48:00.481824 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 15:48:00.516238 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 15:48:00.569511 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 15:48:00.589882 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 15:48:00.623731 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 15:48:01.209840 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2378 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 15:48:01.219336 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:48:01.234161 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 15:48:01.309798 tst switch_tch_pdch.py: using LAC 29897 15:48:01.442427 tst switch_tch_pdch.py: using RAC 62 15:48:01.564753 tst switch_tch_pdch.py: using CellId 29897 15:48:01.702721 tst switch_tch_pdch.py: using BVCI 29898 15:48:01.838136 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:48:01.851040 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:48:01.863786 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:48:01.877455 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:48:01.892205 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:48:01.905941 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:48:01.918821 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 15:48:01.933580 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 15:48:02.057410 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 15:48:02.199251 tst switch_tch_pdch.py:51: start network... 15:48:02.421398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:02.899450 run create_hlr_db(pid=24853): Launched 15:48:03.025842 bus /gobi_6: Setting Powered False 15:48:04.089833 run create_hlr_db(pid=24853): Terminated: ok {rc=0} 15:48:04.501557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24855): Launched 15:48:04.809239 run osmo-hlr_10.42.42.2(pid=24856): Launched 15:48:04.924922 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:05.433469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24858): Launched 15:48:05.739936 run osmo-stp_10.42.42.5(pid=24859): Launched 15:48:05.854693 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:48:06.352106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24861): Launched 15:48:06.466927 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:48:06.725299 run patchelf(pid=24862): Launched 15:48:06.892562 run osmo-stp_10.42.42.5(pid=24859): ERR: Terminated: ERROR {rc=1} [trial-2378↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24859)] 15:48:07.020049 run osmo-stp_10.42.42.5(pid=24859): stdout: | (launched: 2022-12-12_15:48:05.680844) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:07.149376 run osmo-stp_10.42.42.5(pid=24859): stderr: | 20221212154805856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154805856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154805856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154805858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154805858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154805858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154805858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:07.278472 run osmo-stp_10.42.42.5(pid=24859): stdout: | (launched: 2022-12-12_15:48:05.680844) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:07.401322 run osmo-stp_10.42.42.5(pid=24859): stderr: | 20221212154805856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154805856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154805856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154805858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154805858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154805858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154805858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:07.547301 run patchelf(pid=24862): Terminating (SIGINT) 15:48:07.716257 run patchelf(pid=24862): Terminated: ok {rc=0} 15:48:07.838121 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24859): Process ended prematurely: osmo-stp_10.42.42.5(pid=24859) [trial-2378↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24859)] [trial-2378↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 15:48:07.847133 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 15:48:07.873447 run osmo-hlr_10.42.42.2(pid=24856): ERR: Terminated: ERROR {rc=237} [trial-2378↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24856)] 15:48:07.920529 run osmo-hlr_10.42.42.2(pid=24856): stdout: | (launched: 2022-12-12_15:48:04.750035) 15:48:07.969539 run osmo-hlr_10.42.42.2(pid=24856): stderr: | 20221212154804928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154804928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154804928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154804928 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154804928 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154804928 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154804940 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154804949 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154804949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154804949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:08.018969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24855): Terminating (SIGTERM) 15:48:08.058677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24858): Terminating (SIGTERM) 15:48:08.098113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24861): Terminating (SIGTERM) 15:48:08.137731 --- ParallelTerminationStrategy: PID 24855 died... 15:48:08.156519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24855): Terminated: ok {rc=0} 15:48:08.199998 --- ParallelTerminationStrategy: PID 24858 died... 15:48:08.218447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24858): Terminated: ok {rc=0} 15:48:08.261668 --- ParallelTerminationStrategy: PID 24861 died... 15:48:08.280039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24861): Terminated: ok {rc=0} 15:48:08.365870 bus /gobi_0: Setting Powered False 15:48:09.465613 bus /gobi_0: Setting Powered False 15:48:10.580430 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2378 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 nitb_sms:trx-b200 --------------------------------------------------------------------- 15:48:11.817356 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:11.821231 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 15:48:11.853918 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 15:48:11.860592 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 15:48:11.911468 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 15:48:11.943968 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 15:48:11.950670 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 15:48:12.492858 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 15:48:12.497858 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 15:48:12.508579 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 15:48:12.557081 tst mo_mt_sms.py: using LAC 29898 15:48:12.674162 tst mo_mt_sms.py: using RAC 63 15:48:12.790281 tst mo_mt_sms.py: using CellId 29898 15:48:12.916228 tst mo_mt_sms.py: using BVCI 29899 15:48:13.034818 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 15:48:13.155130 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 15:48:13.274759 tst mo_mt_sms.py:9: start nitb and bts... 15:48:13.478657 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:48:14.099632 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24866): Launched 15:48:14.405544 run osmo-nitb_10.42.42.2(pid=24867): Launched 15:48:14.572768 run osmo-nitb_10.42.42.2(pid=24867): ERR: Terminated: ERROR {rc=2} [trial-2378↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24867)] 15:48:14.709050 run osmo-nitb_10.42.42.2(pid=24867): stdout: | (launched: 2022-12-12_15:48:14.346378) 15:48:14.848415 run osmo-nitb_10.42.42.2(pid=24867): stderr: | (launched: 2022-12-12_15:48:14.391261) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:48:14.986408 run osmo-nitb_10.42.42.2(pid=24867): stdout: | (launched: 2022-12-12_15:48:14.346378) 15:48:15.117571 run osmo-nitb_10.42.42.2(pid=24867): stderr: | (launched: 2022-12-12_15:48:14.391261) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24867): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24867) [trial-2378↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24867)] 15:48:15.519503 tst osmo-nitb_10.42.42.2(pid=24867): stdout: | (launched: 2022-12-12_15:48:14.346378) 15:48:15.641436 tst osmo-nitb_10.42.42.2(pid=24867): stderr: | (launched: 2022-12-12_15:48:14.391261) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:48:15.785751 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=24867): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24867) [trial-2378↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24867)] [trial-2378↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 15:48:15.794282 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 15:48:15.800867 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24866): Terminating (SIGTERM) 15:48:16.008912 --- ParallelTerminationStrategy: PID 24866 died... 15:48:16.036149 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24866): Terminated: ok {rc=0} 15:48:16.144246 bus /sierra_3: Setting Powered False 15:48:17.256295 bus /sierra_3: Setting Powered False 15:48:18.373724 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 sms:trx-b200 --------------------------------------------------------------------- 15:48:19.571508 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:19.576344 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 15:48:19.610820 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 15:48:19.638120 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 15:48:19.696641 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 15:48:19.730599 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 15:48:19.757762 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 15:48:20.299279 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 15:48:20.304576 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:48:20.315700 tst sms:trx-b200: Using 1 x bts (candidates: 1) 15:48:20.364638 tst mo_mt_sms.py: using LAC 29899 15:48:20.492519 tst mo_mt_sms.py: using RAC 64 15:48:20.622299 tst mo_mt_sms.py: using CellId 29899 15:48:20.750153 tst mo_mt_sms.py: using BVCI 29900 15:48:20.868558 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:48:20.879677 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:48:20.890671 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:48:20.901837 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:48:20.912835 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 15:48:20.923893 tst sms:trx-b200: Using 1 x modem (candidates: 2) 15:48:21.043237 tst sms:trx-b200: Using 1 x modem (candidates: 2) 15:48:21.159144 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:21.630835 run create_hlr_db(pid=24871): Launched 15:48:21.756775 bus /sierra_2: Setting Powered False 15:48:22.817688 run create_hlr_db(pid=24871): Terminated: ok {rc=0} 15:48:23.264081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24873): Launched 15:48:23.592194 run osmo-hlr_10.42.42.2(pid=24874): Launched 15:48:23.715951 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:24.277447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24876): Launched 15:48:24.604569 run osmo-stp_10.42.42.5(pid=24877): Launched 15:48:24.728525 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:25.316941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24879): Launched 15:48:25.642643 run osmo-msc_10.42.42.6(pid=24880): Launched 15:48:25.825434 run osmo-stp_10.42.42.5(pid=24877): ERR: Terminated: ERROR {rc=1} [trial-2378↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24877)] 15:48:25.962723 run osmo-stp_10.42.42.5(pid=24877): stdout: | (launched: 2022-12-12_15:48:24.542011) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:26.099635 run osmo-stp_10.42.42.5(pid=24877): stderr: | 20221212154824731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154824731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154824732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154824732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154824733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154824733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154824733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:26.235777 run osmo-stp_10.42.42.5(pid=24877): stdout: | (launched: 2022-12-12_15:48:24.542011) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:26.364438 run osmo-stp_10.42.42.5(pid=24877): stderr: | 20221212154824731 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154824731 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154824732 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154824732 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154824733 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154824733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154824733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:26.518452 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=24877): Process ended prematurely: osmo-stp_10.42.42.5(pid=24877) [trial-2378↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24877)] [trial-2378↪sms:trx-b200↪mo_mt_sms.py:16] 15:48:26.527711 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 15:48:26.555247 run osmo-hlr_10.42.42.2(pid=24874): ERR: Terminated: ERROR {rc=237} [trial-2378↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24874)] 15:48:26.605760 run osmo-hlr_10.42.42.2(pid=24874): stdout: | (launched: 2022-12-12_15:48:23.529900) 15:48:26.657531 run osmo-hlr_10.42.42.2(pid=24874): stderr: | 20221212154823725 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154823725 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154823725 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154823725 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154823725 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154823725 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154823736 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154823746 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154823746 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154823746 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:26.729549 run osmo-msc_10.42.42.6(pid=24880): ERR: Terminated: ERROR {rc=2} [trial-2378↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24880)] 15:48:26.779429 run osmo-msc_10.42.42.6(pid=24880): stdout: | (launched: 2022-12-12_15:48:25.580141) 15:48:26.831159 run osmo-msc_10.42.42.6(pid=24880): stderr: | 20221212154825901 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154825901 DLGLOBAL DEBUG validating counter group 0x7fa815b07c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154825901 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154825901 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154825902 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154825902 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154825903 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154825904 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154825904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154825904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:26.883224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24873): Terminating (SIGTERM) 15:48:26.925287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24876): Terminating (SIGTERM) 15:48:26.967434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24879): Terminating (SIGTERM) 15:48:27.009819 --- ParallelTerminationStrategy: PID 24873 died... 15:48:27.030007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24873): Terminated: ok {rc=0} 15:48:27.077056 --- ParallelTerminationStrategy: PID 24876 died... 15:48:27.096715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24876): Terminated: ok {rc=0} 15:48:27.143546 --- ParallelTerminationStrategy: PID 24879 died... 15:48:27.163320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24879): Terminated: ok {rc=0} 15:48:27.252740 bus /sierra_3: Setting Powered False 15:48:28.352040 bus /sierra_3: Setting Powered False 15:48:29.469777 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 nitb_ussd:trx-b200 --------------------------------------------------------------------- 15:48:30.699454 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:30.703157 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 15:48:30.736032 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 15:48:30.742747 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 15:48:30.777811 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 15:48:30.810887 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 15:48:30.817577 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 15:48:31.345795 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2378 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 15:48:31.351488 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 15:48:31.372397 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 15:48:31.423067 tst assert_extension.py: using LAC 29900 15:48:31.543552 tst assert_extension.py: using RAC 65 15:48:31.694929 tst assert_extension.py: using CellId 29900 15:48:31.860346 tst assert_extension.py: using BVCI 29901 15:48:31.986524 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 15:48:32.136723 tst assert_extension.py:10: start nitb and bts... 15:48:32.356791 run osmo-nitb_10.42.42.2: Starting osmo-nitb 15:48:32.977319 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24886): Launched 15:48:33.282760 run osmo-nitb_10.42.42.2(pid=24887): Launched 15:48:33.451710 run osmo-nitb_10.42.42.2(pid=24887): ERR: Terminated: ERROR {rc=2} [trial-2378↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24887)] 15:48:33.587608 run osmo-nitb_10.42.42.2(pid=24887): stdout: | (launched: 2022-12-12_15:48:33.223749) 15:48:33.724842 run osmo-nitb_10.42.42.2(pid=24887): stderr: | (launched: 2022-12-12_15:48:33.268343) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:48:33.862387 run osmo-nitb_10.42.42.2(pid=24887): stdout: | (launched: 2022-12-12_15:48:33.223749) 15:48:33.994551 run osmo-nitb_10.42.42.2(pid=24887): stderr: | (launched: 2022-12-12_15:48:33.268343) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24887): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24887) [trial-2378↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24887)] 15:48:34.398279 tst osmo-nitb_10.42.42.2(pid=24887): stdout: | (launched: 2022-12-12_15:48:33.223749) 15:48:34.519727 tst osmo-nitb_10.42.42.2(pid=24887): stderr: | (launched: 2022-12-12_15:48:33.268343) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 15:48:34.662677 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=24887): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24887) [trial-2378↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24887)] [trial-2378↪nitb_ussd:trx-b200↪assert_extension.py:12] 15:48:34.670955 tst assert_extension.py:12: Test FAILED (3.3 sec) 15:48:34.677507 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24886): Terminating (SIGTERM) 15:48:34.885764 --- ParallelTerminationStrategy: PID 24886 died... 15:48:34.906636 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24886): Terminated: ok {rc=0} 15:48:34.991386 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 ussd:trx-b200 --------------------------------------------------------------------- 15:48:36.170431 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:36.174551 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 15:48:36.207825 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 15:48:36.234528 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 15:48:36.272100 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 15:48:36.306944 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 15:48:36.334467 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 15:48:36.857010 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2378 ussd:trx-b200 assert_extension.py ---------------------------------------------- 15:48:36.862194 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:48:36.872835 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 15:48:36.923193 tst assert_extension.py: using LAC 29901 15:48:37.040494 tst assert_extension.py: using RAC 66 15:48:37.157037 tst assert_extension.py: using CellId 29901 15:48:37.273168 tst assert_extension.py: using BVCI 29902 15:48:37.381713 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:48:37.392238 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:48:37.402692 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:48:37.413085 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:48:37.423571 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 15:48:37.433955 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 15:48:37.550383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:38.054912 run create_hlr_db(pid=24891): Launched 15:48:38.179348 bus /sierra_2: Setting Powered False 15:48:39.243062 run create_hlr_db(pid=24891): Terminated: ok {rc=0} 15:48:39.678688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24893): Launched 15:48:39.984029 run osmo-hlr_10.42.42.2(pid=24894): Launched 15:48:40.098309 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:40.621683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24896): Launched 15:48:40.927549 run osmo-stp_10.42.42.5(pid=24897): Launched 15:48:41.044373 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:41.591514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24899): Launched 15:48:41.896714 run osmo-msc_10.42.42.6(pid=24900): Launched 15:48:42.065308 run osmo-stp_10.42.42.5(pid=24897): ERR: Terminated: ERROR {rc=1} [trial-2378↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24897)] 15:48:42.193088 run osmo-stp_10.42.42.5(pid=24897): stdout: | (launched: 2022-12-12_15:48:40.868103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:42.321314 run osmo-stp_10.42.42.5(pid=24897): stderr: | 20221212154841040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154841041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154841041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154841041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154841042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154841042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154841042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:42.447241 run osmo-stp_10.42.42.5(pid=24897): stdout: | (launched: 2022-12-12_15:48:40.868103) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:42.567254 run osmo-stp_10.42.42.5(pid=24897): stderr: | 20221212154841040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154841041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154841041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154841041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154841042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154841042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154841042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:42.711152 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24897): Process ended prematurely: osmo-stp_10.42.42.5(pid=24897) [trial-2378↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24897)] [trial-2378↪ussd:trx-b200↪assert_extension.py:17] 15:48:42.719623 tst assert_extension.py:17: Test FAILED (5.9 sec) 15:48:42.745987 run osmo-hlr_10.42.42.2(pid=24894): ERR: Terminated: ERROR {rc=237} [trial-2378↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24894)] 15:48:42.794653 run osmo-hlr_10.42.42.2(pid=24894): stdout: | (launched: 2022-12-12_15:48:39.924435) 15:48:42.844671 run osmo-hlr_10.42.42.2(pid=24894): stderr: | 20221212154840100 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154840100 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154840100 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154840100 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154840100 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154840100 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154840112 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154840120 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154840120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154840121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:42.914258 run osmo-msc_10.42.42.6(pid=24900): ERR: Terminated: ERROR {rc=2} [trial-2378↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24900)] 15:48:42.962082 run osmo-msc_10.42.42.6(pid=24900): stdout: | (launched: 2022-12-12_15:48:41.837224) 15:48:43.011736 run osmo-msc_10.42.42.6(pid=24900): stderr: | 20221212154842108 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154842109 DLGLOBAL DEBUG validating counter group 0x7fdce3312c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154842109 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154842109 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154842109 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154842109 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154842111 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154842111 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154842111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154842112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:43.061951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24893): Terminating (SIGTERM) 15:48:43.102018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24896): Terminating (SIGTERM) 15:48:43.142253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24899): Terminating (SIGTERM) 15:48:43.182641 --- ParallelTerminationStrategy: PID 24893 died... 15:48:43.202106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24893): Terminated: ok {rc=0} 15:48:43.246740 --- ParallelTerminationStrategy: PID 24896 died... 15:48:43.265448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24896): Terminated: ok {rc=0} 15:48:43.309766 --- ParallelTerminationStrategy: PID 24899 died... 15:48:43.328513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24899): Terminated: ok {rc=0} 15:48:43.412287 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 15:48:44.628000 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:48:44.635537 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 15:48:44.668539 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 15:48:44.695028 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 15:48:44.747805 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 15:48:44.781508 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 15:48:44.807707 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 15:48:45.355771 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 15:48:45.405828 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:45.417125 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:48:45.486053 tst mo_mt_call.py: using LAC 29902 15:48:45.606793 tst mo_mt_call.py: using RAC 67 15:48:45.729047 tst mo_mt_call.py: using CellId 29902 15:48:45.850417 tst mo_mt_call.py: using BVCI 29903 15:48:45.965748 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:45.977464 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:45.989147 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:46.002876 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:46.015012 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:46.026660 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:48:46.148018 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:48:46.278137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:46.823849 run create_hlr_db(pid=24905): Launched 15:48:46.986981 bus /sierra_2: Setting Powered False 15:48:48.049048 run create_hlr_db(pid=24905): Terminated: ok {rc=0} 15:48:48.501939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24907): Launched 15:48:48.836880 run osmo-hlr_10.42.42.2(pid=24908): Launched 15:48:48.962902 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:49.529481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24910): Launched 15:48:49.862437 run osmo-stp_10.42.42.5(pid=24911): Launched 15:48:49.989660 run osmo-msc_10.42.42.6: Starting osmo-msc 15:48:50.592050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24913): Launched 15:48:50.927044 run osmo-msc_10.42.42.6(pid=24914): Launched 15:48:51.111096 run osmo-stp_10.42.42.5(pid=24911): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24911)] 15:48:51.253612 run osmo-stp_10.42.42.5(pid=24911): stdout: | (launched: 2022-12-12_15:48:49.799048) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:51.390642 run osmo-stp_10.42.42.5(pid=24911): stderr: | 20221212154849995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154849995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154849995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154849995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154849996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154849996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154849996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:51.528198 run osmo-stp_10.42.42.5(pid=24911): stdout: | (launched: 2022-12-12_15:48:49.799048) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:48:51.659005 run osmo-stp_10.42.42.5(pid=24911): stderr: | 20221212154849995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154849995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154849995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154849995 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154849996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154849996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154849996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:48:51.815700 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24911): Process ended prematurely: osmo-stp_10.42.42.5(pid=24911) [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24911)] [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 15:48:51.825433 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 15:48:51.853724 run osmo-hlr_10.42.42.2(pid=24908): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24908)] 15:48:51.904228 run osmo-hlr_10.42.42.2(pid=24908): stdout: | (launched: 2022-12-12_15:48:48.773582) 15:48:51.956180 run osmo-hlr_10.42.42.2(pid=24908): stderr: | 20221212154848972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154848972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154848972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154848972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154848972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154848973 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154848984 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154848993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154848994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154848994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:48:52.028411 run osmo-msc_10.42.42.6(pid=24914): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24914)] 15:48:52.078958 run osmo-msc_10.42.42.6(pid=24914): stdout: | (launched: 2022-12-12_15:48:50.863268) 15:48:52.130973 run osmo-msc_10.42.42.6(pid=24914): stderr: | 20221212154851190 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154851190 DLGLOBAL DEBUG validating counter group 0x7f803f8d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154851190 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154851190 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154851190 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154851190 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154851192 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154851192 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154851193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154851193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:48:52.183310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24907): Terminating (SIGTERM) 15:48:52.225608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24910): Terminating (SIGTERM) 15:48:52.267563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24913): Terminating (SIGTERM) 15:48:52.309722 --- ParallelTerminationStrategy: PID 24907 died... 15:48:52.329605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24907): Terminated: ok {rc=0} 15:48:52.376396 --- ParallelTerminationStrategy: PID 24910 died... 15:48:52.395870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24910): Terminated: ok {rc=0} 15:48:52.443188 --- ParallelTerminationStrategy: PID 24913 died... 15:48:52.462805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24913): Terminated: ok {rc=0} 15:48:52.552466 bus /sierra_3: Setting Powered False 15:48:53.650667 bus /sierra_3: Setting Powered False 15:48:54.767483 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 15:48:55.914897 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:55.926887 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 15:48:55.996940 tst mo_mt_call_osmux.py: using LAC 29903 15:48:56.120926 tst mo_mt_call_osmux.py: using RAC 68 15:48:56.243899 tst mo_mt_call_osmux.py: using CellId 29903 15:48:56.366536 tst mo_mt_call_osmux.py: using BVCI 29904 15:48:56.479671 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:56.490870 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:56.501811 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:56.512787 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:56.523972 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 15:48:56.534982 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:48:56.650627 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 15:48:56.770234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:48:57.287018 run create_hlr_db(pid=24916): Launched 15:48:57.414835 bus /sierra_2: Setting Powered False 15:48:58.479214 run create_hlr_db(pid=24916): Terminated: ok {rc=0} 15:48:58.923277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24918): Launched 15:48:59.235529 run osmo-hlr_10.42.42.2(pid=24919): Launched 15:48:59.354284 run osmo-stp_10.42.42.5: Starting osmo-stp 15:48:59.900151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24921): Launched 15:49:00.235136 run osmo-stp_10.42.42.5(pid=24922): Launched 15:49:00.361970 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:00.982538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24924): Launched 15:49:01.341664 run osmo-msc_10.42.42.6(pid=24925): Launched 15:49:01.816128 run osmo-stp_10.42.42.5(pid=24922): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24922)] 15:49:02.132278 run osmo-stp_10.42.42.5(pid=24922): stdout: | (launched: 2022-12-12_15:49:00.171201) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:02.347041 run osmo-stp_10.42.42.5(pid=24922): stderr: | 20221212154900362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154900362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154900362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154900364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154900364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154900364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154900365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:02.500184 run osmo-stp_10.42.42.5(pid=24922): stdout: | (launched: 2022-12-12_15:49:00.171201) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:02.631379 run osmo-stp_10.42.42.5(pid=24922): stderr: | 20221212154900362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154900362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154900362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154900364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154900364 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154900364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154900365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:02.788215 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24922): Process ended prematurely: osmo-stp_10.42.42.5(pid=24922) [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24922)] [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 15:49:02.798268 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 15:49:02.826720 run osmo-hlr_10.42.42.2(pid=24919): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24919)] 15:49:02.878369 run osmo-hlr_10.42.42.2(pid=24919): stdout: | (launched: 2022-12-12_15:48:59.175778) 15:49:02.931087 run osmo-hlr_10.42.42.2(pid=24919): stderr: | 20221212154859351 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154859351 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154859352 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154859352 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154859352 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154859352 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154859365 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154859375 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154859375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154859375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:03.004446 run osmo-msc_10.42.42.6(pid=24925): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24925)] 15:49:03.055180 run osmo-msc_10.42.42.6(pid=24925): stdout: | (launched: 2022-12-12_15:49:01.274994) 15:49:03.107741 run osmo-msc_10.42.42.6(pid=24925): stderr: | 20221212154901797 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154901797 DLGLOBAL DEBUG validating counter group 0x7fc58c114c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154901798 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154901798 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154901798 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154901799 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154901806 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154901806 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154901806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154901806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:03.160509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24918): Terminating (SIGTERM) 15:49:03.203206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24921): Terminating (SIGTERM) 15:49:03.246427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24924): Terminating (SIGTERM) 15:49:03.289619 --- ParallelTerminationStrategy: PID 24918 died... 15:49:03.309713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24918): Terminated: ok {rc=0} 15:49:03.357353 --- ParallelTerminationStrategy: PID 24921 died... 15:49:03.377302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24921): Terminated: ok {rc=0} 15:49:03.424617 --- ParallelTerminationStrategy: PID 24924 died... 15:49:03.444510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24924): Terminated: ok {rc=0} 15:49:03.534336 bus /sierra_3: Setting Powered False 15:49:04.634108 bus /sierra_3: Setting Powered False 15:49:05.752645 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 15:49:07.007344 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:49:07.013926 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 15:49:07.047249 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 15:49:07.073771 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 15:49:07.126472 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 15:49:07.162242 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 15:49:07.189980 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 15:49:07.734051 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 15:49:07.782790 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:07.793920 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:49:07.861160 tst mo_mt_call.py: using LAC 29904 15:49:07.979754 tst mo_mt_call.py: using RAC 69 15:49:08.098726 tst mo_mt_call.py: using CellId 29904 15:49:08.220064 tst mo_mt_call.py: using BVCI 29905 15:49:08.331014 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:08.342181 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:08.353308 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:08.364133 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:08.375092 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:08.386039 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:49:08.503749 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:49:08.619458 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:09.097703 run create_hlr_db(pid=24930): Launched 15:49:09.223213 bus /sierra_2: Setting Powered False 15:49:10.283755 run create_hlr_db(pid=24930): Terminated: ok {rc=0} 15:49:10.735855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24932): Launched 15:49:11.070146 run osmo-hlr_10.42.42.2(pid=24933): Launched 15:49:11.195353 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:11.768536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24935): Launched 15:49:12.101481 run osmo-stp_10.42.42.5(pid=24936): Launched 15:49:12.227850 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:12.826180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24938): Launched 15:49:13.159787 run osmo-msc_10.42.42.6(pid=24939): Launched 15:49:13.342869 run osmo-stp_10.42.42.5(pid=24936): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24936)] 15:49:13.481916 run osmo-stp_10.42.42.5(pid=24936): stdout: | (launched: 2022-12-12_15:49:12.037773) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:13.621662 run osmo-stp_10.42.42.5(pid=24936): stderr: | 20221212154912230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154912231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154912231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154912231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154912232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154912232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154912232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:13.759489 run osmo-stp_10.42.42.5(pid=24936): stdout: | (launched: 2022-12-12_15:49:12.037773) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:13.890577 run osmo-stp_10.42.42.5(pid=24936): stderr: | 20221212154912230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154912231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154912231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154912231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154912232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154912232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154912232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:14.047450 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24936): Process ended prematurely: osmo-stp_10.42.42.5(pid=24936) [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24936)] [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 15:49:14.057446 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 15:49:14.085740 run osmo-hlr_10.42.42.2(pid=24933): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24933)] 15:49:14.136827 run osmo-hlr_10.42.42.2(pid=24933): stdout: | (launched: 2022-12-12_15:49:11.006711) 15:49:14.189303 run osmo-hlr_10.42.42.2(pid=24933): stderr: | 20221212154911203 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154911203 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154911203 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154911203 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154911203 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154911204 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154911216 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154911225 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154911225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154911225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:14.262317 run osmo-msc_10.42.42.6(pid=24939): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24939)] 15:49:14.312839 run osmo-msc_10.42.42.6(pid=24939): stdout: | (launched: 2022-12-12_15:49:13.096461) 15:49:14.365263 run osmo-msc_10.42.42.6(pid=24939): stderr: | 20221212154913418 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154913418 DLGLOBAL DEBUG validating counter group 0x7fca686c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154913418 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154913418 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154913418 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154913418 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154913420 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154913421 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154913421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154913421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:14.417891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24932): Terminating (SIGTERM) 15:49:14.460079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24935): Terminating (SIGTERM) 15:49:14.502754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24938): Terminating (SIGTERM) 15:49:14.545244 --- ParallelTerminationStrategy: PID 24932 died... 15:49:14.565509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24932): Terminated: ok {rc=0} 15:49:14.612846 --- ParallelTerminationStrategy: PID 24935 died... 15:49:14.632749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24935): Terminated: ok {rc=0} 15:49:14.680161 --- ParallelTerminationStrategy: PID 24938 died... 15:49:14.700019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24938): Terminated: ok {rc=0} 15:49:14.788755 bus /sierra_3: Setting Powered False 15:49:15.891775 bus /sierra_3: Setting Powered False 15:49:17.023864 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 15:49:18.178308 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:18.190789 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 15:49:18.262828 tst mo_mt_call_osmux.py: using LAC 29905 15:49:18.392384 tst mo_mt_call_osmux.py: using RAC 70 15:49:18.522944 tst mo_mt_call_osmux.py: using CellId 29905 15:49:18.651700 tst mo_mt_call_osmux.py: using BVCI 29906 15:49:18.771359 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:18.783052 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:18.794638 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:18.806977 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:18.818978 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 15:49:18.831250 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:49:18.947819 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 15:49:19.065921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:19.547302 run create_hlr_db(pid=24941): Launched 15:49:19.673617 bus /sierra_2: Setting Powered False 15:49:20.734511 run create_hlr_db(pid=24941): Terminated: ok {rc=0} 15:49:21.188035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24943): Launched 15:49:21.524345 run osmo-hlr_10.42.42.2(pid=24944): Launched 15:49:21.649645 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:22.219316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24946): Launched 15:49:22.554803 run osmo-stp_10.42.42.5(pid=24947): Launched 15:49:22.681138 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:23.285699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24949): Launched 15:49:23.621608 run osmo-msc_10.42.42.6(pid=24950): Launched 15:49:23.805966 run osmo-stp_10.42.42.5(pid=24947): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24947)] 15:49:23.944705 run osmo-stp_10.42.42.5(pid=24947): stdout: | (launched: 2022-12-12_15:49:22.491036) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:24.085289 run osmo-stp_10.42.42.5(pid=24947): stderr: | 20221212154922684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154922684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154922684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154922685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154922685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154922685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154922685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:24.223693 run osmo-stp_10.42.42.5(pid=24947): stdout: | (launched: 2022-12-12_15:49:22.491036) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:24.355721 run osmo-stp_10.42.42.5(pid=24947): stderr: | 20221212154922684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154922684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154922684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154922685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154922685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154922685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154922685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:24.513054 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24947): Process ended prematurely: osmo-stp_10.42.42.5(pid=24947) [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24947)] [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 15:49:24.522821 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 15:49:24.551182 run osmo-hlr_10.42.42.2(pid=24944): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24944)] 15:49:24.601587 run osmo-hlr_10.42.42.2(pid=24944): stdout: | (launched: 2022-12-12_15:49:21.460484) 15:49:24.653729 run osmo-hlr_10.42.42.2(pid=24944): stderr: | 20221212154921658 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154921658 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154921658 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154921658 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154921658 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154921658 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154921670 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154921679 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154921679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154921679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:24.726613 run osmo-msc_10.42.42.6(pid=24950): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24950)] 15:49:24.777098 run osmo-msc_10.42.42.6(pid=24950): stdout: | (launched: 2022-12-12_15:49:23.557876) 15:49:24.829120 run osmo-msc_10.42.42.6(pid=24950): stderr: | 20221212154923880 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154923880 DLGLOBAL DEBUG validating counter group 0x7f20d5152c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154923880 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154923880 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154923880 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154923880 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154923882 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154923882 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154923883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154923883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:24.881436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24943): Terminating (SIGTERM) 15:49:24.923610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24946): Terminating (SIGTERM) 15:49:24.965944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24949): Terminating (SIGTERM) 15:49:25.008424 --- ParallelTerminationStrategy: PID 24943 died... 15:49:25.028534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24943): Terminated: ok {rc=0} 15:49:25.075855 --- ParallelTerminationStrategy: PID 24946 died... 15:49:25.095237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24946): Terminated: ok {rc=0} 15:49:25.141910 --- ParallelTerminationStrategy: PID 24949 died... 15:49:25.161406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24949): Terminated: ok {rc=0} 15:49:25.250207 bus /sierra_3: Setting Powered False 15:49:26.350079 bus /sierra_3: Setting Powered False 15:49:27.465427 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 15:49:28.713432 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:49:28.720091 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 15:49:28.756920 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 15:49:28.784854 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 15:49:28.840085 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 15:49:28.874271 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 15:49:28.901771 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 15:49:29.452840 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 15:49:29.506227 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:29.518083 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:49:29.590046 tst mo_mt_call.py: using LAC 29906 15:49:29.713326 tst mo_mt_call.py: using RAC 71 15:49:29.837885 tst mo_mt_call.py: using CellId 29906 15:49:29.958874 tst mo_mt_call.py: using BVCI 29907 15:49:30.072446 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:30.083783 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:30.094822 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:30.106276 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:30.117894 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:30.129410 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:49:30.250293 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:49:30.369953 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:30.890797 run create_hlr_db(pid=24955): Launched 15:49:31.065307 bus /sierra_2: Setting Powered False 15:49:32.146753 run create_hlr_db(pid=24955): Terminated: ok {rc=0} 15:49:32.630773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24957): Launched 15:49:32.966700 run osmo-hlr_10.42.42.2(pid=24958): Launched 15:49:33.094322 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:33.668042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24960): Launched 15:49:34.001951 run osmo-stp_10.42.42.5(pid=24961): Launched 15:49:34.128717 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:34.728903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24963): Launched 15:49:35.063071 run osmo-msc_10.42.42.6(pid=24964): Launched 15:49:35.247602 run osmo-stp_10.42.42.5(pid=24961): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24961)] 15:49:35.387164 run osmo-stp_10.42.42.5(pid=24961): stdout: | (launched: 2022-12-12_15:49:33.937895) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:35.526942 run osmo-stp_10.42.42.5(pid=24961): stderr: | 20221212154934130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154934131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154934131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154934131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154934132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154934132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154934132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:35.664229 run osmo-stp_10.42.42.5(pid=24961): stdout: | (launched: 2022-12-12_15:49:33.937895) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:35.795312 run osmo-stp_10.42.42.5(pid=24961): stderr: | 20221212154934130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154934131 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154934131 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154934131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154934132 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154934132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154934132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:35.952394 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24961): Process ended prematurely: osmo-stp_10.42.42.5(pid=24961) [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24961)] [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 15:49:35.962276 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 15:49:35.990561 run osmo-hlr_10.42.42.2(pid=24958): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24958)] 15:49:36.040867 run osmo-hlr_10.42.42.2(pid=24958): stdout: | (launched: 2022-12-12_15:49:32.902623) 15:49:36.092913 run osmo-hlr_10.42.42.2(pid=24958): stderr: | 20221212154933100 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154933100 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154933100 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154933100 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154933100 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154933100 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154933112 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154933121 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154933122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154933122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:36.165060 run osmo-msc_10.42.42.6(pid=24964): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24964)] 15:49:36.215240 run osmo-msc_10.42.42.6(pid=24964): stdout: | (launched: 2022-12-12_15:49:34.999482) 15:49:36.267152 run osmo-msc_10.42.42.6(pid=24964): stderr: | 20221212154935321 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154935321 DLGLOBAL DEBUG validating counter group 0x7f44372c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154935322 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154935322 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154935322 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154935322 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154935324 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154935324 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154935324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154935324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:36.319384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24957): Terminating (SIGTERM) 15:49:36.361563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24960): Terminating (SIGTERM) 15:49:36.403867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24963): Terminating (SIGTERM) 15:49:36.446460 --- ParallelTerminationStrategy: PID 24957 died... 15:49:36.466431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24957): Terminated: ok {rc=0} 15:49:36.513357 --- ParallelTerminationStrategy: PID 24960 died... 15:49:36.532994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24960): Terminated: ok {rc=0} 15:49:36.579991 --- ParallelTerminationStrategy: PID 24963 died... 15:49:36.599562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24963): Terminated: ok {rc=0} 15:49:36.688548 bus /sierra_3: Setting Powered False 15:49:37.788133 bus /sierra_3: Setting Powered False 15:49:38.906004 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 15:49:40.059453 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:40.071987 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 15:49:40.145177 tst mo_mt_call_osmux.py: using LAC 29907 15:49:40.275741 tst mo_mt_call_osmux.py: using RAC 72 15:49:40.407674 tst mo_mt_call_osmux.py: using CellId 29907 15:49:40.535968 tst mo_mt_call_osmux.py: using BVCI 29908 15:49:40.655586 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:40.667530 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:40.679026 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:40.690771 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:40.702518 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 15:49:40.714427 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:49:40.835572 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 15:49:40.954539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:41.471183 run create_hlr_db(pid=24966): Launched 15:49:41.598216 bus /sierra_2: Setting Powered False 15:49:42.663028 run create_hlr_db(pid=24966): Terminated: ok {rc=0} 15:49:43.106908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24968): Launched 15:49:43.418357 run osmo-hlr_10.42.42.2(pid=24969): Launched 15:49:43.536581 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:44.069899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24971): Launched 15:49:44.380712 run osmo-stp_10.42.42.5(pid=24972): Launched 15:49:44.498832 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:45.058893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24974): Launched 15:49:45.373159 run osmo-msc_10.42.42.6(pid=24975): Launched 15:49:45.543910 run osmo-stp_10.42.42.5(pid=24972): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24972)] 15:49:45.674626 run osmo-stp_10.42.42.5(pid=24972): stdout: | (launched: 2022-12-12_15:49:44.321265) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:45.804336 run osmo-stp_10.42.42.5(pid=24972): stderr: | 20221212154944492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154944493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154944493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154944493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154944494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154944494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154944494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:45.964909 run osmo-stp_10.42.42.5(pid=24972): stdout: | (launched: 2022-12-12_15:49:44.321265) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:46.088757 run osmo-stp_10.42.42.5(pid=24972): stderr: | 20221212154944492 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154944493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154944493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154944493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154944494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154944494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154944494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:46.237398 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24972): Process ended prematurely: osmo-stp_10.42.42.5(pid=24972) [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24972)] [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 15:49:46.247505 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:49:46.275309 run osmo-hlr_10.42.42.2(pid=24969): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24969)] 15:49:46.324257 run osmo-hlr_10.42.42.2(pid=24969): stdout: | (launched: 2022-12-12_15:49:43.358077) 15:49:46.374941 run osmo-hlr_10.42.42.2(pid=24969): stderr: | 20221212154943537 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154943537 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154943537 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154943537 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154943537 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154943537 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154943549 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154943558 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154943558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154943558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:46.444479 run osmo-msc_10.42.42.6(pid=24975): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24975)] 15:49:46.493308 run osmo-msc_10.42.42.6(pid=24975): stdout: | (launched: 2022-12-12_15:49:45.312639) 15:49:46.543327 run osmo-msc_10.42.42.6(pid=24975): stderr: | 20221212154945587 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154945587 DLGLOBAL DEBUG validating counter group 0x7f54dc354c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154945588 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154945588 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154945588 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154945588 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154945590 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154945590 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154945590 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154945590 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:46.594247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24968): Terminating (SIGTERM) 15:49:46.634764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24971): Terminating (SIGTERM) 15:49:46.675519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24974): Terminating (SIGTERM) 15:49:46.716123 --- ParallelTerminationStrategy: PID 24968 died... 15:49:46.735555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24968): Terminated: ok {rc=0} 15:49:46.780566 --- ParallelTerminationStrategy: PID 24971 died... 15:49:46.799637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24971): Terminated: ok {rc=0} 15:49:46.843880 --- ParallelTerminationStrategy: PID 24974 died... 15:49:46.863077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24974): Terminated: ok {rc=0} 15:49:46.947955 bus /sierra_3: Setting Powered False 15:49:48.042755 bus /sierra_3: Setting Powered False 15:49:49.155087 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 15:49:50.400387 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:49:50.406998 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 15:49:50.439814 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 15:49:50.466273 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 15:49:50.519243 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 15:49:50.553840 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 15:49:50.581112 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 15:49:51.131321 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 15:49:51.184880 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:49:51.196696 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:49:51.267816 tst mo_mt_call.py: using LAC 29908 15:49:51.397179 tst mo_mt_call.py: using RAC 73 15:49:51.525624 tst mo_mt_call.py: using CellId 29908 15:49:51.650510 tst mo_mt_call.py: using BVCI 29909 15:49:51.762969 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:49:51.774153 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:49:51.785090 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:49:51.796162 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:49:51.807130 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:49:51.818067 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:49:51.939448 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:49:52.061285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:49:52.577620 run create_hlr_db(pid=24981): Launched 15:49:52.706264 bus /sierra_2: Setting Powered False 15:49:53.770933 run create_hlr_db(pid=24981): Terminated: ok {rc=0} 15:49:54.232884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24983): Launched 15:49:54.568553 run osmo-hlr_10.42.42.2(pid=24984): Launched 15:49:54.694433 run osmo-stp_10.42.42.5: Starting osmo-stp 15:49:55.263277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24986): Launched 15:49:55.597228 run osmo-stp_10.42.42.5(pid=24987): Launched 15:49:55.723583 run osmo-msc_10.42.42.6: Starting osmo-msc 15:49:56.325477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24989): Launched 15:49:56.661591 run osmo-msc_10.42.42.6(pid=24990): Launched 15:49:56.846262 run osmo-stp_10.42.42.5(pid=24987): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24987)] 15:49:56.985972 run osmo-stp_10.42.42.5(pid=24987): stdout: | (launched: 2022-12-12_15:49:55.533819) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:57.126237 run osmo-stp_10.42.42.5(pid=24987): stderr: | 20221212154955724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154955724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154955724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154955725 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154955725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154955725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154955725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:57.264219 run osmo-stp_10.42.42.5(pid=24987): stdout: | (launched: 2022-12-12_15:49:55.533819) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:49:57.395734 run osmo-stp_10.42.42.5(pid=24987): stderr: | 20221212154955724 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212154955724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212154955724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212154955725 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212154955725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212154955725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212154955725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:49:57.552782 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24987): Process ended prematurely: osmo-stp_10.42.42.5(pid=24987) [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24987)] [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 15:49:57.562778 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 15:49:57.590916 run osmo-hlr_10.42.42.2(pid=24984): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24984)] 15:49:57.641695 run osmo-hlr_10.42.42.2(pid=24984): stdout: | (launched: 2022-12-12_15:49:54.504525) 15:49:57.694072 run osmo-hlr_10.42.42.2(pid=24984): stderr: | 20221212154954702 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212154954702 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212154954702 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212154954702 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212154954702 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212154954702 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212154954714 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212154954722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212154954722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212154954722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:49:57.766273 run osmo-msc_10.42.42.6(pid=24990): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24990)] 15:49:57.816543 run osmo-msc_10.42.42.6(pid=24990): stdout: | (launched: 2022-12-12_15:49:56.597672) 15:49:57.868435 run osmo-msc_10.42.42.6(pid=24990): stderr: | 20221212154956920 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212154956920 DLGLOBAL DEBUG validating counter group 0x7f298ff7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212154956920 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212154956921 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212154956921 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212154956921 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212154956923 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212154956923 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212154956923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212154956923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:49:57.921117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24983): Terminating (SIGTERM) 15:49:57.963258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24986): Terminating (SIGTERM) 15:49:58.005401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24989): Terminating (SIGTERM) 15:49:58.047769 --- ParallelTerminationStrategy: PID 24983 died... 15:49:58.067931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24983): Terminated: ok {rc=0} 15:49:58.114948 --- ParallelTerminationStrategy: PID 24986 died... 15:49:58.134616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24986): Terminated: ok {rc=0} 15:49:58.181724 --- ParallelTerminationStrategy: PID 24989 died... 15:49:58.201316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24989): Terminated: ok {rc=0} 15:49:58.291290 bus /sierra_3: Setting Powered False 15:49:59.390973 bus /sierra_3: Setting Powered False 15:50:00.508593 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 15:50:01.657437 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:01.670815 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 15:50:01.742823 tst mo_mt_call_osmux.py: using LAC 29909 15:50:01.915962 tst mo_mt_call_osmux.py: using RAC 74 15:50:02.046806 tst mo_mt_call_osmux.py: using CellId 29909 15:50:02.177847 tst mo_mt_call_osmux.py: using BVCI 29910 15:50:02.296814 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:02.308516 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:02.320017 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:02.331538 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:02.342593 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 15:50:02.353855 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:50:02.469782 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 15:50:02.591898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:03.073531 run create_hlr_db(pid=24995): Launched 15:50:03.198818 bus /sierra_2: Setting Powered False 15:50:04.259561 run create_hlr_db(pid=24995): Terminated: ok {rc=0} 15:50:04.711529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24997): Launched 15:50:05.045690 run osmo-hlr_10.42.42.2(pid=24998): Launched 15:50:05.171140 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:05.745185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25000): Launched 15:50:06.078678 run osmo-stp_10.42.42.5(pid=25001): Launched 15:50:06.203168 run osmo-msc_10.42.42.6: Starting osmo-msc 15:50:06.802800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25003): Launched 15:50:07.137588 run osmo-msc_10.42.42.6(pid=25004): Launched 15:50:07.321732 run osmo-stp_10.42.42.5(pid=25001): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25001)] 15:50:07.460725 run osmo-stp_10.42.42.5(pid=25001): stdout: | (launched: 2022-12-12_15:50:06.015077) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:07.601096 run osmo-stp_10.42.42.5(pid=25001): stderr: | 20221212155006207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155006207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155006207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155006207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155006208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155006208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155006208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:07.738791 run osmo-stp_10.42.42.5(pid=25001): stdout: | (launched: 2022-12-12_15:50:06.015077) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:07.869185 run osmo-stp_10.42.42.5(pid=25001): stderr: | 20221212155006207 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155006207 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155006207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155006207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155006208 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155006208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155006208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:08.025745 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25001): Process ended prematurely: osmo-stp_10.42.42.5(pid=25001) [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25001)] [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 15:50:08.035509 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 15:50:08.064107 run osmo-hlr_10.42.42.2(pid=24998): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24998)] 15:50:08.114535 run osmo-hlr_10.42.42.2(pid=24998): stdout: | (launched: 2022-12-12_15:50:04.982287) 15:50:08.166663 run osmo-hlr_10.42.42.2(pid=24998): stderr: | 20221212155005179 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155005180 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155005180 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155005180 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155005180 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155005180 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155005192 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155005201 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155005202 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155005202 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:08.239082 run osmo-msc_10.42.42.6(pid=25004): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25004)] 15:50:08.289824 run osmo-msc_10.42.42.6(pid=25004): stdout: | (launched: 2022-12-12_15:50:07.073821) 15:50:08.341907 run osmo-msc_10.42.42.6(pid=25004): stderr: | 20221212155007395 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212155007396 DLGLOBAL DEBUG validating counter group 0x7f43a106bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212155007396 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212155007396 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212155007396 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212155007396 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212155007398 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212155007398 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212155007398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212155007398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:50:08.394144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24997): Terminating (SIGTERM) 15:50:08.436119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25000): Terminating (SIGTERM) 15:50:08.478391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25003): Terminating (SIGTERM) 15:50:08.520730 --- ParallelTerminationStrategy: PID 24997 died... 15:50:08.540868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24997): Terminated: ok {rc=0} 15:50:08.587760 --- ParallelTerminationStrategy: PID 25000 died... 15:50:08.607384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25000): Terminated: ok {rc=0} 15:50:08.654142 --- ParallelTerminationStrategy: PID 25003 died... 15:50:08.673837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25003): Terminated: ok {rc=0} 15:50:08.763160 bus /sierra_3: Setting Powered False 15:50:09.863440 bus /sierra_3: Setting Powered False 15:50:10.979679 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 15:50:12.232653 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:50:12.240270 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 15:50:12.275693 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 15:50:12.303273 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 15:50:12.356336 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 15:50:12.390562 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 15:50:12.418028 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 15:50:12.969723 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 15:50:13.020670 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:13.032103 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:50:13.100361 tst mo_mt_call.py: using LAC 29910 15:50:13.221270 tst mo_mt_call.py: using RAC 75 15:50:13.346701 tst mo_mt_call.py: using CellId 29910 15:50:13.466359 tst mo_mt_call.py: using BVCI 29911 15:50:13.578721 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:13.590447 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:13.601617 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:13.612769 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:13.623971 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:13.635134 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:50:13.750109 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:50:13.870836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:14.385262 run create_hlr_db(pid=25009): Launched 15:50:14.511981 bus /sierra_2: Setting Powered False 15:50:15.577667 run create_hlr_db(pid=25009): Terminated: ok {rc=0} 15:50:16.045655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25011): Launched 15:50:16.392792 run osmo-hlr_10.42.42.2(pid=25012): Launched 15:50:16.644353 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:17.326918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25014): Launched 15:50:17.661727 run osmo-stp_10.42.42.5(pid=25015): Launched 15:50:17.789741 run osmo-msc_10.42.42.6: Starting osmo-msc 15:50:18.388615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25017): Launched 15:50:18.721607 run osmo-msc_10.42.42.6(pid=25018): Launched 15:50:18.905209 run osmo-stp_10.42.42.5(pid=25015): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25015)] 15:50:19.043577 run osmo-stp_10.42.42.5(pid=25015): stdout: | (launched: 2022-12-12_15:50:17.597992) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:19.183037 run osmo-stp_10.42.42.5(pid=25015): stderr: | 20221212155017789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155017789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155017789 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155017789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155017790 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155017790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155017790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:19.321711 run osmo-stp_10.42.42.5(pid=25015): stdout: | (launched: 2022-12-12_15:50:17.597992) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:19.451889 run osmo-stp_10.42.42.5(pid=25015): stderr: | 20221212155017789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155017789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155017789 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155017789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155017790 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155017790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155017790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:19.608453 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25015): Process ended prematurely: osmo-stp_10.42.42.5(pid=25015) [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25015)] [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 15:50:19.618235 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 15:50:19.646395 run osmo-hlr_10.42.42.2(pid=25012): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25012)] 15:50:19.696561 run osmo-hlr_10.42.42.2(pid=25012): stdout: | (launched: 2022-12-12_15:50:16.327821) 15:50:19.748296 run osmo-hlr_10.42.42.2(pid=25012): stderr: | 20221212155016635 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155016635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155016635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155016635 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155016635 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155016635 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155016662 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155016679 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155016679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155016679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:19.820463 run osmo-msc_10.42.42.6(pid=25018): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25018)] 15:50:19.870689 run osmo-msc_10.42.42.6(pid=25018): stdout: | (launched: 2022-12-12_15:50:18.658017) 15:50:19.922405 run osmo-msc_10.42.42.6(pid=25018): stderr: | 20221212155018984 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212155018985 DLGLOBAL DEBUG validating counter group 0x7fc47bfd5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212155018985 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212155018985 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212155018985 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212155018985 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212155018987 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212155018987 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212155018987 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212155018987 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:50:19.974742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25011): Terminating (SIGTERM) 15:50:20.016610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25014): Terminating (SIGTERM) 15:50:20.058444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25017): Terminating (SIGTERM) 15:50:20.100430 --- ParallelTerminationStrategy: PID 25011 died... 15:50:20.120508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25011): Terminated: ok {rc=0} 15:50:20.166982 --- ParallelTerminationStrategy: PID 25014 died... 15:50:20.186470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25014): Terminated: ok {rc=0} 15:50:20.232904 --- ParallelTerminationStrategy: PID 25017 died... 15:50:20.252820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25017): Terminated: ok {rc=0} 15:50:20.343332 bus /sierra_3: Setting Powered False 15:50:21.444075 bus /sierra_3: Setting Powered False 15:50:22.561493 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 15:50:23.713453 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:23.726100 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 15:50:23.798673 tst mo_mt_call_osmux.py: using LAC 29911 15:50:23.928473 tst mo_mt_call_osmux.py: using RAC 76 15:50:24.057172 tst mo_mt_call_osmux.py: using CellId 29911 15:50:24.185419 tst mo_mt_call_osmux.py: using BVCI 29912 15:50:24.305997 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:24.317798 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:24.329326 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:24.341068 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:24.352892 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 15:50:24.364574 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:50:24.484544 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 15:50:24.601815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:25.086225 run create_hlr_db(pid=25020): Launched 15:50:25.215203 bus /sierra_2: Setting Powered False 15:50:26.276002 run create_hlr_db(pid=25020): Terminated: ok {rc=0} 15:50:26.730271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25022): Launched 15:50:27.067095 run osmo-hlr_10.42.42.2(pid=25024): Launched 15:50:27.193826 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:27.767660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25026): Launched 15:50:28.104780 run osmo-stp_10.42.42.5(pid=25027): Launched 15:50:28.232371 run osmo-msc_10.42.42.6: Starting osmo-msc 15:50:28.833213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25029): Launched 15:50:29.169243 run osmo-msc_10.42.42.6(pid=25030): Launched 15:50:29.354148 run osmo-stp_10.42.42.5(pid=25027): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25027)] 15:50:29.494115 run osmo-stp_10.42.42.5(pid=25027): stdout: | (launched: 2022-12-12_15:50:28.041009) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:29.635526 run osmo-stp_10.42.42.5(pid=25027): stderr: | 20221212155028231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155028231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155028232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155028232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155028233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155028233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155028233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:29.773810 run osmo-stp_10.42.42.5(pid=25027): stdout: | (launched: 2022-12-12_15:50:28.041009) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:29.904857 run osmo-stp_10.42.42.5(pid=25027): stderr: | 20221212155028231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155028231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155028232 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155028232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155028233 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155028233 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155028233 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:30.061734 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25027): Process ended prematurely: osmo-stp_10.42.42.5(pid=25027) [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25027)] [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 15:50:30.071722 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 15:50:30.099808 run osmo-hlr_10.42.42.2(pid=25024): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25024)] 15:50:30.150452 run osmo-hlr_10.42.42.2(pid=25024): stdout: | (launched: 2022-12-12_15:50:27.003342) 15:50:30.202468 run osmo-hlr_10.42.42.2(pid=25024): stderr: | 20221212155027200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155027200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155027201 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155027201 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155027201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155027201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155027212 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155027221 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155027222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155027222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:30.275508 run osmo-msc_10.42.42.6(pid=25030): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25030)] 15:50:30.325942 run osmo-msc_10.42.42.6(pid=25030): stdout: | (launched: 2022-12-12_15:50:29.105202) 15:50:30.377838 run osmo-msc_10.42.42.6(pid=25030): stderr: | 20221212155029425 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212155029425 DLGLOBAL DEBUG validating counter group 0x7fa678277c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212155029425 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212155029425 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212155029425 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212155029426 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212155029427 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212155029428 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212155029428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212155029428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:50:30.430204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25022): Terminating (SIGTERM) 15:50:30.472602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25026): Terminating (SIGTERM) 15:50:30.515003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25029): Terminating (SIGTERM) 15:50:30.557710 --- ParallelTerminationStrategy: PID 25022 died... 15:50:30.578000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25022): Terminated: ok {rc=0} 15:50:30.625149 --- ParallelTerminationStrategy: PID 25026 died... 15:50:30.645114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25026): Terminated: ok {rc=0} 15:50:30.692156 --- ParallelTerminationStrategy: PID 25029 died... 15:50:30.711906 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25029): Terminated: ok {rc=0} 15:50:30.800121 bus /sierra_3: Setting Powered False 15:50:31.897868 bus /sierra_3: Setting Powered False 15:50:33.017531 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 15:50:34.269913 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:50:34.276503 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 15:50:34.309343 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 15:50:34.335803 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 15:50:34.387477 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 15:50:34.420278 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 15:50:34.446621 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 15:50:35.004038 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 15:50:35.053376 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:35.064769 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:50:35.134252 tst mo_mt_call.py: using LAC 29912 15:50:35.257183 tst mo_mt_call.py: using RAC 77 15:50:35.377810 tst mo_mt_call.py: using CellId 29912 15:50:35.500647 tst mo_mt_call.py: using BVCI 29913 15:50:35.613609 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:35.624638 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:35.635665 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:35.646615 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:35.657694 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:35.668608 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:50:35.783343 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:50:35.905129 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:36.387432 run create_hlr_db(pid=25035): Launched 15:50:36.513298 bus /sierra_2: Setting Powered False 15:50:37.574884 run create_hlr_db(pid=25035): Terminated: ok {rc=0} 15:50:38.029109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25037): Launched 15:50:38.367907 run osmo-hlr_10.42.42.2(pid=25038): Launched 15:50:38.494457 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:39.064436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25040): Launched 15:50:39.399973 run osmo-stp_10.42.42.5(pid=25041): Launched 15:50:39.525618 run osmo-msc_10.42.42.6: Starting osmo-msc 15:50:40.118128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25043): Launched 15:50:40.431854 run osmo-msc_10.42.42.6(pid=25044): Launched 15:50:40.604178 run osmo-stp_10.42.42.5(pid=25041): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25041)] 15:50:40.734030 run osmo-stp_10.42.42.5(pid=25041): stdout: | (launched: 2022-12-12_15:50:39.336033) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:40.864183 run osmo-stp_10.42.42.5(pid=25041): stderr: | 20221212155039528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155039528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155039528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155039529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155039529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155039529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155039529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:40.993598 run osmo-stp_10.42.42.5(pid=25041): stdout: | (launched: 2022-12-12_15:50:39.336033) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:41.115796 run osmo-stp_10.42.42.5(pid=25041): stderr: | 20221212155039528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155039528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155039528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155039529 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155039529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155039529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155039529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:41.262267 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25041): Process ended prematurely: osmo-stp_10.42.42.5(pid=25041) [trial-2378↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25041)] [trial-2378↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 15:50:41.271336 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 15:50:41.297580 run osmo-hlr_10.42.42.2(pid=25038): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25038)] 15:50:41.345136 run osmo-hlr_10.42.42.2(pid=25038): stdout: | (launched: 2022-12-12_15:50:38.303644) 15:50:41.394156 run osmo-hlr_10.42.42.2(pid=25038): stderr: | 20221212155038501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155038501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155038501 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155038501 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155038501 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155038501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155038514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155038523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155038523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155038523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:41.462505 run osmo-msc_10.42.42.6(pid=25044): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25044)] 15:50:41.510124 run osmo-msc_10.42.42.6(pid=25044): stdout: | (launched: 2022-12-12_15:50:40.371601) 15:50:41.559144 run osmo-msc_10.42.42.6(pid=25044): stderr: | 20221212155040647 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212155040647 DLGLOBAL DEBUG validating counter group 0x7f41d9fdbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212155040647 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212155040647 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212155040647 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212155040647 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212155040649 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212155040650 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212155040650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212155040650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:50:41.608563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25037): Terminating (SIGTERM) 15:50:41.648223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25040): Terminating (SIGTERM) 15:50:41.687748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25043): Terminating (SIGTERM) 15:50:41.727581 --- ParallelTerminationStrategy: PID 25037 died... 15:50:41.746848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25037): Terminated: ok {rc=0} 15:50:41.790967 --- ParallelTerminationStrategy: PID 25040 died... 15:50:41.809757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25040): Terminated: ok {rc=0} 15:50:41.853496 --- ParallelTerminationStrategy: PID 25043 died... 15:50:41.872256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25043): Terminated: ok {rc=0} 15:50:41.956588 bus /sierra_3: Setting Powered False 15:50:43.055330 bus /sierra_3: Setting Powered False 15:50:44.173385 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 15:50:45.324848 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:45.337695 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 15:50:45.410299 tst mo_mt_call_osmux.py: using LAC 29913 15:50:45.550647 tst mo_mt_call_osmux.py: using RAC 78 15:50:45.686809 tst mo_mt_call_osmux.py: using CellId 29913 15:50:45.817822 tst mo_mt_call_osmux.py: using BVCI 29914 15:50:45.942333 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:45.954318 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:45.967229 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:45.980022 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:45.991887 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 15:50:46.003773 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:50:46.120152 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 15:50:46.273817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:46.809371 run create_hlr_db(pid=25046): Launched 15:50:46.976179 bus /sierra_2: Setting Powered False 15:50:48.038046 run create_hlr_db(pid=25046): Terminated: ok {rc=0} 15:50:48.493491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25048): Launched 15:50:48.829369 run osmo-hlr_10.42.42.2(pid=25049): Launched 15:50:48.956690 run osmo-stp_10.42.42.5: Starting osmo-stp 15:50:49.534884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25051): Launched 15:50:49.869795 run osmo-stp_10.42.42.5(pid=25052): Launched 15:50:49.995869 run osmo-msc_10.42.42.6: Starting osmo-msc 15:50:50.595304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25054): Launched 15:50:50.930164 run osmo-msc_10.42.42.6(pid=25055): Launched 15:50:51.114623 run osmo-stp_10.42.42.5(pid=25052): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25052)] 15:50:51.254000 run osmo-stp_10.42.42.5(pid=25052): stdout: | (launched: 2022-12-12_15:50:49.806276) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:51.394716 run osmo-stp_10.42.42.5(pid=25052): stderr: | 20221212155049999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155049999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155050000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155050000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155050000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155050001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155050001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:51.532839 run osmo-stp_10.42.42.5(pid=25052): stdout: | (launched: 2022-12-12_15:50:49.806276) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:50:51.664152 run osmo-stp_10.42.42.5(pid=25052): stderr: | 20221212155049999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155049999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155050000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155050000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155050000 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155050001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155050001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:50:51.821125 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25052): Process ended prematurely: osmo-stp_10.42.42.5(pid=25052) [trial-2378↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25052)] [trial-2378↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 15:50:51.831033 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 15:50:51.859874 run osmo-hlr_10.42.42.2(pid=25049): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25049)] 15:50:51.910576 run osmo-hlr_10.42.42.2(pid=25049): stdout: | (launched: 2022-12-12_15:50:48.765687) 15:50:51.962900 run osmo-hlr_10.42.42.2(pid=25049): stderr: | 20221212155048965 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155048965 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155048965 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155048965 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155048965 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155048965 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155048978 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155048988 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155048988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155048988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:50:52.035634 run osmo-msc_10.42.42.6(pid=25055): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25055)] 15:50:52.086033 run osmo-msc_10.42.42.6(pid=25055): stdout: | (launched: 2022-12-12_15:50:50.866308) 15:50:52.137939 run osmo-msc_10.42.42.6(pid=25055): stderr: | 20221212155051191 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212155051191 DLGLOBAL DEBUG validating counter group 0x7f2b29f57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212155051191 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212155051192 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212155051192 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212155051192 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212155051194 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212155051194 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212155051194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212155051194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:50:52.190194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25048): Terminating (SIGTERM) 15:50:52.232163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25051): Terminating (SIGTERM) 15:50:52.274811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25054): Terminating (SIGTERM) 15:50:52.317320 --- ParallelTerminationStrategy: PID 25048 died... 15:50:52.337432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25048): Terminated: ok {rc=0} 15:50:52.384117 --- ParallelTerminationStrategy: PID 25051 died... 15:50:52.403764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25051): Terminated: ok {rc=0} 15:50:52.450558 --- ParallelTerminationStrategy: PID 25054 died... 15:50:52.470224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25054): Terminated: ok {rc=0} 15:50:52.558768 bus /sierra_3: Setting Powered False 15:50:53.659101 bus /sierra_3: Setting Powered False 15:50:54.776567 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 15:50:56.027031 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:50:56.033180 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 15:50:56.066869 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 15:50:56.093268 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 15:50:56.144911 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 15:50:56.177679 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 15:50:56.203833 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 15:50:56.753833 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 15:50:56.809644 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:50:56.821272 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:50:56.894342 tst mo_mt_call.py: using LAC 29914 15:50:57.024398 tst mo_mt_call.py: using RAC 79 15:50:57.155045 tst mo_mt_call.py: using CellId 29914 15:50:57.284511 tst mo_mt_call.py: using BVCI 29915 15:50:57.406242 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:50:57.417749 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:50:57.429039 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:50:57.440731 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:50:57.452528 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:50:57.464241 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:50:57.582052 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:50:57.699990 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:50:58.183086 run create_hlr_db(pid=25060): Launched 15:50:58.311020 bus /sierra_2: Setting Powered False 15:50:59.372057 run create_hlr_db(pid=25060): Terminated: ok {rc=0} 15:50:59.825605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25062): Launched 15:51:00.161434 run osmo-hlr_10.42.42.2(pid=25063): Launched 15:51:00.288123 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:00.867086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25065): Launched 15:51:01.217659 run osmo-stp_10.42.42.5(pid=25066): Launched 15:51:01.482342 run osmo-msc_10.42.42.6: Starting osmo-msc 15:51:02.161702 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25068): Launched 15:51:02.476387 run osmo-msc_10.42.42.6(pid=25069): Launched 15:51:02.648912 run osmo-stp_10.42.42.5(pid=25066): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25066)] 15:51:02.780504 run osmo-stp_10.42.42.5(pid=25066): stdout: | (launched: 2022-12-12_15:51:01.152074) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:02.911618 run osmo-stp_10.42.42.5(pid=25066): stderr: | 20221212155101442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155101442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155101443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155101443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155101443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155101444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155101444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:03.040599 run osmo-stp_10.42.42.5(pid=25066): stdout: | (launched: 2022-12-12_15:51:01.152074) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:03.164223 run osmo-stp_10.42.42.5(pid=25066): stderr: | 20221212155101442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155101442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155101443 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155101443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155101443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155101444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155101444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:03.311106 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25066): Process ended prematurely: osmo-stp_10.42.42.5(pid=25066) [trial-2378↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25066)] [trial-2378↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 15:51:03.320108 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 15:51:03.346587 run osmo-hlr_10.42.42.2(pid=25063): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25063)] 15:51:03.394531 run osmo-hlr_10.42.42.2(pid=25063): stdout: | (launched: 2022-12-12_15:51:00.097405) 15:51:03.444143 run osmo-hlr_10.42.42.2(pid=25063): stderr: | 20221212155100295 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155100295 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155100296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155100296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155100296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155100296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155100308 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155100317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155100318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155100318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:03.513533 run osmo-msc_10.42.42.6(pid=25069): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25069)] 15:51:03.561430 run osmo-msc_10.42.42.6(pid=25069): stdout: | (launched: 2022-12-12_15:51:02.415892) 15:51:03.611109 run osmo-msc_10.42.42.6(pid=25069): stderr: | 20221212155102692 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212155102692 DLGLOBAL DEBUG validating counter group 0x7ff8bf027c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212155102692 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212155102692 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212155102692 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212155102692 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212155102694 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212155102695 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212155102695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212155102695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:51:03.661095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25062): Terminating (SIGTERM) 15:51:03.701184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25065): Terminating (SIGTERM) 15:51:03.741109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25068): Terminating (SIGTERM) 15:51:03.781220 --- ParallelTerminationStrategy: PID 25062 died... 15:51:03.800399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25062): Terminated: ok {rc=0} 15:51:03.844624 --- ParallelTerminationStrategy: PID 25065 died... 15:51:03.863339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25065): Terminated: ok {rc=0} 15:51:03.907867 --- ParallelTerminationStrategy: PID 25068 died... 15:51:03.926600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25068): Terminated: ok {rc=0} 15:51:04.013130 bus /sierra_3: Setting Powered False 15:51:05.114770 bus /sierra_3: Setting Powered False 15:51:06.231882 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 15:51:07.380221 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:07.391884 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 15:51:07.462533 tst mo_mt_call_osmux.py: using LAC 29915 15:51:07.583702 tst mo_mt_call_osmux.py: using RAC 80 15:51:07.707007 tst mo_mt_call_osmux.py: using CellId 29915 15:51:07.834290 tst mo_mt_call_osmux.py: using BVCI 29916 15:51:07.947461 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:07.958603 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:07.969586 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:07.980365 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:07.991159 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 15:51:08.001952 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:51:08.121166 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 15:51:08.241315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:08.723492 run create_hlr_db(pid=25071): Launched 15:51:08.849577 bus /sierra_2: Setting Powered False 15:51:09.911099 run create_hlr_db(pid=25071): Terminated: ok {rc=0} 15:51:10.366203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25073): Launched 15:51:10.702219 run osmo-hlr_10.42.42.2(pid=25074): Launched 15:51:10.828626 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:11.401268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25076): Launched 15:51:11.735448 run osmo-stp_10.42.42.5(pid=25077): Launched 15:51:11.862344 run osmo-msc_10.42.42.6: Starting osmo-msc 15:51:12.463392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25079): Launched 15:51:12.799521 run osmo-msc_10.42.42.6(pid=25080): Launched 15:51:12.983927 run osmo-stp_10.42.42.5(pid=25077): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25077)] 15:51:13.122779 run osmo-stp_10.42.42.5(pid=25077): stdout: | (launched: 2022-12-12_15:51:11.671449) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:13.262319 run osmo-stp_10.42.42.5(pid=25077): stderr: | 20221212155111865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155111865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155111865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155111866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155111866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155111866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155111866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:13.401079 run osmo-stp_10.42.42.5(pid=25077): stdout: | (launched: 2022-12-12_15:51:11.671449) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:13.532645 run osmo-stp_10.42.42.5(pid=25077): stderr: | 20221212155111865 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155111865 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155111865 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155111866 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155111866 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155111866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155111866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:13.690144 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25077): Process ended prematurely: osmo-stp_10.42.42.5(pid=25077) [trial-2378↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25077)] [trial-2378↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 15:51:13.700068 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 15:51:13.729276 run osmo-hlr_10.42.42.2(pid=25074): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25074)] 15:51:13.780139 run osmo-hlr_10.42.42.2(pid=25074): stdout: | (launched: 2022-12-12_15:51:10.638658) 15:51:13.832850 run osmo-hlr_10.42.42.2(pid=25074): stderr: | 20221212155110838 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155110838 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155110838 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155110838 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155110838 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155110838 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155110850 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155110859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155110860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155110860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:13.905885 run osmo-msc_10.42.42.6(pid=25080): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25080)] 15:51:13.956671 run osmo-msc_10.42.42.6(pid=25080): stdout: | (launched: 2022-12-12_15:51:12.735504) 15:51:14.009437 run osmo-msc_10.42.42.6(pid=25080): stderr: | 20221212155113059 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212155113059 DLGLOBAL DEBUG validating counter group 0x7f2ad3f94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212155113059 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212155113059 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212155113059 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212155113059 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212155113061 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212155113061 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212155113062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212155113062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:51:14.062350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25073): Terminating (SIGTERM) 15:51:14.104833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25076): Terminating (SIGTERM) 15:51:14.147593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25079): Terminating (SIGTERM) 15:51:14.190562 --- ParallelTerminationStrategy: PID 25073 died... 15:51:14.210714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25073): Terminated: ok {rc=0} 15:51:14.258142 --- ParallelTerminationStrategy: PID 25076 died... 15:51:14.278216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25076): Terminated: ok {rc=0} 15:51:14.325311 --- ParallelTerminationStrategy: PID 25079 died... 15:51:14.345129 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25079): Terminated: ok {rc=0} 15:51:14.434625 bus /sierra_3: Setting Powered False 15:51:15.530935 bus /sierra_3: Setting Powered False 15:51:16.652689 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 15:51:17.908429 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:51:17.915496 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 15:51:17.951369 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 15:51:17.979575 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 15:51:18.033317 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 15:51:18.067411 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 15:51:18.095087 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 15:51:18.644345 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 15:51:18.694876 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:51:18.705948 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 15:51:18.756500 tst mo_mt_call.py: using LAC 29916 15:51:18.879673 tst mo_mt_call.py: using RAC 81 15:51:19.001879 tst mo_mt_call.py: using CellId 29916 15:51:19.122614 tst mo_mt_call.py: using BVCI 29917 15:51:19.236443 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:51:19.247510 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:51:19.258458 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:51:19.269179 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:51:19.279811 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:51:19.290681 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 15:51:19.411720 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 15:51:19.531818 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:20.014405 run create_hlr_db(pid=25085): Launched 15:51:20.142978 bus /sierra_2: Setting Powered False 15:51:21.203722 run create_hlr_db(pid=25085): Terminated: ok {rc=0} 15:51:21.638245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25090): Launched 15:51:21.955399 run osmo-hlr_10.42.42.2(pid=25091): Launched 15:51:22.073866 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:22.623058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25093): Launched 15:51:22.935907 run osmo-stp_10.42.42.5(pid=25094): Launched 15:51:23.054752 run osmo-msc_10.42.42.6: Starting osmo-msc 15:51:23.616149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25096): Launched 15:51:23.928117 run osmo-msc_10.42.42.6(pid=25097): Launched 15:51:24.100682 run osmo-stp_10.42.42.5(pid=25094): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25094)] 15:51:24.230372 run osmo-stp_10.42.42.5(pid=25094): stdout: | (launched: 2022-12-12_15:51:22.875708) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:24.359934 run osmo-stp_10.42.42.5(pid=25094): stderr: | 20221212155123050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155123050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155123050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155123051 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155123051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155123051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155123051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:24.488021 run osmo-stp_10.42.42.5(pid=25094): stdout: | (launched: 2022-12-12_15:51:22.875708) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:24.609764 run osmo-stp_10.42.42.5(pid=25094): stderr: | 20221212155123050 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155123050 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155123050 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155123051 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155123051 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155123051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155123051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:24.756426 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25094): Process ended prematurely: osmo-stp_10.42.42.5(pid=25094) [trial-2378↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25094)] [trial-2378↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 15:51:24.765526 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 15:51:24.791579 run osmo-hlr_10.42.42.2(pid=25091): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25091)] 15:51:24.838686 run osmo-hlr_10.42.42.2(pid=25091): stdout: | (launched: 2022-12-12_15:51:21.895098) 15:51:24.887590 run osmo-hlr_10.42.42.2(pid=25091): stderr: | 20221212155122074 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155122074 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155122074 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155122074 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155122074 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155122075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155122087 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155122095 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155122095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155122095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:24.955892 run osmo-msc_10.42.42.6(pid=25097): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25097)] 15:51:25.003195 run osmo-msc_10.42.42.6(pid=25097): stdout: | (launched: 2022-12-12_15:51:23.867919) 15:51:25.052494 run osmo-msc_10.42.42.6(pid=25097): stderr: | 20221212155124144 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212155124145 DLGLOBAL DEBUG validating counter group 0x7f1ebda2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212155124145 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212155124145 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212155124145 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212155124145 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212155124147 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212155124147 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212155124147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212155124148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:51:25.101840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25090): Terminating (SIGTERM) 15:51:25.141679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25093): Terminating (SIGTERM) 15:51:25.181447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25096): Terminating (SIGTERM) 15:51:25.221721 --- ParallelTerminationStrategy: PID 25090 died... 15:51:25.240912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25090): Terminated: ok {rc=0} 15:51:25.285559 --- ParallelTerminationStrategy: PID 25093 died... 15:51:25.304485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25093): Terminated: ok {rc=0} 15:51:25.348446 --- ParallelTerminationStrategy: PID 25096 died... 15:51:25.367142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25096): Terminated: ok {rc=0} 15:51:25.453666 bus /sierra_3: Setting Powered False 15:51:26.554233 bus /sierra_3: Setting Powered False 15:51:27.670583 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 15:51:28.817415 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:51:28.829104 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 15:51:28.879322 tst mo_mt_call_osmux.py: using LAC 29917 15:51:29.000936 tst mo_mt_call_osmux.py: using RAC 82 15:51:29.122785 tst mo_mt_call_osmux.py: using CellId 29917 15:51:29.244839 tst mo_mt_call_osmux.py: using BVCI 29918 15:51:29.358523 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:51:29.369711 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:51:29.380483 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:51:29.391307 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:51:29.402151 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 15:51:29.412909 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 15:51:29.535805 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 15:51:29.657143 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:30.175119 run create_hlr_db(pid=25099): Launched 15:51:30.304342 bus /sierra_2: Setting Powered False 15:51:31.381943 run create_hlr_db(pid=25099): Terminated: ok {rc=0} 15:51:31.855352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25101): Launched 15:51:32.204698 run osmo-hlr_10.42.42.2(pid=25102): Launched 15:51:32.329176 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:32.867092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25104): Launched 15:51:33.182589 run osmo-stp_10.42.42.5(pid=25105): Launched 15:51:33.298855 run osmo-msc_10.42.42.6: Starting osmo-msc 15:51:33.861376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25107): Launched 15:51:34.176498 run osmo-msc_10.42.42.6(pid=25108): Launched 15:51:34.350304 run osmo-stp_10.42.42.5(pid=25105): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25105)] 15:51:34.481589 run osmo-stp_10.42.42.5(pid=25105): stdout: | (launched: 2022-12-12_15:51:33.121958) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:34.611455 run osmo-stp_10.42.42.5(pid=25105): stderr: | 20221212155133295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155133295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155133295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155133296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155133296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155133296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155133296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:34.739197 run osmo-stp_10.42.42.5(pid=25105): stdout: | (launched: 2022-12-12_15:51:33.121958) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:34.861195 run osmo-stp_10.42.42.5(pid=25105): stderr: | 20221212155133295 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155133295 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155133295 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155133296 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155133296 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155133296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155133296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:35.007845 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25105): Process ended prematurely: osmo-stp_10.42.42.5(pid=25105) [trial-2378↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25105)] [trial-2378↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 15:51:35.017045 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 15:51:35.043215 run osmo-hlr_10.42.42.2(pid=25102): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25102)] 15:51:35.090856 run osmo-hlr_10.42.42.2(pid=25102): stdout: | (launched: 2022-12-12_15:51:32.141412) 15:51:35.140047 run osmo-hlr_10.42.42.2(pid=25102): stderr: | 20221212155132336 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155132336 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155132336 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155132336 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155132336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155132336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155132348 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155132358 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155132359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155132359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:35.208238 run osmo-msc_10.42.42.6(pid=25108): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25108)] 15:51:35.255917 run osmo-msc_10.42.42.6(pid=25108): stdout: | (launched: 2022-12-12_15:51:34.116060) 15:51:35.305058 run osmo-msc_10.42.42.6(pid=25108): stderr: | 20221212155134390 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212155134390 DLGLOBAL DEBUG validating counter group 0x7ff936fb3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212155134390 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212155134390 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212155134391 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212155134391 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212155134392 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212155134393 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212155134393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212155134393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:51:35.354888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25101): Terminating (SIGTERM) 15:51:35.394469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25104): Terminating (SIGTERM) 15:51:35.434090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25107): Terminating (SIGTERM) 15:51:35.473917 --- ParallelTerminationStrategy: PID 25101 died... 15:51:35.492855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25101): Terminated: ok {rc=0} 15:51:35.536741 --- ParallelTerminationStrategy: PID 25104 died... 15:51:35.555290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25104): Terminated: ok {rc=0} 15:51:35.598992 --- ParallelTerminationStrategy: PID 25107 died... 15:51:35.617441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25107): Terminated: ok {rc=0} 15:51:35.700931 bus /sierra_3: Setting Powered False 15:51:36.799147 bus /sierra_3: Setting Powered False 15:51:37.918884 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 15:51:39.174326 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:51:39.180255 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 15:51:39.213236 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 15:51:39.239785 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 15:51:39.290176 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 15:51:39.322934 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 15:51:39.349315 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 15:51:39.903248 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 15:51:39.952498 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:51:39.963882 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 15:51:40.015147 tst mo_mt_call.py: using LAC 29918 15:51:40.142753 tst mo_mt_call.py: using RAC 83 15:51:40.265934 tst mo_mt_call.py: using CellId 29918 15:51:40.386188 tst mo_mt_call.py: using BVCI 29919 15:51:40.499286 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:51:40.510689 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:51:40.521882 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:51:40.533596 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:51:40.544665 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:51:40.555869 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 15:51:40.678569 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 15:51:40.800823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:41.319185 run create_hlr_db(pid=25113): Launched 15:51:41.448536 bus /sierra_2: Setting Powered False 15:51:42.514120 run create_hlr_db(pid=25113): Terminated: ok {rc=0} 15:51:42.959004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25115): Launched 15:51:43.272548 run osmo-hlr_10.42.42.2(pid=25116): Launched 15:51:43.392044 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:43.929893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25118): Launched 15:51:44.242510 run osmo-stp_10.42.42.5(pid=25119): Launched 15:51:44.359142 run osmo-msc_10.42.42.6: Starting osmo-msc 15:51:44.919956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25121): Launched 15:51:45.233662 run osmo-msc_10.42.42.6(pid=25122): Launched 15:51:45.407096 run osmo-stp_10.42.42.5(pid=25119): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25119)] 15:51:45.539436 run osmo-stp_10.42.42.5(pid=25119): stdout: | (launched: 2022-12-12_15:51:44.182561) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:45.670634 run osmo-stp_10.42.42.5(pid=25119): stderr: | 20221212155144356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155144356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155144357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155144357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155144357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155144358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155144358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:45.800378 run osmo-stp_10.42.42.5(pid=25119): stdout: | (launched: 2022-12-12_15:51:44.182561) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:45.943993 run osmo-stp_10.42.42.5(pid=25119): stderr: | 20221212155144356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155144356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155144357 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155144357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155144357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155144358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155144358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:46.109871 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25119): Process ended prematurely: osmo-stp_10.42.42.5(pid=25119) [trial-2378↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25119)] [trial-2378↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 15:51:46.120784 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 15:51:46.152682 run osmo-hlr_10.42.42.2(pid=25116): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25116)] 15:51:46.207276 run osmo-hlr_10.42.42.2(pid=25116): stdout: | (launched: 2022-12-12_15:51:43.211960) 15:51:46.262401 run osmo-hlr_10.42.42.2(pid=25116): stderr: | 20221212155143392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155143392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155143392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155143392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155143392 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155143392 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155143404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155143412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155143412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155143412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:46.338406 run osmo-msc_10.42.42.6(pid=25122): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25122)] 15:51:46.392188 run osmo-msc_10.42.42.6(pid=25122): stdout: | (launched: 2022-12-12_15:51:45.172666) 15:51:46.447039 run osmo-msc_10.42.42.6(pid=25122): stderr: | 20221212155145448 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212155145448 DLGLOBAL DEBUG validating counter group 0x7fe29e8d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212155145448 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212155145448 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212155145449 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212155145449 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212155145450 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212155145451 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212155145451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212155145451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:51:46.501936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25115): Terminating (SIGTERM) 15:51:46.547593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25118): Terminating (SIGTERM) 15:51:46.595392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25121): Terminating (SIGTERM) 15:51:46.642367 --- ParallelTerminationStrategy: PID 25115 died... 15:51:46.663758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25115): Terminated: ok {rc=0} 15:51:46.715623 --- ParallelTerminationStrategy: PID 25118 died... 15:51:46.736556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25118): Terminated: ok {rc=0} 15:51:46.788718 --- ParallelTerminationStrategy: PID 25121 died... 15:51:46.811935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25121): Terminated: ok {rc=0} 15:51:46.915760 bus /sierra_3: Setting Powered False 15:51:48.021928 bus /sierra_3: Setting Powered False 15:51:49.136437 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 15:51:50.283799 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:51:50.295880 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 15:51:50.347341 tst mo_mt_call_osmux.py: using LAC 29919 15:51:50.470669 tst mo_mt_call_osmux.py: using RAC 84 15:51:50.593179 tst mo_mt_call_osmux.py: using CellId 29919 15:51:50.715201 tst mo_mt_call_osmux.py: using BVCI 29920 15:51:50.828683 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:51:50.840085 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:51:50.851250 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:51:50.862393 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:51:50.873587 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 15:51:50.884663 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 15:51:51.003802 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 15:51:51.124746 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:51:51.607805 run create_hlr_db(pid=25124): Launched 15:51:51.735169 bus /sierra_2: Setting Powered False 15:51:52.796878 run create_hlr_db(pid=25124): Terminated: ok {rc=0} 15:51:53.251820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25126): Launched 15:51:53.588630 run osmo-hlr_10.42.42.2(pid=25127): Launched 15:51:53.715402 run osmo-stp_10.42.42.5: Starting osmo-stp 15:51:54.295236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25129): Launched 15:51:54.631390 run osmo-stp_10.42.42.5(pid=25130): Launched 15:51:54.758185 run osmo-msc_10.42.42.6: Starting osmo-msc 15:51:55.360405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25132): Launched 15:51:55.696755 run osmo-msc_10.42.42.6(pid=25133): Launched 15:51:55.880343 run osmo-stp_10.42.42.5(pid=25130): ERR: Terminated: ERROR {rc=1} [trial-2378↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25130)] 15:51:56.022252 run osmo-stp_10.42.42.5(pid=25130): stdout: | (launched: 2022-12-12_15:51:54.567525) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:56.161764 run osmo-stp_10.42.42.5(pid=25130): stderr: | 20221212155154759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155154759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155154759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155154759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155154760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155154760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155154760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:56.294541 run osmo-stp_10.42.42.5(pid=25130): stdout: | (launched: 2022-12-12_15:51:54.567525) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:51:56.416892 run osmo-stp_10.42.42.5(pid=25130): stderr: | 20221212155154759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155154759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155154759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155154759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155154760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155154760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155154760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:51:56.563226 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25130): Process ended prematurely: osmo-stp_10.42.42.5(pid=25130) [trial-2378↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25130)] [trial-2378↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 15:51:56.572532 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 15:51:56.598778 run osmo-hlr_10.42.42.2(pid=25127): ERR: Terminated: ERROR {rc=237} [trial-2378↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25127)] 15:51:56.646267 run osmo-hlr_10.42.42.2(pid=25127): stdout: | (launched: 2022-12-12_15:51:53.525330) 15:51:56.695453 run osmo-hlr_10.42.42.2(pid=25127): stderr: | 20221212155153721 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155153721 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155153721 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155153721 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155153721 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155153721 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155153733 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155153742 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155153742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155153742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:51:56.764186 run osmo-msc_10.42.42.6(pid=25133): ERR: Terminated: ERROR {rc=2} [trial-2378↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25133)] 15:51:56.811701 run osmo-msc_10.42.42.6(pid=25133): stdout: | (launched: 2022-12-12_15:51:55.632701) 15:51:56.861068 run osmo-msc_10.42.42.6(pid=25133): stderr: | 20221212155155953 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212155155954 DLGLOBAL DEBUG validating counter group 0x7f3be9909c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212155155954 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221212155155954 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212155155954 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212155155954 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212155155956 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212155155956 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212155155956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212155155956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:51:56.910485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25126): Terminating (SIGTERM) 15:51:56.950007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25129): Terminating (SIGTERM) 15:51:56.989545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25132): Terminating (SIGTERM) 15:51:57.029895 --- ParallelTerminationStrategy: PID 25126 died... 15:51:57.048587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25126): Terminated: ok {rc=0} 15:51:57.092616 --- ParallelTerminationStrategy: PID 25129 died... 15:51:57.111187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25129): Terminated: ok {rc=0} 15:51:57.154686 --- ParallelTerminationStrategy: PID 25132 died... 15:51:57.173119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25132): Terminated: ok {rc=0} 15:51:57.259069 bus /sierra_3: Setting Powered False 15:51:58.360622 bus /sierra_3: Setting Powered False 15:51:59.477085 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 emergency:trx-b200 --------------------------------------------------------------------- 15:52:00.727697 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:52:00.732897 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 15:52:00.766646 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 15:52:00.793240 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 15:52:00.890609 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 15:52:00.934527 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 15:52:00.969969 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 15:52:01.531069 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2378 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 15:52:01.536396 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:52:01.548201 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 15:52:01.597400 tst emergency_mo_mt_call.py: using LAC 29920 15:52:01.731067 tst emergency_mo_mt_call.py: using RAC 85 15:52:01.901229 tst emergency_mo_mt_call.py: using CellId 29920 15:52:02.024192 tst emergency_mo_mt_call.py: using BVCI 29921 15:52:02.170036 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:52:02.183562 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:52:02.196124 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:52:02.211175 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:52:02.224605 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:52:02.236832 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:52:02.361761 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:52:02.480616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:02.954059 run create_hlr_db(pid=25138): Launched 15:52:03.079111 bus /sierra_2: Setting Powered False 15:52:04.140173 run create_hlr_db(pid=25138): Terminated: ok {rc=0} 15:52:04.589160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25140): Launched 15:52:04.920061 run osmo-hlr_10.42.42.2(pid=25141): Launched 15:52:05.044896 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:05.610182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25143): Launched 15:52:05.941661 run osmo-stp_10.42.42.5(pid=25144): Launched 15:52:06.076167 tst emergency_mo_mt_call.py: using MSISDN 7856 15:52:06.246819 run osmo-msc_10.42.42.6: Starting osmo-msc 15:52:06.837231 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25146): Launched 15:52:07.165706 run osmo-msc_10.42.42.6(pid=25147): Launched 15:52:07.347348 run osmo-stp_10.42.42.5(pid=25144): ERR: Terminated: ERROR {rc=1} [trial-2378↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25144)] 15:52:07.483885 run osmo-stp_10.42.42.5(pid=25144): stdout: | (launched: 2022-12-12_15:52:05.878358) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:07.620623 run osmo-stp_10.42.42.5(pid=25144): stderr: | 20221212155206071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155206071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155206072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155206072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155206072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155206073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155206073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:07.756889 run osmo-stp_10.42.42.5(pid=25144): stdout: | (launched: 2022-12-12_15:52:05.878358) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:07.886042 run osmo-stp_10.42.42.5(pid=25144): stderr: | 20221212155206071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155206071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155206072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155206072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155206072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155206073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155206073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:08.040562 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25144): Process ended prematurely: osmo-stp_10.42.42.5(pid=25144) [trial-2378↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25144)] [trial-2378↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 15:52:08.050068 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 15:52:08.078129 run osmo-hlr_10.42.42.2(pid=25141): ERR: Terminated: ERROR {rc=237} [trial-2378↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25141)] 15:52:08.128281 run osmo-hlr_10.42.42.2(pid=25141): stdout: | (launched: 2022-12-12_15:52:04.857262) 15:52:08.180055 run osmo-hlr_10.42.42.2(pid=25141): stderr: | 20221212155205055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155205055 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155205055 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155205055 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155205055 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155205055 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155205067 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155205077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155205077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155205077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:08.252097 run osmo-msc_10.42.42.6(pid=25147): ERR: Terminated: ERROR {rc=2} [trial-2378↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25147)] 15:52:08.302259 run osmo-msc_10.42.42.6(pid=25147): stdout: | (launched: 2022-12-12_15:52:07.102666) 15:52:08.354381 run osmo-msc_10.42.42.6(pid=25147): stderr: | 20221212155207425 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212155207425 DLGLOBAL DEBUG validating counter group 0x7f40b6b45c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212155207425 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212155207425 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212155207426 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212155207426 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212155207427 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212155207428 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212155207428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212155207428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:52:08.406449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25140): Terminating (SIGTERM) 15:52:08.448645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25143): Terminating (SIGTERM) 15:52:08.490871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25146): Terminating (SIGTERM) 15:52:08.533350 --- ParallelTerminationStrategy: PID 25140 died... 15:52:08.553514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25140): Terminated: ok {rc=0} 15:52:08.600379 --- ParallelTerminationStrategy: PID 25143 died... 15:52:08.620071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25143): Terminated: ok {rc=0} 15:52:08.666715 --- ParallelTerminationStrategy: PID 25146 died... 15:52:08.686380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25146): Terminated: ok {rc=0} 15:52:08.775302 bus /sierra_3: Setting Powered False 15:52:09.875111 bus /sierra_3: Setting Powered False 15:52:10.991147 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2378 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 15:52:12.079596 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:52:12.091956 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 15:52:12.145927 tst emergency_preemptive_call.py: using LAC 29921 15:52:12.273634 tst emergency_preemptive_call.py: using RAC 86 15:52:12.395631 tst emergency_preemptive_call.py: using CellId 29921 15:52:12.515043 tst emergency_preemptive_call.py: using BVCI 29922 15:52:12.624113 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:52:12.635244 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:52:12.646160 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:52:12.656914 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:52:12.667565 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 15:52:12.678172 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:52:12.797977 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:52:12.918524 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:52:13.034743 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 15:52:13.152528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:13.631212 run create_hlr_db(pid=25149): Launched 15:52:13.755380 bus /sierra_2: Setting Powered False 15:52:14.815517 run create_hlr_db(pid=25149): Terminated: ok {rc=0} 15:52:15.242024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25151): Launched 15:52:15.548588 run osmo-hlr_10.42.42.2(pid=25152): Launched 15:52:15.664587 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:16.223187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25154): Launched 15:52:16.573652 run osmo-stp_10.42.42.5(pid=25155): Launched 15:52:16.854717 tst emergency_preemptive_call.py: using MSISDN 7857 15:52:17.061000 run osmo-msc_10.42.42.6: Starting osmo-msc 15:52:17.612806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25157): Launched 15:52:17.922099 run osmo-msc_10.42.42.6(pid=25158): Launched 15:52:18.089597 run osmo-stp_10.42.42.5(pid=25155): ERR: Terminated: ERROR {rc=1} [trial-2378↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25155)] 15:52:18.217114 run osmo-stp_10.42.42.5(pid=25155): stdout: | (launched: 2022-12-12_15:52:16.507236) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:18.344813 run osmo-stp_10.42.42.5(pid=25155): stderr: | 20221212155216738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155216738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155216738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155216739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155216739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155216739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155216740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:18.471677 run osmo-stp_10.42.42.5(pid=25155): stdout: | (launched: 2022-12-12_15:52:16.507236) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:18.592072 run osmo-stp_10.42.42.5(pid=25155): stderr: | 20221212155216738 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155216738 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155216738 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155216739 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155216739 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155216739 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155216740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:18.736194 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25155): Process ended prematurely: osmo-stp_10.42.42.5(pid=25155) [trial-2378↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25155)] [trial-2378↪emergency:trx-b200↪emergency_preemptive_call.py:32] 15:52:18.744914 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 15:52:18.771650 run osmo-hlr_10.42.42.2(pid=25152): ERR: Terminated: ERROR {rc=237} [trial-2378↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25152)] 15:52:18.819651 run osmo-hlr_10.42.42.2(pid=25152): stdout: | (launched: 2022-12-12_15:52:15.489305) 15:52:18.869605 run osmo-hlr_10.42.42.2(pid=25152): stderr: | 20221212155215669 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155215669 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155215669 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155215669 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155215669 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155215669 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155215681 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155215690 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155215691 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155215691 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:18.939279 run osmo-msc_10.42.42.6(pid=25158): ERR: Terminated: ERROR {rc=2} [trial-2378↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25158)] 15:52:18.987364 run osmo-msc_10.42.42.6(pid=25158): stdout: | (launched: 2022-12-12_15:52:17.862528) 15:52:19.036890 run osmo-msc_10.42.42.6(pid=25158): stderr: | 20221212155218141 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221212155218141 DLGLOBAL DEBUG validating counter group 0x7fb545cb4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221212155218141 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221212155218141 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221212155218141 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221212155218142 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221212155218143 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221212155218144 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221212155218144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221212155218144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 15:52:19.086726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25151): Terminating (SIGTERM) 15:52:19.126892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25154): Terminating (SIGTERM) 15:52:19.167067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25157): Terminating (SIGTERM) 15:52:19.207456 --- ParallelTerminationStrategy: PID 25151 died... 15:52:19.226771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25151): Terminated: ok {rc=0} 15:52:19.271620 --- ParallelTerminationStrategy: PID 25154 died... 15:52:19.290490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25154): Terminated: ok {rc=0} 15:52:19.334899 --- ParallelTerminationStrategy: PID 25157 died... 15:52:19.353806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25157): Terminated: ok {rc=0} 15:52:19.440475 bus /sierra_9: Setting Powered False 15:52:20.541226 bus /sierra_9: Setting Powered False 15:52:21.655990 bus /sierra_8: Setting Powered False 15:52:22.755400 bus /sierra_8: Setting Powered False 15:52:23.872137 bus /sierra_3: Setting Powered False 15:52:24.970801 bus /sierra_3: Setting Powered False 15:52:26.088454 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2378 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 gprs:trx-b200 --------------------------------------------------------------------- 15:52:27.377157 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:52:27.382444 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 15:52:27.419891 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 15:52:27.459732 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 15:52:27.547899 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 15:52:27.580543 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 15:52:27.618593 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 15:52:28.209036 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2378 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 15:52:28.258885 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:28.269874 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 15:52:28.316379 tst cs_paging_gprs_active.py: using LAC 29922 15:52:28.436397 tst cs_paging_gprs_active.py: using RAC 87 15:52:28.555172 tst cs_paging_gprs_active.py: using CellId 29922 15:52:28.676206 tst cs_paging_gprs_active.py: using BVCI 29923 15:52:28.787669 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:28.798429 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:28.808730 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:28.819185 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:28.829507 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:28.839781 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:28.850289 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:28.860622 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:28.871131 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:52:28.985882 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:52:29.105685 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:52:29.329911 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:29.664885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25163): Launched 15:52:29.956117 run iperf3-srv_10.42.42.10(pid=25164): Launched 15:52:30.082090 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:52:30.305606 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:30.642026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25165): Launched 15:52:30.965671 run iperf3-srv_10.42.42.10(pid=25166): Launched 15:52:31.115226 tst cs_paging_gprs_active.py:38: start network... 15:52:31.328805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:31.827898 run create_hlr_db(pid=25167): Launched 15:52:31.979220 bus /sierra_2: Setting Powered False 15:52:33.043714 run create_hlr_db(pid=25167): Terminated: ok {rc=0} 15:52:33.491480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25169): Launched 15:52:33.804407 run osmo-hlr_10.42.42.2(pid=25170): Launched 15:52:33.922113 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:34.460063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25172): Launched 15:52:34.773196 run osmo-stp_10.42.42.5(pid=25173): Launched 15:52:34.890480 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:35.426346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25175): Launched 15:52:35.546442 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:35.811803 run patchelf(pid=25176): Launched 15:52:35.986152 run osmo-stp_10.42.42.5(pid=25173): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25173)] 15:52:36.116881 run osmo-stp_10.42.42.5(pid=25173): stdout: | (launched: 2022-12-12_15:52:34.712361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:36.249736 run osmo-stp_10.42.42.5(pid=25173): stderr: | 20221212155234888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155234888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155234888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155234888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155234889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155234889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155234889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:36.382471 run osmo-stp_10.42.42.5(pid=25173): stdout: | (launched: 2022-12-12_15:52:34.712361) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:36.509512 run osmo-stp_10.42.42.5(pid=25173): stderr: | 20221212155234888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155234888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155234888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155234888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155234889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155234889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155234889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:36.658889 run patchelf(pid=25176): Terminating (SIGINT) 15:52:36.831992 run patchelf(pid=25176): Terminated: ok {rc=0} 15:52:36.956829 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25173): Process ended prematurely: osmo-stp_10.42.42.5(pid=25173) [trial-2378↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25173)] [trial-2378↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 15:52:36.966371 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 15:52:36.993336 run osmo-hlr_10.42.42.2(pid=25170): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25170)] 15:52:37.040330 run osmo-hlr_10.42.42.2(pid=25170): stdout: | (launched: 2022-12-12_15:52:33.743902) 15:52:37.089318 run osmo-hlr_10.42.42.2(pid=25170): stderr: | 20221212155233923 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155233924 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155233924 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155233924 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155233924 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155233924 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155233936 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155233944 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155233944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155233944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:37.138693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25163): Terminating (SIGTERM) 15:52:37.178280 run iperf3-srv_10.42.42.10(pid=25164): Terminating (SIGTERM) 15:52:37.217811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25165): Terminating (SIGTERM) 15:52:37.257247 run iperf3-srv_10.42.42.10(pid=25166): Terminating (SIGTERM) 15:52:37.296457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25169): Terminating (SIGTERM) 15:52:37.336113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25172): Terminating (SIGTERM) 15:52:37.375806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25175): Terminating (SIGTERM) 15:52:37.415797 --- ParallelTerminationStrategy: PID 25163 died... 15:52:37.434986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25163): Terminated: ok {rc=0} 15:52:37.479100 --- ParallelTerminationStrategy: PID 25164 died... 15:52:37.497741 run iperf3-srv_10.42.42.10(pid=25164): Terminated {rc=256} 15:52:37.541038 --- ParallelTerminationStrategy: PID 25165 died... 15:52:37.559332 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25165): Terminated: ok {rc=0} 15:52:37.602817 --- ParallelTerminationStrategy: PID 25166 died... 15:52:37.621343 run iperf3-srv_10.42.42.10(pid=25166): Terminated {rc=256} 15:52:37.664656 --- ParallelTerminationStrategy: PID 25169 died... 15:52:37.683284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25169): Terminated: ok {rc=0} 15:52:37.726701 --- ParallelTerminationStrategy: PID 25172 died... 15:52:37.745177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25172): Terminated: ok {rc=0} 15:52:37.788733 --- ParallelTerminationStrategy: PID 25175 died... 15:52:37.807491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25175): Terminated: ok {rc=0} 15:52:37.893797 bus /gobi_0: Setting Powered False 15:52:38.995709 bus /gobi_0: Setting Powered False 15:52:40.111105 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:trx-b200 iperf3.py ---------------------------------------------- 15:52:41.258003 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:41.269644 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 15:52:41.325576 tst iperf3.py: using LAC 29923 15:52:41.446249 tst iperf3.py: using RAC 88 15:52:41.568329 tst iperf3.py: using CellId 29923 15:52:41.689464 tst iperf3.py: using BVCI 29924 15:52:41.803561 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:41.814417 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:41.824876 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:41.835458 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:41.845928 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:41.856280 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:41.867317 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:41.877884 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:41.888591 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:52:42.007144 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:52:42.231599 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:42.568158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25177): Launched 15:52:42.859882 run iperf3-srv_10.42.42.10(pid=25178): Launched 15:52:42.983849 tst iperf3.py:8: start network... 15:52:43.207381 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:43.723592 run create_hlr_db(pid=25179): Launched 15:52:43.851660 bus /gobi_6: Setting Powered False 15:52:44.915887 run create_hlr_db(pid=25179): Terminated: ok {rc=0} 15:52:45.360630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25181): Launched 15:52:45.674811 run osmo-hlr_10.42.42.2(pid=25182): Launched 15:52:45.792230 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:46.521362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25184): Launched 15:52:46.849337 run osmo-stp_10.42.42.5(pid=25185): Launched 15:52:47.069153 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:52:47.669564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25187): Launched 15:52:47.787715 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:52:48.053410 run patchelf(pid=25188): Launched 15:52:48.226264 run osmo-stp_10.42.42.5(pid=25185): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25185)] 15:52:48.357070 run osmo-stp_10.42.42.5(pid=25185): stdout: | (launched: 2022-12-12_15:52:46.788150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:48.489269 run osmo-stp_10.42.42.5(pid=25185): stderr: | 20221212155247175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155247175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155247178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155247179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155247182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155247182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155247182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:48.621953 run osmo-stp_10.42.42.5(pid=25185): stdout: | (launched: 2022-12-12_15:52:46.788150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:52:48.748082 run osmo-stp_10.42.42.5(pid=25185): stderr: | 20221212155247175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155247175 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155247178 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155247179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155247182 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155247182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155247182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:52:48.898154 run patchelf(pid=25188): Terminating (SIGINT) 15:52:49.071621 run patchelf(pid=25188): Terminated: ok {rc=0} 15:52:49.196727 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25185): Process ended prematurely: osmo-stp_10.42.42.5(pid=25185) [trial-2378↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25185)] [trial-2378↪gprs:trx-b200↪iperf3.py:8] 15:52:49.206326 tst iperf3.py:8: Test FAILED (8.0 sec) 15:52:49.233579 run osmo-hlr_10.42.42.2(pid=25182): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25182)] 15:52:49.280734 run osmo-hlr_10.42.42.2(pid=25182): stdout: | (launched: 2022-12-12_15:52:45.614563) 15:52:49.330152 run osmo-hlr_10.42.42.2(pid=25182): stderr: | 20221212155245796 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155245796 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155245796 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155245796 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155245796 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155245796 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155245808 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155245817 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155245817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155245817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:52:49.379575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25177): Terminating (SIGTERM) 15:52:49.419206 run iperf3-srv_10.42.42.10(pid=25178): Terminating (SIGTERM) 15:52:49.460393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25181): Terminating (SIGTERM) 15:52:49.500470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25184): Terminating (SIGTERM) 15:52:49.540069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25187): Terminating (SIGTERM) 15:52:49.580011 --- ParallelTerminationStrategy: PID 25177 died... 15:52:49.599335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25177): Terminated: ok {rc=0} 15:52:49.643406 --- ParallelTerminationStrategy: PID 25178 died... 15:52:49.661941 run iperf3-srv_10.42.42.10(pid=25178): Terminated {rc=256} 15:52:49.705648 --- ParallelTerminationStrategy: PID 25181 died... 15:52:49.724265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25181): Terminated: ok {rc=0} 15:52:49.767944 --- ParallelTerminationStrategy: PID 25184 died... 15:52:49.786626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25184): Terminated: ok {rc=0} 15:52:49.830568 --- ParallelTerminationStrategy: PID 25187 died... 15:52:49.849319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25187): Terminated: ok {rc=0} 15:52:49.933923 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 15:52:51.086348 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:51.099038 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 15:52:51.149762 tst iperf3m4.py: using LAC 29924 15:52:51.279373 tst iperf3m4.py: using RAC 89 15:52:51.409367 tst iperf3m4.py: using CellId 29924 15:52:51.539058 tst iperf3m4.py: using BVCI 29925 15:52:51.661054 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:51.672417 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:51.683435 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:51.694858 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:51.706126 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:51.717428 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:51.728832 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:51.740206 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:52:51.751643 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:52:51.875574 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:52:52.001327 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:52:52.117964 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:52:52.237152 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:52:52.445809 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:52.760638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25189): Launched 15:52:53.035840 run iperf3-srv_10.42.42.10(pid=25190): Launched 15:52:53.152000 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:52:53.359005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:53.673225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25191): Launched 15:52:53.947669 run iperf3-srv_10.42.42.10(pid=25192): Launched 15:52:54.064089 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:52:54.270469 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:54.584030 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25193): Launched 15:52:54.857187 run iperf3-srv_10.42.42.10(pid=25194): Launched 15:52:54.973791 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:52:55.179373 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:52:55.492883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25195): Launched 15:52:55.766142 run iperf3-srv_10.42.42.10(pid=25196): Launched 15:52:55.884261 tst iperf3m4.py:8: start network... 15:52:56.091917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:52:56.574439 run create_hlr_db(pid=25197): Launched 15:52:56.702288 bus /gobi_6: Setting Powered False 15:52:57.763619 run create_hlr_db(pid=25197): Terminated: ok {rc=0} 15:52:58.219036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25199): Launched 15:52:58.556833 run osmo-hlr_10.42.42.2(pid=25200): Launched 15:52:58.683672 run osmo-stp_10.42.42.5: Starting osmo-stp 15:52:59.261555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25202): Launched 15:52:59.598250 run osmo-stp_10.42.42.5(pid=25203): Launched 15:52:59.724893 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:00.301508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25205): Launched 15:53:00.430673 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:00.714734 run patchelf(pid=25206): Launched 15:53:00.908432 run osmo-stp_10.42.42.5(pid=25203): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25203)] 15:53:01.052506 run osmo-stp_10.42.42.5(pid=25203): stdout: | (launched: 2022-12-12_15:52:59.534042) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:01.197792 run osmo-stp_10.42.42.5(pid=25203): stderr: | 20221212155259725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155259725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155259725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155259726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155259726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155259726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155259726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:01.344219 run osmo-stp_10.42.42.5(pid=25203): stdout: | (launched: 2022-12-12_15:52:59.534042) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:01.483937 run osmo-stp_10.42.42.5(pid=25203): stderr: | 20221212155259725 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155259725 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155259725 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155259726 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155259726 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155259726 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155259726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:01.649772 run patchelf(pid=25206): Terminating (SIGINT) 15:53:01.840223 run patchelf(pid=25206): Terminated: ok {rc=0} 15:53:01.977747 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25203): Process ended prematurely: osmo-stp_10.42.42.5(pid=25203) [trial-2378↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25203)] [trial-2378↪gprs:trx-b200↪iperf3m4.py:8] 15:53:01.989341 tst iperf3m4.py:8: Test FAILED (10.9 sec) 15:53:02.023675 run osmo-hlr_10.42.42.2(pid=25200): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25200)] 15:53:02.076836 run osmo-hlr_10.42.42.2(pid=25200): stdout: | (launched: 2022-12-12_15:52:58.492652) 15:53:02.132020 run osmo-hlr_10.42.42.2(pid=25200): stderr: | 20221212155258691 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155258691 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155258692 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155258692 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155258692 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155258692 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155258704 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155258714 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155258714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155258714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:02.187329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25189): Terminating (SIGTERM) 15:53:02.232602 run iperf3-srv_10.42.42.10(pid=25190): Terminating (SIGTERM) 15:53:02.277680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25191): Terminating (SIGTERM) 15:53:02.320323 run iperf3-srv_10.42.42.10(pid=25192): Terminating (SIGTERM) 15:53:02.362942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25193): Terminating (SIGTERM) 15:53:02.405712 run iperf3-srv_10.42.42.10(pid=25194): Terminating (SIGTERM) 15:53:02.447861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25195): Terminating (SIGTERM) 15:53:02.490443 run iperf3-srv_10.42.42.10(pid=25196): Terminating (SIGTERM) 15:53:02.532927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25199): Terminating (SIGTERM) 15:53:02.575553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25202): Terminating (SIGTERM) 15:53:02.617958 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25205): Terminating (SIGTERM) 15:53:02.660579 --- ParallelTerminationStrategy: PID 25189 died... 15:53:02.680344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25189): Terminated: ok {rc=0} 15:53:02.727547 --- ParallelTerminationStrategy: PID 25190 died... 15:53:02.747122 run iperf3-srv_10.42.42.10(pid=25190): Terminated {rc=256} 15:53:02.794323 --- ParallelTerminationStrategy: PID 25191 died... 15:53:02.814170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25191): Terminated: ok {rc=0} 15:53:02.861228 --- ParallelTerminationStrategy: PID 25192 died... 15:53:02.880860 run iperf3-srv_10.42.42.10(pid=25192): Terminated {rc=256} 15:53:02.927964 --- ParallelTerminationStrategy: PID 25193 died... 15:53:02.947803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25193): Terminated: ok {rc=0} 15:53:02.994889 --- ParallelTerminationStrategy: PID 25194 died... 15:53:03.014734 run iperf3-srv_10.42.42.10(pid=25194): Terminated {rc=256} 15:53:03.061708 --- ParallelTerminationStrategy: PID 25195 died... 15:53:03.081507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25195): Terminated: ok {rc=0} 15:53:03.128516 --- ParallelTerminationStrategy: PID 25196 died... 15:53:03.148388 run iperf3-srv_10.42.42.10(pid=25196): Terminated {rc=256} 15:53:03.195227 --- ParallelTerminationStrategy: PID 25199 died... 15:53:03.214746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25199): Terminated: ok {rc=0} 15:53:03.261716 --- ParallelTerminationStrategy: PID 25202 died... 15:53:03.281600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25202): Terminated: ok {rc=0} 15:53:03.328465 --- ParallelTerminationStrategy: PID 25205 died... 15:53:03.348596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25205): Terminated: ok {rc=0} 15:53:03.438056 bus /gobi_4: Setting Powered False 15:53:04.538890 bus /gobi_4: Setting Powered False 15:53:05.656253 bus /gobi_1: Setting Powered False 15:53:06.755231 bus /gobi_1: Setting Powered False 15:53:07.873369 bus /gobi_0: Setting Powered False 15:53:08.971803 bus /gobi_0: Setting Powered False 15:53:10.090692 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:trx-b200 ping.py ---------------------------------------------- 15:53:11.191161 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:53:11.202483 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 15:53:11.251215 tst ping.py: using LAC 29925 15:53:11.372066 tst ping.py: using RAC 90 15:53:11.492662 tst ping.py: using CellId 29925 15:53:11.612670 tst ping.py: using BVCI 29926 15:53:11.722596 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:53:11.733267 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:53:11.743740 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:53:11.754256 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:53:11.764518 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:53:11.774949 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:53:11.785539 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:53:11.795928 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:53:11.910548 tst ping.py:19: start network... 15:53:12.114656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:12.589516 run create_hlr_db(pid=25207): Launched 15:53:12.714488 bus /gobi_6: Setting Powered False 15:53:13.775605 run create_hlr_db(pid=25207): Terminated: ok {rc=0} 15:53:14.226081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25209): Launched 15:53:14.558614 run osmo-hlr_10.42.42.2(pid=25210): Launched 15:53:14.683829 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:15.250975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25212): Launched 15:53:15.583127 run osmo-stp_10.42.42.5(pid=25213): Launched 15:53:15.707692 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:16.319779 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25215): Launched 15:53:16.452107 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:16.720752 run patchelf(pid=25216): Launched 15:53:16.941886 run osmo-stp_10.42.42.5(pid=25213): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25213)] 15:53:17.083507 run osmo-stp_10.42.42.5(pid=25213): stdout: | (launched: 2022-12-12_15:53:15.519713) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:17.227752 run osmo-stp_10.42.42.5(pid=25213): stderr: | 20221212155315712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155315712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155315713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155315713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155315714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155315714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155315714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:17.368728 run osmo-stp_10.42.42.5(pid=25213): stdout: | (launched: 2022-12-12_15:53:15.519713) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:17.502704 run osmo-stp_10.42.42.5(pid=25213): stderr: | 20221212155315712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155315712 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155315713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155315713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155315714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155315714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155315714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:17.661417 run patchelf(pid=25216): Terminating (SIGINT) 15:53:17.844514 run patchelf(pid=25216): Terminated: ok {rc=0} 15:53:17.976414 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25213): Process ended prematurely: osmo-stp_10.42.42.5(pid=25213) [trial-2378↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25213)] [trial-2378↪gprs:trx-b200↪ping.py:22] 15:53:17.986475 tst ping.py:22: Test FAILED (6.8 sec) 15:53:18.016555 run osmo-hlr_10.42.42.2(pid=25210): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25210)] 15:53:18.067848 run osmo-hlr_10.42.42.2(pid=25210): stdout: | (launched: 2022-12-12_15:53:14.495232) 15:53:18.121100 run osmo-hlr_10.42.42.2(pid=25210): stderr: | 20221212155314693 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155314693 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155314693 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155314693 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155314693 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155314693 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155314709 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155314719 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155314719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155314719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:18.174667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25209): Terminating (SIGTERM) 15:53:18.217528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25212): Terminating (SIGTERM) 15:53:18.260700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25215): Terminating (SIGTERM) 15:53:18.304660 --- ParallelTerminationStrategy: PID 25209 died... 15:53:18.325201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25209): Terminated: ok {rc=0} 15:53:18.373250 --- ParallelTerminationStrategy: PID 25212 died... 15:53:18.393302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25212): Terminated: ok {rc=0} 15:53:18.440704 --- ParallelTerminationStrategy: PID 25215 died... 15:53:18.460663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25215): Terminated: ok {rc=0} 15:53:18.549651 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 15:53:19.637844 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:53:19.650045 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 15:53:19.702111 tst ping_idle_ping.py: using LAC 29926 15:53:19.831003 tst ping_idle_ping.py: using RAC 91 15:53:19.960191 tst ping_idle_ping.py: using CellId 29926 15:53:20.087476 tst ping_idle_ping.py: using BVCI 29927 15:53:20.207975 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:53:20.219176 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:53:20.230249 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:53:20.241794 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:53:20.252925 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:53:20.264242 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:53:20.275640 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 15:53:20.286957 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 15:53:20.407251 tst ping_idle_ping.py:24: start network... 15:53:20.628578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:21.140572 run create_hlr_db(pid=25217): Launched 15:53:21.267102 bus /gobi_6: Setting Powered False 15:53:22.331638 run create_hlr_db(pid=25217): Terminated: ok {rc=0} 15:53:22.772663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25219): Launched 15:53:23.083228 run osmo-hlr_10.42.42.2(pid=25220): Launched 15:53:23.199279 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:23.741861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25222): Launched 15:53:24.049395 run osmo-stp_10.42.42.5(pid=25223): Launched 15:53:24.174083 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:24.742648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25225): Launched 15:53:24.869859 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:25.149788 run patchelf(pid=25226): Launched 15:53:25.331442 run osmo-stp_10.42.42.5(pid=25223): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25223)] 15:53:25.470554 run osmo-stp_10.42.42.5(pid=25223): stdout: | (launched: 2022-12-12_15:53:23.989483) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:25.610542 run osmo-stp_10.42.42.5(pid=25223): stderr: | 20221212155324169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155324169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155324169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155324169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155324170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155324170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155324170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:25.750474 run osmo-stp_10.42.42.5(pid=25223): stdout: | (launched: 2022-12-12_15:53:23.989483) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:25.883843 run osmo-stp_10.42.42.5(pid=25223): stderr: | 20221212155324169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155324169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155324169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155324169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155324170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155324170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155324170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:26.042305 run patchelf(pid=25226): Terminating (SIGINT) 15:53:26.224522 run patchelf(pid=25226): Terminated: ok {rc=0} 15:53:26.356883 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25223): Process ended prematurely: osmo-stp_10.42.42.5(pid=25223) [trial-2378↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25223)] [trial-2378↪gprs:trx-b200↪ping_idle_ping.py:27] 15:53:26.366800 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 15:53:26.395668 run osmo-hlr_10.42.42.2(pid=25220): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25220)] 15:53:26.446486 run osmo-hlr_10.42.42.2(pid=25220): stdout: | (launched: 2022-12-12_15:53:23.023517) 15:53:26.499129 run osmo-hlr_10.42.42.2(pid=25220): stderr: | 20221212155323202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155323202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155323202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155323202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155323202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155323202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155323215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155323225 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155323226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155323226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:26.552270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25219): Terminating (SIGTERM) 15:53:26.595050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25222): Terminating (SIGTERM) 15:53:26.637786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25225): Terminating (SIGTERM) 15:53:26.680556 --- ParallelTerminationStrategy: PID 25219 died... 15:53:26.701012 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25219): Terminated: ok {rc=0} 15:53:26.748392 --- ParallelTerminationStrategy: PID 25222 died... 15:53:26.768357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25222): Terminated: ok {rc=0} 15:53:26.815179 --- ParallelTerminationStrategy: PID 25225 died... 15:53:26.835024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25225): Terminated: ok {rc=0} 15:53:26.924388 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2378 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2378 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 15:53:28.232309 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 15:53:28.238046 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 15:53:28.271171 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 15:53:28.309230 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 15:53:28.395571 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 15:53:28.428101 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 15:53:28.465914 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 15:53:29.063107 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2378 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 15:53:29.112448 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:29.123320 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:53:29.171685 tst cs_paging_gprs_active.py: using LAC 29927 15:53:29.290284 tst cs_paging_gprs_active.py: using RAC 92 15:53:29.411433 tst cs_paging_gprs_active.py: using CellId 29927 15:53:29.537295 tst cs_paging_gprs_active.py: using BVCI 29928 15:53:29.650289 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:29.661226 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:29.671756 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:29.682428 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:29.692942 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:29.703492 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:29.714291 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:29.724834 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:29.735538 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:53:29.855471 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:53:29.975482 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 15:53:30.184011 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:30.499230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25230): Launched 15:53:30.772862 run iperf3-srv_10.42.42.10(pid=25231): Launched 15:53:30.922779 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 15:53:31.159711 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:31.523875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25232): Launched 15:53:31.834669 run iperf3-srv_10.42.42.10(pid=25233): Launched 15:53:32.015851 tst cs_paging_gprs_active.py:38: start network... 15:53:32.278992 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:32.764475 run create_hlr_db(pid=25234): Launched 15:53:32.893455 bus /gobi_6: Setting Powered False 15:53:33.954564 run create_hlr_db(pid=25234): Terminated: ok {rc=0} 15:53:34.411090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25236): Launched 15:53:34.747423 run osmo-hlr_10.42.42.2(pid=25237): Launched 15:53:34.874379 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:35.446942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25239): Launched 15:53:35.783653 run osmo-stp_10.42.42.5(pid=25240): Launched 15:53:35.910298 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:36.486199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25242): Launched 15:53:36.614674 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:36.898524 run patchelf(pid=25243): Launched 15:53:37.084217 run osmo-stp_10.42.42.5(pid=25240): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25240)] 15:53:37.224867 run osmo-stp_10.42.42.5(pid=25240): stdout: | (launched: 2022-12-12_15:53:35.719185) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:37.367615 run osmo-stp_10.42.42.5(pid=25240): stderr: | 20221212155335911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155335912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155335912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155335912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155335913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155335913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155335913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:37.509719 run osmo-stp_10.42.42.5(pid=25240): stdout: | (launched: 2022-12-12_15:53:35.719185) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:37.645413 run osmo-stp_10.42.42.5(pid=25240): stderr: | 20221212155335911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155335912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155335912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155335912 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155335913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155335913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155335913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:37.806497 run patchelf(pid=25243): Terminating (SIGINT) 15:53:37.992503 run patchelf(pid=25243): Terminated: ok {rc=0} 15:53:38.127062 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25240): Process ended prematurely: osmo-stp_10.42.42.5(pid=25240) [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25240)] [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 15:53:38.137403 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 15:53:38.166059 run osmo-hlr_10.42.42.2(pid=25237): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25237)] 15:53:38.216445 run osmo-hlr_10.42.42.2(pid=25237): stdout: | (launched: 2022-12-12_15:53:34.683570) 15:53:38.268404 run osmo-hlr_10.42.42.2(pid=25237): stderr: | 20221212155334881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155334881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155334881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155334881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155334881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155334881 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155334894 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155334903 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155334903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155334903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:38.321011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25230): Terminating (SIGTERM) 15:53:38.363579 run iperf3-srv_10.42.42.10(pid=25231): Terminating (SIGTERM) 15:53:38.405610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25232): Terminating (SIGTERM) 15:53:38.447592 run iperf3-srv_10.42.42.10(pid=25233): Terminating (SIGTERM) 15:53:38.489619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25236): Terminating (SIGTERM) 15:53:38.531521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25239): Terminating (SIGTERM) 15:53:38.573499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25242): Terminating (SIGTERM) 15:53:38.615492 --- ParallelTerminationStrategy: PID 25230 died... 15:53:38.635497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25230): Terminated: ok {rc=0} 15:53:38.682003 --- ParallelTerminationStrategy: PID 25231 died... 15:53:38.701355 run iperf3-srv_10.42.42.10(pid=25231): Terminated {rc=256} 15:53:38.747563 --- ParallelTerminationStrategy: PID 25232 died... 15:53:38.767005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25232): Terminated: ok {rc=0} 15:53:38.813504 --- ParallelTerminationStrategy: PID 25233 died... 15:53:38.832852 run iperf3-srv_10.42.42.10(pid=25233): Terminated {rc=256} 15:53:38.879138 --- ParallelTerminationStrategy: PID 25236 died... 15:53:38.898525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25236): Terminated: ok {rc=0} 15:53:38.944874 --- ParallelTerminationStrategy: PID 25239 died... 15:53:38.964821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25239): Terminated: ok {rc=0} 15:53:39.011112 --- ParallelTerminationStrategy: PID 25242 died... 15:53:39.030495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25242): Terminated: ok {rc=0} 15:53:39.118979 bus /gobi_0: Setting Powered False 15:53:40.217722 bus /gobi_0: Setting Powered False 15:53:41.332693 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 15:53:42.483230 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:42.495274 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:53:42.549784 tst iperf3.py: using LAC 29928 15:53:42.679210 tst iperf3.py: using RAC 93 15:53:42.809887 tst iperf3.py: using CellId 29928 15:53:42.939527 tst iperf3.py: using BVCI 29929 15:53:43.062023 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:43.073588 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:43.084628 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:43.096141 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:43.107495 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:43.118927 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:43.130803 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:43.142180 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:43.153775 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:53:43.274744 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 15:53:43.500119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:43.837732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25244): Launched 15:53:44.131893 run iperf3-srv_10.42.42.10(pid=25245): Launched 15:53:44.258179 tst iperf3.py:8: start network... 15:53:44.483212 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:44.999923 run create_hlr_db(pid=25246): Launched 15:53:45.126224 bus /gobi_6: Setting Powered False 15:53:46.229842 run create_hlr_db(pid=25246): Terminated: ok {rc=0} 15:53:46.834201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25296): Launched 15:53:47.208177 run osmo-hlr_10.42.42.2(pid=25301): Launched 15:53:47.481854 run osmo-stp_10.42.42.5: Starting osmo-stp 15:53:48.275804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25357): Launched 15:53:48.673814 run osmo-stp_10.42.42.5(pid=25386): Launched 15:53:48.945281 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:53:49.764075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25524): Launched 15:53:49.964802 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:53:50.257804 run patchelf(pid=25527): Launched 15:53:50.461298 run osmo-stp_10.42.42.5(pid=25386): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25386)] 15:53:50.606576 run osmo-stp_10.42.42.5(pid=25386): stdout: | (launched: 2022-12-12_15:53:48.605831) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:50.753550 run osmo-stp_10.42.42.5(pid=25386): stderr: | 20221212155348966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155348966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155348966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155348967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155348967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155348967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155348967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:50.899657 run osmo-stp_10.42.42.5(pid=25386): stdout: | (launched: 2022-12-12_15:53:48.605831) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:53:51.039775 run osmo-stp_10.42.42.5(pid=25386): stderr: | 20221212155348966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155348966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155348966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155348967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155348967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155348967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155348967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:53:51.205029 run patchelf(pid=25527): Terminating (SIGINT) 15:53:51.396765 run patchelf(pid=25527): Terminated: ok {rc=0} 15:53:51.535604 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25386): Process ended prematurely: osmo-stp_10.42.42.5(pid=25386) [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25386)] [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 15:53:51.547088 tst iperf3.py:8: Test FAILED (9.1 sec) 15:53:51.579665 run osmo-hlr_10.42.42.2(pid=25301): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25301)] 15:53:51.632900 run osmo-hlr_10.42.42.2(pid=25301): stdout: | (launched: 2022-12-12_15:53:47.142917) 15:53:51.687557 run osmo-hlr_10.42.42.2(pid=25301): stderr: | 20221212155347506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155347506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155347506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155347506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155347506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155347506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155347524 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155347532 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155347533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155347533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:53:51.743101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25244): Terminating (SIGTERM) 15:53:51.787850 run iperf3-srv_10.42.42.10(pid=25245): Terminating (SIGTERM) 15:53:51.834983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25296): Terminating (SIGTERM) 15:53:51.880055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25357): Terminating (SIGTERM) 15:53:51.925410 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25524): Terminating (SIGTERM) 15:53:51.967659 --- ParallelTerminationStrategy: PID 25244 died... 15:53:51.987066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25244): Terminated: ok {rc=0} 15:53:52.033697 --- ParallelTerminationStrategy: PID 25245 died... 15:53:52.052505 run iperf3-srv_10.42.42.10(pid=25245): Terminated {rc=256} 15:53:52.096438 --- ParallelTerminationStrategy: PID 25296 died... 15:53:52.115659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25296): Terminated: ok {rc=0} 15:53:52.161102 --- ParallelTerminationStrategy: PID 25357 died... 15:53:52.180114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25357): Terminated: ok {rc=0} 15:53:52.225665 --- ParallelTerminationStrategy: PID 25524 died... 15:53:52.244882 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25524): Terminated: ok {rc=0} 15:53:52.330641 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 15:53:53.479598 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:53.492244 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:53:53.543977 tst iperf3m4.py: using LAC 29929 15:53:53.668339 tst iperf3m4.py: using RAC 94 15:53:53.791644 tst iperf3m4.py: using CellId 29929 15:53:53.916399 tst iperf3m4.py: using BVCI 29930 15:53:54.033551 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:54.045517 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:54.057284 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:54.069251 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:54.081488 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:54.093990 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:54.105957 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:54.118303 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:53:54.131595 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:53:54.254135 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:53:54.376242 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:53:54.499570 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:53:54.623013 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 15:53:54.837071 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:55.159375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25530): Launched 15:53:55.452551 run iperf3-srv_10.42.42.10(pid=25531): Launched 15:53:55.586247 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 15:53:55.801911 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:56.122504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25532): Launched 15:53:56.416628 run iperf3-srv_10.42.42.10(pid=25533): Launched 15:53:56.550883 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 15:53:56.764175 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:57.088063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25534): Launched 15:53:57.382437 run iperf3-srv_10.42.42.10(pid=25535): Launched 15:53:57.522666 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 15:53:57.751516 run iperf3-srv_10.42.42.10: Starting iperf3-srv 15:53:58.094481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25536): Launched 15:53:58.402409 run iperf3-srv_10.42.42.10(pid=25537): Launched 15:53:58.543481 tst iperf3m4.py:8: start network... 15:53:58.772724 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:53:59.300174 run create_hlr_db(pid=25538): Launched 15:53:59.462692 bus /gobi_6: Setting Powered False 15:54:00.529648 run create_hlr_db(pid=25538): Terminated: ok {rc=0} 15:54:01.073698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25540): Launched 15:54:01.431933 run osmo-hlr_10.42.42.2(pid=25541): Launched 15:54:01.690944 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:02.499093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25543): Launched 15:54:02.923512 run osmo-stp_10.42.42.5(pid=25544): Launched 15:54:03.244388 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:03.893874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25546): Launched 15:54:04.036893 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:04.330947 run patchelf(pid=25547): Launched 15:54:04.536089 run osmo-stp_10.42.42.5(pid=25544): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25544)] 15:54:04.683690 run osmo-stp_10.42.42.5(pid=25544): stdout: | (launched: 2022-12-12_15:54:02.848209) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:04.831933 run osmo-stp_10.42.42.5(pid=25544): stderr: | 20221212155403111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155403111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155403111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155403112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155403112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155403112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155403112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:04.980100 run osmo-stp_10.42.42.5(pid=25544): stdout: | (launched: 2022-12-12_15:54:02.848209) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:05.121602 run osmo-stp_10.42.42.5(pid=25544): stderr: | 20221212155403111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155403111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155403111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155403112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155403112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155403112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155403112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:05.291285 run patchelf(pid=25547): Terminating (SIGINT) 15:54:05.486272 run patchelf(pid=25547): Terminated: ok {rc=0} 15:54:05.626720 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25544): Process ended prematurely: osmo-stp_10.42.42.5(pid=25544) [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25544)] [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 15:54:05.638248 tst iperf3m4.py:8: Test FAILED (12.2 sec) 15:54:05.672293 run osmo-hlr_10.42.42.2(pid=25541): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25541)] 15:54:05.726006 run osmo-hlr_10.42.42.2(pid=25541): stdout: | (launched: 2022-12-12_15:54:01.369984) 15:54:05.782194 run osmo-hlr_10.42.42.2(pid=25541): stderr: | 20221212155401668 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155401668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155401668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155401668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155401668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155401668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155401681 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155401699 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155401699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155401699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:05.839386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25530): Terminating (SIGTERM) 15:54:05.885530 run iperf3-srv_10.42.42.10(pid=25531): Terminating (SIGTERM) 15:54:05.934585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25532): Terminating (SIGTERM) 15:54:05.981157 run iperf3-srv_10.42.42.10(pid=25533): Terminating (SIGTERM) 15:54:06.030430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25534): Terminating (SIGTERM) 15:54:06.076454 run iperf3-srv_10.42.42.10(pid=25535): Terminating (SIGTERM) 15:54:06.124566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25536): Terminating (SIGTERM) 15:54:06.171180 run iperf3-srv_10.42.42.10(pid=25537): Terminating (SIGTERM) 15:54:06.220802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25540): Terminating (SIGTERM) 15:54:06.266373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25543): Terminating (SIGTERM) 15:54:06.312006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25546): Terminating (SIGTERM) 15:54:06.359481 --- ParallelTerminationStrategy: PID 25530 died... 15:54:06.381242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25530): Terminated: ok {rc=0} 15:54:06.434487 --- ParallelTerminationStrategy: PID 25531 died... 15:54:06.455878 run iperf3-srv_10.42.42.10(pid=25531): Terminated {rc=256} 15:54:06.506421 --- ParallelTerminationStrategy: PID 25532 died... 15:54:06.527833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25532): Terminated: ok {rc=0} 15:54:06.578710 --- ParallelTerminationStrategy: PID 25533 died... 15:54:06.599809 run iperf3-srv_10.42.42.10(pid=25533): Terminated {rc=256} 15:54:06.651368 --- ParallelTerminationStrategy: PID 25534 died... 15:54:06.672806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25534): Terminated: ok {rc=0} 15:54:06.723734 --- ParallelTerminationStrategy: PID 25535 died... 15:54:06.744527 run iperf3-srv_10.42.42.10(pid=25535): Terminated {rc=256} 15:54:06.795904 --- ParallelTerminationStrategy: PID 25536 died... 15:54:06.817846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25536): Terminated: ok {rc=0} 15:54:06.868312 --- ParallelTerminationStrategy: PID 25537 died... 15:54:06.889672 run iperf3-srv_10.42.42.10(pid=25537): Terminated {rc=256} 15:54:06.940589 --- ParallelTerminationStrategy: PID 25540 died... 15:54:06.962400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25540): Terminated: ok {rc=0} 15:54:07.014160 --- ParallelTerminationStrategy: PID 25543 died... 15:54:07.035511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25543): Terminated: ok {rc=0} 15:54:07.086062 --- ParallelTerminationStrategy: PID 25546 died... 15:54:07.107363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25546): Terminated: ok {rc=0} 15:54:07.202896 bus /gobi_4: Setting Powered False 15:54:08.308633 bus /gobi_4: Setting Powered False 15:54:09.431441 bus /gobi_1: Setting Powered False 15:54:10.531911 bus /gobi_1: Setting Powered False 15:54:11.652033 bus /gobi_0: Setting Powered False 15:54:12.753769 bus /gobi_0: Setting Powered False 15:54:13.870393 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 15:54:14.973203 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:54:14.985396 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:54:15.039324 tst ping.py: using LAC 29930 15:54:15.166739 tst ping.py: using RAC 95 15:54:15.294900 tst ping.py: using CellId 29930 15:54:15.423888 tst ping.py: using BVCI 29931 15:54:15.542165 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:54:15.553678 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:54:15.564879 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:54:15.576510 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:54:15.587909 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:54:15.599275 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:54:15.610902 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:54:15.622366 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:54:15.740366 tst ping.py:19: start network... 15:54:15.962922 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:16.547859 run create_hlr_db(pid=25549): Launched 15:54:16.751736 bus /gobi_6: Setting Powered False 15:54:17.816439 run create_hlr_db(pid=25549): Terminated: ok {rc=0} 15:54:18.283348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25551): Launched 15:54:18.614814 run osmo-hlr_10.42.42.2(pid=25552): Launched 15:54:18.740297 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:19.307758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25554): Launched 15:54:19.638253 run osmo-stp_10.42.42.5(pid=25555): Launched 15:54:19.763226 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:20.328620 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25557): Launched 15:54:20.454484 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:20.731488 run patchelf(pid=25558): Launched 15:54:20.913191 run osmo-stp_10.42.42.5(pid=25555): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25555)] 15:54:21.050548 run osmo-stp_10.42.42.5(pid=25555): stdout: | (launched: 2022-12-12_15:54:19.575315) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:21.190036 run osmo-stp_10.42.42.5(pid=25555): stderr: | 20221212155419766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155419767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155419767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155419767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155419768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155419768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155419768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:21.329665 run osmo-stp_10.42.42.5(pid=25555): stdout: | (launched: 2022-12-12_15:54:19.575315) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:21.463239 run osmo-stp_10.42.42.5(pid=25555): stderr: | 20221212155419766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155419767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155419767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155419767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155419768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155419768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155419768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:21.621181 run patchelf(pid=25558): Terminating (SIGINT) 15:54:21.802692 run patchelf(pid=25558): Terminated: ok {rc=0} 15:54:21.934008 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25555): Process ended prematurely: osmo-stp_10.42.42.5(pid=25555) [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25555)] [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 15:54:21.943811 tst ping.py:22: Test FAILED (7.0 sec) 15:54:21.972309 run osmo-hlr_10.42.42.2(pid=25552): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25552)] 15:54:22.022022 run osmo-hlr_10.42.42.2(pid=25552): stdout: | (launched: 2022-12-12_15:54:18.551221) 15:54:22.073862 run osmo-hlr_10.42.42.2(pid=25552): stderr: | 20221212155418749 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155418749 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155418749 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155418749 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155418749 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155418749 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155418761 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155418770 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155418770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155418770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:22.126289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25551): Terminating (SIGTERM) 15:54:22.167952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25554): Terminating (SIGTERM) 15:54:22.209662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25557): Terminating (SIGTERM) 15:54:22.251760 --- ParallelTerminationStrategy: PID 25551 died... 15:54:22.271682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25551): Terminated: ok {rc=0} 15:54:22.318472 --- ParallelTerminationStrategy: PID 25554 died... 15:54:22.337980 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25554): Terminated: ok {rc=0} 15:54:22.385528 --- ParallelTerminationStrategy: PID 25557 died... 15:54:22.405034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25557): Terminated: ok {rc=0} 15:54:22.492556 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2378 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 15:54:23.580062 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:54:23.592179 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 15:54:23.644526 tst ping_idle_ping.py: using LAC 29931 15:54:23.772463 tst ping_idle_ping.py: using RAC 96 15:54:23.898540 tst ping_idle_ping.py: using CellId 29931 15:54:24.026385 tst ping_idle_ping.py: using BVCI 29932 15:54:24.146100 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:54:24.157633 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:54:24.168699 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:54:24.180319 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:54:24.191883 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:54:24.203239 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:54:24.214868 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 15:54:24.226368 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 15:54:24.342862 tst ping_idle_ping.py:24: start network... 15:54:24.548256 run osmo-hlr_10.42.42.2: Starting osmo-hlr 15:54:25.025182 run create_hlr_db(pid=25559): Launched 15:54:25.151085 bus /gobi_6: Setting Powered False 15:54:26.211889 run create_hlr_db(pid=25559): Terminated: ok {rc=0} 15:54:26.641506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25561): Launched 15:54:26.952471 run osmo-hlr_10.42.42.2(pid=25562): Launched 15:54:27.069499 run osmo-stp_10.42.42.5: Starting osmo-stp 15:54:27.599936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25564): Launched 15:54:27.910356 run osmo-stp_10.42.42.5(pid=25565): Launched 15:54:28.027444 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 15:54:28.557420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25567): Launched 15:54:28.675230 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 15:54:28.937281 run patchelf(pid=25568): Launched 15:54:29.107861 run osmo-stp_10.42.42.5(pid=25565): ERR: Terminated: ERROR {rc=1} [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25565)] 15:54:29.236561 run osmo-stp_10.42.42.5(pid=25565): stdout: | (launched: 2022-12-12_15:54:27.850399) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:29.366865 run osmo-stp_10.42.42.5(pid=25565): stderr: | 20221212155428024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155428025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155428025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155428025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155428026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155428026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155428026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:29.496845 run osmo-stp_10.42.42.5(pid=25565): stdout: | (launched: 2022-12-12_15:54:27.850399) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 15:54:29.621225 run osmo-stp_10.42.42.5(pid=25565): stderr: | 20221212155428024 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221212155428025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221212155428025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221212155428025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221212155428026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221212155428026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221212155428026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 15:54:29.768398 run patchelf(pid=25568): Terminating (SIGINT) 15:54:29.939340 run patchelf(pid=25568): Terminated: ok {rc=0} 15:54:30.062465 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25565): Process ended prematurely: osmo-stp_10.42.42.5(pid=25565) [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25565)] [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 15:54:30.071371 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 15:54:30.098248 run osmo-hlr_10.42.42.2(pid=25562): ERR: Terminated: ERROR {rc=237} [trial-2378↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25562)] 15:54:30.145291 run osmo-hlr_10.42.42.2(pid=25562): stdout: | (launched: 2022-12-12_15:54:26.892783) 15:54:30.194486 run osmo-hlr_10.42.42.2(pid=25562): stderr: | 20221212155427071 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221212155427071 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221212155427071 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221212155427071 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221212155427071 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221212155427071 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221212155427084 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2378/run.2022-12-12_15-30-01/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221212155427094 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221212155427094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221212155427095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 15:54:30.243900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25561): Terminating (SIGTERM) 15:54:30.283348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25564): Terminating (SIGTERM) 15:54:30.322917 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25567): Terminating (SIGTERM) 15:54:30.362983 --- ParallelTerminationStrategy: PID 25561 died... 15:54:30.381878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25561): Terminated: ok {rc=0} 15:54:30.426097 --- ParallelTerminationStrategy: PID 25564 died... 15:54:30.444892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25564): Terminated: ok {rc=0} 15:54:30.489011 --- ParallelTerminationStrategy: PID 25567 died... 15:54:30.507898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25567): Terminated: ok {rc=0} 15:54:30.592012 bus /gobi_6: Setting Powered False FATAL: command execution failed java.io.EOFException at java.base/java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2905) at java.base/java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3400) at java.base/java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:936) at java.base/java.io.ObjectInputStream.(ObjectInputStream.java:379) at hudson.remoting.ObjectInputStreamEx.(ObjectInputStreamEx.java:49) at hudson.remoting.Command.readFrom(Command.java:142) at hudson.remoting.Command.readFrom(Command.java:128) at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61) Caused: java.io.IOException: Unexpected termination of the channel at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:75) Caused: java.io.IOException: Backing channel 'osmo-gsm-tester-prod' is disconnected. at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285) at com.sun.proxy.$Proxy77.isAlive(Unknown Source) at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215) at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207) at hudson.tasks.CommandInterpreter.join(CommandInterpreter.java:195) at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:145) at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:92) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814) at hudson.model.Build$BuildExecution.build(Build.java:199) at hudson.model.Build$BuildExecution.doRun(Build.java:164) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522) at hudson.model.Run.execute(Run.java:1896) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:442) FATAL: Unable to delete script file /tmp/jenkins12576255231115906942.sh java.io.EOFException at java.base/java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2905) at java.base/java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3400) at java.base/java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:936) at java.base/java.io.ObjectInputStream.(ObjectInputStream.java:379) at hudson.remoting.ObjectInputStreamEx.(ObjectInputStreamEx.java:49) at hudson.remoting.Command.readFrom(Command.java:142) at hudson.remoting.Command.readFrom(Command.java:128) at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35) at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61) Caused: java.io.IOException: Unexpected termination of the channel at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:75) Caused: hudson.remoting.ChannelClosedException: Channel "hudson.remoting.Channel@10128372:osmo-gsm-tester-prod": Remote call on osmo-gsm-tester-prod failed. The channel is closing down or has closed down at hudson.remoting.Channel.call(Channel.java:993) at hudson.FilePath.act(FilePath.java:1194) at hudson.FilePath.act(FilePath.java:1183) at hudson.FilePath.delete(FilePath.java:1730) at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:163) at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:92) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814) at hudson.model.Build$BuildExecution.build(Build.java:199) at hudson.model.Build$BuildExecution.doRun(Build.java:164) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522) at hudson.model.Run.execute(Run.java:1896) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44) at hudson.model.ResourceController.execute(ResourceController.java:101) at hudson.model.Executor.run(Executor.java:442) Build step 'Execute shell' marked build as failure ERROR: Step ‘Archive the artifacts’ failed: no workspace for osmo-gsm-tester_run-prod #2378 ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for osmo-gsm-tester_run-prod #2378 Sending e-mails to: pespin@sysmocom.de Finished: FAILURE