![[Jenkins]](/jenkins/static/b68c8964/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-ggsn" build number 6694 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6689 originally caused by: Started by upstream project "master-libosmocore" build number 3073 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29313 originally caused by: Started by upstream project "master-osmo-msc" build number 34276 originally caused by: Started by upstream project "master-libsmpp34" build number 1817 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9259 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9130 originally caused by: Started by upstream project "master-libosmo-netif" build number 6970 originally caused by: Started by upstream project "master-libosmo-abis" build number 4963 originally caused by: Started by upstream project "master-libosmocore" build number 3073 originally caused by: Started by timer Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8963 originally caused by: Started by upstream project "master-osmo-mgw" build number 9195 originally caused by: Started by upstream project "master-libosmo-netif" build number 6970 originally caused by: Started by upstream project "master-libosmo-abis" build number 4963 originally caused by: Started by upstream project "master-libosmocore" build number 3073 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8718 originally caused by: Started by upstream project "master-osmo-hlr" build number 8853 originally caused by: Started by upstream project "master-libosmo-netif" build number 6970 originally caused by: Started by upstream project "master-libosmo-abis" build number 4963 originally caused by: Started by upstream project "master-libosmocore" build number 3073 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-nitb" build number 12994 originally caused by: Started by upstream project "master-openbsc" build number 13191 originally caused by: Started by upstream project "master-libsmpp34" build number 1817 originally caused by: Started by timer Started by upstream project "master-openbsc" build number 13192 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9130 originally caused by: Started by upstream project "master-libosmo-netif" build number 6970 originally caused by: Started by upstream project "master-libosmo-abis" build number 4963 originally caused by: Started by upstream project "master-libosmocore" build number 3073 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bsc" build number 17685 originally caused by: Started by upstream project "master-osmo-bsc" build number 20147 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9130 originally caused by: Started by upstream project "master-libosmo-netif" build number 6970 originally caused by: Started by upstream project "master-libosmo-abis" build number 4963 originally caused by: Started by upstream project "master-libosmocore" build number 3073 originally caused by: Started by timer Started by upstream project "master-osmo-bsc" build number 20148 originally caused by: Started by upstream project "master-osmo-mgw" build number 9195 originally caused by: Started by upstream project "master-libosmo-netif" build number 6970 Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30099 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37270 originally caused by: Started by upstream project "master-osmo-ggsn" build number 6689 originally caused by: Started by upstream project "master-libosmocore" build number 3073 originally caused by: Started by timer Started by upstream project "master-osmo-sgsn" build number 37271 originally caused by: Started by upstream project "master-libosmo-netif" build number 6970 originally caused by: Started by upstream project "master-libosmo-abis" build number 4963 originally caused by: Started by upstream project "master-libosmocore" build number 3073 Started by upstream project "master-osmo-sgsn" build number 37272 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9130 originally caused by: Started by upstream project "master-libosmo-netif" build number 6970 Started by upstream project "master-osmo-sgsn" build number 37273 originally caused by: Started by upstream project "master-osmo-iuh" build number 12877 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9130 Started by upstream project "osmo-gsm-tester_build-osmo-bts" build number 7514 originally caused by: Started by upstream project "master-osmo-bts" build number 7578 originally caused by: Started by upstream project "master-libosmo-abis" build number 4963 originally caused by: Started by upstream project "master-libosmocore" build number 3073 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5541 originally caused by: Started by upstream project "master-osmo-bts" build number 7578 originally caused by: Started by upstream project "master-libosmo-abis" build number 4963 originally caused by: Started by upstream project "master-libosmocore" build number 3073 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29314 originally caused by: Started by upstream project "master-osmo-msc" build number 34277 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9130 originally caused by: Started by upstream project "master-libosmo-netif" build number 6970 originally caused by: Started by upstream project "master-libosmo-abis" build number 4963 originally caused by: Started by upstream project "master-libosmocore" build number 3073 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34278 originally caused by: Started by upstream project "master-osmo-mgw" build number 9195 originally caused by: Started by upstream project "master-libosmo-netif" build number 6970 Started by upstream project "master-osmo-msc" build number 34279 originally caused by: Started by upstream project "master-osmo-iuh" build number 12877 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9130 Started by upstream project "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8045 originally caused by: Started by upstream project "master-osmo-bts" build number 7578 originally caused by: Started by upstream project "master-libosmo-abis" build number 4963 originally caused by: Started by upstream project "master-libosmocore" build number 3073 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-trx" build number 4686 originally caused by: Started by upstream project "master-osmo-trx" build number 4895 originally caused by: Started by upstream project "master-libosmocore" build number 3073 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-mgw" build number 8964 originally caused by: Started by upstream project "master-osmo-mgw" build number 9196 originally caused by: Started by upstream project "master-libosmo-netif" build number 6971 originally caused by: Started by upstream project "master-libosmo-abis" build number 4964 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-hlr" build number 8719 originally caused by: Started by upstream project "master-osmo-hlr" build number 8854 originally caused by: Started by upstream project "master-libosmo-netif" build number 6971 originally caused by: Started by upstream project "master-libosmo-abis" build number 4964 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-stp" build number 9260 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9131 originally caused by: Started by upstream project "master-libosmo-netif" build number 6971 originally caused by: Started by upstream project "master-libosmo-abis" build number 4964 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30100 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37274 originally caused by: Started by upstream project "master-libosmo-netif" build number 6971 originally caused by: Started by upstream project "master-libosmo-abis" build number 4964 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts" build number 7515 originally caused by: Started by upstream project "master-osmo-bts" build number 7579 originally caused by: Started by upstream project "master-libosmo-abis" build number 4964 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5542 originally caused by: Started by upstream project "master-osmo-bts" build number 7579 originally caused by: Started by upstream project "master-libosmo-abis" build number 4964 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8046 originally caused by: Started by upstream project "master-osmo-bts" build number 7579 originally caused by: Started by upstream project "master-libosmo-abis" build number 4964 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29315 originally caused by: Started by upstream project "master-osmo-msc" build number 34280 originally caused by: Started by upstream project "master-osmo-mgw" build number 9196 originally caused by: Started by upstream project "master-libosmo-netif" build number 6971 originally caused by: Started by upstream project "master-libosmo-abis" build number 4964 originally caused by: Started by timer Started by upstream project "master-osmo-msc" build number 34281 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9131 originally caused by: Started by upstream project "master-libosmo-netif" build number 6971 Started by upstream project "master-osmo-msc" build number 34282 originally caused by: Started by upstream project "master-osmo-iuh" build number 12878 originally caused by: Started by upstream project "master-libosmo-sccp" build number 9131 Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17685 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7515 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6694 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8719 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8964 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2993 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29315 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5155 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30100 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4686 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12994 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9260 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4714 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8046 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5194 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5542 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3911 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins2746840311126520075.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-14 02:07:35 + trial_dir_prefix=trial- + rm -rf trial-2397 trial-2397-bin.tgz trial-2397-run.tgz + trial_dir=trial-2398 + mkdir -p trial-2398 + mv open5gs.build-8.tgz osmo-bsc.build-17685.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6694.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2993.tgz osmo-mgw.build-8964.tgz osmo-msc.build-29315.tgz osmo-nitb.build-12994.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30100.tgz osmo-stp.build-9260.tgz osmo-trx.build-4686.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz trial-2398 + cat open5gs.build-8.md5 osmo-bsc.build-17685.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6694.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2993.md5 osmo-mgw.build-8964.md5 osmo-msc.build-29315.md5 osmo-nitb.build-12994.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30100.md5 osmo-stp.build-9260.md5 osmo-trx.build-4686.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17685.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6694.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2993.md5 osmo-mgw.build-8964.md5 osmo-msc.build-29315.md5 osmo-nitb.build-12994.md5 osmo-pcu-oc2g.build-3911.md5 osmo-pcu-sysmo.build-5194.md5 osmo-pcu.build-5155.md5 osmo-sgsn.build-30100.md5 osmo-stp.build-9260.md5 osmo-trx.build-4686.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2398 combinations: None trial: 'trial-2398' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2398 -------------------------------------------------------------------------------------------- 02:07:46.673935 tst trial-2398: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/log --------------------------------------------------------------------- trial-2398 nitb_sms:sysmo --------------------------------------------------------------------- 02:09:53.166794 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:09:53.171378 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 02:09:53.192661 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 02:09:53.199944 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 02:09:53.254549 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 02:09:53.274932 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 02:09:53.281614 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 02:09:53.817539 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 02:09:53.822448 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 02:09:53.833010 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 02:09:54.200826 tst mo_mt_sms.py: using LAC 37813 02:09:54.434531 tst mo_mt_sms.py: using RAC 73 02:09:54.549048 tst mo_mt_sms.py: using CellId 37813 02:09:54.661263 tst mo_mt_sms.py: using BVCI 37814 02:09:54.764551 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 02:09:54.942141 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 02:09:55.059126 tst mo_mt_sms.py:9: start nitb and bts... 02:09:55.271109 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:09:57.594172 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28071): Launched 02:09:57.909954 run osmo-nitb_10.42.42.2(pid=28072): Launched 02:09:58.082153 run osmo-nitb_10.42.42.2(pid=28072): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28072)] 02:09:58.212298 run osmo-nitb_10.42.42.2(pid=28072): stdout: | (launched: 2022-12-14_02:09:57.852045) 02:09:58.343423 run osmo-nitb_10.42.42.2(pid=28072): stderr: | (launched: 2022-12-14_02:09:57.899127) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:09:58.474991 run osmo-nitb_10.42.42.2(pid=28072): stdout: | (launched: 2022-12-14_02:09:57.852045) 02:09:58.600804 run osmo-nitb_10.42.42.2(pid=28072): stderr: | (launched: 2022-12-14_02:09:57.899127) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:09:58.751207 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28072): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28072) [trial-2398↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28072)] [trial-2398↪nitb_sms:sysmo↪mo_mt_sms.py:11] 02:09:58.759983 tst mo_mt_sms.py:11: Test FAILED (4.9 sec) 02:09:58.766990 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28071): Terminating (SIGTERM) 02:09:58.978142 --- ParallelTerminationStrategy: PID 28071 died... 02:09:59.000027 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28071): Terminated: ok {rc=0} 02:09:59.089514 bus /sierra_3: Setting Powered False 02:10:00.188419 bus /sierra_3: Setting Powered False 02:10:01.307808 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 sms:sysmo --------------------------------------------------------------------- 02:10:02.492316 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:10:02.496545 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 02:10:02.517566 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 02:10:02.545542 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 02:10:02.598828 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 02:10:02.619073 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 02:10:02.645304 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 02:10:03.191843 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 sms:sysmo mo_mt_sms.py ---------------------------------------------- 02:10:03.198114 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:10:03.208903 tst sms:sysmo: Using 1 x bts (candidates: 1) 02:10:03.247057 tst mo_mt_sms.py: using LAC 37814 02:10:03.372786 tst mo_mt_sms.py: using RAC 74 02:10:03.496747 tst mo_mt_sms.py: using CellId 37814 02:10:03.619445 tst mo_mt_sms.py: using BVCI 37815 02:10:03.734449 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:10:03.745301 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:10:03.756145 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:10:03.767001 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:10:03.778729 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 02:10:03.790413 tst sms:sysmo: Using 1 x modem (candidates: 2) 02:10:03.907358 tst sms:sysmo: Using 1 x modem (candidates: 2) 02:10:04.027289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:10:05.763292 run create_hlr_db(pid=28081): Launched 02:10:05.884676 bus /sierra_2: Setting Powered False 02:10:06.947861 run create_hlr_db(pid=28081): Terminated: ok {rc=0} 02:10:07.372605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28083): Launched 02:10:07.692055 run osmo-hlr_10.42.42.2(pid=28084): Launched 02:10:07.814057 run osmo-stp_10.42.42.5: Starting osmo-stp 02:10:10.390109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28086): Launched 02:10:10.706883 run osmo-stp_10.42.42.5(pid=28087): Launched 02:10:10.828038 run osmo-msc_10.42.42.6: Starting osmo-msc 02:10:16.241731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28089): Launched 02:10:16.553209 run osmo-msc_10.42.42.6(pid=28090): Launched 02:10:16.924314 run osmo-stp_10.42.42.5(pid=28087): ERR: Terminated: ERROR {rc=1} [trial-2398↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28087)] 02:10:17.249772 run osmo-stp_10.42.42.5(pid=28087): stdout: | (launched: 2022-12-14_02:10:10.648597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:17.407092 run osmo-stp_10.42.42.5(pid=28087): stderr: | [0;m[38;5;43m20221214021010840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021010840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021010841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021010841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021010843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021010843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021010843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:17.529440 run osmo-stp_10.42.42.5(pid=28087): stdout: | (launched: 2022-12-14_02:10:10.648597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:17.646263 run osmo-stp_10.42.42.5(pid=28087): stderr: | [0;m[38;5;43m20221214021010840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021010840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021010841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021010841 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021010843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021010843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021010843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:17.785974 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28087): Process ended prematurely: osmo-stp_10.42.42.5(pid=28087) [trial-2398↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28087)] [trial-2398↪sms:sysmo↪mo_mt_sms.py:16] 02:10:17.794078 tst mo_mt_sms.py:16: Test FAILED (14.6 sec) 02:10:17.820111 run osmo-hlr_10.42.42.2(pid=28084): ERR: Terminated: ERROR {rc=237} [trial-2398↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28084)] 02:10:17.868815 run osmo-hlr_10.42.42.2(pid=28084): stdout: | (launched: 2022-12-14_02:10:07.633668) 02:10:17.918857 run osmo-hlr_10.42.42.2(pid=28084): stderr: | [0;m[1;31m20221214021007832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021007832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021007832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021007832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021007832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021007832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021007844 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021007852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021007852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021007852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:10:17.987797 run osmo-msc_10.42.42.6(pid=28090): ERR: Terminated: ERROR {rc=2} [trial-2398↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28090)] 02:10:18.035615 run osmo-msc_10.42.42.6(pid=28090): stdout: | (launched: 2022-12-14_02:10:16.497718) 02:10:18.085230 run osmo-msc_10.42.42.6(pid=28090): stderr: | [0;m[38;5;43m20221214021017008 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021017008 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f42e6c87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021017008 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021017008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021017008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021017008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021017010 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021017011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021017011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021017011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:10:18.135120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28083): Terminating (SIGTERM) 02:10:18.175426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28086): Terminating (SIGTERM) 02:10:18.215301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28089): Terminating (SIGTERM) 02:10:18.255388 --- ParallelTerminationStrategy: PID 28083 died... 02:10:18.274560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28083): Terminated: ok {rc=0} 02:10:18.318983 --- ParallelTerminationStrategy: PID 28086 died... 02:10:18.337690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28086): Terminated: ok {rc=0} 02:10:18.381972 --- ParallelTerminationStrategy: PID 28089 died... 02:10:18.400917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28089): Terminated: ok {rc=0} 02:10:18.487232 bus /sierra_3: Setting Powered False 02:10:19.587481 bus /sierra_3: Setting Powered False 02:10:20.701285 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_ussd:sysmo --------------------------------------------------------------------- 02:10:21.958084 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:10:21.961596 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 02:10:21.981735 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 02:10:21.988323 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 02:10:22.021825 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 02:10:22.041975 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 02:10:22.048434 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 02:10:22.568776 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2398 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 02:10:22.574037 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 02:10:22.584400 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 02:10:22.618894 tst assert_extension.py: using LAC 37815 02:10:22.744802 tst assert_extension.py: using RAC 75 02:10:22.868559 tst assert_extension.py: using CellId 37815 02:10:22.992035 tst assert_extension.py: using BVCI 37816 02:10:23.107509 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 02:10:23.222458 tst assert_extension.py:10: start nitb and bts... 02:10:23.418319 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:10:24.018716 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28095): Launched 02:10:24.312719 run osmo-nitb_10.42.42.2(pid=28096): Launched 02:10:24.475357 run osmo-nitb_10.42.42.2(pid=28096): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28096)] 02:10:24.607260 run osmo-nitb_10.42.42.2(pid=28096): stdout: | (launched: 2022-12-14_02:10:24.257919) 02:10:24.740692 run osmo-nitb_10.42.42.2(pid=28096): stderr: | (launched: 2022-12-14_02:10:24.301756) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:10:24.874277 run osmo-nitb_10.42.42.2(pid=28096): stdout: | (launched: 2022-12-14_02:10:24.257919) 02:10:25.002521 run osmo-nitb_10.42.42.2(pid=28096): stderr: | (launched: 2022-12-14_02:10:24.301756) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28096): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28096) [trial-2398↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28096)] 02:10:25.423660 tst osmo-nitb_10.42.42.2(pid=28096): stdout: | (launched: 2022-12-14_02:10:24.257919) 02:10:25.542876 tst osmo-nitb_10.42.42.2(pid=28096): stderr: | (launched: 2022-12-14_02:10:24.301756) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:10:25.682659 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28096): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28096) [trial-2398↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28096)] [trial-2398↪nitb_ussd:sysmo↪assert_extension.py:12] 02:10:25.690925 tst assert_extension.py:12: Test FAILED (3.1 sec) 02:10:25.697496 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28095): Terminating (SIGTERM) 02:10:25.906729 --- ParallelTerminationStrategy: PID 28095 died... 02:10:25.927571 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28095): Terminated: ok {rc=0} 02:10:26.014765 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 ussd:sysmo --------------------------------------------------------------------- 02:10:27.183464 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:10:27.187656 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 02:10:27.208368 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 02:10:27.235103 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 02:10:27.268270 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 02:10:27.288414 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 02:10:27.314431 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 02:10:27.845807 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2398 ussd:sysmo assert_extension.py ---------------------------------------------- 02:10:27.850906 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:10:27.861492 tst ussd:sysmo: Using 1 x bts (candidates: 1) 02:10:27.898127 tst assert_extension.py: using LAC 37816 02:10:28.014176 tst assert_extension.py: using RAC 76 02:10:28.128173 tst assert_extension.py: using CellId 37816 02:10:28.241769 tst assert_extension.py: using BVCI 37817 02:10:28.348059 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:10:28.358516 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:10:28.368777 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:10:28.379036 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:10:28.389232 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 02:10:28.399346 tst ussd:sysmo: Using 1 x modem (candidates: 1) 02:10:28.510314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:10:28.965618 run create_hlr_db(pid=28101): Launched 02:10:29.086096 bus /sierra_2: Setting Powered False 02:10:30.145075 run create_hlr_db(pid=28101): Terminated: ok {rc=0} 02:10:30.579199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28103): Launched 02:10:30.901791 run osmo-hlr_10.42.42.2(pid=28104): Launched 02:10:31.101763 run osmo-stp_10.42.42.5: Starting osmo-stp 02:10:31.821825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28106): Launched 02:10:32.152124 run osmo-stp_10.42.42.5(pid=28107): Launched 02:10:32.330639 run osmo-msc_10.42.42.6: Starting osmo-msc 02:10:32.931439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28109): Launched 02:10:33.248600 run osmo-msc_10.42.42.6(pid=28110): Launched 02:10:33.426666 run osmo-stp_10.42.42.5(pid=28107): ERR: Terminated: ERROR {rc=1} [trial-2398↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28107)] 02:10:33.561981 run osmo-stp_10.42.42.5(pid=28107): stdout: | (launched: 2022-12-14_02:10:32.089106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:33.697466 run osmo-stp_10.42.42.5(pid=28107): stderr: | [0;m[38;5;43m20221214021032398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021032398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021032399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021032399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021032399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021032399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021032399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:33.831727 run osmo-stp_10.42.42.5(pid=28107): stdout: | (launched: 2022-12-14_02:10:32.089106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:33.958325 run osmo-stp_10.42.42.5(pid=28107): stderr: | [0;m[38;5;43m20221214021032398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021032398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021032399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021032399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021032399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021032399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021032399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:34.109485 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28107): Process ended prematurely: osmo-stp_10.42.42.5(pid=28107) [trial-2398↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28107)] [trial-2398↪ussd:sysmo↪assert_extension.py:17] 02:10:34.118316 tst assert_extension.py:17: Test FAILED (6.3 sec) 02:10:34.145486 run osmo-hlr_10.42.42.2(pid=28104): ERR: Terminated: ERROR {rc=237} [trial-2398↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28104)] 02:10:34.196479 run osmo-hlr_10.42.42.2(pid=28104): stdout: | (launched: 2022-12-14_02:10:30.843050) 02:10:34.249286 run osmo-hlr_10.42.42.2(pid=28104): stderr: | [0;m[1;31m20221214021031183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021031183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021031183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021031183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021031183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021031183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021031209 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021031221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021031221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021031221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:10:34.321994 run osmo-msc_10.42.42.6(pid=28110): ERR: Terminated: ERROR {rc=2} [trial-2398↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28110)] 02:10:34.372099 run osmo-msc_10.42.42.6(pid=28110): stdout: | (launched: 2022-12-14_02:10:33.190473) 02:10:34.424193 run osmo-msc_10.42.42.6(pid=28110): stderr: | [0;m[38;5;43m20221214021033510 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021033511 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2eeeed1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021033511 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021033511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021033511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021033511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021033513 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021033513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021033513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021033513 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:10:34.476865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28103): Terminating (SIGTERM) 02:10:34.518934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28106): Terminating (SIGTERM) 02:10:34.561488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28109): Terminating (SIGTERM) 02:10:34.603861 --- ParallelTerminationStrategy: PID 28103 died... 02:10:34.624255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28103): Terminated: ok {rc=0} 02:10:34.671168 --- ParallelTerminationStrategy: PID 28106 died... 02:10:34.691133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28106): Terminated: ok {rc=0} 02:10:34.737610 --- ParallelTerminationStrategy: PID 28109 died... 02:10:34.757446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28109): Terminated: ok {rc=0} 02:10:34.846293 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:10:36.041485 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:10:36.048347 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:10:36.069236 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:10:36.096801 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:10:36.152489 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:10:36.174412 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:10:36.201648 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:10:36.748011 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:10:36.801567 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:36.812777 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:10:36.872733 tst mo_mt_call.py: using LAC 37817 02:10:37.001088 tst mo_mt_call.py: using RAC 77 02:10:37.119059 tst mo_mt_call.py: using CellId 37817 02:10:37.237045 tst mo_mt_call.py: using BVCI 37818 02:10:37.345535 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:37.356563 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:37.367485 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:37.378377 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:37.389274 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:37.400129 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:10:37.520551 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:10:37.637069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:10:38.103614 run create_hlr_db(pid=28115): Launched 02:10:38.226375 bus /sierra_2: Setting Powered False 02:10:39.286069 run create_hlr_db(pid=28115): Terminated: ok {rc=0} 02:10:39.727834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28117): Launched 02:10:40.052562 run osmo-hlr_10.42.42.2(pid=28118): Launched 02:10:40.175915 run osmo-stp_10.42.42.5: Starting osmo-stp 02:10:40.737630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28120): Launched 02:10:41.060168 run osmo-stp_10.42.42.5(pid=28121): Launched 02:10:41.182887 run osmo-msc_10.42.42.6: Starting osmo-msc 02:10:41.763584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28123): Launched 02:10:42.086511 run osmo-msc_10.42.42.6(pid=28124): Launched 02:10:42.267056 run osmo-stp_10.42.42.5(pid=28121): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28121)] 02:10:42.402907 run osmo-stp_10.42.42.5(pid=28121): stdout: | (launched: 2022-12-14_02:10:41.001179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:42.539747 run osmo-stp_10.42.42.5(pid=28121): stderr: | [0;m[38;5;43m20221214021041192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021041192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021041193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021041194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021041194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021041194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021041194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:42.675337 run osmo-stp_10.42.42.5(pid=28121): stdout: | (launched: 2022-12-14_02:10:41.001179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:42.804040 run osmo-stp_10.42.42.5(pid=28121): stderr: | [0;m[38;5;43m20221214021041192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021041192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021041193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021041194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021041194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021041194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021041194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:42.958049 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28121): Process ended prematurely: osmo-stp_10.42.42.5(pid=28121) [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28121)] [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:10:42.967387 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:10:42.994828 run osmo-hlr_10.42.42.2(pid=28118): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28118)] 02:10:43.045477 run osmo-hlr_10.42.42.2(pid=28118): stdout: | (launched: 2022-12-14_02:10:39.993229) 02:10:43.097823 run osmo-hlr_10.42.42.2(pid=28118): stderr: | [0;m[1;31m20221214021040191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021040191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021040191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021040191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021040191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021040191 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021040206 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021040216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021040216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021040217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:10:43.170227 run osmo-msc_10.42.42.6(pid=28124): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28124)] 02:10:43.220165 run osmo-msc_10.42.42.6(pid=28124): stdout: | (launched: 2022-12-14_02:10:42.027693) 02:10:43.271939 run osmo-msc_10.42.42.6(pid=28124): stderr: | [0;m[38;5;43m20221214021042369 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021042369 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8d283a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021042369 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021042369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021042370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021042370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021042371 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021042372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021042372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021042372 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:10:43.324435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28117): Terminating (SIGTERM) 02:10:43.366239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28120): Terminating (SIGTERM) 02:10:43.408427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28123): Terminating (SIGTERM) 02:10:43.450973 --- ParallelTerminationStrategy: PID 28117 died... 02:10:43.471059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28117): Terminated: ok {rc=0} 02:10:43.517135 --- ParallelTerminationStrategy: PID 28120 died... 02:10:43.536753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28120): Terminated: ok {rc=0} 02:10:43.583332 --- ParallelTerminationStrategy: PID 28123 died... 02:10:43.603095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28123): Terminated: ok {rc=0} 02:10:43.691360 bus /sierra_3: Setting Powered False 02:10:44.789148 bus /sierra_3: Setting Powered False 02:10:45.923109 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:10:47.089144 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:47.104034 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:10:47.174153 tst mo_mt_call_osmux.py: using LAC 37818 02:10:47.323186 tst mo_mt_call_osmux.py: using RAC 78 02:10:47.451239 tst mo_mt_call_osmux.py: using CellId 37818 02:10:47.579090 tst mo_mt_call_osmux.py: using BVCI 37819 02:10:47.696849 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:47.708355 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:47.719645 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:47.730935 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:47.742579 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:10:47.754049 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:10:47.873838 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:10:47.992056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:10:48.494278 run create_hlr_db(pid=28126): Launched 02:10:48.618500 bus /sierra_2: Setting Powered False 02:10:49.683757 run create_hlr_db(pid=28126): Terminated: ok {rc=0} 02:10:50.128683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28128): Launched 02:10:50.429330 run osmo-hlr_10.42.42.2(pid=28129): Launched 02:10:50.543208 run osmo-stp_10.42.42.5: Starting osmo-stp 02:10:51.077311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28131): Launched 02:10:51.377317 run osmo-stp_10.42.42.5(pid=28132): Launched 02:10:51.490334 run osmo-msc_10.42.42.6: Starting osmo-msc 02:10:52.035169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28135): Launched 02:10:52.334452 run osmo-msc_10.42.42.6(pid=28136): Launched 02:10:52.500796 run osmo-stp_10.42.42.5(pid=28132): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28132)] 02:10:52.627837 run osmo-stp_10.42.42.5(pid=28132): stdout: | (launched: 2022-12-14_02:10:51.321690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:52.754368 run osmo-stp_10.42.42.5(pid=28132): stderr: | [0;m[38;5;43m20221214021051494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021051494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021051495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021051495 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021051495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021051495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021051495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:52.879020 run osmo-stp_10.42.42.5(pid=28132): stdout: | (launched: 2022-12-14_02:10:51.321690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:10:52.998510 run osmo-stp_10.42.42.5(pid=28132): stderr: | [0;m[38;5;43m20221214021051494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021051494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021051495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021051495 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021051495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021051495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021051495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:10:53.141074 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28132): Process ended prematurely: osmo-stp_10.42.42.5(pid=28132) [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28132)] [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:10:53.149853 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:10:53.175935 run osmo-hlr_10.42.42.2(pid=28129): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28129)] 02:10:53.223456 run osmo-hlr_10.42.42.2(pid=28129): stdout: | (launched: 2022-12-14_02:10:50.374089) 02:10:53.272501 run osmo-hlr_10.42.42.2(pid=28129): stderr: | [0;m[1;31m20221214021050549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021050549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021050549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021050549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021050549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021050550 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021050562 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021050573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021050573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021050573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:10:53.341339 run osmo-msc_10.42.42.6(pid=28136): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28136)] 02:10:53.388886 run osmo-msc_10.42.42.6(pid=28136): stdout: | (launched: 2022-12-14_02:10:52.279004) 02:10:53.438318 run osmo-msc_10.42.42.6(pid=28136): stderr: | [0;m[38;5;43m20221214021052551 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021052551 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f33b2aa5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021052551 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021052551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021052551 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021052552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021052553 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021052554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021052554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021052554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:10:53.487953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28128): Terminating (SIGTERM) 02:10:53.527535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28131): Terminating (SIGTERM) 02:10:53.567008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28135): Terminating (SIGTERM) 02:10:53.606812 --- ParallelTerminationStrategy: PID 28128 died... 02:10:53.625820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28128): Terminated: ok {rc=0} 02:10:53.669537 --- ParallelTerminationStrategy: PID 28131 died... 02:10:53.688054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28131): Terminated: ok {rc=0} 02:10:53.731756 --- ParallelTerminationStrategy: PID 28135 died... 02:10:53.750237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28135): Terminated: ok {rc=0} 02:10:53.836152 bus /sierra_3: Setting Powered False 02:10:54.935243 bus /sierra_3: Setting Powered False 02:10:56.047389 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:10:57.283941 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:10:57.291295 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:10:57.312830 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:10:57.340820 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:10:57.392298 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:10:57.415696 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:10:57.442829 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:10:57.993091 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:10:58.042515 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:58.053917 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:10:58.107646 tst mo_mt_call.py: using LAC 37819 02:10:58.223879 tst mo_mt_call.py: using RAC 79 02:10:58.340260 tst mo_mt_call.py: using CellId 37819 02:10:58.456127 tst mo_mt_call.py: using BVCI 37820 02:10:58.564626 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:58.575597 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:58.586316 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:58.596908 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:58.607625 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:10:58.618319 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:10:58.731911 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:10:58.851154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:10:59.353258 run create_hlr_db(pid=28141): Launched 02:10:59.477307 bus /sierra_2: Setting Powered False 02:11:00.539347 run create_hlr_db(pid=28141): Terminated: ok {rc=0} 02:11:01.013673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28143): Launched 02:11:01.361689 run osmo-hlr_10.42.42.2(pid=28144): Launched 02:11:01.594828 run osmo-stp_10.42.42.5: Starting osmo-stp 02:11:02.323908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28146): Launched 02:11:02.626807 run osmo-stp_10.42.42.5(pid=28147): Launched 02:11:02.740308 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:03.300401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28149): Launched 02:11:03.626076 run osmo-msc_10.42.42.6(pid=28150): Launched 02:11:03.805537 run osmo-stp_10.42.42.5(pid=28147): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28147)] 02:11:03.941887 run osmo-stp_10.42.42.5(pid=28147): stdout: | (launched: 2022-12-14_02:11:02.571117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:04.078974 run osmo-stp_10.42.42.5(pid=28147): stderr: | [0;m[38;5;43m20221214021102742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021102742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021102743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021102743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021102743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021102744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021102744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:04.214599 run osmo-stp_10.42.42.5(pid=28147): stdout: | (launched: 2022-12-14_02:11:02.571117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:04.343861 run osmo-stp_10.42.42.5(pid=28147): stderr: | [0;m[38;5;43m20221214021102742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021102742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021102743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021102743 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021102743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021102744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021102744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:04.498563 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28147): Process ended prematurely: osmo-stp_10.42.42.5(pid=28147) [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28147)] [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:11:04.508066 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 02:11:04.535852 run osmo-hlr_10.42.42.2(pid=28144): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28144)] 02:11:04.587148 run osmo-hlr_10.42.42.2(pid=28144): stdout: | (launched: 2022-12-14_02:11:01.289345) 02:11:04.639591 run osmo-hlr_10.42.42.2(pid=28144): stderr: | [0;m[1;31m20221214021101639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021101639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021101639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021101639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021101639 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021101640 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021101660 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021101687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021101687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021101687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:04.711873 run osmo-msc_10.42.42.6(pid=28150): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28150)] 02:11:04.761583 run osmo-msc_10.42.42.6(pid=28150): stdout: | (launched: 2022-12-14_02:11:03.566591) 02:11:04.813644 run osmo-msc_10.42.42.6(pid=28150): stderr: | [0;m[38;5;43m20221214021103889 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021103889 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff2c959ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021103889 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021103889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021103889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021103889 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021103891 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021103891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021103891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021103891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:04.865992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28143): Terminating (SIGTERM) 02:11:04.908007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28146): Terminating (SIGTERM) 02:11:04.950348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28149): Terminating (SIGTERM) 02:11:04.992752 --- ParallelTerminationStrategy: PID 28143 died... 02:11:05.013176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28143): Terminated: ok {rc=0} 02:11:05.059883 --- ParallelTerminationStrategy: PID 28146 died... 02:11:05.079732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28146): Terminated: ok {rc=0} 02:11:05.126063 --- ParallelTerminationStrategy: PID 28149 died... 02:11:05.146026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28149): Terminated: ok {rc=0} 02:11:05.234297 bus /sierra_3: Setting Powered False 02:11:06.332864 bus /sierra_3: Setting Powered False 02:11:07.449215 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:11:08.598734 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:08.610897 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:11:08.668180 tst mo_mt_call_osmux.py: using LAC 37820 02:11:08.796393 tst mo_mt_call_osmux.py: using RAC 80 02:11:08.922701 tst mo_mt_call_osmux.py: using CellId 37820 02:11:09.048755 tst mo_mt_call_osmux.py: using BVCI 37821 02:11:09.166445 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:09.177842 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:09.188857 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:09.200013 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:09.211428 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:11:09.223070 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:11:09.342914 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:11:09.460758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:11:09.926983 run create_hlr_db(pid=28152): Launched 02:11:10.050570 bus /sierra_2: Setting Powered False 02:11:11.110852 run create_hlr_db(pid=28152): Terminated: ok {rc=0} 02:11:11.551630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28154): Launched 02:11:11.876309 run osmo-hlr_10.42.42.2(pid=28155): Launched 02:11:12.000332 run osmo-stp_10.42.42.5: Starting osmo-stp 02:11:12.560741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28157): Launched 02:11:12.884927 run osmo-stp_10.42.42.5(pid=28158): Launched 02:11:13.008422 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:13.593196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28160): Launched 02:11:13.916089 run osmo-msc_10.42.42.6(pid=28161): Launched 02:11:14.095464 run osmo-stp_10.42.42.5(pid=28158): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28158)] 02:11:14.231983 run osmo-stp_10.42.42.5(pid=28158): stdout: | (launched: 2022-12-14_02:11:12.825890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:14.369081 run osmo-stp_10.42.42.5(pid=28158): stderr: | [0;m[38;5;43m20221214021113019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021113019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021113019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021113020 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021113022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021113022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021113022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:14.505338 run osmo-stp_10.42.42.5(pid=28158): stdout: | (launched: 2022-12-14_02:11:12.825890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:14.634626 run osmo-stp_10.42.42.5(pid=28158): stderr: | [0;m[38;5;43m20221214021113019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021113019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021113019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021113020 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021113022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021113022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021113022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:14.788792 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28158): Process ended prematurely: osmo-stp_10.42.42.5(pid=28158) [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28158)] [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:11:14.798422 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:11:14.825778 run osmo-hlr_10.42.42.2(pid=28155): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28155)] 02:11:14.876428 run osmo-hlr_10.42.42.2(pid=28155): stdout: | (launched: 2022-12-14_02:11:11.817320) 02:11:14.928378 run osmo-hlr_10.42.42.2(pid=28155): stderr: | [0;m[1;31m20221214021112015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021112016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021112016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021112016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021112016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021112016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021112028 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021112036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021112037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021112037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:15.001132 run osmo-msc_10.42.42.6(pid=28161): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28161)] 02:11:15.050941 run osmo-msc_10.42.42.6(pid=28161): stdout: | (launched: 2022-12-14_02:11:13.857137) 02:11:15.103212 run osmo-msc_10.42.42.6(pid=28161): stderr: | [0;m[38;5;43m20221214021114180 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021114180 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdd05d1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021114180 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021114180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021114180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021114181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021114182 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021114183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021114183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021114183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:15.155160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28154): Terminating (SIGTERM) 02:11:15.197075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28157): Terminating (SIGTERM) 02:11:15.238858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28160): Terminating (SIGTERM) 02:11:15.281596 --- ParallelTerminationStrategy: PID 28154 died... 02:11:15.301853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28154): Terminated: ok {rc=0} 02:11:15.348273 --- ParallelTerminationStrategy: PID 28157 died... 02:11:15.368086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28157): Terminated: ok {rc=0} 02:11:15.414570 --- ParallelTerminationStrategy: PID 28160 died... 02:11:15.434471 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28160): Terminated: ok {rc=0} 02:11:15.522876 bus /sierra_3: Setting Powered False 02:11:16.618720 bus /sierra_3: Setting Powered False 02:11:17.737239 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:11:18.972148 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:11:18.979330 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:11:19.000326 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:11:19.027979 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:11:19.080305 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:11:19.101047 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:11:19.127644 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:11:19.680100 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:11:19.733257 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:19.744521 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:11:19.801351 tst mo_mt_call.py: using LAC 37821 02:11:19.929075 tst mo_mt_call.py: using RAC 81 02:11:20.061952 tst mo_mt_call.py: using CellId 37821 02:11:20.191792 tst mo_mt_call.py: using BVCI 37822 02:11:20.311559 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:20.322956 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:20.334074 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:20.345089 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:20.356411 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:20.367939 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:11:20.483832 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:11:20.604254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:11:21.106480 run create_hlr_db(pid=28166): Launched 02:11:21.229939 bus /sierra_2: Setting Powered False 02:11:22.293630 run create_hlr_db(pid=28166): Terminated: ok {rc=0} 02:11:22.724811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28168): Launched 02:11:23.026025 run osmo-hlr_10.42.42.2(pid=28169): Launched 02:11:23.140078 run osmo-stp_10.42.42.5: Starting osmo-stp 02:11:23.657245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28171): Launched 02:11:23.957340 run osmo-stp_10.42.42.5(pid=28172): Launched 02:11:24.071542 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:24.614634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28174): Launched 02:11:24.915479 run osmo-msc_10.42.42.6(pid=28175): Launched 02:11:25.083026 run osmo-stp_10.42.42.5(pid=28172): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28172)] 02:11:25.209810 run osmo-stp_10.42.42.5(pid=28172): stdout: | (launched: 2022-12-14_02:11:23.901959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:25.336731 run osmo-stp_10.42.42.5(pid=28172): stderr: | [0;m[38;5;43m20221214021124073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021124074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021124074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021124074 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021124075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021124075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021124075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:25.462072 run osmo-stp_10.42.42.5(pid=28172): stdout: | (launched: 2022-12-14_02:11:23.901959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:25.582040 run osmo-stp_10.42.42.5(pid=28172): stderr: | [0;m[38;5;43m20221214021124073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021124074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021124074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021124074 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021124075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021124075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021124075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:25.725691 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28172): Process ended prematurely: osmo-stp_10.42.42.5(pid=28172) [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28172)] [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:11:25.734479 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:11:25.760811 run osmo-hlr_10.42.42.2(pid=28169): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28169)] 02:11:25.808774 run osmo-hlr_10.42.42.2(pid=28169): stdout: | (launched: 2022-12-14_02:11:22.970371) 02:11:25.858670 run osmo-hlr_10.42.42.2(pid=28169): stderr: | [0;m[1;31m20221214021123144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021123144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021123144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021123144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021123144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021123144 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021123157 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021123166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021123166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021123166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:25.927939 run osmo-msc_10.42.42.6(pid=28175): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28175)] 02:11:25.975615 run osmo-msc_10.42.42.6(pid=28175): stdout: | (launched: 2022-12-14_02:11:24.859604) 02:11:26.025093 run osmo-msc_10.42.42.6(pid=28175): stderr: | [0;m[38;5;43m20221214021125131 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021125131 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f03de7d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021125131 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021125131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021125132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021125132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021125134 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021125134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021125134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021125134 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:26.074721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28168): Terminating (SIGTERM) 02:11:26.114158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28171): Terminating (SIGTERM) 02:11:26.153784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28174): Terminating (SIGTERM) 02:11:26.193469 --- ParallelTerminationStrategy: PID 28168 died... 02:11:26.212448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28168): Terminated: ok {rc=0} 02:11:26.256597 --- ParallelTerminationStrategy: PID 28171 died... 02:11:26.275536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28171): Terminated: ok {rc=0} 02:11:26.319095 --- ParallelTerminationStrategy: PID 28174 died... 02:11:26.337726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28174): Terminated: ok {rc=0} 02:11:26.423367 bus /sierra_3: Setting Powered False 02:11:27.522208 bus /sierra_3: Setting Powered False 02:11:28.635008 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:11:29.784362 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:29.796377 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:11:29.854158 tst mo_mt_call_osmux.py: using LAC 37822 02:11:29.983262 tst mo_mt_call_osmux.py: using RAC 82 02:11:30.111624 tst mo_mt_call_osmux.py: using CellId 37822 02:11:30.240175 tst mo_mt_call_osmux.py: using BVCI 37823 02:11:30.360079 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:30.371383 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:30.382641 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:30.393806 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:30.405683 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:11:30.417129 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:11:30.532358 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:11:30.653394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:11:31.186304 run create_hlr_db(pid=28177): Launched 02:11:31.342091 bus /sierra_2: Setting Powered False 02:11:32.401852 run create_hlr_db(pid=28177): Terminated: ok {rc=0} 02:11:32.861745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28179): Launched 02:11:33.185582 run osmo-hlr_10.42.42.2(pid=28180): Launched 02:11:33.309619 run osmo-stp_10.42.42.5: Starting osmo-stp 02:11:33.870895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28182): Launched 02:11:34.195209 run osmo-stp_10.42.42.5(pid=28183): Launched 02:11:34.318875 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:34.908077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28185): Launched 02:11:35.231928 run osmo-msc_10.42.42.6(pid=28186): Launched 02:11:35.411498 run osmo-stp_10.42.42.5(pid=28183): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28183)] 02:11:35.547878 run osmo-stp_10.42.42.5(pid=28183): stdout: | (launched: 2022-12-14_02:11:34.135275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:35.685622 run osmo-stp_10.42.42.5(pid=28183): stderr: | [0;m[38;5;43m20221214021134327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021134327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021134328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021134328 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021134329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021134329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021134329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:35.821866 run osmo-stp_10.42.42.5(pid=28183): stdout: | (launched: 2022-12-14_02:11:34.135275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:35.950874 run osmo-stp_10.42.42.5(pid=28183): stderr: | [0;m[38;5;43m20221214021134327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021134327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021134328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021134328 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021134329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021134329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021134329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:36.105052 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28183): Process ended prematurely: osmo-stp_10.42.42.5(pid=28183) [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28183)] [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:11:36.115088 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 02:11:36.142583 run osmo-hlr_10.42.42.2(pid=28180): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28180)] 02:11:36.192880 run osmo-hlr_10.42.42.2(pid=28180): stdout: | (launched: 2022-12-14_02:11:33.126028) 02:11:36.244558 run osmo-hlr_10.42.42.2(pid=28180): stderr: | [0;m[1;31m20221214021133324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021133324 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021133325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021133325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021133325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021133325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021133337 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021133345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021133345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021133345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:36.316942 run osmo-msc_10.42.42.6(pid=28186): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28186)] 02:11:36.367060 run osmo-msc_10.42.42.6(pid=28186): stdout: | (launched: 2022-12-14_02:11:35.172479) 02:11:36.419114 run osmo-msc_10.42.42.6(pid=28186): stderr: | [0;m[38;5;43m20221214021135495 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021135495 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb4ff6e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021135495 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021135495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021135495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021135495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021135497 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021135497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021135498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021135498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:36.471989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28179): Terminating (SIGTERM) 02:11:36.513893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28182): Terminating (SIGTERM) 02:11:36.556398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28185): Terminating (SIGTERM) 02:11:36.598930 --- ParallelTerminationStrategy: PID 28179 died... 02:11:36.619069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28179): Terminated: ok {rc=0} 02:11:36.665439 --- ParallelTerminationStrategy: PID 28182 died... 02:11:36.685281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28182): Terminated: ok {rc=0} 02:11:36.731347 --- ParallelTerminationStrategy: PID 28185 died... 02:11:36.751106 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28185): Terminated: ok {rc=0} 02:11:36.838759 bus /sierra_3: Setting Powered False 02:11:37.937283 bus /sierra_3: Setting Powered False 02:11:39.054105 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:11:40.289443 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:11:40.295794 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:11:40.315879 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:11:40.342089 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:11:40.392853 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:11:40.413868 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:11:40.439515 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:11:40.987769 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:11:41.036312 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:41.047278 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:11:41.108164 tst mo_mt_call.py: using LAC 37823 02:11:41.230621 tst mo_mt_call.py: using RAC 83 02:11:41.349740 tst mo_mt_call.py: using CellId 37823 02:11:41.466279 tst mo_mt_call.py: using BVCI 37824 02:11:41.575243 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:41.586267 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:41.596911 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:41.607577 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:41.618237 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:41.628849 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:11:41.743807 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:11:41.864434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:11:42.329376 run create_hlr_db(pid=28191): Launched 02:11:42.452275 bus /sierra_2: Setting Powered False 02:11:43.512446 run create_hlr_db(pid=28191): Terminated: ok {rc=0} 02:11:43.930566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28193): Launched 02:11:44.229681 run osmo-hlr_10.42.42.2(pid=28194): Launched 02:11:44.343111 run osmo-stp_10.42.42.5: Starting osmo-stp 02:11:44.857766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28196): Launched 02:11:45.157455 run osmo-stp_10.42.42.5(pid=28197): Launched 02:11:45.271703 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:45.814099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28199): Launched 02:11:46.130789 run osmo-msc_10.42.42.6(pid=28200): Launched 02:11:46.481439 run osmo-stp_10.42.42.5(pid=28197): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28197)] 02:11:46.748718 run osmo-stp_10.42.42.5(pid=28197): stdout: | (launched: 2022-12-14_02:11:45.101803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:46.988461 run osmo-stp_10.42.42.5(pid=28197): stderr: | [0;m[38;5;43m20221214021145272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021145272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021145272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021145273 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021145275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021145275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021145275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:47.145383 run osmo-stp_10.42.42.5(pid=28197): stdout: | (launched: 2022-12-14_02:11:45.101803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:47.267764 run osmo-stp_10.42.42.5(pid=28197): stderr: | [0;m[38;5;43m20221214021145272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021145272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021145272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021145273 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021145275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021145275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021145275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:47.412784 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28197): Process ended prematurely: osmo-stp_10.42.42.5(pid=28197) [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28197)] [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:11:47.421607 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 02:11:47.447525 run osmo-hlr_10.42.42.2(pid=28194): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28194)] 02:11:47.494883 run osmo-hlr_10.42.42.2(pid=28194): stdout: | (launched: 2022-12-14_02:11:44.174587) 02:11:47.543902 run osmo-hlr_10.42.42.2(pid=28194): stderr: | [0;m[1;31m20221214021144350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021144350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021144350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021144351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021144351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021144351 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021144403 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021144414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021144415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021144415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:47.612141 run osmo-msc_10.42.42.6(pid=28200): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28200)] 02:11:47.659420 run osmo-msc_10.42.42.6(pid=28200): stdout: | (launched: 2022-12-14_02:11:46.068105) 02:11:47.708254 run osmo-msc_10.42.42.6(pid=28200): stderr: | [0;m[38;5;43m20221214021146662 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021146662 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb928f43c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021146662 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021146662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021146662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021146662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021146664 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021146664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021146665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021146665 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:47.757716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28193): Terminating (SIGTERM) 02:11:47.796883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28196): Terminating (SIGTERM) 02:11:47.836111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28199): Terminating (SIGTERM) 02:11:47.875683 --- ParallelTerminationStrategy: PID 28193 died... 02:11:47.894539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28193): Terminated: ok {rc=0} 02:11:47.937756 --- ParallelTerminationStrategy: PID 28196 died... 02:11:47.955981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28196): Terminated: ok {rc=0} 02:11:47.999454 --- ParallelTerminationStrategy: PID 28199 died... 02:11:48.017957 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28199): Terminated: ok {rc=0} 02:11:48.101457 bus /sierra_3: Setting Powered False 02:11:49.199116 bus /sierra_3: Setting Powered False 02:11:50.318213 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:11:51.463129 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:51.475744 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:11:51.530169 tst mo_mt_call_osmux.py: using LAC 37824 02:11:51.658855 tst mo_mt_call_osmux.py: using RAC 84 02:11:51.785397 tst mo_mt_call_osmux.py: using CellId 37824 02:11:51.912582 tst mo_mt_call_osmux.py: using BVCI 37825 02:11:52.030989 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:52.042367 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:52.053596 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:52.064606 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:52.076138 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:11:52.087615 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:11:52.202989 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:11:52.322402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:11:52.825930 run create_hlr_db(pid=28202): Launched 02:11:52.948686 bus /sierra_2: Setting Powered False 02:11:54.012548 run create_hlr_db(pid=28202): Terminated: ok {rc=0} 02:11:54.443502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28204): Launched 02:11:54.745408 run osmo-hlr_10.42.42.2(pid=28205): Launched 02:11:54.859418 run osmo-stp_10.42.42.5: Starting osmo-stp 02:11:55.379743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28207): Launched 02:11:55.680135 run osmo-stp_10.42.42.5(pid=28208): Launched 02:11:55.795152 run osmo-msc_10.42.42.6: Starting osmo-msc 02:11:56.338624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28210): Launched 02:11:56.640260 run osmo-msc_10.42.42.6(pid=28211): Launched 02:11:56.807754 run osmo-stp_10.42.42.5(pid=28208): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28208)] 02:11:56.939125 run osmo-stp_10.42.42.5(pid=28208): stdout: | (launched: 2022-12-14_02:11:55.624139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:57.066335 run osmo-stp_10.42.42.5(pid=28208): stderr: | [0;m[38;5;43m20221214021155797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021155797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021155797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021155798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021155798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021155798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021155798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:57.191164 run osmo-stp_10.42.42.5(pid=28208): stdout: | (launched: 2022-12-14_02:11:55.624139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:11:57.310699 run osmo-stp_10.42.42.5(pid=28208): stderr: | [0;m[38;5;43m20221214021155797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021155797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021155797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021155798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021155798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021155798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021155798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:11:57.453240 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28208): Process ended prematurely: osmo-stp_10.42.42.5(pid=28208) [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28208)] [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:11:57.462041 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:11:57.488001 run osmo-hlr_10.42.42.2(pid=28205): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28205)] 02:11:57.535827 run osmo-hlr_10.42.42.2(pid=28205): stdout: | (launched: 2022-12-14_02:11:54.689707) 02:11:57.584841 run osmo-hlr_10.42.42.2(pid=28205): stderr: | [0;m[1;31m20221214021154865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021154865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021154865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021154865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021154865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021154866 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021154878 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021154887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021154887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021154887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:11:57.653949 run osmo-msc_10.42.42.6(pid=28211): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28211)] 02:11:57.701246 run osmo-msc_10.42.42.6(pid=28211): stdout: | (launched: 2022-12-14_02:11:56.583995) 02:11:57.750331 run osmo-msc_10.42.42.6(pid=28211): stderr: | [0;m[38;5;43m20221214021156855 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021156855 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5bcf4a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021156856 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021156856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021156856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021156856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021156859 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021156860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021156860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021156860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:11:57.799586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28204): Terminating (SIGTERM) 02:11:57.838996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28207): Terminating (SIGTERM) 02:11:57.878335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28210): Terminating (SIGTERM) 02:11:57.917813 --- ParallelTerminationStrategy: PID 28204 died... 02:11:57.936647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28204): Terminated: ok {rc=0} 02:11:57.980213 --- ParallelTerminationStrategy: PID 28207 died... 02:11:57.998667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28207): Terminated: ok {rc=0} 02:11:58.042012 --- ParallelTerminationStrategy: PID 28210 died... 02:11:58.060355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28210): Terminated: ok {rc=0} 02:11:58.145211 bus /sierra_3: Setting Powered False 02:11:59.243001 bus /sierra_3: Setting Powered False 02:12:00.356238 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:12:01.602025 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:12:01.611007 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:12:01.632331 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:12:01.662756 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:12:01.717247 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:12:01.739297 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:12:01.768136 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:12:02.315467 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:12:02.368234 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:02.379779 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:12:02.437139 tst mo_mt_call.py: using LAC 37825 02:12:02.565295 tst mo_mt_call.py: using RAC 85 02:12:02.693791 tst mo_mt_call.py: using CellId 37825 02:12:02.822531 tst mo_mt_call.py: using BVCI 37826 02:12:02.942687 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:02.954372 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:02.965571 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:02.976634 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:02.988164 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:02.999787 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:12:03.116414 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:12:03.235907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:12:03.738748 run create_hlr_db(pid=28216): Launched 02:12:03.861936 bus /sierra_2: Setting Powered False 02:12:04.926208 run create_hlr_db(pid=28216): Terminated: ok {rc=0} 02:12:05.357663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28218): Launched 02:12:05.658868 run osmo-hlr_10.42.42.2(pid=28219): Launched 02:12:05.773506 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:06.306394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28221): Launched 02:12:06.607371 run osmo-stp_10.42.42.5(pid=28222): Launched 02:12:06.722144 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:07.264406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28224): Launched 02:12:07.565308 run osmo-msc_10.42.42.6(pid=28225): Launched 02:12:07.733885 run osmo-stp_10.42.42.5(pid=28222): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28222)] 02:12:07.860877 run osmo-stp_10.42.42.5(pid=28222): stdout: | (launched: 2022-12-14_02:12:06.551113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:07.987807 run osmo-stp_10.42.42.5(pid=28222): stderr: | [0;m[38;5;43m20221214021206721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021206721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021206721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021206722 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021206724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021206724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021206724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:08.112853 run osmo-stp_10.42.42.5(pid=28222): stdout: | (launched: 2022-12-14_02:12:06.551113) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:08.232260 run osmo-stp_10.42.42.5(pid=28222): stderr: | [0;m[38;5;43m20221214021206721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021206721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021206721 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021206722 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021206724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021206724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021206724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:08.375097 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28222): Process ended prematurely: osmo-stp_10.42.42.5(pid=28222) [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28222)] [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:12:08.384036 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:12:08.410261 run osmo-hlr_10.42.42.2(pid=28219): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28219)] 02:12:08.458128 run osmo-hlr_10.42.42.2(pid=28219): stdout: | (launched: 2022-12-14_02:12:05.603100) 02:12:08.507322 run osmo-hlr_10.42.42.2(pid=28219): stderr: | [0;m[1;31m20221214021205780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021205780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021205780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021205780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021205780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021205780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021205792 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021205804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021205805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021205805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:12:08.575604 run osmo-msc_10.42.42.6(pid=28225): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28225)] 02:12:08.623906 run osmo-msc_10.42.42.6(pid=28225): stdout: | (launched: 2022-12-14_02:12:07.509461) 02:12:08.673317 run osmo-msc_10.42.42.6(pid=28225): stderr: | [0;m[38;5;43m20221214021207783 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021207783 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f11008a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021207783 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021207783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021207783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021207783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021207785 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021207786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021207786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021207786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:12:08.722611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28218): Terminating (SIGTERM) 02:12:08.761890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28221): Terminating (SIGTERM) 02:12:08.801285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28224): Terminating (SIGTERM) 02:12:08.841415 --- ParallelTerminationStrategy: PID 28218 died... 02:12:08.860235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28218): Terminated: ok {rc=0} 02:12:08.903571 --- ParallelTerminationStrategy: PID 28221 died... 02:12:08.922037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28221): Terminated: ok {rc=0} 02:12:08.965525 --- ParallelTerminationStrategy: PID 28224 died... 02:12:08.983944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28224): Terminated: ok {rc=0} 02:12:09.067384 bus /sierra_3: Setting Powered False 02:12:10.165367 bus /sierra_3: Setting Powered False 02:12:11.283547 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:12:12.435821 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:12.448024 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:12:12.506306 tst mo_mt_call_osmux.py: using LAC 37826 02:12:12.635018 tst mo_mt_call_osmux.py: using RAC 86 02:12:12.762817 tst mo_mt_call_osmux.py: using CellId 37826 02:12:12.889414 tst mo_mt_call_osmux.py: using BVCI 37827 02:12:13.006864 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:13.018306 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:13.029523 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:13.040741 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:13.052317 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:12:13.063918 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:12:13.180889 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:12:13.303264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:12:13.804605 run create_hlr_db(pid=28227): Launched 02:12:13.927916 bus /sierra_2: Setting Powered False 02:12:14.992030 run create_hlr_db(pid=28227): Terminated: ok {rc=0} 02:12:15.421625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28229): Launched 02:12:15.721425 run osmo-hlr_10.42.42.2(pid=28230): Launched 02:12:15.850622 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:16.554148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28232): Launched 02:12:16.891839 run osmo-stp_10.42.42.5(pid=28233): Launched 02:12:17.140066 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:17.787650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28235): Launched 02:12:18.110750 run osmo-msc_10.42.42.6(pid=28236): Launched 02:12:18.290124 run osmo-stp_10.42.42.5(pid=28233): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28233)] 02:12:18.426699 run osmo-stp_10.42.42.5(pid=28233): stdout: | (launched: 2022-12-14_02:12:16.827144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:18.563705 run osmo-stp_10.42.42.5(pid=28233): stderr: | [0;m[38;5;43m20221214021217130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021217130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021217131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021217131 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021217132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021217132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021217132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:18.700498 run osmo-stp_10.42.42.5(pid=28233): stdout: | (launched: 2022-12-14_02:12:16.827144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:18.829769 run osmo-stp_10.42.42.5(pid=28233): stderr: | [0;m[38;5;43m20221214021217130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021217130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021217131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021217131 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021217132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021217132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021217132 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:18.983851 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28233): Process ended prematurely: osmo-stp_10.42.42.5(pid=28233) [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28233)] [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:12:18.993591 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 02:12:19.021192 run osmo-hlr_10.42.42.2(pid=28230): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28230)] 02:12:19.071775 run osmo-hlr_10.42.42.2(pid=28230): stdout: | (launched: 2022-12-14_02:12:15.666288) 02:12:19.123529 run osmo-hlr_10.42.42.2(pid=28230): stderr: | [0;m[1;31m20221214021215871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021215871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021215871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021215871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021215871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021215871 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021215898 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021215915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021215915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021215915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:12:19.195379 run osmo-msc_10.42.42.6(pid=28236): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28236)] 02:12:19.244888 run osmo-msc_10.42.42.6(pid=28236): stdout: | (launched: 2022-12-14_02:12:18.051752) 02:12:19.296536 run osmo-msc_10.42.42.6(pid=28236): stderr: | [0;m[38;5;43m20221214021218372 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021218373 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd885c38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021218373 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021218373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021218373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021218374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021218375 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021218376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021218376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021218376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:12:19.348840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28229): Terminating (SIGTERM) 02:12:19.390505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28232): Terminating (SIGTERM) 02:12:19.432136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28235): Terminating (SIGTERM) 02:12:19.474042 --- ParallelTerminationStrategy: PID 28229 died... 02:12:19.494073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28229): Terminated: ok {rc=0} 02:12:19.540036 --- ParallelTerminationStrategy: PID 28232 died... 02:12:19.559743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28232): Terminated: ok {rc=0} 02:12:19.605713 --- ParallelTerminationStrategy: PID 28235 died... 02:12:19.625812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28235): Terminated: ok {rc=0} 02:12:19.713976 bus /sierra_3: Setting Powered False 02:12:20.811238 bus /sierra_3: Setting Powered False 02:12:21.926500 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:12:23.152582 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:12:23.158901 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:12:23.178768 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:12:23.204913 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:12:23.254157 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:12:23.274331 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:12:23.299924 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:12:23.852311 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:12:23.900724 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:23.911814 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:12:23.965685 tst mo_mt_call.py: using LAC 37827 02:12:24.081543 tst mo_mt_call.py: using RAC 87 02:12:24.197866 tst mo_mt_call.py: using CellId 37827 02:12:24.316028 tst mo_mt_call.py: using BVCI 37828 02:12:24.424730 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:24.435574 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:24.446191 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:24.456855 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:24.467589 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:24.478415 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:12:24.599016 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:12:24.714376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:12:25.182214 run create_hlr_db(pid=28243): Launched 02:12:25.304441 bus /sierra_2: Setting Powered False 02:12:26.364684 run create_hlr_db(pid=28243): Terminated: ok {rc=0} 02:12:26.807296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28245): Launched 02:12:27.131708 run osmo-hlr_10.42.42.2(pid=28246): Launched 02:12:27.255218 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:27.817187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28248): Launched 02:12:28.141047 run osmo-stp_10.42.42.5(pid=28249): Launched 02:12:28.264521 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:28.824842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28251): Launched 02:12:29.126606 run osmo-msc_10.42.42.6(pid=28252): Launched 02:12:29.294142 run osmo-stp_10.42.42.5(pid=28249): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28249)] 02:12:29.421470 run osmo-stp_10.42.42.5(pid=28249): stdout: | (launched: 2022-12-14_02:12:28.081651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:29.548814 run osmo-stp_10.42.42.5(pid=28249): stderr: | [0;m[38;5;43m20221214021228275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021228275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021228276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021228276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021228276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021228277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021228277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:29.674232 run osmo-stp_10.42.42.5(pid=28249): stdout: | (launched: 2022-12-14_02:12:28.081651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:29.794164 run osmo-stp_10.42.42.5(pid=28249): stderr: | [0;m[38;5;43m20221214021228275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021228275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021228276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021228276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021228276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021228277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021228277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:29.937240 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28249): Process ended prematurely: osmo-stp_10.42.42.5(pid=28249) [trial-2398↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28249)] [trial-2398↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:12:29.945956 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:12:29.971934 run osmo-hlr_10.42.42.2(pid=28246): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28246)] 02:12:30.019838 run osmo-hlr_10.42.42.2(pid=28246): stdout: | (launched: 2022-12-14_02:12:27.072706) 02:12:30.069125 run osmo-hlr_10.42.42.2(pid=28246): stderr: | [0;m[1;31m20221214021227270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021227270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021227270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021227270 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021227271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021227271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021227283 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021227291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021227291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021227291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:12:30.137905 run osmo-msc_10.42.42.6(pid=28252): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28252)] 02:12:30.185514 run osmo-msc_10.42.42.6(pid=28252): stdout: | (launched: 2022-12-14_02:12:29.070943) 02:12:30.234953 run osmo-msc_10.42.42.6(pid=28252): stderr: | [0;m[38;5;43m20221214021229346 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021229346 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc678276c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021229346 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021229346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021229346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021229346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021229348 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021229348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021229349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021229349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:12:30.284392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28245): Terminating (SIGTERM) 02:12:30.323965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28248): Terminating (SIGTERM) 02:12:30.363496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28251): Terminating (SIGTERM) 02:12:30.403258 --- ParallelTerminationStrategy: PID 28245 died... 02:12:30.421874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28245): Terminated: ok {rc=0} 02:12:30.465720 --- ParallelTerminationStrategy: PID 28248 died... 02:12:30.484261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28248): Terminated: ok {rc=0} 02:12:30.528130 --- ParallelTerminationStrategy: PID 28251 died... 02:12:30.546726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28251): Terminated: ok {rc=0} 02:12:30.632429 bus /sierra_3: Setting Powered False 02:12:31.741924 bus /sierra_3: Setting Powered False 02:12:32.866803 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:12:34.015698 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:34.027793 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:12:34.085924 tst mo_mt_call_osmux.py: using LAC 37828 02:12:34.217916 tst mo_mt_call_osmux.py: using RAC 88 02:12:34.344779 tst mo_mt_call_osmux.py: using CellId 37828 02:12:34.470282 tst mo_mt_call_osmux.py: using BVCI 37829 02:12:34.588586 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:34.600165 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:34.611535 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:34.623175 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:34.634809 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:12:34.646509 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:12:34.765736 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:12:34.880696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:12:35.348692 run create_hlr_db(pid=28254): Launched 02:12:35.471687 bus /sierra_2: Setting Powered False 02:12:36.535679 run create_hlr_db(pid=28254): Terminated: ok {rc=0} 02:12:36.988114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28256): Launched 02:12:37.312056 run osmo-hlr_10.42.42.2(pid=28257): Launched 02:12:37.435859 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:37.993269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28259): Launched 02:12:38.317168 run osmo-stp_10.42.42.5(pid=28260): Launched 02:12:38.440649 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:39.026000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28262): Launched 02:12:39.349093 run osmo-msc_10.42.42.6(pid=28263): Launched 02:12:39.529304 run osmo-stp_10.42.42.5(pid=28260): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28260)] 02:12:39.668146 run osmo-stp_10.42.42.5(pid=28260): stdout: | (launched: 2022-12-14_02:12:38.257983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:39.797082 run osmo-stp_10.42.42.5(pid=28260): stderr: | [0;m[38;5;43m20221214021238451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021238451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021238451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021238452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021238454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021238454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021238454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:39.922545 run osmo-stp_10.42.42.5(pid=28260): stdout: | (launched: 2022-12-14_02:12:38.257983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:40.043660 run osmo-stp_10.42.42.5(pid=28260): stderr: | [0;m[38;5;43m20221214021238451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021238451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021238451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021238452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021238454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021238454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021238454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:40.186964 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28260): Process ended prematurely: osmo-stp_10.42.42.5(pid=28260) [trial-2398↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28260)] [trial-2398↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:12:40.195628 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:12:40.221760 run osmo-hlr_10.42.42.2(pid=28257): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28257)] 02:12:40.269698 run osmo-hlr_10.42.42.2(pid=28257): stdout: | (launched: 2022-12-14_02:12:37.252756) 02:12:40.318639 run osmo-hlr_10.42.42.2(pid=28257): stderr: | [0;m[1;31m20221214021237451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021237451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021237451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021237451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021237451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021237451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021237463 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021237471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021237472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021237472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:12:40.387050 run osmo-msc_10.42.42.6(pid=28263): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28263)] 02:12:40.434189 run osmo-msc_10.42.42.6(pid=28263): stdout: | (launched: 2022-12-14_02:12:39.289583) 02:12:40.483018 run osmo-msc_10.42.42.6(pid=28263): stderr: | [0;m[38;5;43m20221214021239613 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021239613 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f84744b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021239613 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021239613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021239613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021239613 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021239615 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021239615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021239615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021239616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:12:40.531850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28256): Terminating (SIGTERM) 02:12:40.571064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28259): Terminating (SIGTERM) 02:12:40.610784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28262): Terminating (SIGTERM) 02:12:40.650080 --- ParallelTerminationStrategy: PID 28256 died... 02:12:40.668837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28256): Terminated: ok {rc=0} 02:12:40.712368 --- ParallelTerminationStrategy: PID 28259 died... 02:12:40.730813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28259): Terminated: ok {rc=0} 02:12:40.774203 --- ParallelTerminationStrategy: PID 28262 died... 02:12:40.792569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28262): Terminated: ok {rc=0} 02:12:40.876338 bus /sierra_3: Setting Powered False 02:12:41.973491 bus /sierra_3: Setting Powered False 02:12:43.091693 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:12:44.322469 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:12:44.328377 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:12:44.348511 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:12:44.374733 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:12:44.424882 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:12:44.445168 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:12:44.470984 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:12:45.019150 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:12:45.067567 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:45.078401 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:12:45.134333 tst mo_mt_call.py: using LAC 37829 02:12:45.254155 tst mo_mt_call.py: using RAC 89 02:12:45.374295 tst mo_mt_call.py: using CellId 37829 02:12:45.493376 tst mo_mt_call.py: using BVCI 37830 02:12:45.601627 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:45.612287 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:45.622771 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:45.633222 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:45.643736 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:45.654464 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:12:45.775017 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:12:45.920336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:12:46.478421 run create_hlr_db(pid=28268): Launched 02:12:46.636445 bus /sierra_2: Setting Powered False 02:12:47.700186 run create_hlr_db(pid=28268): Terminated: ok {rc=0} 02:12:48.130322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28270): Launched 02:12:48.430674 run osmo-hlr_10.42.42.2(pid=28271): Launched 02:12:48.544446 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:49.065825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28273): Launched 02:12:49.366378 run osmo-stp_10.42.42.5(pid=28274): Launched 02:12:49.480727 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:50.023905 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28276): Launched 02:12:50.324701 run osmo-msc_10.42.42.6(pid=28277): Launched 02:12:50.491626 run osmo-stp_10.42.42.5(pid=28274): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28274)] 02:12:50.618790 run osmo-stp_10.42.42.5(pid=28274): stdout: | (launched: 2022-12-14_02:12:49.311105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:50.745984 run osmo-stp_10.42.42.5(pid=28274): stderr: | [0;m[38;5;43m20221214021249483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021249483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021249483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021249484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021249484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021249484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021249484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:50.871056 run osmo-stp_10.42.42.5(pid=28274): stdout: | (launched: 2022-12-14_02:12:49.311105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:12:50.991337 run osmo-stp_10.42.42.5(pid=28274): stderr: | [0;m[38;5;43m20221214021249483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021249483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021249483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021249484 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021249484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021249484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021249484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:12:51.134560 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28274): Process ended prematurely: osmo-stp_10.42.42.5(pid=28274) [trial-2398↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28274)] [trial-2398↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:12:51.143268 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:12:51.169417 run osmo-hlr_10.42.42.2(pid=28271): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28271)] 02:12:51.217095 run osmo-hlr_10.42.42.2(pid=28271): stdout: | (launched: 2022-12-14_02:12:48.375004) 02:12:51.266146 run osmo-hlr_10.42.42.2(pid=28271): stderr: | [0;m[1;31m20221214021248551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021248551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021248551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021248551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021248551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021248551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021248563 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021248572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021248572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021248572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:12:51.334480 run osmo-msc_10.42.42.6(pid=28277): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28277)] 02:12:51.381830 run osmo-msc_10.42.42.6(pid=28277): stdout: | (launched: 2022-12-14_02:12:50.269315) 02:12:51.430639 run osmo-msc_10.42.42.6(pid=28277): stderr: | [0;m[38;5;43m20221214021250543 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021250543 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7725c84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021250543 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021250543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021250543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021250544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021250545 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021250546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021250546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021250546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:12:51.479650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28270): Terminating (SIGTERM) 02:12:51.519243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28273): Terminating (SIGTERM) 02:12:51.558533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28276): Terminating (SIGTERM) 02:12:51.598266 --- ParallelTerminationStrategy: PID 28270 died... 02:12:51.617459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28270): Terminated: ok {rc=0} 02:12:51.661063 --- ParallelTerminationStrategy: PID 28273 died... 02:12:51.679556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28273): Terminated: ok {rc=0} 02:12:51.722942 --- ParallelTerminationStrategy: PID 28276 died... 02:12:51.741228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28276): Terminated: ok {rc=0} 02:12:51.825664 bus /sierra_3: Setting Powered False 02:12:52.925211 bus /sierra_3: Setting Powered False 02:12:54.039540 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:12:55.184196 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:55.195567 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:12:55.252375 tst mo_mt_call_osmux.py: using LAC 37830 02:12:55.372650 tst mo_mt_call_osmux.py: using RAC 90 02:12:55.492334 tst mo_mt_call_osmux.py: using CellId 37830 02:12:55.611568 tst mo_mt_call_osmux.py: using BVCI 37831 02:12:55.722082 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:55.732841 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:55.743652 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:55.754162 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:55.764609 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:12:55.775244 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:12:55.896407 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:12:56.011571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:12:56.477551 run create_hlr_db(pid=28279): Launched 02:12:56.600023 bus /sierra_2: Setting Powered False 02:12:57.660901 run create_hlr_db(pid=28279): Terminated: ok {rc=0} 02:12:58.082261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28281): Launched 02:12:58.383457 run osmo-hlr_10.42.42.2(pid=28282): Launched 02:12:58.497742 run osmo-stp_10.42.42.5: Starting osmo-stp 02:12:59.013643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28284): Launched 02:12:59.314451 run osmo-stp_10.42.42.5(pid=28285): Launched 02:12:59.428410 run osmo-msc_10.42.42.6: Starting osmo-msc 02:12:59.971469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28287): Launched 02:13:00.272471 run osmo-msc_10.42.42.6(pid=28288): Launched 02:13:00.441620 run osmo-stp_10.42.42.5(pid=28285): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28285)] 02:13:00.568877 run osmo-stp_10.42.42.5(pid=28285): stdout: | (launched: 2022-12-14_02:12:59.258921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:00.696557 run osmo-stp_10.42.42.5(pid=28285): stderr: | [0;m[38;5;43m20221214021259429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021259429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021259429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021259430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021259432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021259432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021259432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:00.821467 run osmo-stp_10.42.42.5(pid=28285): stdout: | (launched: 2022-12-14_02:12:59.258921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:00.958294 run osmo-stp_10.42.42.5(pid=28285): stderr: | [0;m[38;5;43m20221214021259429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021259429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021259429 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021259430 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021259432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021259432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021259432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:01.107213 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28285): Process ended prematurely: osmo-stp_10.42.42.5(pid=28285) [trial-2398↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28285)] [trial-2398↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:13:01.116916 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:13:01.144141 run osmo-hlr_10.42.42.2(pid=28282): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28282)] 02:13:01.192609 run osmo-hlr_10.42.42.2(pid=28282): stdout: | (launched: 2022-12-14_02:12:58.327992) 02:13:01.242688 run osmo-hlr_10.42.42.2(pid=28282): stderr: | [0;m[1;31m20221214021258504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021258504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021258504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021258504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021258504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021258504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021258519 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021258528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021258528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021258528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:13:01.312265 run osmo-msc_10.42.42.6(pid=28288): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28288)] 02:13:01.360542 run osmo-msc_10.42.42.6(pid=28288): stdout: | (launched: 2022-12-14_02:13:00.216710) 02:13:01.410926 run osmo-msc_10.42.42.6(pid=28288): stderr: | [0;m[38;5;43m20221214021300489 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021300489 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3141ba4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021300489 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021300489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021300489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021300490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021300491 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021300492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021300492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021300492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:13:01.461568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28281): Terminating (SIGTERM) 02:13:01.502529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28284): Terminating (SIGTERM) 02:13:01.543913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28287): Terminating (SIGTERM) 02:13:01.585463 --- ParallelTerminationStrategy: PID 28281 died... 02:13:01.605160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28281): Terminated: ok {rc=0} 02:13:01.649694 --- ParallelTerminationStrategy: PID 28284 died... 02:13:01.670110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28284): Terminated: ok {rc=0} 02:13:01.715563 --- ParallelTerminationStrategy: PID 28287 died... 02:13:01.735291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28287): Terminated: ok {rc=0} 02:13:01.825459 bus /sierra_3: Setting Powered False 02:13:02.932847 bus /sierra_3: Setting Powered False 02:13:04.045919 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 emergency:sysmo --------------------------------------------------------------------- 02:13:05.275893 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:13:05.280052 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 02:13:05.300312 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 02:13:05.326721 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 02:13:05.408844 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 02:13:05.429388 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 02:13:05.455592 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 02:13:06.036282 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2398 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 02:13:06.041433 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:06.051755 tst emergency:sysmo: Using 1 x bts (candidates: 1) 02:13:06.086229 tst emergency_mo_mt_call.py: using LAC 37831 02:13:06.204384 tst emergency_mo_mt_call.py: using RAC 91 02:13:06.320502 tst emergency_mo_mt_call.py: using CellId 37831 02:13:06.447433 tst emergency_mo_mt_call.py: using BVCI 37832 02:13:06.563369 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:06.574446 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:06.585481 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:06.596311 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:06.607531 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:06.618690 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:13:06.733780 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:13:06.852109 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:13:07.346793 run create_hlr_db(pid=28293): Launched 02:13:07.467823 bus /sierra_2: Setting Powered False 02:13:08.530482 run create_hlr_db(pid=28293): Terminated: ok {rc=0} 02:13:08.955596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28295): Launched 02:13:09.253215 run osmo-hlr_10.42.42.2(pid=28296): Launched 02:13:09.366850 run osmo-stp_10.42.42.5: Starting osmo-stp 02:13:09.875999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28298): Launched 02:13:10.171427 run osmo-stp_10.42.42.5(pid=28299): Launched 02:13:10.294268 tst emergency_mo_mt_call.py: using MSISDN 8455 02:13:10.458727 run osmo-msc_10.42.42.6: Starting osmo-msc 02:13:10.990295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28301): Launched 02:13:11.286447 run osmo-msc_10.42.42.6(pid=28302): Launched 02:13:11.451067 run osmo-stp_10.42.42.5(pid=28299): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28299)] 02:13:11.575670 run osmo-stp_10.42.42.5(pid=28299): stdout: | (launched: 2022-12-14_02:13:10.116800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:11.700521 run osmo-stp_10.42.42.5(pid=28299): stderr: | [0;m[38;5;43m20221214021310288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021310288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021310288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021310288 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021310289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021310289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021310289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:11.823684 run osmo-stp_10.42.42.5(pid=28299): stdout: | (launched: 2022-12-14_02:13:10.116800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:11.941396 run osmo-stp_10.42.42.5(pid=28299): stderr: | [0;m[38;5;43m20221214021310288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021310288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021310288 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021310288 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021310289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021310289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021310289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:12.082075 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28299): Process ended prematurely: osmo-stp_10.42.42.5(pid=28299) [trial-2398↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28299)] [trial-2398↪emergency:sysmo↪emergency_mo_mt_call.py:19] 02:13:12.090456 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 02:13:12.116375 run osmo-hlr_10.42.42.2(pid=28296): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28296)] 02:13:12.164752 run osmo-hlr_10.42.42.2(pid=28296): stdout: | (launched: 2022-12-14_02:13:09.197760) 02:13:12.214256 run osmo-hlr_10.42.42.2(pid=28296): stderr: | [0;m[1;31m20221214021309373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021309373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021309373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021309373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021309373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021309373 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021309385 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021309394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021309394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021309394 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:13:12.283409 run osmo-msc_10.42.42.6(pid=28302): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28302)] 02:13:12.331254 run osmo-msc_10.42.42.6(pid=28302): stdout: | (launched: 2022-12-14_02:13:11.231241) 02:13:12.381147 run osmo-msc_10.42.42.6(pid=28302): stderr: | [0;m[38;5;43m20221214021311503 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021311503 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1b6672bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021311503 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021311503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021311503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021311503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021311505 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021311506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021311506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021311506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:13:12.431275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28295): Terminating (SIGTERM) 02:13:12.471355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28298): Terminating (SIGTERM) 02:13:12.511402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28301): Terminating (SIGTERM) 02:13:12.551743 --- ParallelTerminationStrategy: PID 28295 died... 02:13:12.570927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28295): Terminated: ok {rc=0} 02:13:12.615075 --- ParallelTerminationStrategy: PID 28298 died... 02:13:12.633910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28298): Terminated: ok {rc=0} 02:13:12.678037 --- ParallelTerminationStrategy: PID 28301 died... 02:13:12.696840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28301): Terminated: ok {rc=0} 02:13:12.783494 bus /sierra_3: Setting Powered False 02:13:13.882344 bus /sierra_3: Setting Powered False 02:13:14.995209 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 02:13:16.080759 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:16.093576 tst emergency:sysmo: Using 1 x bts (candidates: 1) 02:13:16.133113 tst emergency_preemptive_call.py: using LAC 37832 02:13:16.254398 tst emergency_preemptive_call.py: using RAC 92 02:13:16.406620 tst emergency_preemptive_call.py: using CellId 37832 02:13:16.527275 tst emergency_preemptive_call.py: using BVCI 37833 02:13:16.672861 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:16.687460 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:16.699812 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:16.713877 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:16.726171 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 02:13:16.738917 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:13:16.863899 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:13:16.988141 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:13:17.112572 tst emergency:sysmo: Using 1 x modem (candidates: 4) 02:13:17.235489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:13:17.733651 run create_hlr_db(pid=28304): Launched 02:13:17.855906 bus /sierra_2: Setting Powered False 02:13:18.919597 run create_hlr_db(pid=28304): Terminated: ok {rc=0} 02:13:19.344097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28306): Launched 02:13:19.641438 run osmo-hlr_10.42.42.2(pid=28307): Launched 02:13:19.754651 run osmo-stp_10.42.42.5: Starting osmo-stp 02:13:20.264089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28309): Launched 02:13:20.560272 run osmo-stp_10.42.42.5(pid=28310): Launched 02:13:20.684352 tst emergency_preemptive_call.py: using MSISDN 8456 02:13:20.835711 run osmo-msc_10.42.42.6: Starting osmo-msc 02:13:21.367350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28312): Launched 02:13:21.663886 run osmo-msc_10.42.42.6(pid=28313): Launched 02:13:21.835667 run osmo-stp_10.42.42.5(pid=28310): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28310)] 02:13:21.961341 run osmo-stp_10.42.42.5(pid=28310): stdout: | (launched: 2022-12-14_02:13:20.505330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:22.086495 run osmo-stp_10.42.42.5(pid=28310): stderr: | [0;m[38;5;43m20221214021320678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021320679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021320679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021320679 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021320680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021320680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021320680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:22.210137 run osmo-stp_10.42.42.5(pid=28310): stdout: | (launched: 2022-12-14_02:13:20.505330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:22.327872 run osmo-stp_10.42.42.5(pid=28310): stderr: | [0;m[38;5;43m20221214021320678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021320679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021320679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021320679 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021320680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021320680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021320680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:22.468795 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28310): Process ended prematurely: osmo-stp_10.42.42.5(pid=28310) [trial-2398↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28310)] [trial-2398↪emergency:sysmo↪emergency_preemptive_call.py:32] 02:13:22.477287 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 02:13:22.503109 run osmo-hlr_10.42.42.2(pid=28307): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28307)] 02:13:22.551210 run osmo-hlr_10.42.42.2(pid=28307): stdout: | (launched: 2022-12-14_02:13:19.586455) 02:13:22.600694 run osmo-hlr_10.42.42.2(pid=28307): stderr: | [0;m[1;31m20221214021319763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021319763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021319763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021319763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021319763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021319763 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021319775 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021319786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021319786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021319786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:13:22.669653 run osmo-msc_10.42.42.6(pid=28313): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28313)] 02:13:22.717237 run osmo-msc_10.42.42.6(pid=28313): stdout: | (launched: 2022-12-14_02:13:21.608630) 02:13:22.766101 run osmo-msc_10.42.42.6(pid=28313): stderr: | [0;m[38;5;43m20221214021321882 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021321883 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1d1147ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021321883 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021321883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021321883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021321883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021321885 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021321885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021321886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021321886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:13:22.815332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28306): Terminating (SIGTERM) 02:13:22.854772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28309): Terminating (SIGTERM) 02:13:22.894280 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28312): Terminating (SIGTERM) 02:13:22.934061 --- ParallelTerminationStrategy: PID 28306 died... 02:13:22.953244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28306): Terminated: ok {rc=0} 02:13:22.996861 --- ParallelTerminationStrategy: PID 28309 died... 02:13:23.015691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28309): Terminated: ok {rc=0} 02:13:23.059330 --- ParallelTerminationStrategy: PID 28312 died... 02:13:23.078025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28312): Terminated: ok {rc=0} 02:13:23.163236 bus /sierra_9: Setting Powered False 02:13:24.262534 bus /sierra_9: Setting Powered False 02:13:25.377599 bus /sierra_8: Setting Powered False 02:13:26.475756 bus /sierra_8: Setting Powered False 02:13:27.590790 bus /sierra_3: Setting Powered False 02:13:28.687219 bus /sierra_3: Setting Powered False 02:13:29.802694 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:sysmo --------------------------------------------------------------------- 02:13:31.089052 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:13:31.094675 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 02:13:31.119612 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 02:13:31.165413 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 02:13:31.266163 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 02:13:31.294907 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 02:13:31.337982 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 02:13:31.907855 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 02:13:31.958655 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:31.969501 tst gprs:sysmo: Using 1 x bts (candidates: 1) 02:13:32.003372 tst cs_paging_gprs_active.py: using LAC 37833 02:13:32.125108 tst cs_paging_gprs_active.py: using RAC 93 02:13:32.272648 tst cs_paging_gprs_active.py: using CellId 37833 02:13:32.402612 tst cs_paging_gprs_active.py: using BVCI 37834 02:13:32.523536 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:32.534572 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:32.545574 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:32.556290 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:32.567578 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:32.578823 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:32.590649 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:32.602073 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:32.613574 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:32.729483 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:32.844525 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:13:33.046800 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:13:33.352669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28318): Launched 02:13:33.616505 run iperf3-srv_10.42.42.10(pid=28319): Launched 02:13:33.729484 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:13:33.931496 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:13:34.234326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28321): Launched 02:13:34.496466 run iperf3-srv_10.42.42.10(pid=28322): Launched 02:13:34.609101 tst cs_paging_gprs_active.py:38: start network... 02:13:34.810729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:13:35.278868 run create_hlr_db(pid=28323): Launched 02:13:35.404146 bus /sierra_2: Setting Powered False 02:13:36.465131 run create_hlr_db(pid=28323): Terminated: ok {rc=0} 02:13:36.886272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28325): Launched 02:13:37.189106 run osmo-hlr_10.42.42.2(pid=28326): Launched 02:13:37.305435 run osmo-stp_10.42.42.5: Starting osmo-stp 02:13:37.824465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28328): Launched 02:13:38.125607 run osmo-stp_10.42.42.5(pid=28329): Launched 02:13:38.240675 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:13:39.734166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28331): Launched 02:13:39.849615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:13:40.106402 run patchelf(pid=28332): Launched 02:13:40.275898 run osmo-stp_10.42.42.5(pid=28329): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28329)] 02:13:40.403607 run osmo-stp_10.42.42.5(pid=28329): stdout: | (launched: 2022-12-14_02:13:38.069668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:40.533145 run osmo-stp_10.42.42.5(pid=28329): stderr: | [0;m[38;5;43m20221214021338240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021338240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021338240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021338241 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021338243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021338243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021338243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:40.662197 run osmo-stp_10.42.42.5(pid=28329): stdout: | (launched: 2022-12-14_02:13:38.069668) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:40.785977 run osmo-stp_10.42.42.5(pid=28329): stderr: | [0;m[38;5;43m20221214021338240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021338240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021338240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021338241 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021338243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021338243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021338243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:40.932394 run patchelf(pid=28332): Terminating (SIGINT) 02:13:41.103229 run patchelf(pid=28332): Terminated: ok {rc=0} 02:13:41.226336 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28329): Process ended prematurely: osmo-stp_10.42.42.5(pid=28329) [trial-2398↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28329)] [trial-2398↪gprs:sysmo↪cs_paging_gprs_active.py:38] 02:13:41.235597 tst cs_paging_gprs_active.py:38: Test FAILED (9.3 sec) 02:13:41.262616 run osmo-hlr_10.42.42.2(pid=28326): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28326)] 02:13:41.310247 run osmo-hlr_10.42.42.2(pid=28326): stdout: | (launched: 2022-12-14_02:13:37.132874) 02:13:41.360375 run osmo-hlr_10.42.42.2(pid=28326): stderr: | [0;m[1;31m20221214021337313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021337313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021337313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021337313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021337313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021337313 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021337325 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021337334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021337335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021337335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:13:41.410128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28318): Terminating (SIGTERM) 02:13:41.449756 run iperf3-srv_10.42.42.10(pid=28319): Terminating (SIGTERM) 02:13:41.489316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28321): Terminating (SIGTERM) 02:13:41.529341 run iperf3-srv_10.42.42.10(pid=28322): Terminating (SIGTERM) 02:13:41.568653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28325): Terminating (SIGTERM) 02:13:41.608365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28328): Terminating (SIGTERM) 02:13:41.647723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28331): Terminating (SIGTERM) 02:13:41.687372 --- ParallelTerminationStrategy: PID 28318 died... 02:13:41.705871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28318): Terminated: ok {rc=0} 02:13:41.749936 --- ParallelTerminationStrategy: PID 28319 died... 02:13:41.768339 run iperf3-srv_10.42.42.10(pid=28319): Terminated {rc=256} 02:13:41.812160 --- ParallelTerminationStrategy: PID 28321 died... 02:13:41.830844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28321): Terminated: ok {rc=0} 02:13:41.874637 --- ParallelTerminationStrategy: PID 28322 died... 02:13:41.893210 run iperf3-srv_10.42.42.10(pid=28322): Terminated {rc=256} 02:13:41.937047 --- ParallelTerminationStrategy: PID 28325 died... 02:13:41.955639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28325): Terminated: ok {rc=0} 02:13:41.999503 --- ParallelTerminationStrategy: PID 28328 died... 02:13:42.018011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28328): Terminated: ok {rc=0} 02:13:42.061780 --- ParallelTerminationStrategy: PID 28331 died... 02:13:42.080342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28331): Terminated: ok {rc=0} 02:13:42.166841 bus /gobi_0: Setting Powered False 02:13:43.265953 bus /gobi_0: Setting Powered False 02:13:44.377216 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:sysmo iperf3.py ---------------------------------------------- 02:13:45.526843 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:45.538558 tst gprs:sysmo: Using 1 x bts (candidates: 1) 02:13:45.574730 tst iperf3.py: using LAC 37834 02:13:45.704419 tst iperf3.py: using RAC 94 02:13:45.841079 tst iperf3.py: using CellId 37834 02:13:45.981850 tst iperf3.py: using BVCI 37835 02:13:46.133703 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:46.145299 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:46.157523 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:46.168836 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:46.181052 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:46.193406 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:46.205820 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:46.218099 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:46.230481 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:46.351061 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:13:46.560711 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:13:46.881548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28333): Launched 02:13:47.172457 run iperf3-srv_10.42.42.10(pid=28334): Launched 02:13:47.298042 tst iperf3.py:8: start network... 02:13:47.500397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:13:47.967953 run create_hlr_db(pid=28335): Launched 02:13:48.091357 bus /gobi_6: Setting Powered False 02:13:49.151360 run create_hlr_db(pid=28335): Terminated: ok {rc=0} 02:13:49.593463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28337): Launched 02:13:49.918583 run osmo-hlr_10.42.42.2(pid=28338): Launched 02:13:50.042366 run osmo-stp_10.42.42.5: Starting osmo-stp 02:13:50.604037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28340): Launched 02:13:50.928670 run osmo-stp_10.42.42.5(pid=28341): Launched 02:13:51.052134 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:13:51.610330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28343): Launched 02:13:51.735087 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:13:52.010316 run patchelf(pid=28344): Launched 02:13:52.190176 run osmo-stp_10.42.42.5(pid=28341): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28341)] 02:13:52.327172 run osmo-stp_10.42.42.5(pid=28341): stdout: | (launched: 2022-12-14_02:13:50.868781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:52.466258 run osmo-stp_10.42.42.5(pid=28341): stderr: | [0;m[38;5;43m20221214021351063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021351063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021351064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021351064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021351065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021351065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021351065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:52.605029 run osmo-stp_10.42.42.5(pid=28341): stdout: | (launched: 2022-12-14_02:13:50.868781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:13:52.738624 run osmo-stp_10.42.42.5(pid=28341): stderr: | [0;m[38;5;43m20221214021351063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021351063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021351064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021351064 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021351065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021351065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021351065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:13:52.896007 run patchelf(pid=28344): Terminating (SIGINT) 02:13:53.079113 run patchelf(pid=28344): Terminated: ok {rc=0} 02:13:53.211123 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28341): Process ended prematurely: osmo-stp_10.42.42.5(pid=28341) [trial-2398↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28341)] [trial-2398↪gprs:sysmo↪iperf3.py:8] 02:13:53.221148 tst iperf3.py:8: Test FAILED (7.7 sec) 02:13:53.249487 run osmo-hlr_10.42.42.2(pid=28338): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28338)] 02:13:53.300265 run osmo-hlr_10.42.42.2(pid=28338): stdout: | (launched: 2022-12-14_02:13:49.859176) 02:13:53.352609 run osmo-hlr_10.42.42.2(pid=28338): stderr: | [0;m[1;31m20221214021350057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021350057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021350057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021350057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021350057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021350057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021350070 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021350078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021350078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021350078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:13:53.405481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28333): Terminating (SIGTERM) 02:13:53.447430 run iperf3-srv_10.42.42.10(pid=28334): Terminating (SIGTERM) 02:13:53.489899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28337): Terminating (SIGTERM) 02:13:53.531979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28340): Terminating (SIGTERM) 02:13:53.574325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28343): Terminating (SIGTERM) 02:13:53.616501 --- ParallelTerminationStrategy: PID 28333 died... 02:13:53.636766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28333): Terminated: ok {rc=0} 02:13:53.683758 --- ParallelTerminationStrategy: PID 28334 died... 02:13:53.703744 run iperf3-srv_10.42.42.10(pid=28334): Terminated {rc=256} 02:13:53.750091 --- ParallelTerminationStrategy: PID 28337 died... 02:13:53.770033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28337): Terminated: ok {rc=0} 02:13:53.816280 --- ParallelTerminationStrategy: PID 28340 died... 02:13:53.836301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28340): Terminated: ok {rc=0} 02:13:53.882611 --- ParallelTerminationStrategy: PID 28343 died... 02:13:53.902461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28343): Terminated: ok {rc=0} 02:13:53.991192 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:sysmo iperf3m4.py ---------------------------------------------- 02:13:55.141645 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:55.153262 tst gprs:sysmo: Using 1 x bts (candidates: 1) 02:13:55.189127 tst iperf3m4.py: using LAC 37835 02:13:55.316738 tst iperf3m4.py: using RAC 95 02:13:55.435245 tst iperf3m4.py: using CellId 37835 02:13:55.555676 tst iperf3m4.py: using BVCI 37836 02:13:55.666537 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:55.677015 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:55.687324 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:55.697525 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:55.707466 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:55.717577 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:55.728113 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:55.738529 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:13:55.748736 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:55.863921 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:55.985584 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:56.106706 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:13:56.226643 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:13:56.446231 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:13:56.773572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28346): Launched 02:13:57.056468 run iperf3-srv_10.42.42.10(pid=28347): Launched 02:13:57.178842 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:13:57.398566 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:13:57.726535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28348): Launched 02:13:58.010362 run iperf3-srv_10.42.42.10(pid=28349): Launched 02:13:58.132516 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:13:58.352023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:13:58.686443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28350): Launched 02:13:58.977226 run iperf3-srv_10.42.42.10(pid=28354): Launched 02:13:59.090254 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:13:59.291312 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:13:59.595039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28355): Launched 02:13:59.873090 run iperf3-srv_10.42.42.10(pid=28356): Launched 02:13:59.985931 tst iperf3m4.py:8: start network... 02:14:00.186693 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:14:00.657949 run create_hlr_db(pid=28357): Launched 02:14:00.780653 bus /gobi_6: Setting Powered False 02:14:01.841702 run create_hlr_db(pid=28357): Terminated: ok {rc=0} 02:14:02.276590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28359): Launched 02:14:02.579015 run osmo-hlr_10.42.42.2(pid=28360): Launched 02:14:02.694404 run osmo-stp_10.42.42.5: Starting osmo-stp 02:14:03.211388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28362): Launched 02:14:03.517683 run osmo-stp_10.42.42.5(pid=28363): Launched 02:14:03.635236 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:14:04.153496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28365): Launched 02:14:04.268601 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:14:04.524152 run patchelf(pid=28366): Launched 02:14:04.693486 run osmo-stp_10.42.42.5(pid=28363): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28363)] 02:14:04.820858 run osmo-stp_10.42.42.5(pid=28363): stdout: | (launched: 2022-12-14_02:14:03.456803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:04.949773 run osmo-stp_10.42.42.5(pid=28363): stderr: | [0;m[38;5;43m20221214021403635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021403636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021403636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021403636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021403637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021403637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021403637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:05.078484 run osmo-stp_10.42.42.5(pid=28363): stdout: | (launched: 2022-12-14_02:14:03.456803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:05.202009 run osmo-stp_10.42.42.5(pid=28363): stderr: | [0;m[38;5;43m20221214021403635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021403636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021403636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021403636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021403637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021403637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021403637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:05.348351 run patchelf(pid=28366): Terminating (SIGINT) 02:14:05.519201 run patchelf(pid=28366): Terminated: ok {rc=0} 02:14:05.642130 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28363): Process ended prematurely: osmo-stp_10.42.42.5(pid=28363) [trial-2398↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28363)] [trial-2398↪gprs:sysmo↪iperf3m4.py:8] 02:14:05.651504 tst iperf3m4.py:8: Test FAILED (10.6 sec) 02:14:05.678827 run osmo-hlr_10.42.42.2(pid=28360): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28360)] 02:14:05.726630 run osmo-hlr_10.42.42.2(pid=28360): stdout: | (launched: 2022-12-14_02:14:02.523146) 02:14:05.776180 run osmo-hlr_10.42.42.2(pid=28360): stderr: | [0;m[1;31m20221214021402701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021402701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021402701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021402701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021402701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021402701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021402713 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021402722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021402723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021402723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:14:05.826140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28346): Terminating (SIGTERM) 02:14:05.866560 run iperf3-srv_10.42.42.10(pid=28347): Terminating (SIGTERM) 02:14:05.906434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28348): Terminating (SIGTERM) 02:14:05.946339 run iperf3-srv_10.42.42.10(pid=28349): Terminating (SIGTERM) 02:14:05.986064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28350): Terminating (SIGTERM) 02:14:06.025907 run iperf3-srv_10.42.42.10(pid=28354): Terminating (SIGTERM) 02:14:06.065619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28355): Terminating (SIGTERM) 02:14:06.105595 run iperf3-srv_10.42.42.10(pid=28356): Terminating (SIGTERM) 02:14:06.145328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28359): Terminating (SIGTERM) 02:14:06.185293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28362): Terminating (SIGTERM) 02:14:06.225131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28365): Terminating (SIGTERM) 02:14:06.265162 --- ParallelTerminationStrategy: PID 28346 died... 02:14:06.284139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28346): Terminated: ok {rc=0} 02:14:06.328668 --- ParallelTerminationStrategy: PID 28347 died... 02:14:06.347292 run iperf3-srv_10.42.42.10(pid=28347): Terminated {rc=256} 02:14:06.390896 --- ParallelTerminationStrategy: PID 28348 died... 02:14:06.409465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28348): Terminated: ok {rc=0} 02:14:06.453144 --- ParallelTerminationStrategy: PID 28349 died... 02:14:06.471569 run iperf3-srv_10.42.42.10(pid=28349): Terminated {rc=256} 02:14:06.515352 --- ParallelTerminationStrategy: PID 28350 died... 02:14:06.534028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28350): Terminated: ok {rc=0} 02:14:06.577914 --- ParallelTerminationStrategy: PID 28354 died... 02:14:06.596305 run iperf3-srv_10.42.42.10(pid=28354): Terminated {rc=256} 02:14:06.639920 --- ParallelTerminationStrategy: PID 28355 died... 02:14:06.658439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28355): Terminated: ok {rc=0} 02:14:06.701998 --- ParallelTerminationStrategy: PID 28356 died... 02:14:06.720377 run iperf3-srv_10.42.42.10(pid=28356): Terminated {rc=256} 02:14:06.763899 --- ParallelTerminationStrategy: PID 28359 died... 02:14:06.782526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28359): Terminated: ok {rc=0} 02:14:06.826035 --- ParallelTerminationStrategy: PID 28362 died... 02:14:06.844537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28362): Terminated: ok {rc=0} 02:14:06.888278 --- ParallelTerminationStrategy: PID 28365 died... 02:14:06.907051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28365): Terminated: ok {rc=0} 02:14:06.992623 bus /gobi_4: Setting Powered False 02:14:08.091977 bus /gobi_4: Setting Powered False 02:14:09.209140 bus /gobi_1: Setting Powered False 02:14:10.306563 bus /gobi_1: Setting Powered False 02:14:11.422452 bus /gobi_0: Setting Powered False 02:14:12.517334 bus /gobi_0: Setting Powered False 02:14:13.632576 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:sysmo ping.py ---------------------------------------------- 02:14:14.734784 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:14.746294 tst gprs:sysmo: Using 1 x bts (candidates: 1) 02:14:14.781580 tst ping.py: using LAC 37836 02:14:14.901018 tst ping.py: using RAC 96 02:14:15.018506 tst ping.py: using CellId 37836 02:14:15.136647 tst ping.py: using BVCI 37837 02:14:15.243519 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:15.253936 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:15.264194 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:15.274393 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:15.284409 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:15.294574 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:15.304744 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:15.314988 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:14:15.427713 tst ping.py:19: start network... 02:14:15.626524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:14:16.103088 run create_hlr_db(pid=28367): Launched 02:14:16.253613 bus /gobi_6: Setting Powered False 02:14:17.311313 run create_hlr_db(pid=28367): Terminated: ok {rc=0} 02:14:17.747677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28369): Launched 02:14:18.067217 run osmo-hlr_10.42.42.2(pid=28370): Launched 02:14:18.188820 run osmo-stp_10.42.42.5: Starting osmo-stp 02:14:18.741159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28372): Launched 02:14:19.058812 run osmo-stp_10.42.42.5(pid=28373): Launched 02:14:19.179834 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:14:19.730197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28375): Launched 02:14:19.852262 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:14:20.125895 run patchelf(pid=28376): Launched 02:14:20.305503 run osmo-stp_10.42.42.5(pid=28373): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28373)] 02:14:20.441118 run osmo-stp_10.42.42.5(pid=28373): stdout: | (launched: 2022-12-14_02:14:19.000215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:20.578014 run osmo-stp_10.42.42.5(pid=28373): stderr: | [0;m[38;5;43m20221214021419193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021419194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021419194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021419194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021419195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021419195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021419195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:20.715434 run osmo-stp_10.42.42.5(pid=28373): stdout: | (launched: 2022-12-14_02:14:19.000215) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:20.846947 run osmo-stp_10.42.42.5(pid=28373): stderr: | [0;m[38;5;43m20221214021419193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021419194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021419194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021419194 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021419195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021419195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021419195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:21.002827 run patchelf(pid=28376): Terminating (SIGINT) 02:14:21.183551 run patchelf(pid=28376): Terminated: ok {rc=0} 02:14:21.313795 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28373): Process ended prematurely: osmo-stp_10.42.42.5(pid=28373) [trial-2398↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28373)] [trial-2398↪gprs:sysmo↪ping.py:22] 02:14:21.323224 tst ping.py:22: Test FAILED (6.6 sec) 02:14:21.351083 run osmo-hlr_10.42.42.2(pid=28370): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28370)] 02:14:21.401528 run osmo-hlr_10.42.42.2(pid=28370): stdout: | (launched: 2022-12-14_02:14:18.008430) 02:14:21.453650 run osmo-hlr_10.42.42.2(pid=28370): stderr: | [0;m[1;31m20221214021418206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021418206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021418206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021418206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021418206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021418206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021418221 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021418229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021418230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021418230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:14:21.506504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28369): Terminating (SIGTERM) 02:14:21.548371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28372): Terminating (SIGTERM) 02:14:21.590747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28375): Terminating (SIGTERM) 02:14:21.633251 --- ParallelTerminationStrategy: PID 28369 died... 02:14:21.653664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28369): Terminated: ok {rc=0} 02:14:21.701526 --- ParallelTerminationStrategy: PID 28372 died... 02:14:21.721593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28372): Terminated: ok {rc=0} 02:14:21.768280 --- ParallelTerminationStrategy: PID 28375 died... 02:14:21.788207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28375): Terminated: ok {rc=0} 02:14:21.877396 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 02:14:22.964226 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:22.975801 tst gprs:sysmo: Using 1 x bts (candidates: 1) 02:14:23.012068 tst ping_idle_ping.py: using LAC 37837 02:14:23.134366 tst ping_idle_ping.py: using RAC 97 02:14:23.250130 tst ping_idle_ping.py: using CellId 37837 02:14:23.365198 tst ping_idle_ping.py: using BVCI 37838 02:14:23.472466 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:23.482919 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:23.493246 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:23.503395 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:23.513489 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:23.523620 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:23.533906 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 02:14:23.544169 tst gprs:sysmo: Using 1 x modem (candidates: 4) 02:14:23.666418 tst ping_idle_ping.py:24: start network... 02:14:23.865166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:14:24.322725 run create_hlr_db(pid=28377): Launched 02:14:24.443541 bus /gobi_6: Setting Powered False 02:14:25.502263 run create_hlr_db(pid=28377): Terminated: ok {rc=0} 02:14:25.917233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28379): Launched 02:14:26.214219 run osmo-hlr_10.42.42.2(pid=28380): Launched 02:14:26.326437 run osmo-stp_10.42.42.5: Starting osmo-stp 02:14:26.833687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28382): Launched 02:14:27.129314 run osmo-stp_10.42.42.5(pid=28383): Launched 02:14:27.241770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:14:27.753570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28385): Launched 02:14:27.866719 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:14:28.117437 run patchelf(pid=28386): Launched 02:14:28.281818 run osmo-stp_10.42.42.5(pid=28383): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28383)] 02:14:28.406794 run osmo-stp_10.42.42.5(pid=28383): stdout: | (launched: 2022-12-14_02:14:27.074045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:28.533633 run osmo-stp_10.42.42.5(pid=28383): stderr: | [0;m[38;5;43m20221214021427243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021427244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021427244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021427244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021427245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021427245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021427245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:28.659929 run osmo-stp_10.42.42.5(pid=28383): stdout: | (launched: 2022-12-14_02:14:27.074045) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:28.781301 run osmo-stp_10.42.42.5(pid=28383): stderr: | [0;m[38;5;43m20221214021427243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021427244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021427244 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021427244 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021427245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021427245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021427245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:28.924866 run patchelf(pid=28386): Terminating (SIGINT) 02:14:29.091554 run patchelf(pid=28386): Terminated: ok {rc=0} 02:14:29.212303 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28383): Process ended prematurely: osmo-stp_10.42.42.5(pid=28383) [trial-2398↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28383)] [trial-2398↪gprs:sysmo↪ping_idle_ping.py:27] 02:14:29.220996 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 02:14:29.247193 run osmo-hlr_10.42.42.2(pid=28380): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28380)] 02:14:29.294730 run osmo-hlr_10.42.42.2(pid=28380): stdout: | (launched: 2022-12-14_02:14:26.158596) 02:14:29.343528 run osmo-hlr_10.42.42.2(pid=28380): stderr: | [0;m[1;31m20221214021426333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021426333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021426333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021426333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021426334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021426334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021426355 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021426365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021426365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021426365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:14:29.392534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28379): Terminating (SIGTERM) 02:14:29.431821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28382): Terminating (SIGTERM) 02:14:29.470907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28385): Terminating (SIGTERM) 02:14:29.510209 --- ParallelTerminationStrategy: PID 28379 died... 02:14:29.528936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28379): Terminated: ok {rc=0} 02:14:29.572284 --- ParallelTerminationStrategy: PID 28382 died... 02:14:29.590659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28382): Terminated: ok {rc=0} 02:14:29.633861 --- ParallelTerminationStrategy: PID 28385 died... 02:14:29.651965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28385): Terminated: ok {rc=0} 02:14:29.735092 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 02:14:31.062826 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:14:31.068571 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:14:31.090528 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:14:31.134299 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:14:31.226186 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:14:31.250134 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:14:31.290851 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:14:31.901881 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:14:31.976080 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:31.991355 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:14:32.038966 tst cs_paging_gprs_active.py: using LAC 37838 02:14:32.186071 tst cs_paging_gprs_active.py: using RAC 98 02:14:32.316711 tst cs_paging_gprs_active.py: using CellId 37838 02:14:32.438323 tst cs_paging_gprs_active.py: using BVCI 37839 02:14:32.551030 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:32.561841 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:32.572252 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:32.582810 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:32.593084 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:32.603808 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:32.614854 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:32.625214 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:32.635743 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:32.757644 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:32.875822 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:14:33.078742 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:33.382658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28391): Launched 02:14:33.646635 run iperf3-srv_10.42.42.10(pid=28392): Launched 02:14:33.760463 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:14:33.962589 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:34.265362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28393): Launched 02:14:34.528785 run iperf3-srv_10.42.42.10(pid=28394): Launched 02:14:34.642248 tst cs_paging_gprs_active.py:38: start network... 02:14:34.843918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:14:35.311534 run create_hlr_db(pid=28395): Launched 02:14:35.435191 bus /gobi_6: Setting Powered False 02:14:36.495810 run create_hlr_db(pid=28395): Terminated: ok {rc=0} 02:14:36.915969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28397): Launched 02:14:37.218030 run osmo-hlr_10.42.42.2(pid=28398): Launched 02:14:37.333100 run osmo-stp_10.42.42.5: Starting osmo-stp 02:14:37.853009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28400): Launched 02:14:38.155584 run osmo-stp_10.42.42.5(pid=28401): Launched 02:14:38.271091 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:14:38.793031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28403): Launched 02:14:38.908454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:14:39.164428 run patchelf(pid=28404): Launched 02:14:39.332091 run osmo-stp_10.42.42.5(pid=28401): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28401)] 02:14:39.459701 run osmo-stp_10.42.42.5(pid=28401): stdout: | (launched: 2022-12-14_02:14:38.099295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:39.588408 run osmo-stp_10.42.42.5(pid=28401): stderr: | [0;m[38;5;43m20221214021438270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021438270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021438270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021438271 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021438273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021438273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021438273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:39.717981 run osmo-stp_10.42.42.5(pid=28401): stdout: | (launched: 2022-12-14_02:14:38.099295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:39.842333 run osmo-stp_10.42.42.5(pid=28401): stderr: | [0;m[38;5;43m20221214021438270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021438270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021438270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021438271 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021438273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021438273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021438273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:39.988753 run patchelf(pid=28404): Terminating (SIGINT) 02:14:40.159246 run patchelf(pid=28404): Terminated: ok {rc=0} 02:14:40.282090 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28401): Process ended prematurely: osmo-stp_10.42.42.5(pid=28401) [trial-2398↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28401)] [trial-2398↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:14:40.291504 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 02:14:40.318681 run osmo-hlr_10.42.42.2(pid=28398): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28398)] 02:14:40.366369 run osmo-hlr_10.42.42.2(pid=28398): stdout: | (launched: 2022-12-14_02:14:37.162234) 02:14:40.415759 run osmo-hlr_10.42.42.2(pid=28398): stderr: | [0;m[1;31m20221214021437335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021437335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021437335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021437335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021437335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021437336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021437348 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021437356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021437357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021437357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:14:40.467217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28391): Terminating (SIGTERM) 02:14:40.507029 run iperf3-srv_10.42.42.10(pid=28392): Terminating (SIGTERM) 02:14:40.546560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28393): Terminating (SIGTERM) 02:14:40.586418 run iperf3-srv_10.42.42.10(pid=28394): Terminating (SIGTERM) 02:14:40.625859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28397): Terminating (SIGTERM) 02:14:40.665602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28400): Terminating (SIGTERM) 02:14:40.705341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28403): Terminating (SIGTERM) 02:14:40.745327 --- ParallelTerminationStrategy: PID 28391 died... 02:14:40.764437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28391): Terminated: ok {rc=0} 02:14:40.808861 --- ParallelTerminationStrategy: PID 28392 died... 02:14:40.827574 run iperf3-srv_10.42.42.10(pid=28392): Terminated {rc=256} 02:14:40.871211 --- ParallelTerminationStrategy: PID 28393 died... 02:14:40.889861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28393): Terminated: ok {rc=0} 02:14:40.933487 --- ParallelTerminationStrategy: PID 28394 died... 02:14:40.952019 run iperf3-srv_10.42.42.10(pid=28394): Terminated {rc=256} 02:14:40.995615 --- ParallelTerminationStrategy: PID 28397 died... 02:14:41.014126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28397): Terminated: ok {rc=0} 02:14:41.057724 --- ParallelTerminationStrategy: PID 28400 died... 02:14:41.076289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28400): Terminated: ok {rc=0} 02:14:41.119993 --- ParallelTerminationStrategy: PID 28403 died... 02:14:41.138537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28403): Terminated: ok {rc=0} 02:14:41.224275 bus /gobi_0: Setting Powered False 02:14:42.323629 bus /gobi_0: Setting Powered False 02:14:43.438554 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:14:44.584194 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:44.595534 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:14:44.632317 tst iperf3.py: using LAC 37839 02:14:44.757699 tst iperf3.py: using RAC 99 02:14:44.889135 tst iperf3.py: using CellId 37839 02:14:45.010122 tst iperf3.py: using BVCI 37840 02:14:45.120827 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:45.131445 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:45.142021 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:45.152358 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:45.163185 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:45.173547 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:45.184063 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:45.194389 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:45.204886 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:45.321597 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:14:45.523566 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:45.826179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28405): Launched 02:14:46.128443 run iperf3-srv_10.42.42.10(pid=28406): Launched 02:14:46.249117 tst iperf3.py:8: start network... 02:14:46.453406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:14:46.933621 run create_hlr_db(pid=28407): Launched 02:14:47.087325 bus /gobi_6: Setting Powered False 02:14:48.147550 run create_hlr_db(pid=28407): Terminated: ok {rc=0} 02:14:48.590147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28409): Launched 02:14:48.916013 run osmo-hlr_10.42.42.2(pid=28410): Launched 02:14:49.039590 run osmo-stp_10.42.42.5: Starting osmo-stp 02:14:49.601272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28412): Launched 02:14:49.926073 run osmo-stp_10.42.42.5(pid=28413): Launched 02:14:50.048364 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:14:50.569789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28415): Launched 02:14:50.685460 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:14:50.940632 run patchelf(pid=28416): Launched 02:14:51.107631 run osmo-stp_10.42.42.5(pid=28413): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28413)] 02:14:51.235050 run osmo-stp_10.42.42.5(pid=28413): stdout: | (launched: 2022-12-14_02:14:49.866714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:51.363872 run osmo-stp_10.42.42.5(pid=28413): stderr: | [0;m[38;5;43m20221214021450044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021450044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021450045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021450045 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021450046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021450046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021450046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:51.492824 run osmo-stp_10.42.42.5(pid=28413): stdout: | (launched: 2022-12-14_02:14:49.866714) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:14:51.616286 run osmo-stp_10.42.42.5(pid=28413): stderr: | [0;m[38;5;43m20221214021450044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021450044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021450045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021450045 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021450046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021450046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021450046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:14:51.762857 run patchelf(pid=28416): Terminating (SIGINT) 02:14:51.933796 run patchelf(pid=28416): Terminated: ok {rc=0} 02:14:52.056919 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28413): Process ended prematurely: osmo-stp_10.42.42.5(pid=28413) [trial-2398↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28413)] [trial-2398↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 02:14:52.066453 tst iperf3.py:8: Test FAILED (7.5 sec) 02:14:52.093555 run osmo-hlr_10.42.42.2(pid=28410): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28410)] 02:14:52.141078 run osmo-hlr_10.42.42.2(pid=28410): stdout: | (launched: 2022-12-14_02:14:48.856501) 02:14:52.190165 run osmo-hlr_10.42.42.2(pid=28410): stderr: | [0;m[1;31m20221214021449056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021449056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021449056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021449056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021449056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021449056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021449068 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021449077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021449077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021449077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:14:52.239504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28405): Terminating (SIGTERM) 02:14:52.279075 run iperf3-srv_10.42.42.10(pid=28406): Terminating (SIGTERM) 02:14:52.318555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28409): Terminating (SIGTERM) 02:14:52.358083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28412): Terminating (SIGTERM) 02:14:52.397444 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28415): Terminating (SIGTERM) 02:14:52.437137 --- ParallelTerminationStrategy: PID 28405 died... 02:14:52.456139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28405): Terminated: ok {rc=0} 02:14:52.499951 --- ParallelTerminationStrategy: PID 28406 died... 02:14:52.518349 run iperf3-srv_10.42.42.10(pid=28406): Terminated {rc=256} 02:14:52.561703 --- ParallelTerminationStrategy: PID 28409 died... 02:14:52.580155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28409): Terminated: ok {rc=0} 02:14:52.623686 --- ParallelTerminationStrategy: PID 28412 died... 02:14:52.642200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28412): Terminated: ok {rc=0} 02:14:52.685804 --- ParallelTerminationStrategy: PID 28415 died... 02:14:52.704230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28415): Terminated: ok {rc=0} 02:14:52.787270 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:14:53.935729 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:53.947557 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:14:53.989965 tst iperf3m4.py: using LAC 37840 02:14:54.117532 tst iperf3m4.py: using RAC 100 02:14:54.265286 tst iperf3m4.py: using CellId 37840 02:14:54.387595 tst iperf3m4.py: using BVCI 37841 02:14:54.496536 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:54.507207 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:54.518018 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:54.528374 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:54.538770 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:54.549097 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:54.559576 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:54.569921 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:14:54.580360 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:54.699205 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:54.821362 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:54.937740 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:14:55.058409 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:14:55.262335 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:55.567965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28417): Launched 02:14:55.832647 run iperf3-srv_10.42.42.10(pid=28418): Launched 02:14:55.946780 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:14:56.148696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:56.451993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28419): Launched 02:14:56.715907 run iperf3-srv_10.42.42.10(pid=28420): Launched 02:14:56.829420 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:14:57.030830 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:57.334742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28421): Launched 02:14:57.597876 run iperf3-srv_10.42.42.10(pid=28422): Launched 02:14:57.710546 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:14:57.911986 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:14:58.216563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28423): Launched 02:14:58.480755 run iperf3-srv_10.42.42.10(pid=28424): Launched 02:14:58.594004 tst iperf3m4.py:8: start network... 02:14:58.797136 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:14:59.264543 run create_hlr_db(pid=28425): Launched 02:14:59.387430 bus /gobi_6: Setting Powered False 02:15:00.447321 run create_hlr_db(pid=28425): Terminated: ok {rc=0} 02:15:00.907062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28427): Launched 02:15:01.252146 run osmo-hlr_10.42.42.2(pid=28428): Launched 02:15:01.397986 run osmo-stp_10.42.42.5: Starting osmo-stp 02:15:02.201522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28433): Launched 02:15:02.554255 run osmo-stp_10.42.42.5(pid=28434): Launched 02:15:02.679873 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:15:03.242228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28436): Launched 02:15:03.369039 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:15:03.643721 run patchelf(pid=28437): Launched 02:15:03.825127 run osmo-stp_10.42.42.5(pid=28434): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28434)] 02:15:03.962558 run osmo-stp_10.42.42.5(pid=28434): stdout: | (launched: 2022-12-14_02:15:02.494009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:04.101847 run osmo-stp_10.42.42.5(pid=28434): stderr: | [0;m[38;5;43m20221214021502687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021502687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021502687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021502688 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021502688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021502688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021502688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:04.240389 run osmo-stp_10.42.42.5(pid=28434): stdout: | (launched: 2022-12-14_02:15:02.494009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:04.374026 run osmo-stp_10.42.42.5(pid=28434): stderr: | [0;m[38;5;43m20221214021502687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021502687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021502687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021502688 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021502688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021502688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021502688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:04.532165 run patchelf(pid=28437): Terminating (SIGINT) 02:15:04.716146 run patchelf(pid=28437): Terminated: ok {rc=0} 02:15:04.848728 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28434): Process ended prematurely: osmo-stp_10.42.42.5(pid=28434) [trial-2398↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28434)] [trial-2398↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 02:15:04.858978 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:15:04.887649 run osmo-hlr_10.42.42.2(pid=28428): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28428)] 02:15:04.938581 run osmo-hlr_10.42.42.2(pid=28428): stdout: | (launched: 2022-12-14_02:15:01.187397) 02:15:04.991160 run osmo-hlr_10.42.42.2(pid=28428): stderr: | [0;m[1;31m20221214021501548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021501548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021501548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021501548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021501549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021501549 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021501563 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021501579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021501579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021501579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:15:05.043975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28417): Terminating (SIGTERM) 02:15:05.085810 run iperf3-srv_10.42.42.10(pid=28418): Terminating (SIGTERM) 02:15:05.128272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28419): Terminating (SIGTERM) 02:15:05.171109 run iperf3-srv_10.42.42.10(pid=28420): Terminating (SIGTERM) 02:15:05.213016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28421): Terminating (SIGTERM) 02:15:05.255026 run iperf3-srv_10.42.42.10(pid=28422): Terminating (SIGTERM) 02:15:05.296917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28423): Terminating (SIGTERM) 02:15:05.339323 run iperf3-srv_10.42.42.10(pid=28424): Terminating (SIGTERM) 02:15:05.381102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28427): Terminating (SIGTERM) 02:15:05.423756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28433): Terminating (SIGTERM) 02:15:05.465739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28436): Terminating (SIGTERM) 02:15:05.507906 --- ParallelTerminationStrategy: PID 28417 died... 02:15:05.528192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28417): Terminated: ok {rc=0} 02:15:05.575162 --- ParallelTerminationStrategy: PID 28418 died... 02:15:05.595012 run iperf3-srv_10.42.42.10(pid=28418): Terminated {rc=256} 02:15:05.641270 --- ParallelTerminationStrategy: PID 28419 died... 02:15:05.661144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28419): Terminated: ok {rc=0} 02:15:05.707645 --- ParallelTerminationStrategy: PID 28420 died... 02:15:05.727518 run iperf3-srv_10.42.42.10(pid=28420): Terminated {rc=256} 02:15:05.773812 --- ParallelTerminationStrategy: PID 28421 died... 02:15:05.793607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28421): Terminated: ok {rc=0} 02:15:05.840204 --- ParallelTerminationStrategy: PID 28422 died... 02:15:05.860059 run iperf3-srv_10.42.42.10(pid=28422): Terminated {rc=256} 02:15:05.906252 --- ParallelTerminationStrategy: PID 28423 died... 02:15:05.926268 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28423): Terminated: ok {rc=0} 02:15:05.972512 --- ParallelTerminationStrategy: PID 28424 died... 02:15:05.992467 run iperf3-srv_10.42.42.10(pid=28424): Terminated {rc=256} 02:15:06.038983 --- ParallelTerminationStrategy: PID 28427 died... 02:15:06.058876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28427): Terminated: ok {rc=0} 02:15:06.105204 --- ParallelTerminationStrategy: PID 28433 died... 02:15:06.125102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28433): Terminated: ok {rc=0} 02:15:06.171424 --- ParallelTerminationStrategy: PID 28436 died... 02:15:06.191385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28436): Terminated: ok {rc=0} 02:15:06.279676 bus /gobi_4: Setting Powered False 02:15:07.378618 bus /gobi_4: Setting Powered False 02:15:08.494657 bus /gobi_1: Setting Powered False 02:15:09.593139 bus /gobi_1: Setting Powered False 02:15:10.710897 bus /gobi_0: Setting Powered False 02:15:11.809284 bus /gobi_0: Setting Powered False 02:15:12.924492 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 02:15:14.027611 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.039060 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:15:14.076209 tst ping.py: using LAC 37841 02:15:14.195515 tst ping.py: using RAC 101 02:15:14.313397 tst ping.py: using CellId 37841 02:15:14.429637 tst ping.py: using BVCI 37842 02:15:14.548459 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.559597 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.570856 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.581866 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.593074 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.604286 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.615799 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:14.627182 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:15:14.746143 tst ping.py:19: start network... 02:15:14.944901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:15:15.404325 run create_hlr_db(pid=28438): Launched 02:15:15.525444 bus /gobi_6: Setting Powered False 02:15:16.600140 run create_hlr_db(pid=28438): Terminated: ok {rc=0} 02:15:17.087569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28440): Launched 02:15:17.412606 run osmo-hlr_10.42.42.2(pid=28441): Launched 02:15:17.536391 run osmo-stp_10.42.42.5: Starting osmo-stp 02:15:18.084610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28443): Launched 02:15:18.403875 run osmo-stp_10.42.42.5(pid=28444): Launched 02:15:18.526122 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:15:19.077283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28446): Launched 02:15:19.199398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:15:19.469908 run patchelf(pid=28447): Launched 02:15:19.647828 run osmo-stp_10.42.42.5(pid=28444): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28444)] 02:15:19.783415 run osmo-stp_10.42.42.5(pid=28444): stdout: | (launched: 2022-12-14_02:15:18.345300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:19.919839 run osmo-stp_10.42.42.5(pid=28444): stderr: | [0;m[38;5;43m20221214021518538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021518539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021518539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021518539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021518540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021518540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021518540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:20.056511 run osmo-stp_10.42.42.5(pid=28444): stdout: | (launched: 2022-12-14_02:15:18.345300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:20.187792 run osmo-stp_10.42.42.5(pid=28444): stderr: | [0;m[38;5;43m20221214021518538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021518539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021518539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021518539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021518540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021518540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021518540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:20.343482 run patchelf(pid=28447): Terminating (SIGINT) 02:15:20.523708 run patchelf(pid=28447): Terminated: ok {rc=0} 02:15:20.653476 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28444): Process ended prematurely: osmo-stp_10.42.42.5(pid=28444) [trial-2398↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28444)] [trial-2398↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 02:15:20.662887 tst ping.py:22: Test FAILED (6.6 sec) 02:15:20.690779 run osmo-hlr_10.42.42.2(pid=28441): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28441)] 02:15:20.741727 run osmo-hlr_10.42.42.2(pid=28441): stdout: | (launched: 2022-12-14_02:15:17.353907) 02:15:20.793905 run osmo-hlr_10.42.42.2(pid=28441): stderr: | [0;m[1;31m20221214021517548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021517548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021517548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021517548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021517548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021517548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021517561 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021517570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021517570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021517570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:15:20.846468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28440): Terminating (SIGTERM) 02:15:20.888445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28443): Terminating (SIGTERM) 02:15:20.930368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28446): Terminating (SIGTERM) 02:15:20.972612 --- ParallelTerminationStrategy: PID 28440 died... 02:15:20.993200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28440): Terminated: ok {rc=0} 02:15:21.039905 --- ParallelTerminationStrategy: PID 28443 died... 02:15:21.059754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28443): Terminated: ok {rc=0} 02:15:21.106069 --- ParallelTerminationStrategy: PID 28446 died... 02:15:21.125988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28446): Terminated: ok {rc=0} 02:15:21.214239 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:15:22.302872 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:22.314803 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:15:22.353548 tst ping_idle_ping.py: using LAC 37842 02:15:22.479267 tst ping_idle_ping.py: using RAC 102 02:15:22.604846 tst ping_idle_ping.py: using CellId 37842 02:15:22.730832 tst ping_idle_ping.py: using BVCI 37843 02:15:22.849650 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:22.860745 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:22.871788 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:22.882819 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:22.894177 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:22.905443 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:22.916744 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:15:22.928306 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:15:23.055095 tst ping_idle_ping.py:24: start network... 02:15:23.269614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:15:23.763207 run create_hlr_db(pid=28448): Launched 02:15:23.885088 bus /gobi_6: Setting Powered False 02:15:24.947958 run create_hlr_db(pid=28448): Terminated: ok {rc=0} 02:15:25.375038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28450): Launched 02:15:25.672729 run osmo-hlr_10.42.42.2(pid=28451): Launched 02:15:25.786713 run osmo-stp_10.42.42.5: Starting osmo-stp 02:15:26.298972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28453): Launched 02:15:26.596310 run osmo-stp_10.42.42.5(pid=28454): Launched 02:15:26.709274 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:15:27.222760 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28456): Launched 02:15:27.335713 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:15:27.586771 run patchelf(pid=28457): Launched 02:15:27.751642 run osmo-stp_10.42.42.5(pid=28454): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28454)] 02:15:27.876692 run osmo-stp_10.42.42.5(pid=28454): stdout: | (launched: 2022-12-14_02:15:26.541102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:28.003338 run osmo-stp_10.42.42.5(pid=28454): stderr: | [0;m[38;5;43m20221214021526714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021526714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021526714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021526715 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021526715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021526715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021526715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:28.130116 run osmo-stp_10.42.42.5(pid=28454): stdout: | (launched: 2022-12-14_02:15:26.541102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:28.252151 run osmo-stp_10.42.42.5(pid=28454): stderr: | [0;m[38;5;43m20221214021526714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021526714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021526714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021526715 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021526715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021526715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021526715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:28.395812 run patchelf(pid=28457): Terminating (SIGINT) 02:15:28.563428 run patchelf(pid=28457): Terminated: ok {rc=0} 02:15:28.684288 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28454): Process ended prematurely: osmo-stp_10.42.42.5(pid=28454) [trial-2398↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28454)] [trial-2398↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 02:15:28.693275 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:15:28.719537 run osmo-hlr_10.42.42.2(pid=28451): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28451)] 02:15:28.767157 run osmo-hlr_10.42.42.2(pid=28451): stdout: | (launched: 2022-12-14_02:15:25.617865) 02:15:28.816064 run osmo-hlr_10.42.42.2(pid=28451): stderr: | [0;m[1;31m20221214021525790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021525790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021525790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021525791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021525791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021525791 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021525803 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021525812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021525813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021525813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:15:28.865405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28450): Terminating (SIGTERM) 02:15:28.904579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28453): Terminating (SIGTERM) 02:15:28.943828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28456): Terminating (SIGTERM) 02:15:28.983516 --- ParallelTerminationStrategy: PID 28450 died... 02:15:29.002642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28450): Terminated: ok {rc=0} 02:15:29.046260 --- ParallelTerminationStrategy: PID 28453 died... 02:15:29.064597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28453): Terminated: ok {rc=0} 02:15:29.108177 --- ParallelTerminationStrategy: PID 28456 died... 02:15:29.126644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28456): Terminated: ok {rc=0} 02:15:29.211572 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:15:30.494416 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:15:30.500141 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:15:30.520176 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:15:30.561367 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:15:30.649589 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:15:30.670944 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:15:30.710161 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:15:31.302502 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:15:31.358597 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:31.370709 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:15:31.428377 tst cs_paging_gprs_active.py: using LAC 37843 02:15:31.552493 tst cs_paging_gprs_active.py: using RAC 103 02:15:31.677244 tst cs_paging_gprs_active.py: using CellId 37843 02:15:31.800823 tst cs_paging_gprs_active.py: using BVCI 37844 02:15:31.956790 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:31.972591 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:31.985474 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:31.999951 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:32.015039 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:32.030331 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:32.046368 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:32.061432 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:32.077048 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:32.238542 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:32.365079 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:15:32.585066 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:32.912243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28462): Launched 02:15:33.194749 run iperf3-srv_10.42.42.10(pid=28463): Launched 02:15:33.316571 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:15:33.535717 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:33.862978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28464): Launched 02:15:34.145154 run iperf3-srv_10.42.42.10(pid=28465): Launched 02:15:34.267157 tst cs_paging_gprs_active.py:38: start network... 02:15:34.486225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:15:34.990529 run create_hlr_db(pid=28466): Launched 02:15:35.114246 bus /gobi_6: Setting Powered False 02:15:36.178584 run create_hlr_db(pid=28466): Terminated: ok {rc=0} 02:15:36.612037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28468): Launched 02:15:36.915927 run osmo-hlr_10.42.42.2(pid=28469): Launched 02:15:37.030896 run osmo-stp_10.42.42.5: Starting osmo-stp 02:15:37.595301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28471): Launched 02:15:37.922085 run osmo-stp_10.42.42.5(pid=28472): Launched 02:15:38.046518 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:15:38.607066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28474): Launched 02:15:38.731806 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:15:39.007519 run patchelf(pid=28475): Launched 02:15:39.187807 run osmo-stp_10.42.42.5(pid=28472): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28472)] 02:15:39.325903 run osmo-stp_10.42.42.5(pid=28472): stdout: | (launched: 2022-12-14_02:15:37.862161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:39.465442 run osmo-stp_10.42.42.5(pid=28472): stderr: | [0;m[38;5;43m20221214021538057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021538057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021538058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021538058 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021538058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021538059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021538059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:39.604294 run osmo-stp_10.42.42.5(pid=28472): stdout: | (launched: 2022-12-14_02:15:37.862161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:39.738127 run osmo-stp_10.42.42.5(pid=28472): stderr: | [0;m[38;5;43m20221214021538057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021538057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021538058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021538058 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021538058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021538059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021538059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:39.896040 run patchelf(pid=28475): Terminating (SIGINT) 02:15:40.073727 run patchelf(pid=28475): Terminated: ok {rc=0} 02:15:40.197207 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28472): Process ended prematurely: osmo-stp_10.42.42.5(pid=28472) [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28472)] [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:15:40.206632 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 02:15:40.233532 run osmo-hlr_10.42.42.2(pid=28469): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28469)] 02:15:40.282611 run osmo-hlr_10.42.42.2(pid=28469): stdout: | (launched: 2022-12-14_02:15:36.859868) 02:15:40.332698 run osmo-hlr_10.42.42.2(pid=28469): stderr: | [0;m[1;31m20221214021537039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021537039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021537039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021537039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021537039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021537039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021537051 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021537059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021537059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021537060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:15:40.382857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28462): Terminating (SIGTERM) 02:15:40.422990 run iperf3-srv_10.42.42.10(pid=28463): Terminating (SIGTERM) 02:15:40.463173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28464): Terminating (SIGTERM) 02:15:40.503435 run iperf3-srv_10.42.42.10(pid=28465): Terminating (SIGTERM) 02:15:40.543752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28468): Terminating (SIGTERM) 02:15:40.584010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28471): Terminating (SIGTERM) 02:15:40.623920 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28474): Terminating (SIGTERM) 02:15:40.664300 --- ParallelTerminationStrategy: PID 28462 died... 02:15:40.683922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28462): Terminated: ok {rc=0} 02:15:40.728244 --- ParallelTerminationStrategy: PID 28463 died... 02:15:40.747225 run iperf3-srv_10.42.42.10(pid=28463): Terminated {rc=256} 02:15:40.791170 --- ParallelTerminationStrategy: PID 28464 died... 02:15:40.810144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28464): Terminated: ok {rc=0} 02:15:40.854145 --- ParallelTerminationStrategy: PID 28465 died... 02:15:40.873068 run iperf3-srv_10.42.42.10(pid=28465): Terminated {rc=256} 02:15:40.917094 --- ParallelTerminationStrategy: PID 28468 died... 02:15:40.936119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28468): Terminated: ok {rc=0} 02:15:40.980210 --- ParallelTerminationStrategy: PID 28471 died... 02:15:40.999196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28471): Terminated: ok {rc=0} 02:15:41.043157 --- ParallelTerminationStrategy: PID 28474 died... 02:15:41.062151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28474): Terminated: ok {rc=0} 02:15:41.148166 bus /gobi_0: Setting Powered False 02:15:42.246400 bus /gobi_0: Setting Powered False 02:15:43.359652 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:15:44.501560 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:44.512648 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:15:44.573987 tst iperf3.py: using LAC 37844 02:15:44.692167 tst iperf3.py: using RAC 104 02:15:44.812170 tst iperf3.py: using CellId 37844 02:15:44.932075 tst iperf3.py: using BVCI 37845 02:15:45.043462 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:45.054320 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:45.064845 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:45.075497 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:45.085963 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:45.096404 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:45.107280 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:45.118103 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:45.129119 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:45.244693 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:15:45.448059 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:45.751606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28476): Launched 02:15:46.073633 run iperf3-srv_10.42.42.10(pid=28477): Launched 02:15:46.205610 tst iperf3.py:8: start network... 02:15:46.433524 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:15:46.956243 run create_hlr_db(pid=28478): Launched 02:15:47.120018 bus /gobi_6: Setting Powered False 02:15:48.184886 run create_hlr_db(pid=28478): Terminated: ok {rc=0} 02:15:48.618100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28480): Launched 02:15:48.919434 run osmo-hlr_10.42.42.2(pid=28481): Launched 02:15:49.033415 run osmo-stp_10.42.42.5: Starting osmo-stp 02:15:49.550495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28483): Launched 02:15:49.851142 run osmo-stp_10.42.42.5(pid=28484): Launched 02:15:49.965730 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:15:50.484722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28486): Launched 02:15:50.600087 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:15:50.855738 run patchelf(pid=28487): Launched 02:15:51.022706 run osmo-stp_10.42.42.5(pid=28484): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28484)] 02:15:51.149853 run osmo-stp_10.42.42.5(pid=28484): stdout: | (launched: 2022-12-14_02:15:49.795198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:51.278714 run osmo-stp_10.42.42.5(pid=28484): stderr: | [0;m[38;5;43m20221214021549965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021549965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021549966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021549966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021549966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021549967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021549967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:51.407560 run osmo-stp_10.42.42.5(pid=28484): stdout: | (launched: 2022-12-14_02:15:49.795198) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:15:51.531122 run osmo-stp_10.42.42.5(pid=28484): stderr: | [0;m[38;5;43m20221214021549965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021549965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021549966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021549966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021549966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021549967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021549967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:15:51.677541 run patchelf(pid=28487): Terminating (SIGINT) 02:15:51.847280 run patchelf(pid=28487): Terminated: ok {rc=0} 02:15:51.970151 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28484): Process ended prematurely: osmo-stp_10.42.42.5(pid=28484) [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28484)] [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 02:15:51.979432 tst iperf3.py:8: Test FAILED (7.5 sec) 02:15:52.006392 run osmo-hlr_10.42.42.2(pid=28481): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28481)] 02:15:52.053415 run osmo-hlr_10.42.42.2(pid=28481): stdout: | (launched: 2022-12-14_02:15:48.863469) 02:15:52.102301 run osmo-hlr_10.42.42.2(pid=28481): stderr: | [0;m[1;31m20221214021549039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021549039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021549039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021549039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021549039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021549039 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021549066 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021549076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021549076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021549076 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:15:52.152884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28476): Terminating (SIGTERM) 02:15:52.192289 run iperf3-srv_10.42.42.10(pid=28477): Terminating (SIGTERM) 02:15:52.231631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28480): Terminating (SIGTERM) 02:15:52.270966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28483): Terminating (SIGTERM) 02:15:52.310163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28486): Terminating (SIGTERM) 02:15:52.349755 --- ParallelTerminationStrategy: PID 28476 died... 02:15:52.369113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28476): Terminated: ok {rc=0} 02:15:52.412905 --- ParallelTerminationStrategy: PID 28477 died... 02:15:52.431802 run iperf3-srv_10.42.42.10(pid=28477): Terminated {rc=256} 02:15:52.475070 --- ParallelTerminationStrategy: PID 28480 died... 02:15:52.493483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28480): Terminated: ok {rc=0} 02:15:52.536686 --- ParallelTerminationStrategy: PID 28483 died... 02:15:52.555540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28483): Terminated: ok {rc=0} 02:15:52.599012 --- ParallelTerminationStrategy: PID 28486 died... 02:15:52.617447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28486): Terminated: ok {rc=0} 02:15:52.702992 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:15:53.848883 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:53.860136 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:15:53.916467 tst iperf3m4.py: using LAC 37845 02:15:54.036332 tst iperf3m4.py: using RAC 105 02:15:54.156331 tst iperf3m4.py: using CellId 37845 02:15:54.275757 tst iperf3m4.py: using BVCI 37846 02:15:54.387317 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:54.398319 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:54.408838 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:54.419383 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:54.429776 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:54.440612 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:54.451806 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:54.462634 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:15:54.473251 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:54.587689 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:54.710515 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:54.827096 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:15:54.949395 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:15:55.170245 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:55.498932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28490): Launched 02:15:55.783823 run iperf3-srv_10.42.42.10(pid=28491): Launched 02:15:55.906949 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:15:56.126983 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:56.454070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28492): Launched 02:15:56.738201 run iperf3-srv_10.42.42.10(pid=28493): Launched 02:15:56.860617 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:15:57.079933 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:57.407281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28494): Launched 02:15:57.691489 run iperf3-srv_10.42.42.10(pid=28495): Launched 02:15:57.814376 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:15:58.033660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:15:58.360791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28496): Launched 02:15:58.644863 run iperf3-srv_10.42.42.10(pid=28497): Launched 02:15:58.767287 tst iperf3m4.py:8: start network... 02:15:58.986191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:15:59.491950 run create_hlr_db(pid=28498): Launched 02:15:59.616103 bus /gobi_6: Setting Powered False 02:16:00.679574 run create_hlr_db(pid=28498): Terminated: ok {rc=0} 02:16:01.171205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28500): Launched 02:16:01.503559 run osmo-hlr_10.42.42.2(pid=28501): Launched 02:16:01.708193 run osmo-stp_10.42.42.5: Starting osmo-stp 02:16:02.389551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28503): Launched 02:16:02.713953 run osmo-stp_10.42.42.5(pid=28504): Launched 02:16:02.838055 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:16:03.398342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28506): Launched 02:16:03.522838 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:16:03.798011 run patchelf(pid=28507): Launched 02:16:03.978387 run osmo-stp_10.42.42.5(pid=28504): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28504)] 02:16:04.115656 run osmo-stp_10.42.42.5(pid=28504): stdout: | (launched: 2022-12-14_02:16:02.654291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:04.254412 run osmo-stp_10.42.42.5(pid=28504): stderr: | [0;m[38;5;43m20221214021602847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021602848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021602848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021602848 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021602849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021602849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021602849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:04.393239 run osmo-stp_10.42.42.5(pid=28504): stdout: | (launched: 2022-12-14_02:16:02.654291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:04.526985 run osmo-stp_10.42.42.5(pid=28504): stderr: | [0;m[38;5;43m20221214021602847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021602848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021602848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021602848 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021602849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021602849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021602849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:04.685427 run patchelf(pid=28507): Terminating (SIGINT) 02:16:04.868910 run patchelf(pid=28507): Terminated: ok {rc=0} 02:16:05.001255 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28504): Process ended prematurely: osmo-stp_10.42.42.5(pid=28504) [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28504)] [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:16:05.011249 tst iperf3m4.py:8: Test FAILED (11.2 sec) 02:16:05.039826 run osmo-hlr_10.42.42.2(pid=28501): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28501)] 02:16:05.090679 run osmo-hlr_10.42.42.2(pid=28501): stdout: | (launched: 2022-12-14_02:16:01.442830) 02:16:05.143062 run osmo-hlr_10.42.42.2(pid=28501): stderr: | [0;m[1;31m20221214021601787 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021601787 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021601787 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021601787 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021601787 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021601787 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021601807 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021601815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021601816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021601816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:16:05.195417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28490): Terminating (SIGTERM) 02:16:05.237187 run iperf3-srv_10.42.42.10(pid=28491): Terminating (SIGTERM) 02:16:05.279135 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28492): Terminating (SIGTERM) 02:16:05.321883 run iperf3-srv_10.42.42.10(pid=28493): Terminating (SIGTERM) 02:16:05.363672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28494): Terminating (SIGTERM) 02:16:05.406232 run iperf3-srv_10.42.42.10(pid=28495): Terminating (SIGTERM) 02:16:05.448427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28496): Terminating (SIGTERM) 02:16:05.490812 run iperf3-srv_10.42.42.10(pid=28497): Terminating (SIGTERM) 02:16:05.532900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28500): Terminating (SIGTERM) 02:16:05.574764 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28503): Terminating (SIGTERM) 02:16:05.617118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28506): Terminating (SIGTERM) 02:16:05.659257 --- ParallelTerminationStrategy: PID 28490 died... 02:16:05.679439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28490): Terminated: ok {rc=0} 02:16:05.725990 --- ParallelTerminationStrategy: PID 28491 died... 02:16:05.746094 run iperf3-srv_10.42.42.10(pid=28491): Terminated {rc=256} 02:16:05.792437 --- ParallelTerminationStrategy: PID 28492 died... 02:16:05.812351 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28492): Terminated: ok {rc=0} 02:16:05.858461 --- ParallelTerminationStrategy: PID 28493 died... 02:16:05.878278 run iperf3-srv_10.42.42.10(pid=28493): Terminated {rc=256} 02:16:05.924565 --- ParallelTerminationStrategy: PID 28494 died... 02:16:05.944451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28494): Terminated: ok {rc=0} 02:16:05.990792 --- ParallelTerminationStrategy: PID 28495 died... 02:16:06.010621 run iperf3-srv_10.42.42.10(pid=28495): Terminated {rc=256} 02:16:06.056757 --- ParallelTerminationStrategy: PID 28496 died... 02:16:06.076671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28496): Terminated: ok {rc=0} 02:16:06.122986 --- ParallelTerminationStrategy: PID 28497 died... 02:16:06.142927 run iperf3-srv_10.42.42.10(pid=28497): Terminated {rc=256} 02:16:06.188859 --- ParallelTerminationStrategy: PID 28500 died... 02:16:06.209326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28500): Terminated: ok {rc=0} 02:16:06.255601 --- ParallelTerminationStrategy: PID 28503 died... 02:16:06.275408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28503): Terminated: ok {rc=0} 02:16:06.321755 --- ParallelTerminationStrategy: PID 28506 died... 02:16:06.341596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28506): Terminated: ok {rc=0} 02:16:06.430076 bus /gobi_4: Setting Powered False 02:16:07.526629 bus /gobi_4: Setting Powered False 02:16:08.643695 bus /gobi_1: Setting Powered False 02:16:09.742040 bus /gobi_1: Setting Powered False 02:16:10.857836 bus /gobi_0: Setting Powered False 02:16:11.956049 bus /gobi_0: Setting Powered False 02:16:13.074871 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:16:14.177575 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:14.188846 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:16:14.248487 tst ping.py: using LAC 37846 02:16:14.367022 tst ping.py: using RAC 106 02:16:14.482451 tst ping.py: using CellId 37846 02:16:14.600348 tst ping.py: using BVCI 37847 02:16:14.707690 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:14.718522 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:14.729028 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:14.739602 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:14.750103 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:14.760519 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:14.771693 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:14.782760 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:16:14.900101 tst ping.py:19: start network... 02:16:15.115954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:16:15.611154 run create_hlr_db(pid=28508): Launched 02:16:15.733636 bus /gobi_6: Setting Powered False 02:16:16.791836 run create_hlr_db(pid=28508): Terminated: ok {rc=0} 02:16:17.239162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28510): Launched 02:16:17.579280 run osmo-hlr_10.42.42.2(pid=28511): Launched 02:16:17.702344 run osmo-stp_10.42.42.5: Starting osmo-stp 02:16:18.263261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28513): Launched 02:16:18.582739 run osmo-stp_10.42.42.5(pid=28514): Launched 02:16:18.705326 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:16:19.255940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28516): Launched 02:16:19.378121 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:16:19.647555 run patchelf(pid=28517): Launched 02:16:19.825605 run osmo-stp_10.42.42.5(pid=28514): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28514)] 02:16:19.960774 run osmo-stp_10.42.42.5(pid=28514): stdout: | (launched: 2022-12-14_02:16:18.524229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:20.097491 run osmo-stp_10.42.42.5(pid=28514): stderr: | [0;m[38;5;43m20221214021618718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021618718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021618718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021618718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021618719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021618719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021618719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:20.234465 run osmo-stp_10.42.42.5(pid=28514): stdout: | (launched: 2022-12-14_02:16:18.524229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:20.366191 run osmo-stp_10.42.42.5(pid=28514): stderr: | [0;m[38;5;43m20221214021618718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021618718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021618718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021618718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021618719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021618719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021618719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:20.521803 run patchelf(pid=28517): Terminating (SIGINT) 02:16:20.702434 run patchelf(pid=28517): Terminated: ok {rc=0} 02:16:20.833270 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28514): Process ended prematurely: osmo-stp_10.42.42.5(pid=28514) [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28514)] [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 02:16:20.842628 tst ping.py:22: Test FAILED (6.7 sec) 02:16:20.870576 run osmo-hlr_10.42.42.2(pid=28511): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28511)] 02:16:20.921120 run osmo-hlr_10.42.42.2(pid=28511): stdout: | (launched: 2022-12-14_02:16:17.520471) 02:16:20.973452 run osmo-hlr_10.42.42.2(pid=28511): stderr: | [0;m[1;31m20221214021617719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021617719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021617719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021617719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021617719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021617719 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021617733 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021617741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021617741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021617741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:16:21.025702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28510): Terminating (SIGTERM) 02:16:21.067216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28513): Terminating (SIGTERM) 02:16:21.109478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28516): Terminating (SIGTERM) 02:16:21.151783 --- ParallelTerminationStrategy: PID 28510 died... 02:16:21.172222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28510): Terminated: ok {rc=0} 02:16:21.218373 --- ParallelTerminationStrategy: PID 28513 died... 02:16:21.238263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28513): Terminated: ok {rc=0} 02:16:21.284189 --- ParallelTerminationStrategy: PID 28516 died... 02:16:21.304008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28516): Terminated: ok {rc=0} 02:16:21.391582 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:16:22.475901 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:22.487728 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:16:22.545478 tst ping_idle_ping.py: using LAC 37847 02:16:22.673362 tst ping_idle_ping.py: using RAC 107 02:16:22.798571 tst ping_idle_ping.py: using CellId 37847 02:16:22.929236 tst ping_idle_ping.py: using BVCI 37848 02:16:23.046631 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:23.058143 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:23.069363 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:23.080465 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:23.091867 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:23.103020 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:23.114476 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:16:23.125687 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:16:23.242408 tst ping_idle_ping.py:24: start network... 02:16:23.441437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:16:23.902934 run create_hlr_db(pid=28518): Launched 02:16:24.024305 bus /gobi_6: Setting Powered False 02:16:25.088203 run create_hlr_db(pid=28518): Terminated: ok {rc=0} 02:16:25.517242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28520): Launched 02:16:25.817295 run osmo-hlr_10.42.42.2(pid=28521): Launched 02:16:25.930372 run osmo-stp_10.42.42.5: Starting osmo-stp 02:16:26.461218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28523): Launched 02:16:26.760119 run osmo-stp_10.42.42.5(pid=28524): Launched 02:16:26.873764 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:16:27.387858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28526): Launched 02:16:27.505458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:16:27.778171 run patchelf(pid=28527): Launched 02:16:27.957114 run osmo-stp_10.42.42.5(pid=28524): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28524)] 02:16:28.093601 run osmo-stp_10.42.42.5(pid=28524): stdout: | (launched: 2022-12-14_02:16:26.704454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:28.231147 run osmo-stp_10.42.42.5(pid=28524): stderr: | [0;m[38;5;43m20221214021626877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021626877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021626877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021626878 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021626878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021626878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021626878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:28.369377 run osmo-stp_10.42.42.5(pid=28524): stdout: | (launched: 2022-12-14_02:16:26.704454) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:28.501786 run osmo-stp_10.42.42.5(pid=28524): stderr: | [0;m[38;5;43m20221214021626877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021626877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021626877 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021626878 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021626878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021626878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021626878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:28.658889 run patchelf(pid=28527): Terminating (SIGINT) 02:16:28.841184 run patchelf(pid=28527): Terminated: ok {rc=0} 02:16:28.972425 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28524): Process ended prematurely: osmo-stp_10.42.42.5(pid=28524) [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28524)] [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:16:28.982339 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 02:16:29.010358 run osmo-hlr_10.42.42.2(pid=28521): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28521)] 02:16:29.063130 run osmo-hlr_10.42.42.2(pid=28521): stdout: | (launched: 2022-12-14_02:16:25.760754) 02:16:29.116080 run osmo-hlr_10.42.42.2(pid=28521): stderr: | [0;m[1;31m20221214021625939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021625939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021625939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021625939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021625939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021625939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021625951 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021625960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021625960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021625960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:16:29.169320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28520): Terminating (SIGTERM) 02:16:29.211730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28523): Terminating (SIGTERM) 02:16:29.254557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28526): Terminating (SIGTERM) 02:16:29.297939 --- ParallelTerminationStrategy: PID 28520 died... 02:16:29.318621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28520): Terminated: ok {rc=0} 02:16:29.365744 --- ParallelTerminationStrategy: PID 28523 died... 02:16:29.386190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28523): Terminated: ok {rc=0} 02:16:29.433267 --- ParallelTerminationStrategy: PID 28526 died... 02:16:29.453649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28526): Terminated: ok {rc=0} 02:16:29.541859 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:16:30.829551 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:16:30.836370 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:16:30.864352 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:16:30.921142 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:16:31.023749 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:16:31.061909 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:16:31.108542 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:16:31.666799 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:16:31.736296 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:31.751313 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:16:31.820368 tst cs_paging_gprs_active.py: using LAC 37848 02:16:31.943284 tst cs_paging_gprs_active.py: using RAC 108 02:16:32.107741 tst cs_paging_gprs_active.py: using CellId 37848 02:16:32.265416 tst cs_paging_gprs_active.py: using BVCI 37849 02:16:32.394704 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:32.406049 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:32.417138 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:32.427995 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:32.439821 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:32.451782 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:32.463603 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:32.475413 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:32.487360 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:32.607917 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:32.723970 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:16:32.926361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:33.230472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28531): Launched 02:16:33.493493 run iperf3-srv_10.42.42.10(pid=28532): Launched 02:16:33.606389 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:16:33.807844 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:34.110342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28533): Launched 02:16:34.373193 run iperf3-srv_10.42.42.10(pid=28534): Launched 02:16:34.486493 tst cs_paging_gprs_active.py:38: start network... 02:16:34.687612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:16:35.156279 run create_hlr_db(pid=28535): Launched 02:16:35.279761 bus /gobi_6: Setting Powered False 02:16:36.340731 run create_hlr_db(pid=28535): Terminated: ok {rc=0} 02:16:36.770882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28537): Launched 02:16:37.073472 run osmo-hlr_10.42.42.2(pid=28538): Launched 02:16:37.188125 run osmo-stp_10.42.42.5: Starting osmo-stp 02:16:37.722692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28540): Launched 02:16:38.024366 run osmo-stp_10.42.42.5(pid=28541): Launched 02:16:38.139205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:16:38.659131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28543): Launched 02:16:38.774637 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:16:39.030020 run patchelf(pid=28544): Launched 02:16:39.197407 run osmo-stp_10.42.42.5(pid=28541): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28541)] 02:16:39.325451 run osmo-stp_10.42.42.5(pid=28541): stdout: | (launched: 2022-12-14_02:16:37.968304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:39.455034 run osmo-stp_10.42.42.5(pid=28541): stderr: | [0;m[38;5;43m20221214021638139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021638140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021638140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021638140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021638141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021638141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021638141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:39.584639 run osmo-stp_10.42.42.5(pid=28541): stdout: | (launched: 2022-12-14_02:16:37.968304) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:39.708058 run osmo-stp_10.42.42.5(pid=28541): stderr: | [0;m[38;5;43m20221214021638139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021638140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021638140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021638140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021638141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021638141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021638141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:39.855015 run patchelf(pid=28544): Terminating (SIGINT) 02:16:40.025982 run patchelf(pid=28544): Terminated: ok {rc=0} 02:16:40.149605 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28541): Process ended prematurely: osmo-stp_10.42.42.5(pid=28541) [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28541)] [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:16:40.159142 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 02:16:40.186247 run osmo-hlr_10.42.42.2(pid=28538): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28538)] 02:16:40.233538 run osmo-hlr_10.42.42.2(pid=28538): stdout: | (launched: 2022-12-14_02:16:37.017275) 02:16:40.282749 run osmo-hlr_10.42.42.2(pid=28538): stderr: | [0;m[1;31m20221214021637194 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021637194 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021637194 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021637194 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021637194 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021637194 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021637212 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021637221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021637221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021637221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:16:40.332074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28531): Terminating (SIGTERM) 02:16:40.371749 run iperf3-srv_10.42.42.10(pid=28532): Terminating (SIGTERM) 02:16:40.411440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28533): Terminating (SIGTERM) 02:16:40.451058 run iperf3-srv_10.42.42.10(pid=28534): Terminating (SIGTERM) 02:16:40.490421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28537): Terminating (SIGTERM) 02:16:40.530081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28540): Terminating (SIGTERM) 02:16:40.569516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28543): Terminating (SIGTERM) 02:16:40.609075 --- ParallelTerminationStrategy: PID 28531 died... 02:16:40.628252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28531): Terminated: ok {rc=0} 02:16:40.672163 --- ParallelTerminationStrategy: PID 28532 died... 02:16:40.690704 run iperf3-srv_10.42.42.10(pid=28532): Terminated {rc=256} 02:16:40.734006 --- ParallelTerminationStrategy: PID 28533 died... 02:16:40.752830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28533): Terminated: ok {rc=0} 02:16:40.796715 --- ParallelTerminationStrategy: PID 28534 died... 02:16:40.815377 run iperf3-srv_10.42.42.10(pid=28534): Terminated {rc=256} 02:16:40.858821 --- ParallelTerminationStrategy: PID 28537 died... 02:16:40.877525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28537): Terminated: ok {rc=0} 02:16:40.921097 --- ParallelTerminationStrategy: PID 28540 died... 02:16:40.939469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28540): Terminated: ok {rc=0} 02:16:40.982916 --- ParallelTerminationStrategy: PID 28543 died... 02:16:41.001417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28543): Terminated: ok {rc=0} 02:16:41.086916 bus /gobi_0: Setting Powered False 02:16:42.186575 bus /gobi_0: Setting Powered False 02:16:43.299193 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:16:44.443169 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:44.454604 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:16:44.518234 tst iperf3.py: using LAC 37849 02:16:44.651154 tst iperf3.py: using RAC 109 02:16:44.771347 tst iperf3.py: using CellId 37849 02:16:44.901145 tst iperf3.py: using BVCI 37850 02:16:45.019597 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:45.031073 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:45.042279 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:45.053497 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:45.065142 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:45.076599 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:45.088200 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:45.099601 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:45.111261 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:45.227285 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:16:45.430159 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:45.734374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28545): Launched 02:16:46.042851 run iperf3-srv_10.42.42.10(pid=28546): Launched 02:16:46.191914 tst iperf3.py:8: start network... 02:16:46.398354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:16:46.923406 run create_hlr_db(pid=28547): Launched 02:16:47.068139 bus /gobi_6: Setting Powered False 02:16:48.129188 run create_hlr_db(pid=28547): Terminated: ok {rc=0} 02:16:48.590593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28549): Launched 02:16:48.918759 run osmo-hlr_10.42.42.2(pid=28550): Launched 02:16:49.043223 run osmo-stp_10.42.42.5: Starting osmo-stp 02:16:49.602878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28552): Launched 02:16:49.929636 run osmo-stp_10.42.42.5(pid=28553): Launched 02:16:50.054639 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:16:50.618372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28555): Launched 02:16:50.743610 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:16:51.020454 run patchelf(pid=28556): Launched 02:16:51.201864 run osmo-stp_10.42.42.5(pid=28553): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28553)] 02:16:51.339925 run osmo-stp_10.42.42.5(pid=28553): stdout: | (launched: 2022-12-14_02:16:49.869755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:51.479669 run osmo-stp_10.42.42.5(pid=28553): stderr: | [0;m[38;5;43m20221214021650062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021650062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021650063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021650063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021650065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021650065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021650066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:51.619505 run osmo-stp_10.42.42.5(pid=28553): stdout: | (launched: 2022-12-14_02:16:49.869755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:16:51.753928 run osmo-stp_10.42.42.5(pid=28553): stderr: | [0;m[38;5;43m20221214021650062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021650062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021650063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021650063 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021650065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021650065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021650066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:16:51.913323 run patchelf(pid=28556): Terminating (SIGINT) 02:16:52.098662 run patchelf(pid=28556): Terminated: ok {rc=0} 02:16:52.231738 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28553): Process ended prematurely: osmo-stp_10.42.42.5(pid=28553) [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28553)] [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 02:16:52.242033 tst iperf3.py:8: Test FAILED (7.8 sec) 02:16:52.270557 run osmo-hlr_10.42.42.2(pid=28550): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28550)] 02:16:52.321600 run osmo-hlr_10.42.42.2(pid=28550): stdout: | (launched: 2022-12-14_02:16:48.858921) 02:16:52.374340 run osmo-hlr_10.42.42.2(pid=28550): stderr: | [0;m[1;31m20221214021649059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021649059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021649059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021649059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021649059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021649059 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021649076 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021649085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021649085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021649085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:16:52.427022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28545): Terminating (SIGTERM) 02:16:52.469580 run iperf3-srv_10.42.42.10(pid=28546): Terminating (SIGTERM) 02:16:52.512313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28549): Terminating (SIGTERM) 02:16:52.555316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28552): Terminating (SIGTERM) 02:16:52.597845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28555): Terminating (SIGTERM) 02:16:52.640654 --- ParallelTerminationStrategy: PID 28545 died... 02:16:52.661242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28545): Terminated: ok {rc=0} 02:16:52.708190 --- ParallelTerminationStrategy: PID 28546 died... 02:16:52.728296 run iperf3-srv_10.42.42.10(pid=28546): Terminated {rc=256} 02:16:52.775024 --- ParallelTerminationStrategy: PID 28549 died... 02:16:52.795160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28549): Terminated: ok {rc=0} 02:16:52.841722 --- ParallelTerminationStrategy: PID 28552 died... 02:16:52.862021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28552): Terminated: ok {rc=0} 02:16:52.908641 --- ParallelTerminationStrategy: PID 28555 died... 02:16:52.928896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28555): Terminated: ok {rc=0} 02:16:53.017716 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:16:54.167902 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.179861 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:16:54.239120 tst iperf3m4.py: using LAC 37850 02:16:54.366897 tst iperf3m4.py: using RAC 110 02:16:54.496090 tst iperf3m4.py: using CellId 37850 02:16:54.625056 tst iperf3m4.py: using BVCI 37851 02:16:54.743573 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.754874 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.766265 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.777383 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.788688 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.800220 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.811886 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.823268 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:16:54.834908 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:54.952698 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:55.076018 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:55.194411 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:16:55.315816 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:16:55.536258 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:55.863423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28557): Launched 02:16:56.147329 run iperf3-srv_10.42.42.10(pid=28558): Launched 02:16:56.269364 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:16:56.488152 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:56.814627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28559): Launched 02:16:57.098935 run iperf3-srv_10.42.42.10(pid=28560): Launched 02:16:57.221435 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:16:57.440606 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:57.767978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28561): Launched 02:16:58.052201 run iperf3-srv_10.42.42.10(pid=28562): Launched 02:16:58.174777 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:16:58.394650 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:16:58.721461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28563): Launched 02:16:59.006361 run iperf3-srv_10.42.42.10(pid=28564): Launched 02:16:59.128584 tst iperf3m4.py:8: start network... 02:16:59.348032 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:16:59.853302 run create_hlr_db(pid=28565): Launched 02:16:59.977221 bus /gobi_6: Setting Powered False 02:17:01.040771 run create_hlr_db(pid=28565): Terminated: ok {rc=0} 02:17:01.503182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28567): Launched 02:17:01.840091 run osmo-hlr_10.42.42.2(pid=28568): Launched 02:17:02.036488 run osmo-stp_10.42.42.5: Starting osmo-stp 02:17:02.653462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28573): Launched 02:17:02.979559 run osmo-stp_10.42.42.5(pid=28574): Launched 02:17:03.104282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:17:03.667527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28576): Launched 02:17:03.795352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:17:04.072580 run patchelf(pid=28577): Launched 02:17:04.253924 run osmo-stp_10.42.42.5(pid=28574): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28574)] 02:17:04.392453 run osmo-stp_10.42.42.5(pid=28574): stdout: | (launched: 2022-12-14_02:17:02.919847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:04.532254 run osmo-stp_10.42.42.5(pid=28574): stderr: | [0;m[38;5;43m20221214021703112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021703112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021703113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021703113 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021703114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021703114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021703114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:04.672206 run osmo-stp_10.42.42.5(pid=28574): stdout: | (launched: 2022-12-14_02:17:02.919847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:04.807461 run osmo-stp_10.42.42.5(pid=28574): stderr: | [0;m[38;5;43m20221214021703112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021703112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021703113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021703113 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021703114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021703114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021703114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:04.967221 run patchelf(pid=28577): Terminating (SIGINT) 02:17:05.152009 run patchelf(pid=28577): Terminated: ok {rc=0} 02:17:05.285478 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28574): Process ended prematurely: osmo-stp_10.42.42.5(pid=28574) [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28574)] [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:17:05.295626 tst iperf3m4.py:8: Test FAILED (11.2 sec) 02:17:05.324436 run osmo-hlr_10.42.42.2(pid=28568): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28568)] 02:17:05.375881 run osmo-hlr_10.42.42.2(pid=28568): stdout: | (launched: 2022-12-14_02:17:01.774700) 02:17:05.428424 run osmo-hlr_10.42.42.2(pid=28568): stderr: | [0;m[1;31m20221214021702145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021702145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021702145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021702145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021702145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021702146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021702163 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021702179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021702180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021702180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:17:05.481575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28557): Terminating (SIGTERM) 02:17:05.523992 run iperf3-srv_10.42.42.10(pid=28558): Terminating (SIGTERM) 02:17:05.566526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28559): Terminating (SIGTERM) 02:17:05.609461 run iperf3-srv_10.42.42.10(pid=28560): Terminating (SIGTERM) 02:17:05.651895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28561): Terminating (SIGTERM) 02:17:05.694400 run iperf3-srv_10.42.42.10(pid=28562): Terminating (SIGTERM) 02:17:05.737081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28563): Terminating (SIGTERM) 02:17:05.779966 run iperf3-srv_10.42.42.10(pid=28564): Terminating (SIGTERM) 02:17:05.822536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28567): Terminating (SIGTERM) 02:17:05.865085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28573): Terminating (SIGTERM) 02:17:05.907469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28576): Terminating (SIGTERM) 02:17:05.950257 --- ParallelTerminationStrategy: PID 28557 died... 02:17:05.970764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28557): Terminated: ok {rc=0} 02:17:06.017473 --- ParallelTerminationStrategy: PID 28558 died... 02:17:06.037483 run iperf3-srv_10.42.42.10(pid=28558): Terminated {rc=256} 02:17:06.083935 --- ParallelTerminationStrategy: PID 28559 died... 02:17:06.104131 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28559): Terminated: ok {rc=0} 02:17:06.150699 --- ParallelTerminationStrategy: PID 28560 died... 02:17:06.170534 run iperf3-srv_10.42.42.10(pid=28560): Terminated {rc=256} 02:17:06.217063 --- ParallelTerminationStrategy: PID 28561 died... 02:17:06.237116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28561): Terminated: ok {rc=0} 02:17:06.283611 --- ParallelTerminationStrategy: PID 28562 died... 02:17:06.303690 run iperf3-srv_10.42.42.10(pid=28562): Terminated {rc=256} 02:17:06.350234 --- ParallelTerminationStrategy: PID 28563 died... 02:17:06.370377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28563): Terminated: ok {rc=0} 02:17:06.416709 --- ParallelTerminationStrategy: PID 28564 died... 02:17:06.436870 run iperf3-srv_10.42.42.10(pid=28564): Terminated {rc=256} 02:17:06.483145 --- ParallelTerminationStrategy: PID 28567 died... 02:17:06.503074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28567): Terminated: ok {rc=0} 02:17:06.549418 --- ParallelTerminationStrategy: PID 28573 died... 02:17:06.569541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28573): Terminated: ok {rc=0} 02:17:06.615799 --- ParallelTerminationStrategy: PID 28576 died... 02:17:06.635804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28576): Terminated: ok {rc=0} 02:17:06.723690 bus /gobi_4: Setting Powered False 02:17:07.822993 bus /gobi_4: Setting Powered False 02:17:08.940612 bus /gobi_1: Setting Powered False 02:17:10.039648 bus /gobi_1: Setting Powered False 02:17:11.156099 bus /gobi_0: Setting Powered False 02:17:12.253050 bus /gobi_0: Setting Powered False 02:17:13.368288 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:17:14.470024 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:14.481404 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:17:14.538045 tst ping.py: using LAC 37851 02:17:14.655132 tst ping.py: using RAC 111 02:17:14.773674 tst ping.py: using CellId 37851 02:17:14.890208 tst ping.py: using BVCI 37852 02:17:15.000003 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:15.010907 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:15.021925 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:15.032492 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:15.043064 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:15.053537 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:15.064582 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:15.075602 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:17:15.194676 tst ping.py:19: start network... 02:17:15.410880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:17:15.934871 run create_hlr_db(pid=28578): Launched 02:17:16.096461 bus /gobi_6: Setting Powered False 02:17:17.164631 run create_hlr_db(pid=28578): Terminated: ok {rc=0} 02:17:17.596318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28580): Launched 02:17:17.894363 run osmo-hlr_10.42.42.2(pid=28581): Launched 02:17:18.006847 run osmo-stp_10.42.42.5: Starting osmo-stp 02:17:18.519976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28583): Launched 02:17:18.819509 run osmo-stp_10.42.42.5(pid=28584): Launched 02:17:18.932661 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:17:19.446613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28586): Launched 02:17:19.559545 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:17:19.810325 run patchelf(pid=28587): Launched 02:17:19.975124 run osmo-stp_10.42.42.5(pid=28584): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28584)] 02:17:20.100774 run osmo-stp_10.42.42.5(pid=28584): stdout: | (launched: 2022-12-14_02:17:18.763175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:20.228154 run osmo-stp_10.42.42.5(pid=28584): stderr: | [0;m[38;5;43m20221214021718935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021718935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021718935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021718936 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021718936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021718936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021718936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:20.355416 run osmo-stp_10.42.42.5(pid=28584): stdout: | (launched: 2022-12-14_02:17:18.763175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:20.477544 run osmo-stp_10.42.42.5(pid=28584): stderr: | [0;m[38;5;43m20221214021718935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021718935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021718935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021718936 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021718936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021718936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021718936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:20.622063 run patchelf(pid=28587): Terminating (SIGINT) 02:17:20.790134 run patchelf(pid=28587): Terminated: ok {rc=0} 02:17:20.911302 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28584): Process ended prematurely: osmo-stp_10.42.42.5(pid=28584) [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28584)] [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 02:17:20.920132 tst ping.py:22: Test FAILED (6.4 sec) 02:17:20.946806 run osmo-hlr_10.42.42.2(pid=28581): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28581)] 02:17:20.994289 run osmo-hlr_10.42.42.2(pid=28581): stdout: | (launched: 2022-12-14_02:17:17.838989) 02:17:21.043625 run osmo-hlr_10.42.42.2(pid=28581): stderr: | [0;m[1;31m20221214021718014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021718014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021718014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021718014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021718014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021718014 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021718027 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021718036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021718036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021718036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:17:21.094036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28580): Terminating (SIGTERM) 02:17:21.134162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28583): Terminating (SIGTERM) 02:17:21.173819 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28586): Terminating (SIGTERM) 02:17:21.213716 --- ParallelTerminationStrategy: PID 28580 died... 02:17:21.232915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28580): Terminated: ok {rc=0} 02:17:21.276718 --- ParallelTerminationStrategy: PID 28583 died... 02:17:21.295819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28583): Terminated: ok {rc=0} 02:17:21.339451 --- ParallelTerminationStrategy: PID 28586 died... 02:17:21.358214 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28586): Terminated: ok {rc=0} 02:17:21.443741 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:17:22.531043 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:22.542637 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:17:22.599890 tst ping_idle_ping.py: using LAC 37852 02:17:22.729367 tst ping_idle_ping.py: using RAC 112 02:17:22.855350 tst ping_idle_ping.py: using CellId 37852 02:17:22.983071 tst ping_idle_ping.py: using BVCI 37853 02:17:23.102419 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:23.114039 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:23.125265 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:23.136457 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:23.148054 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:23.159477 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:23.171218 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:17:23.182764 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:17:23.298370 tst ping_idle_ping.py:24: start network... 02:17:23.499176 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:17:23.964659 run create_hlr_db(pid=28588): Launched 02:17:24.087195 bus /gobi_6: Setting Powered False 02:17:25.147431 run create_hlr_db(pid=28588): Terminated: ok {rc=0} 02:17:25.586379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28590): Launched 02:17:25.910258 run osmo-hlr_10.42.42.2(pid=28591): Launched 02:17:26.033418 run osmo-stp_10.42.42.5: Starting osmo-stp 02:17:26.589315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28593): Launched 02:17:26.911299 run osmo-stp_10.42.42.5(pid=28594): Launched 02:17:27.034167 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:17:27.587016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28596): Launched 02:17:27.710256 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:17:27.983269 run patchelf(pid=28597): Launched 02:17:28.162710 run osmo-stp_10.42.42.5(pid=28594): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28594)] 02:17:28.299124 run osmo-stp_10.42.42.5(pid=28594): stdout: | (launched: 2022-12-14_02:17:26.852183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:28.437141 run osmo-stp_10.42.42.5(pid=28594): stderr: | [0;m[38;5;43m20221214021727046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021727046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021727046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021727047 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021727047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021727047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021727047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:28.575445 run osmo-stp_10.42.42.5(pid=28594): stdout: | (launched: 2022-12-14_02:17:26.852183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:28.707798 run osmo-stp_10.42.42.5(pid=28594): stderr: | [0;m[38;5;43m20221214021727046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021727046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021727046 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021727047 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021727047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021727047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021727047 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:28.865534 run patchelf(pid=28597): Terminating (SIGINT) 02:17:29.047347 run patchelf(pid=28597): Terminated: ok {rc=0} 02:17:29.179251 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28594): Process ended prematurely: osmo-stp_10.42.42.5(pid=28594) [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28594)] [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:17:29.189053 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 02:17:29.217367 run osmo-hlr_10.42.42.2(pid=28591): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28591)] 02:17:29.268810 run osmo-hlr_10.42.42.2(pid=28591): stdout: | (launched: 2022-12-14_02:17:25.851312) 02:17:29.321396 run osmo-hlr_10.42.42.2(pid=28591): stderr: | [0;m[1;31m20221214021726050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021726050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021726050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021726050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021726050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021726050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021726064 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021726072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021726072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021726072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:17:29.374407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28590): Terminating (SIGTERM) 02:17:29.416522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28593): Terminating (SIGTERM) 02:17:29.458911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28596): Terminating (SIGTERM) 02:17:29.501572 --- ParallelTerminationStrategy: PID 28590 died... 02:17:29.522224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28590): Terminated: ok {rc=0} 02:17:29.568752 --- ParallelTerminationStrategy: PID 28593 died... 02:17:29.588852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28593): Terminated: ok {rc=0} 02:17:29.635234 --- ParallelTerminationStrategy: PID 28596 died... 02:17:29.655296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28596): Terminated: ok {rc=0} 02:17:29.742943 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:17:31.067244 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:17:31.073729 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:17:31.094771 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:17:31.130952 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:17:31.185706 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:17:31.222299 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:17:31.266113 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:17:31.794359 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2398 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:17:31.800132 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:31.811660 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:17:31.870120 tst switch_tch_pdch.py: using LAC 37853 02:17:31.989750 tst switch_tch_pdch.py: using RAC 113 02:17:32.109102 tst switch_tch_pdch.py: using CellId 37853 02:17:32.262802 tst switch_tch_pdch.py: using BVCI 37854 02:17:32.373842 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:32.384997 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:32.395869 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:32.406862 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:32.418119 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:32.429593 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:32.441027 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:17:32.452406 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:17:32.573694 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:17:32.695094 tst switch_tch_pdch.py:51: start network... 02:17:32.910846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:17:33.405643 run create_hlr_db(pid=28601): Launched 02:17:33.526948 bus /gobi_6: Setting Powered False 02:17:34.590233 run create_hlr_db(pid=28601): Terminated: ok {rc=0} 02:17:35.016904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28603): Launched 02:17:35.315480 run osmo-hlr_10.42.42.2(pid=28604): Launched 02:17:35.428257 run osmo-stp_10.42.42.5: Starting osmo-stp 02:17:35.955480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28606): Launched 02:17:36.251155 run osmo-stp_10.42.42.5(pid=28607): Launched 02:17:36.362888 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:17:36.872668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28609): Launched 02:17:36.985432 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:17:37.236805 run patchelf(pid=28610): Launched 02:17:37.401307 run osmo-stp_10.42.42.5(pid=28607): ERR: Terminated: ERROR {rc=1} [trial-2398↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28607)] 02:17:37.526286 run osmo-stp_10.42.42.5(pid=28607): stdout: | (launched: 2022-12-14_02:17:36.195943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:37.652631 run osmo-stp_10.42.42.5(pid=28607): stderr: | [0;m[38;5;43m20221214021736369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021736369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021736369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021736370 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021736370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021736370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021736370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:37.779049 run osmo-stp_10.42.42.5(pid=28607): stdout: | (launched: 2022-12-14_02:17:36.195943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:37.900310 run osmo-stp_10.42.42.5(pid=28607): stderr: | [0;m[38;5;43m20221214021736369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021736369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021736369 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021736370 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021736370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021736370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021736370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:38.043917 run patchelf(pid=28610): Terminating (SIGINT) 02:17:38.211791 run patchelf(pid=28610): Terminated: ok {rc=0} 02:17:38.332619 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28607): Process ended prematurely: osmo-stp_10.42.42.5(pid=28607) [trial-2398↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28607)] [trial-2398↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:17:38.341473 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 02:17:38.367961 run osmo-hlr_10.42.42.2(pid=28604): ERR: Terminated: ERROR {rc=237} [trial-2398↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28604)] 02:17:38.415607 run osmo-hlr_10.42.42.2(pid=28604): stdout: | (launched: 2022-12-14_02:17:35.260266) 02:17:38.464759 run osmo-hlr_10.42.42.2(pid=28604): stderr: | [0;m[1;31m20221214021735435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021735435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021735435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021735435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021735435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021735435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021735446 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021735454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021735454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021735454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:17:38.514329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28603): Terminating (SIGTERM) 02:17:38.553769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28606): Terminating (SIGTERM) 02:17:38.593315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28609): Terminating (SIGTERM) 02:17:38.633078 --- ParallelTerminationStrategy: PID 28603 died... 02:17:38.652056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28603): Terminated: ok {rc=0} 02:17:38.695518 --- ParallelTerminationStrategy: PID 28606 died... 02:17:38.714000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28606): Terminated: ok {rc=0} 02:17:38.757672 --- ParallelTerminationStrategy: PID 28609 died... 02:17:38.776154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28609): Terminated: ok {rc=0} 02:17:38.858595 bus /gobi_0: Setting Powered False 02:17:39.956239 bus /gobi_0: Setting Powered False 02:17:41.072435 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:17:42.309683 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:17:42.316064 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:17:42.337126 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:17:42.374799 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:17:42.426604 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:17:42.447003 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:17:42.481991 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:17:43.034796 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2398 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:17:43.039980 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:17:43.050690 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:17:43.107215 tst switch_tch_pdch.py: using LAC 37854 02:17:43.225028 tst switch_tch_pdch.py: using RAC 114 02:17:43.345913 tst switch_tch_pdch.py: using CellId 37854 02:17:43.462411 tst switch_tch_pdch.py: using BVCI 37855 02:17:43.571284 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:17:43.582125 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:17:43.592673 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:17:43.603191 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:17:43.613630 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:17:43.624396 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:17:43.635805 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:17:43.646541 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:17:43.765087 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:17:43.881993 tst switch_tch_pdch.py:51: start network... 02:17:44.080087 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:17:44.515299 run create_hlr_db(pid=28614): Launched 02:17:44.636283 bus /gobi_6: Setting Powered False 02:17:45.696633 run create_hlr_db(pid=28614): Terminated: ok {rc=0} 02:17:46.117662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28616): Launched 02:17:46.463499 run osmo-hlr_10.42.42.2(pid=28617): Launched 02:17:46.674240 run osmo-stp_10.42.42.5: Starting osmo-stp 02:17:47.324393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28619): Launched 02:17:47.645279 run osmo-stp_10.42.42.5(pid=28620): Launched 02:17:47.768076 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:17:48.293574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28622): Launched 02:17:48.417269 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:17:48.688369 run patchelf(pid=28623): Launched 02:17:48.866865 run osmo-stp_10.42.42.5(pid=28620): ERR: Terminated: ERROR {rc=1} [trial-2398↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28620)] 02:17:49.002638 run osmo-stp_10.42.42.5(pid=28620): stdout: | (launched: 2022-12-14_02:17:47.586368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:49.139792 run osmo-stp_10.42.42.5(pid=28620): stderr: | [0;m[38;5;43m20221214021747780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021747780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021747780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021747781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021747781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021747781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021747781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:49.277040 run osmo-stp_10.42.42.5(pid=28620): stdout: | (launched: 2022-12-14_02:17:47.586368) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:17:49.409380 run osmo-stp_10.42.42.5(pid=28620): stderr: | [0;m[38;5;43m20221214021747780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021747780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021747780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021747781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021747781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021747781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021747781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:17:49.565761 run patchelf(pid=28623): Terminating (SIGINT) 02:17:49.746550 run patchelf(pid=28623): Terminated: ok {rc=0} 02:17:49.877422 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28620): Process ended prematurely: osmo-stp_10.42.42.5(pid=28620) [trial-2398↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28620)] [trial-2398↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 02:17:49.887077 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 02:17:49.915116 run osmo-hlr_10.42.42.2(pid=28617): ERR: Terminated: ERROR {rc=237} [trial-2398↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28617)] 02:17:49.966683 run osmo-hlr_10.42.42.2(pid=28617): stdout: | (launched: 2022-12-14_02:17:46.398077) 02:17:50.019825 run osmo-hlr_10.42.42.2(pid=28617): stderr: | [0;m[1;31m20221214021746740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021746740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021746740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021746740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021746740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021746740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021746764 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021746789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021746789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021746789 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:17:50.072790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28616): Terminating (SIGTERM) 02:17:50.115185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28619): Terminating (SIGTERM) 02:17:50.157980 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28622): Terminating (SIGTERM) 02:17:50.200929 --- ParallelTerminationStrategy: PID 28616 died... 02:17:50.221762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28616): Terminated: ok {rc=0} 02:17:50.268884 --- ParallelTerminationStrategy: PID 28619 died... 02:17:50.289609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28619): Terminated: ok {rc=0} 02:17:50.336670 --- ParallelTerminationStrategy: PID 28622 died... 02:17:50.357119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28622): Terminated: ok {rc=0} 02:17:50.446403 bus /gobi_0: Setting Powered False 02:17:51.545362 bus /gobi_0: Setting Powered False 02:17:52.662216 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_sms:oc2g --------------------------------------------------------------------- 02:17:53.901107 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:17:53.905248 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 02:17:53.926005 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 02:17:53.932885 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 02:17:53.987214 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 02:17:54.008058 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 02:17:54.015064 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 02:17:54.550907 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 02:17:54.556223 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 02:17:54.567326 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 02:17:54.602385 tst mo_mt_sms.py: using LAC 37855 02:17:54.721057 tst mo_mt_sms.py: using RAC 115 02:17:54.837037 tst mo_mt_sms.py: using CellId 37855 02:17:54.953363 tst mo_mt_sms.py: using BVCI 37856 02:17:55.060819 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 02:17:55.180755 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 02:17:55.300620 tst mo_mt_sms.py:9: start nitb and bts... 02:17:55.516587 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:17:56.167532 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28628): Launched 02:17:56.490230 run osmo-nitb_10.42.42.2(pid=28629): Launched 02:17:56.668033 run osmo-nitb_10.42.42.2(pid=28629): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28629)] 02:17:56.812165 run osmo-nitb_10.42.42.2(pid=28629): stdout: | (launched: 2022-12-14_02:17:56.431190) 02:17:56.957396 run osmo-nitb_10.42.42.2(pid=28629): stderr: | (launched: 2022-12-14_02:17:56.478853) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:17:57.102423 run osmo-nitb_10.42.42.2(pid=28629): stdout: | (launched: 2022-12-14_02:17:56.431190) 02:17:57.241931 run osmo-nitb_10.42.42.2(pid=28629): stderr: | (launched: 2022-12-14_02:17:56.478853) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28629): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28629) [trial-2398↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28629)] 02:17:57.611732 tst osmo-nitb_10.42.42.2(pid=28629): stdout: | (launched: 2022-12-14_02:17:56.431190) 02:17:57.740809 tst osmo-nitb_10.42.42.2(pid=28629): stderr: | (launched: 2022-12-14_02:17:56.478853) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:17:57.893018 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28629): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28629) [trial-2398↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28629)] [trial-2398↪nitb_sms:oc2g↪mo_mt_sms.py:11] 02:17:57.901898 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 02:17:57.908734 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28628): Terminating (SIGTERM) 02:17:58.119696 --- ParallelTerminationStrategy: PID 28628 died... 02:17:58.141279 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28628): Terminated: ok {rc=0} 02:17:58.231126 bus /sierra_3: Setting Powered False 02:17:59.329634 bus /sierra_3: Setting Powered False 02:18:00.446583 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 sms:oc2g --------------------------------------------------------------------- 02:18:01.632668 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:18:01.639155 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 02:18:01.667163 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 02:18:01.699999 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 02:18:01.762934 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 02:18:01.784467 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 02:18:01.812691 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 02:18:02.351762 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 sms:oc2g mo_mt_sms.py ---------------------------------------------- 02:18:02.356755 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:18:02.367579 tst sms:oc2g: Using 1 x bts (candidates: 1) 02:18:02.400478 tst mo_mt_sms.py: using LAC 37856 02:18:02.525263 tst mo_mt_sms.py: using RAC 116 02:18:02.651255 tst mo_mt_sms.py: using CellId 37856 02:18:02.776216 tst mo_mt_sms.py: using BVCI 37857 02:18:02.892738 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:18:02.903571 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:18:02.914339 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:18:02.925026 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:18:02.936017 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 02:18:02.946980 tst sms:oc2g: Using 1 x modem (candidates: 2) 02:18:03.061695 tst sms:oc2g: Using 1 x modem (candidates: 2) 02:18:03.180771 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:18:03.677228 run create_hlr_db(pid=28633): Launched 02:18:03.798873 bus /sierra_2: Setting Powered False 02:18:04.862583 run create_hlr_db(pid=28633): Terminated: ok {rc=0} 02:18:05.290457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28635): Launched 02:18:05.588574 run osmo-hlr_10.42.42.2(pid=28636): Launched 02:18:05.701484 run osmo-stp_10.42.42.5: Starting osmo-stp 02:18:06.212468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28638): Launched 02:18:06.511519 run osmo-stp_10.42.42.5(pid=28639): Launched 02:18:06.625428 run osmo-msc_10.42.42.6: Starting osmo-msc 02:18:07.162953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28641): Launched 02:18:07.460879 run osmo-msc_10.42.42.6(pid=28642): Launched 02:18:07.628202 run osmo-stp_10.42.42.5(pid=28639): ERR: Terminated: ERROR {rc=1} [trial-2398↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28639)] 02:18:07.754509 run osmo-stp_10.42.42.5(pid=28639): stdout: | (launched: 2022-12-14_02:18:06.456002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:07.880077 run osmo-stp_10.42.42.5(pid=28639): stderr: | [0;m[38;5;43m20221214021806628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021806628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021806629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021806629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021806629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021806630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021806630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:08.003534 run osmo-stp_10.42.42.5(pid=28639): stdout: | (launched: 2022-12-14_02:18:06.456002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:08.121479 run osmo-stp_10.42.42.5(pid=28639): stderr: | [0;m[38;5;43m20221214021806628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021806628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021806629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021806629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021806629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021806630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021806630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:08.262709 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28639): Process ended prematurely: osmo-stp_10.42.42.5(pid=28639) [trial-2398↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28639)] [trial-2398↪sms:oc2g↪mo_mt_sms.py:16] 02:18:08.271207 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 02:18:08.297437 run osmo-hlr_10.42.42.2(pid=28636): ERR: Terminated: ERROR {rc=237} [trial-2398↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28636)] 02:18:08.345709 run osmo-hlr_10.42.42.2(pid=28636): stdout: | (launched: 2022-12-14_02:18:05.533186) 02:18:08.395445 run osmo-hlr_10.42.42.2(pid=28636): stderr: | [0;m[1;31m20221214021805709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021805709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021805709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021805709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021805709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021805709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021805721 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021805730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021805730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021805730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:18:08.464773 run osmo-msc_10.42.42.6(pid=28642): ERR: Terminated: ERROR {rc=2} [trial-2398↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28642)] 02:18:08.512613 run osmo-msc_10.42.42.6(pid=28642): stdout: | (launched: 2022-12-14_02:18:07.404728) 02:18:08.561970 run osmo-msc_10.42.42.6(pid=28642): stderr: | [0;m[38;5;43m20221214021807679 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021807679 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd01cfb4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021807679 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021807679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021807679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021807679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021807681 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021807682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021807682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021807682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:18:08.611589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28635): Terminating (SIGTERM) 02:18:08.651330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28638): Terminating (SIGTERM) 02:18:08.691285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28641): Terminating (SIGTERM) 02:18:08.731710 --- ParallelTerminationStrategy: PID 28635 died... 02:18:08.751131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28635): Terminated: ok {rc=0} 02:18:08.795368 --- ParallelTerminationStrategy: PID 28638 died... 02:18:08.814264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28638): Terminated: ok {rc=0} 02:18:08.858333 --- ParallelTerminationStrategy: PID 28641 died... 02:18:08.877118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28641): Terminated: ok {rc=0} 02:18:08.960928 bus /sierra_3: Setting Powered False 02:18:10.059379 bus /sierra_3: Setting Powered False 02:18:11.178488 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_ussd:oc2g --------------------------------------------------------------------- 02:18:12.397024 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:18:12.400905 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 02:18:12.422421 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 02:18:12.429328 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 02:18:12.463734 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 02:18:12.484837 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 02:18:12.491748 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 02:18:13.012836 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2398 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 02:18:13.018361 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 02:18:13.029289 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 02:18:13.062790 tst assert_extension.py: using LAC 37857 02:18:13.186615 tst assert_extension.py: using RAC 117 02:18:13.317715 tst assert_extension.py: using CellId 37857 02:18:13.443785 tst assert_extension.py: using BVCI 37858 02:18:13.560501 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 02:18:13.674680 tst assert_extension.py:10: start nitb and bts... 02:18:13.874424 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:18:14.480777 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28648): Launched 02:18:14.778482 run osmo-nitb_10.42.42.2(pid=28649): Launched 02:18:14.942715 run osmo-nitb_10.42.42.2(pid=28649): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28649)] 02:18:15.075876 run osmo-nitb_10.42.42.2(pid=28649): stdout: | (launched: 2022-12-14_02:18:14.722893) 02:18:15.210787 run osmo-nitb_10.42.42.2(pid=28649): stderr: | (launched: 2022-12-14_02:18:14.767128) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:18:15.345272 run osmo-nitb_10.42.42.2(pid=28649): stdout: | (launched: 2022-12-14_02:18:14.722893) 02:18:15.475401 run osmo-nitb_10.42.42.2(pid=28649): stderr: | (launched: 2022-12-14_02:18:14.767128) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28649): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28649) [trial-2398↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28649)] 02:18:15.890117 tst osmo-nitb_10.42.42.2(pid=28649): stdout: | (launched: 2022-12-14_02:18:14.722893) 02:18:16.011413 tst osmo-nitb_10.42.42.2(pid=28649): stderr: | (launched: 2022-12-14_02:18:14.767128) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:18:16.155058 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28649): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28649) [trial-2398↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28649)] [trial-2398↪nitb_ussd:oc2g↪assert_extension.py:12] 02:18:16.163886 tst assert_extension.py:12: Test FAILED (3.1 sec) 02:18:16.171009 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28648): Terminating (SIGTERM) 02:18:16.381308 --- ParallelTerminationStrategy: PID 28648 died... 02:18:16.401385 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28648): Terminated: ok {rc=0} 02:18:16.489951 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 ussd:oc2g --------------------------------------------------------------------- 02:18:17.647508 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:18:17.651358 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 02:18:17.671397 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 02:18:17.697651 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 02:18:17.732088 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 02:18:17.752181 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 02:18:17.778668 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 02:18:18.305597 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2398 ussd:oc2g assert_extension.py ---------------------------------------------- 02:18:18.310589 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:18:18.321107 tst ussd:oc2g: Using 1 x bts (candidates: 1) 02:18:18.354427 tst assert_extension.py: using LAC 37858 02:18:18.482732 tst assert_extension.py: using RAC 118 02:18:18.608522 tst assert_extension.py: using CellId 37858 02:18:18.733375 tst assert_extension.py: using BVCI 37859 02:18:18.850321 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:18:18.861307 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:18:18.872177 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:18:18.882847 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:18:18.894133 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 02:18:18.905188 tst ussd:oc2g: Using 1 x modem (candidates: 1) 02:18:19.020160 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:18:19.517664 run create_hlr_db(pid=28653): Launched 02:18:19.639193 bus /sierra_2: Setting Powered False 02:18:20.702143 run create_hlr_db(pid=28653): Terminated: ok {rc=0} 02:18:21.129161 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28655): Launched 02:18:21.425457 run osmo-hlr_10.42.42.2(pid=28656): Launched 02:18:21.538786 run osmo-stp_10.42.42.5: Starting osmo-stp 02:18:22.055836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28658): Launched 02:18:22.352677 run osmo-stp_10.42.42.5(pid=28659): Launched 02:18:22.466025 run osmo-msc_10.42.42.6: Starting osmo-msc 02:18:23.001520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28661): Launched 02:18:23.297971 run osmo-msc_10.42.42.6(pid=28662): Launched 02:18:23.463342 run osmo-stp_10.42.42.5(pid=28659): ERR: Terminated: ERROR {rc=1} [trial-2398↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28659)] 02:18:23.590059 run osmo-stp_10.42.42.5(pid=28659): stdout: | (launched: 2022-12-14_02:18:22.297305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:23.715148 run osmo-stp_10.42.42.5(pid=28659): stderr: | [0;m[38;5;43m20221214021822468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021822468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021822468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021822469 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021822469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021822469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021822469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:23.838566 run osmo-stp_10.42.42.5(pid=28659): stdout: | (launched: 2022-12-14_02:18:22.297305) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:23.956391 run osmo-stp_10.42.42.5(pid=28659): stderr: | [0;m[38;5;43m20221214021822468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021822468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021822468 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021822469 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021822469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021822469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021822469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:24.096842 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28659): Process ended prematurely: osmo-stp_10.42.42.5(pid=28659) [trial-2398↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28659)] [trial-2398↪ussd:oc2g↪assert_extension.py:17] 02:18:24.105100 tst assert_extension.py:17: Test FAILED (5.8 sec) 02:18:24.130943 run osmo-hlr_10.42.42.2(pid=28656): ERR: Terminated: ERROR {rc=237} [trial-2398↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28656)] 02:18:24.178211 run osmo-hlr_10.42.42.2(pid=28656): stdout: | (launched: 2022-12-14_02:18:21.370121) 02:18:24.226953 run osmo-hlr_10.42.42.2(pid=28656): stderr: | [0;m[1;31m20221214021821543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021821543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021821543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021821543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021821543 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021821544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021821555 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021821564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021821564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021821564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:18:24.295017 run osmo-msc_10.42.42.6(pid=28662): ERR: Terminated: ERROR {rc=2} [trial-2398↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28662)] 02:18:24.342189 run osmo-msc_10.42.42.6(pid=28662): stdout: | (launched: 2022-12-14_02:18:23.242572) 02:18:24.391013 run osmo-msc_10.42.42.6(pid=28662): stderr: | [0;m[38;5;43m20221214021823516 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021823516 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f402d8bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021823516 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021823516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021823516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021823516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021823518 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021823519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021823519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021823519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:18:24.440325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28655): Terminating (SIGTERM) 02:18:24.479596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28658): Terminating (SIGTERM) 02:18:24.519305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28661): Terminating (SIGTERM) 02:18:24.558895 --- ParallelTerminationStrategy: PID 28655 died... 02:18:24.577683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28655): Terminated: ok {rc=0} 02:18:24.620912 --- ParallelTerminationStrategy: PID 28658 died... 02:18:24.639359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28658): Terminated: ok {rc=0} 02:18:24.682595 --- ParallelTerminationStrategy: PID 28661 died... 02:18:24.700694 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28661): Terminated: ok {rc=0} 02:18:24.785521 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:18:25.984349 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:18:25.991242 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:18:26.012102 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:18:26.040425 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:18:26.095858 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:18:26.116712 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:18:26.142797 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:18:26.689344 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:18:26.738139 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:26.748860 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:18:26.803628 tst mo_mt_call.py: using LAC 37859 02:18:26.923775 tst mo_mt_call.py: using RAC 119 02:18:27.043584 tst mo_mt_call.py: using CellId 37859 02:18:27.161359 tst mo_mt_call.py: using BVCI 37860 02:18:27.270191 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:27.281112 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:27.291696 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:27.302372 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:27.313271 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:27.323861 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:18:27.441889 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:18:27.560009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:18:28.028899 run create_hlr_db(pid=28667): Launched 02:18:28.151892 bus /sierra_2: Setting Powered False 02:18:29.213167 run create_hlr_db(pid=28667): Terminated: ok {rc=0} 02:18:29.655839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28669): Launched 02:18:29.982913 run osmo-hlr_10.42.42.2(pid=28670): Launched 02:18:30.107972 run osmo-stp_10.42.42.5: Starting osmo-stp 02:18:30.670801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28672): Launched 02:18:31.011422 run osmo-stp_10.42.42.5(pid=28673): Launched 02:18:31.211704 run osmo-msc_10.42.42.6: Starting osmo-msc 02:18:31.949696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28675): Launched 02:18:32.291561 run osmo-msc_10.42.42.6(pid=28676): Launched 02:18:32.533628 run osmo-stp_10.42.42.5(pid=28673): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28673)] 02:18:32.665409 run osmo-stp_10.42.42.5(pid=28673): stdout: | (launched: 2022-12-14_02:18:30.952528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:32.795805 run osmo-stp_10.42.42.5(pid=28673): stderr: | [0;m[38;5;43m20221214021831304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021831305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021831305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021831305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021831306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021831306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021831306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:32.923118 run osmo-stp_10.42.42.5(pid=28673): stdout: | (launched: 2022-12-14_02:18:30.952528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:33.044005 run osmo-stp_10.42.42.5(pid=28673): stderr: | [0;m[38;5;43m20221214021831304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021831305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021831305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021831305 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021831306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021831306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021831306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:33.188744 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28673): Process ended prematurely: osmo-stp_10.42.42.5(pid=28673) [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28673)] [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:18:33.197553 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 02:18:33.223810 run osmo-hlr_10.42.42.2(pid=28670): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28670)] 02:18:33.271587 run osmo-hlr_10.42.42.2(pid=28670): stdout: | (launched: 2022-12-14_02:18:29.923029) 02:18:33.321413 run osmo-hlr_10.42.42.2(pid=28670): stderr: | [0;m[1;31m20221214021830121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021830121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021830122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021830122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021830122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021830122 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021830134 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021830144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021830145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021830145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:18:33.390278 run osmo-msc_10.42.42.6(pid=28676): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28676)] 02:18:33.437998 run osmo-msc_10.42.42.6(pid=28676): stdout: | (launched: 2022-12-14_02:18:32.225954) 02:18:33.487213 run osmo-msc_10.42.42.6(pid=28676): stderr: | [0;m[38;5;43m20221214021832600 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021832600 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa709031c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021832600 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021832600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021832600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021832601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021832602 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021832603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021832603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021832603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:18:33.537260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28669): Terminating (SIGTERM) 02:18:33.576824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28672): Terminating (SIGTERM) 02:18:33.616487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28675): Terminating (SIGTERM) 02:18:33.657067 --- ParallelTerminationStrategy: PID 28669 died... 02:18:33.676194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28669): Terminated: ok {rc=0} 02:18:33.719980 --- ParallelTerminationStrategy: PID 28672 died... 02:18:33.738551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28672): Terminated: ok {rc=0} 02:18:33.782667 --- ParallelTerminationStrategy: PID 28675 died... 02:18:33.801426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28675): Terminated: ok {rc=0} 02:18:33.887026 bus /sierra_3: Setting Powered False 02:18:34.986131 bus /sierra_3: Setting Powered False 02:18:36.101973 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:18:37.253760 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:37.265814 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:18:37.323249 tst mo_mt_call_osmux.py: using LAC 37860 02:18:37.453153 tst mo_mt_call_osmux.py: using RAC 120 02:18:37.584239 tst mo_mt_call_osmux.py: using CellId 37860 02:18:37.704075 tst mo_mt_call_osmux.py: using BVCI 37861 02:18:37.815071 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:37.826056 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:37.836786 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:37.847447 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:37.858143 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:18:37.868812 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:18:37.988608 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:18:38.106938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:18:38.612714 run create_hlr_db(pid=28678): Launched 02:18:38.737762 bus /sierra_2: Setting Powered False 02:18:39.801845 run create_hlr_db(pid=28678): Terminated: ok {rc=0} 02:18:40.235807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28680): Launched 02:18:40.539112 run osmo-hlr_10.42.42.2(pid=28681): Launched 02:18:40.655246 run osmo-stp_10.42.42.5: Starting osmo-stp 02:18:41.174481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28683): Launched 02:18:41.476827 run osmo-stp_10.42.42.5(pid=28684): Launched 02:18:41.593321 run osmo-msc_10.42.42.6: Starting osmo-msc 02:18:42.140456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28686): Launched 02:18:42.442523 run osmo-msc_10.42.42.6(pid=28687): Launched 02:18:42.611642 run osmo-stp_10.42.42.5(pid=28684): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28684)] 02:18:42.739612 run osmo-stp_10.42.42.5(pid=28684): stdout: | (launched: 2022-12-14_02:18:41.420787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:42.866897 run osmo-stp_10.42.42.5(pid=28684): stderr: | [0;m[38;5;43m20221214021841590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021841591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021841591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021841591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021841594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021841594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021841594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:42.992337 run osmo-stp_10.42.42.5(pid=28684): stdout: | (launched: 2022-12-14_02:18:41.420787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:43.112267 run osmo-stp_10.42.42.5(pid=28684): stderr: | [0;m[38;5;43m20221214021841590 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021841591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021841591 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021841591 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021841594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021841594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021841594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:43.256244 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28684): Process ended prematurely: osmo-stp_10.42.42.5(pid=28684) [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28684)] [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:18:43.265004 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:18:43.291288 run osmo-hlr_10.42.42.2(pid=28681): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28681)] 02:18:43.339217 run osmo-hlr_10.42.42.2(pid=28681): stdout: | (launched: 2022-12-14_02:18:40.483107) 02:18:43.389051 run osmo-hlr_10.42.42.2(pid=28681): stderr: | [0;m[1;31m20221214021840661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021840661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021840661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021840661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021840661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021840661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021840682 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021840691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021840691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021840691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:18:43.457674 run osmo-msc_10.42.42.6(pid=28687): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28687)] 02:18:43.505034 run osmo-msc_10.42.42.6(pid=28687): stdout: | (launched: 2022-12-14_02:18:42.386413) 02:18:43.554137 run osmo-msc_10.42.42.6(pid=28687): stderr: | [0;m[38;5;43m20221214021842659 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021842659 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f34dc47bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021842659 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021842659 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021842660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021842660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021842662 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021842662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021842663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021842663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:18:43.603723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28680): Terminating (SIGTERM) 02:18:43.643175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28683): Terminating (SIGTERM) 02:18:43.683592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28686): Terminating (SIGTERM) 02:18:43.724483 --- ParallelTerminationStrategy: PID 28680 died... 02:18:43.743872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28680): Terminated: ok {rc=0} 02:18:43.788015 --- ParallelTerminationStrategy: PID 28683 died... 02:18:43.806928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28683): Terminated: ok {rc=0} 02:18:43.851118 --- ParallelTerminationStrategy: PID 28686 died... 02:18:43.869930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28686): Terminated: ok {rc=0} 02:18:43.953430 bus /sierra_3: Setting Powered False 02:18:45.052315 bus /sierra_3: Setting Powered False 02:18:46.172241 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:18:47.416928 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:18:47.423302 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:18:47.443247 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:18:47.469381 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:18:47.522976 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:18:47.544285 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:18:47.571666 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:18:48.116482 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:18:48.164897 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:48.175859 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:18:48.230489 tst mo_mt_call.py: using LAC 37861 02:18:48.351846 tst mo_mt_call.py: using RAC 121 02:18:48.472616 tst mo_mt_call.py: using CellId 37861 02:18:48.593617 tst mo_mt_call.py: using BVCI 37862 02:18:48.704938 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:48.715885 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:48.726612 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:48.737268 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:48.747890 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:48.759031 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:18:48.878333 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:18:48.994748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:18:49.465364 run create_hlr_db(pid=28692): Launched 02:18:49.589133 bus /sierra_2: Setting Powered False 02:18:50.649445 run create_hlr_db(pid=28692): Terminated: ok {rc=0} 02:18:51.095292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28694): Launched 02:18:51.422268 run osmo-hlr_10.42.42.2(pid=28695): Launched 02:18:51.546964 run osmo-stp_10.42.42.5: Starting osmo-stp 02:18:52.109094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28697): Launched 02:18:52.435182 run osmo-stp_10.42.42.5(pid=28698): Launched 02:18:52.560070 run osmo-msc_10.42.42.6: Starting osmo-msc 02:18:53.149920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28700): Launched 02:18:53.478001 run osmo-msc_10.42.42.6(pid=28701): Launched 02:18:53.659832 run osmo-stp_10.42.42.5(pid=28698): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28698)] 02:18:53.798179 run osmo-stp_10.42.42.5(pid=28698): stdout: | (launched: 2022-12-14_02:18:52.375496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:53.936648 run osmo-stp_10.42.42.5(pid=28698): stderr: | [0;m[38;5;43m20221214021852568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021852568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021852568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021852568 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021852569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021852569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021852569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:54.073965 run osmo-stp_10.42.42.5(pid=28698): stdout: | (launched: 2022-12-14_02:18:52.375496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:18:54.204814 run osmo-stp_10.42.42.5(pid=28698): stderr: | [0;m[38;5;43m20221214021852568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021852568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021852568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021852568 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021852569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021852569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021852569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:18:54.361640 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28698): Process ended prematurely: osmo-stp_10.42.42.5(pid=28698) [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28698)] [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:18:54.371297 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:18:54.399352 run osmo-hlr_10.42.42.2(pid=28695): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28695)] 02:18:54.450832 run osmo-hlr_10.42.42.2(pid=28695): stdout: | (launched: 2022-12-14_02:18:51.362186) 02:18:54.503140 run osmo-hlr_10.42.42.2(pid=28695): stderr: | [0;m[1;31m20221214021851559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021851560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021851560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021851560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021851560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021851560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021851572 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021851580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021851581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021851581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:18:54.576051 run osmo-msc_10.42.42.6(pid=28701): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28701)] 02:18:54.626616 run osmo-msc_10.42.42.6(pid=28701): stdout: | (launched: 2022-12-14_02:18:53.417802) 02:18:54.678911 run osmo-msc_10.42.42.6(pid=28701): stderr: | [0;m[38;5;43m20221214021853741 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021853742 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffab92b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021853742 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021853742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021853742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021853742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021853744 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021853744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021853744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021853744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:18:54.731679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28694): Terminating (SIGTERM) 02:18:54.773509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28697): Terminating (SIGTERM) 02:18:54.815751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28700): Terminating (SIGTERM) 02:18:54.858495 --- ParallelTerminationStrategy: PID 28694 died... 02:18:54.879288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28694): Terminated: ok {rc=0} 02:18:54.925890 --- ParallelTerminationStrategy: PID 28697 died... 02:18:54.945991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28697): Terminated: ok {rc=0} 02:18:54.992285 --- ParallelTerminationStrategy: PID 28700 died... 02:18:55.012183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28700): Terminated: ok {rc=0} 02:18:55.100740 bus /sierra_3: Setting Powered False 02:18:56.199244 bus /sierra_3: Setting Powered False 02:18:57.314697 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:18:58.465055 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:58.476933 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:18:58.534306 tst mo_mt_call_osmux.py: using LAC 37862 02:18:58.663754 tst mo_mt_call_osmux.py: using RAC 122 02:18:58.792772 tst mo_mt_call_osmux.py: using CellId 37862 02:18:58.922905 tst mo_mt_call_osmux.py: using BVCI 37863 02:18:59.043010 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:59.054389 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:59.065590 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:59.076601 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:59.088164 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:18:59.099683 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:18:59.216065 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:18:59.339823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:18:59.847234 run create_hlr_db(pid=28703): Launched 02:18:59.971761 bus /sierra_2: Setting Powered False 02:19:01.032142 run create_hlr_db(pid=28703): Terminated: ok {rc=0} 02:19:01.488506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28705): Launched 02:19:01.816170 run osmo-hlr_10.42.42.2(pid=28706): Launched 02:19:02.064538 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:02.716179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28708): Launched 02:19:03.042675 run osmo-stp_10.42.42.5(pid=28709): Launched 02:19:03.167388 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:03.757208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28711): Launched 02:19:04.084391 run osmo-msc_10.42.42.6(pid=28712): Launched 02:19:04.267146 run osmo-stp_10.42.42.5(pid=28709): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28709)] 02:19:04.404910 run osmo-stp_10.42.42.5(pid=28709): stdout: | (launched: 2022-12-14_02:19:02.982642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:04.543753 run osmo-stp_10.42.42.5(pid=28709): stderr: | [0;m[38;5;43m20221214021903174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021903174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021903175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021903175 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021903176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021903176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021903176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:04.681510 run osmo-stp_10.42.42.5(pid=28709): stdout: | (launched: 2022-12-14_02:19:02.982642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:04.811514 run osmo-stp_10.42.42.5(pid=28709): stderr: | [0;m[38;5;43m20221214021903174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021903174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021903175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021903175 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021903176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021903176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021903176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:04.967657 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28709): Process ended prematurely: osmo-stp_10.42.42.5(pid=28709) [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28709)] [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:19:04.977133 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 02:19:05.004765 run osmo-hlr_10.42.42.2(pid=28706): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28706)] 02:19:05.055821 run osmo-hlr_10.42.42.2(pid=28706): stdout: | (launched: 2022-12-14_02:19:01.749184) 02:19:05.108013 run osmo-hlr_10.42.42.2(pid=28706): stderr: | [0;m[1;31m20221214021901990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021901990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021901990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021901990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021901990 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021901991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021902006 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021902018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021902018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021902018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:05.180581 run osmo-msc_10.42.42.6(pid=28712): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28712)] 02:19:05.230671 run osmo-msc_10.42.42.6(pid=28712): stdout: | (launched: 2022-12-14_02:19:04.024445) 02:19:05.282729 run osmo-msc_10.42.42.6(pid=28712): stderr: | [0;m[38;5;43m20221214021904347 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021904347 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbfd71fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021904347 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021904347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021904347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021904347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021904349 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021904349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021904350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021904350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:05.335096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28705): Terminating (SIGTERM) 02:19:05.376855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28708): Terminating (SIGTERM) 02:19:05.419082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28711): Terminating (SIGTERM) 02:19:05.461433 --- ParallelTerminationStrategy: PID 28705 died... 02:19:05.481881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28705): Terminated: ok {rc=0} 02:19:05.528362 --- ParallelTerminationStrategy: PID 28708 died... 02:19:05.548194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28708): Terminated: ok {rc=0} 02:19:05.594384 --- ParallelTerminationStrategy: PID 28711 died... 02:19:05.614075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28711): Terminated: ok {rc=0} 02:19:05.702369 bus /sierra_3: Setting Powered False 02:19:06.801659 bus /sierra_3: Setting Powered False 02:19:07.917211 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:19:09.156418 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:19:09.163289 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:19:09.183955 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:19:09.211177 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:19:09.263112 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:19:09.284013 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:19:09.311140 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:19:09.862044 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:19:09.914678 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:09.925965 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:19:09.984842 tst mo_mt_call.py: using LAC 37863 02:19:10.113770 tst mo_mt_call.py: using RAC 123 02:19:10.241213 tst mo_mt_call.py: using CellId 37863 02:19:10.368724 tst mo_mt_call.py: using BVCI 37864 02:19:10.487565 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:10.498954 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:10.510139 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:10.521285 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:10.532736 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:10.544218 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:19:10.661245 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:19:10.781953 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:19:11.289365 run create_hlr_db(pid=28717): Launched 02:19:11.413822 bus /sierra_2: Setting Powered False 02:19:12.478841 run create_hlr_db(pid=28717): Terminated: ok {rc=0} 02:19:12.912437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28719): Launched 02:19:13.215894 run osmo-hlr_10.42.42.2(pid=28720): Launched 02:19:13.331906 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:13.892887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28722): Launched 02:19:14.218651 run osmo-stp_10.42.42.5(pid=28723): Launched 02:19:14.343697 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:14.933849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28725): Launched 02:19:15.260108 run osmo-msc_10.42.42.6(pid=28726): Launched 02:19:15.442862 run osmo-stp_10.42.42.5(pid=28723): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28723)] 02:19:15.580593 run osmo-stp_10.42.42.5(pid=28723): stdout: | (launched: 2022-12-14_02:19:14.159060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:15.718706 run osmo-stp_10.42.42.5(pid=28723): stderr: | [0;m[38;5;43m20221214021914351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021914351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021914352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021914352 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021914353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021914353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021914353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:15.865153 run osmo-stp_10.42.42.5(pid=28723): stdout: | (launched: 2022-12-14_02:19:14.159060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:16.008243 run osmo-stp_10.42.42.5(pid=28723): stderr: | [0;m[38;5;43m20221214021914351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021914351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021914352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021914352 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021914353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021914353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021914353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:16.168556 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28723): Process ended prematurely: osmo-stp_10.42.42.5(pid=28723) [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28723)] [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:19:16.179164 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:19:16.208265 run osmo-hlr_10.42.42.2(pid=28720): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28720)] 02:19:16.263004 run osmo-hlr_10.42.42.2(pid=28720): stdout: | (launched: 2022-12-14_02:19:13.159735) 02:19:16.317463 run osmo-hlr_10.42.42.2(pid=28720): stderr: | [0;m[1;31m20221214021913337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021913337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021913337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021913337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021913337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021913337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021913350 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021913358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021913358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021913358 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:16.392453 run osmo-msc_10.42.42.6(pid=28726): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28726)] 02:19:16.445276 run osmo-msc_10.42.42.6(pid=28726): stdout: | (launched: 2022-12-14_02:19:15.199785) 02:19:16.499456 run osmo-msc_10.42.42.6(pid=28726): stderr: | [0;m[38;5;43m20221214021915523 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021915523 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2c2c548c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021915524 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021915524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021915524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021915524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021915526 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021915526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021915526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021915526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:16.554507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28719): Terminating (SIGTERM) 02:19:16.598056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28722): Terminating (SIGTERM) 02:19:16.643974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28725): Terminating (SIGTERM) 02:19:16.689603 --- ParallelTerminationStrategy: PID 28719 died... 02:19:16.710830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28719): Terminated: ok {rc=0} 02:19:16.760627 --- ParallelTerminationStrategy: PID 28722 died... 02:19:16.781336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28722): Terminated: ok {rc=0} 02:19:16.831207 --- ParallelTerminationStrategy: PID 28725 died... 02:19:16.851782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28725): Terminated: ok {rc=0} 02:19:16.947502 bus /sierra_3: Setting Powered False 02:19:18.049350 bus /sierra_3: Setting Powered False 02:19:19.165711 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:19:20.310138 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:20.321797 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:19:20.377327 tst mo_mt_call_osmux.py: using LAC 37864 02:19:20.497643 tst mo_mt_call_osmux.py: using RAC 124 02:19:20.619803 tst mo_mt_call_osmux.py: using CellId 37864 02:19:20.740825 tst mo_mt_call_osmux.py: using BVCI 37865 02:19:20.852525 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:20.863559 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:20.874402 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:20.885305 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:20.896020 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:19:20.906990 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:19:21.025535 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:19:21.141517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:19:21.611481 run create_hlr_db(pid=28728): Launched 02:19:21.735387 bus /sierra_2: Setting Powered False 02:19:22.795488 run create_hlr_db(pid=28728): Terminated: ok {rc=0} 02:19:23.217435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28730): Launched 02:19:23.520741 run osmo-hlr_10.42.42.2(pid=28731): Launched 02:19:23.635327 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:24.156148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28733): Launched 02:19:24.459064 run osmo-stp_10.42.42.5(pid=28734): Launched 02:19:24.573845 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:25.119351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28736): Launched 02:19:25.422251 run osmo-msc_10.42.42.6(pid=28737): Launched 02:19:25.590473 run osmo-stp_10.42.42.5(pid=28734): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28734)] 02:19:25.718392 run osmo-stp_10.42.42.5(pid=28734): stdout: | (launched: 2022-12-14_02:19:24.402725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:25.846459 run osmo-stp_10.42.42.5(pid=28734): stderr: | [0;m[38;5;43m20221214021924574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021924574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021924574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021924575 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021924575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021924575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021924575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:25.972047 run osmo-stp_10.42.42.5(pid=28734): stdout: | (launched: 2022-12-14_02:19:24.402725) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:26.093412 run osmo-stp_10.42.42.5(pid=28734): stderr: | [0;m[38;5;43m20221214021924574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021924574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021924574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021924575 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021924575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021924575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021924575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:26.237607 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28734): Process ended prematurely: osmo-stp_10.42.42.5(pid=28734) [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28734)] [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:19:26.246319 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:19:26.273027 run osmo-hlr_10.42.42.2(pid=28731): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28731)] 02:19:26.320773 run osmo-hlr_10.42.42.2(pid=28731): stdout: | (launched: 2022-12-14_02:19:23.464425) 02:19:26.370336 run osmo-hlr_10.42.42.2(pid=28731): stderr: | [0;m[1;31m20221214021923644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021923644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021923644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021923644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021923644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021923644 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021923656 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021923666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021923666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021923666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:26.439287 run osmo-msc_10.42.42.6(pid=28737): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28737)] 02:19:26.486765 run osmo-msc_10.42.42.6(pid=28737): stdout: | (launched: 2022-12-14_02:19:25.366257) 02:19:26.535785 run osmo-msc_10.42.42.6(pid=28737): stderr: | [0;m[38;5;43m20221214021925639 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021925640 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5d114dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021925640 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021925640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021925640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021925640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021925642 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021925642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021925642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021925643 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:26.585487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28730): Terminating (SIGTERM) 02:19:26.624878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28733): Terminating (SIGTERM) 02:19:26.665154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28736): Terminating (SIGTERM) 02:19:26.705543 --- ParallelTerminationStrategy: PID 28730 died... 02:19:26.724659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28730): Terminated: ok {rc=0} 02:19:26.768579 --- ParallelTerminationStrategy: PID 28733 died... 02:19:26.787154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28733): Terminated: ok {rc=0} 02:19:26.830964 --- ParallelTerminationStrategy: PID 28736 died... 02:19:26.849714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28736): Terminated: ok {rc=0} 02:19:26.935220 bus /sierra_3: Setting Powered False 02:19:28.033159 bus /sierra_3: Setting Powered False 02:19:29.145035 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:19:30.372558 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:19:30.379442 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:19:30.399556 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:19:30.425584 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:19:30.477263 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:19:30.497592 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:19:30.523489 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:19:31.077952 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:19:31.133926 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:31.147025 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:19:31.206480 tst mo_mt_call.py: using LAC 37865 02:19:31.346204 tst mo_mt_call.py: using RAC 125 02:19:31.512702 tst mo_mt_call.py: using CellId 37865 02:19:31.687949 tst mo_mt_call.py: using BVCI 37866 02:19:31.822809 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:31.834370 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:31.845643 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:31.856622 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:31.868125 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:31.879766 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:19:32.002642 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:19:32.127478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:19:32.635020 run create_hlr_db(pid=28742): Launched 02:19:32.760111 bus /sierra_2: Setting Powered False 02:19:33.823911 run create_hlr_db(pid=28742): Terminated: ok {rc=0} 02:19:34.259093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28744): Launched 02:19:34.562751 run osmo-hlr_10.42.42.2(pid=28745): Launched 02:19:34.678571 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:35.199087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28747): Launched 02:19:35.502107 run osmo-stp_10.42.42.5(pid=28748): Launched 02:19:35.617247 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:36.163837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28750): Launched 02:19:36.467340 run osmo-msc_10.42.42.6(pid=28751): Launched 02:19:36.636136 run osmo-stp_10.42.42.5(pid=28748): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28748)] 02:19:36.763935 run osmo-stp_10.42.42.5(pid=28748): stdout: | (launched: 2022-12-14_02:19:35.445779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:36.891735 run osmo-stp_10.42.42.5(pid=28748): stderr: | [0;m[38;5;43m20221214021935616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021935616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021935616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021935617 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021935619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021935619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021935619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:37.017553 run osmo-stp_10.42.42.5(pid=28748): stdout: | (launched: 2022-12-14_02:19:35.445779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:37.138031 run osmo-stp_10.42.42.5(pid=28748): stderr: | [0;m[38;5;43m20221214021935616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021935616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021935616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021935617 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021935619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021935619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021935619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:37.282146 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28748): Process ended prematurely: osmo-stp_10.42.42.5(pid=28748) [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28748)] [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:19:37.291110 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:19:37.317431 run osmo-hlr_10.42.42.2(pid=28745): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28745)] 02:19:37.365615 run osmo-hlr_10.42.42.2(pid=28745): stdout: | (launched: 2022-12-14_02:19:34.506419) 02:19:37.415567 run osmo-hlr_10.42.42.2(pid=28745): stderr: | [0;m[1;31m20221214021934684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021934684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021934684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021934684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021934684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021934684 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021934716 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021934725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021934725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021934725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:37.484633 run osmo-msc_10.42.42.6(pid=28751): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28751)] 02:19:37.532610 run osmo-msc_10.42.42.6(pid=28751): stdout: | (launched: 2022-12-14_02:19:36.411143) 02:19:37.582063 run osmo-msc_10.42.42.6(pid=28751): stderr: | [0;m[38;5;43m20221214021936683 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021936683 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe1a5216c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021936684 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021936684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021936684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021936684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021936686 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021936686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021936686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021936686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:37.632132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28744): Terminating (SIGTERM) 02:19:37.671954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28747): Terminating (SIGTERM) 02:19:37.711554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28750): Terminating (SIGTERM) 02:19:37.751501 --- ParallelTerminationStrategy: PID 28744 died... 02:19:37.770826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28744): Terminated: ok {rc=0} 02:19:37.815023 --- ParallelTerminationStrategy: PID 28747 died... 02:19:37.833802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28747): Terminated: ok {rc=0} 02:19:37.877739 --- ParallelTerminationStrategy: PID 28750 died... 02:19:37.896376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28750): Terminated: ok {rc=0} 02:19:37.980153 bus /sierra_3: Setting Powered False 02:19:39.078133 bus /sierra_3: Setting Powered False 02:19:40.197131 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:19:41.343272 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:41.354927 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:19:41.410062 tst mo_mt_call_osmux.py: using LAC 37866 02:19:41.531062 tst mo_mt_call_osmux.py: using RAC 126 02:19:41.651791 tst mo_mt_call_osmux.py: using CellId 37866 02:19:41.772141 tst mo_mt_call_osmux.py: using BVCI 37867 02:19:41.883624 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:41.894577 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:41.905272 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:41.915906 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:41.926585 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:19:41.937411 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:19:42.057534 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:19:42.173612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:19:42.644238 run create_hlr_db(pid=28753): Launched 02:19:42.767679 bus /sierra_2: Setting Powered False 02:19:43.828119 run create_hlr_db(pid=28753): Terminated: ok {rc=0} 02:19:44.250986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28756): Launched 02:19:44.554516 run osmo-hlr_10.42.42.2(pid=28757): Launched 02:19:44.668637 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:45.187991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28759): Launched 02:19:45.490700 run osmo-stp_10.42.42.5(pid=28760): Launched 02:19:45.605114 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:46.183452 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28762): Launched 02:19:46.513629 run osmo-msc_10.42.42.6(pid=28763): Launched 02:19:46.786424 run osmo-stp_10.42.42.5(pid=28760): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28760)] 02:19:47.048124 run osmo-stp_10.42.42.5(pid=28760): stdout: | (launched: 2022-12-14_02:19:45.434249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:47.259206 run osmo-stp_10.42.42.5(pid=28760): stderr: | [0;m[38;5;43m20221214021945607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021945607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021945607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021945607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021945608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021945608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021945608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:47.397735 run osmo-stp_10.42.42.5(pid=28760): stdout: | (launched: 2022-12-14_02:19:45.434249) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:47.522583 run osmo-stp_10.42.42.5(pid=28760): stderr: | [0;m[38;5;43m20221214021945607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021945607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021945607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021945607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021945608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021945608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021945608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:47.667271 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28760): Process ended prematurely: osmo-stp_10.42.42.5(pid=28760) [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28760)] [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:19:47.676336 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 02:19:47.702675 run osmo-hlr_10.42.42.2(pid=28757): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28757)] 02:19:47.750357 run osmo-hlr_10.42.42.2(pid=28757): stdout: | (launched: 2022-12-14_02:19:44.498101) 02:19:47.799774 run osmo-hlr_10.42.42.2(pid=28757): stderr: | [0;m[1;31m20221214021944677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021944677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021944677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021944677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021944677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021944677 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021944692 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021944700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021944700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021944701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:47.868709 run osmo-msc_10.42.42.6(pid=28763): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28763)] 02:19:47.916338 run osmo-msc_10.42.42.6(pid=28763): stdout: | (launched: 2022-12-14_02:19:46.447389) 02:19:47.965365 run osmo-msc_10.42.42.6(pid=28763): stderr: | [0;m[38;5;43m20221214021947055 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021947055 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5211479c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021947055 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021947055 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021947056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021947056 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021947057 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021947058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021947058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021947058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:48.014835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28756): Terminating (SIGTERM) 02:19:48.054532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28759): Terminating (SIGTERM) 02:19:48.094049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28762): Terminating (SIGTERM) 02:19:48.133949 --- ParallelTerminationStrategy: PID 28756 died... 02:19:48.152838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28756): Terminated: ok {rc=0} 02:19:48.196930 --- ParallelTerminationStrategy: PID 28759 died... 02:19:48.215683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28759): Terminated: ok {rc=0} 02:19:48.260035 --- ParallelTerminationStrategy: PID 28762 died... 02:19:48.278718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28762): Terminated: ok {rc=0} 02:19:48.363770 bus /sierra_3: Setting Powered False 02:19:49.461336 bus /sierra_3: Setting Powered False 02:19:50.577583 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:19:51.807566 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:19:51.813810 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:19:51.833795 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:19:51.860249 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:19:51.916312 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:19:51.938137 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:19:51.965416 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:19:52.506220 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:19:52.554396 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:52.565228 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:19:52.618614 tst mo_mt_call.py: using LAC 37867 02:19:52.735923 tst mo_mt_call.py: using RAC 127 02:19:52.864413 tst mo_mt_call.py: using CellId 37867 02:19:52.990345 tst mo_mt_call.py: using BVCI 37868 02:19:53.109437 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:53.120994 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:53.132452 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:53.143684 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:53.155188 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:19:53.166749 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:19:53.285735 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:19:53.403328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:19:53.871331 run create_hlr_db(pid=28768): Launched 02:19:53.994859 bus /sierra_2: Setting Powered False 02:19:55.055201 run create_hlr_db(pid=28768): Terminated: ok {rc=0} 02:19:55.500386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28770): Launched 02:19:55.828175 run osmo-hlr_10.42.42.2(pid=28771): Launched 02:19:55.953345 run osmo-stp_10.42.42.5: Starting osmo-stp 02:19:56.521993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28773): Launched 02:19:56.849471 run osmo-stp_10.42.42.5(pid=28774): Launched 02:19:56.974623 run osmo-msc_10.42.42.6: Starting osmo-msc 02:19:57.565921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28776): Launched 02:19:57.894160 run osmo-msc_10.42.42.6(pid=28777): Launched 02:19:58.076153 run osmo-stp_10.42.42.5(pid=28774): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28774)] 02:19:58.214856 run osmo-stp_10.42.42.5(pid=28774): stdout: | (launched: 2022-12-14_02:19:56.789321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:58.353709 run osmo-stp_10.42.42.5(pid=28774): stderr: | [0;m[38;5;43m20221214021956982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021956982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021956982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021956982 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021956985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021956985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021956985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:58.491669 run osmo-stp_10.42.42.5(pid=28774): stdout: | (launched: 2022-12-14_02:19:56.789321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:19:58.622494 run osmo-stp_10.42.42.5(pid=28774): stderr: | [0;m[38;5;43m20221214021956982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214021956982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214021956982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214021956982 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214021956985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214021956985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214021956985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:19:58.778682 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28774): Process ended prematurely: osmo-stp_10.42.42.5(pid=28774) [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28774)] [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:19:58.788173 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:19:58.815994 run osmo-hlr_10.42.42.2(pid=28771): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28771)] 02:19:58.867374 run osmo-hlr_10.42.42.2(pid=28771): stdout: | (launched: 2022-12-14_02:19:55.768220) 02:19:58.919451 run osmo-hlr_10.42.42.2(pid=28771): stderr: | [0;m[1;31m20221214021955968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214021955968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214021955968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214021955968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214021955968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214021955968 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214021955980 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214021955989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214021955989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214021955989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:19:58.992186 run osmo-msc_10.42.42.6(pid=28777): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28777)] 02:19:59.042017 run osmo-msc_10.42.42.6(pid=28777): stdout: | (launched: 2022-12-14_02:19:57.833471) 02:19:59.094116 run osmo-msc_10.42.42.6(pid=28777): stderr: | [0;m[38;5;43m20221214021958157 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214021958157 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f42410d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214021958157 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214021958157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214021958157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214021958157 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214021958159 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214021958159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214021958160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214021958160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:19:59.146347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28770): Terminating (SIGTERM) 02:19:59.188140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28773): Terminating (SIGTERM) 02:19:59.230765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28776): Terminating (SIGTERM) 02:19:59.273192 --- ParallelTerminationStrategy: PID 28770 died... 02:19:59.293616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28770): Terminated: ok {rc=0} 02:19:59.340101 --- ParallelTerminationStrategy: PID 28773 died... 02:19:59.360065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28773): Terminated: ok {rc=0} 02:19:59.406375 --- ParallelTerminationStrategy: PID 28776 died... 02:19:59.426219 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28776): Terminated: ok {rc=0} 02:19:59.513863 bus /sierra_3: Setting Powered False 02:20:00.612777 bus /sierra_3: Setting Powered False 02:20:01.733665 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:20:02.890157 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:02.901758 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:20:02.957566 tst mo_mt_call_osmux.py: using LAC 37868 02:20:03.086461 tst mo_mt_call_osmux.py: using RAC 128 02:20:03.213781 tst mo_mt_call_osmux.py: using CellId 37868 02:20:03.343299 tst mo_mt_call_osmux.py: using BVCI 37869 02:20:03.462112 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:03.473541 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:03.484557 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:03.495704 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:03.507206 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:20:03.518827 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:20:03.636088 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:20:03.758512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:04.228221 run create_hlr_db(pid=28782): Launched 02:20:04.352112 bus /sierra_2: Setting Powered False 02:20:05.411854 run create_hlr_db(pid=28782): Terminated: ok {rc=0} 02:20:05.855656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28784): Launched 02:20:06.182730 run osmo-hlr_10.42.42.2(pid=28785): Launched 02:20:06.307089 run osmo-stp_10.42.42.5: Starting osmo-stp 02:20:06.874430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28787): Launched 02:20:07.201736 run osmo-stp_10.42.42.5(pid=28788): Launched 02:20:07.326106 run osmo-msc_10.42.42.6: Starting osmo-msc 02:20:07.916541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28790): Launched 02:20:08.243352 run osmo-msc_10.42.42.6(pid=28791): Launched 02:20:08.424753 run osmo-stp_10.42.42.5(pid=28788): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28788)] 02:20:08.562732 run osmo-stp_10.42.42.5(pid=28788): stdout: | (launched: 2022-12-14_02:20:07.141758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:08.700852 run osmo-stp_10.42.42.5(pid=28788): stderr: | [0;m[38;5;43m20221214022007337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022007337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022007337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022007338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022007338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022007338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022007338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:08.838538 run osmo-stp_10.42.42.5(pid=28788): stdout: | (launched: 2022-12-14_02:20:07.141758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:08.969595 run osmo-stp_10.42.42.5(pid=28788): stderr: | [0;m[38;5;43m20221214022007337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022007337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022007337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022007338 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022007338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022007338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022007338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:09.125516 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28788): Process ended prematurely: osmo-stp_10.42.42.5(pid=28788) [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28788)] [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:20:09.135231 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:20:09.163355 run osmo-hlr_10.42.42.2(pid=28785): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28785)] 02:20:09.214368 run osmo-hlr_10.42.42.2(pid=28785): stdout: | (launched: 2022-12-14_02:20:06.122716) 02:20:09.267573 run osmo-hlr_10.42.42.2(pid=28785): stderr: | [0;m[1;31m20221214022006321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022006321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022006321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022006321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022006321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022006321 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022006334 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022006342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022006342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022006342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:20:09.340844 run osmo-msc_10.42.42.6(pid=28791): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28791)] 02:20:09.391186 run osmo-msc_10.42.42.6(pid=28791): stdout: | (launched: 2022-12-14_02:20:08.183271) 02:20:09.443444 run osmo-msc_10.42.42.6(pid=28791): stderr: | [0;m[38;5;43m20221214022008508 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022008508 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1cbe107c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022008508 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022008508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022008508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022008508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022008510 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022008510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022008511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022008511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:20:09.496572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28784): Terminating (SIGTERM) 02:20:09.538600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28787): Terminating (SIGTERM) 02:20:09.581438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28790): Terminating (SIGTERM) 02:20:09.624240 --- ParallelTerminationStrategy: PID 28784 died... 02:20:09.645132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28784): Terminated: ok {rc=0} 02:20:09.692091 --- ParallelTerminationStrategy: PID 28787 died... 02:20:09.712281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28787): Terminated: ok {rc=0} 02:20:09.759328 --- ParallelTerminationStrategy: PID 28790 died... 02:20:09.779503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28790): Terminated: ok {rc=0} 02:20:09.868702 bus /sierra_3: Setting Powered False 02:20:10.967111 bus /sierra_3: Setting Powered False 02:20:12.083204 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:20:13.326871 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:20:13.333743 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:20:13.354422 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:20:13.382041 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:20:13.432052 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:20:13.452389 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:20:13.478487 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:20:14.037289 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:20:14.090042 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:14.101557 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:20:14.157874 tst mo_mt_call.py: using LAC 37869 02:20:14.285571 tst mo_mt_call.py: using RAC 129 02:20:14.410835 tst mo_mt_call.py: using CellId 37869 02:20:14.536618 tst mo_mt_call.py: using BVCI 37870 02:20:14.654819 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:14.666261 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:14.677550 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:14.688632 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:14.700148 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:14.711694 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:20:14.827483 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:20:14.941610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:15.409752 run create_hlr_db(pid=28796): Launched 02:20:15.533635 bus /sierra_2: Setting Powered False 02:20:16.594874 run create_hlr_db(pid=28796): Terminated: ok {rc=0} 02:20:17.032534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28798): Launched 02:20:17.349476 run osmo-hlr_10.42.42.2(pid=28799): Launched 02:20:17.464399 run osmo-stp_10.42.42.5: Starting osmo-stp 02:20:17.984936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28801): Launched 02:20:18.288074 run osmo-stp_10.42.42.5(pid=28802): Launched 02:20:18.405469 run osmo-msc_10.42.42.6: Starting osmo-msc 02:20:18.951739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28804): Launched 02:20:19.254496 run osmo-msc_10.42.42.6(pid=28805): Launched 02:20:19.423503 run osmo-stp_10.42.42.5(pid=28802): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28802)] 02:20:19.551693 run osmo-stp_10.42.42.5(pid=28802): stdout: | (launched: 2022-12-14_02:20:18.231146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:19.679892 run osmo-stp_10.42.42.5(pid=28802): stderr: | [0;m[38;5;43m20221214022018403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022018403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022018404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022018404 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022018404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022018405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022018405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:19.805456 run osmo-stp_10.42.42.5(pid=28802): stdout: | (launched: 2022-12-14_02:20:18.231146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:19.925923 run osmo-stp_10.42.42.5(pid=28802): stderr: | [0;m[38;5;43m20221214022018403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022018403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022018404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022018404 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022018404 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022018405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022018405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:20.069472 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28802): Process ended prematurely: osmo-stp_10.42.42.5(pid=28802) [trial-2398↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28802)] [trial-2398↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:20:20.078264 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:20:20.104482 run osmo-hlr_10.42.42.2(pid=28799): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28799)] 02:20:20.152113 run osmo-hlr_10.42.42.2(pid=28799): stdout: | (launched: 2022-12-14_02:20:17.293213) 02:20:20.201659 run osmo-hlr_10.42.42.2(pid=28799): stderr: | [0;m[1;31m20221214022017472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022017472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022017472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022017472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022017472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022017472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022017489 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022017498 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022017499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022017499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:20:20.270655 run osmo-msc_10.42.42.6(pid=28805): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28805)] 02:20:20.318359 run osmo-msc_10.42.42.6(pid=28805): stdout: | (launched: 2022-12-14_02:20:19.198148) 02:20:20.367764 run osmo-msc_10.42.42.6(pid=28805): stderr: | [0;m[38;5;43m20221214022019473 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022019473 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fecfde8ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022019473 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022019474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022019474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022019474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022019476 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022019476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022019476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022019476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:20:20.417495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28798): Terminating (SIGTERM) 02:20:20.457388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28801): Terminating (SIGTERM) 02:20:20.497538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28804): Terminating (SIGTERM) 02:20:20.537920 --- ParallelTerminationStrategy: PID 28798 died... 02:20:20.557170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28798): Terminated: ok {rc=0} 02:20:20.601152 --- ParallelTerminationStrategy: PID 28801 died... 02:20:20.619774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28801): Terminated: ok {rc=0} 02:20:20.663922 --- ParallelTerminationStrategy: PID 28804 died... 02:20:20.682525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28804): Terminated: ok {rc=0} 02:20:20.767757 bus /sierra_3: Setting Powered False 02:20:21.866464 bus /sierra_3: Setting Powered False 02:20:22.982390 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:20:24.128177 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:24.140112 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:20:24.200927 tst mo_mt_call_osmux.py: using LAC 37870 02:20:24.318331 tst mo_mt_call_osmux.py: using RAC 130 02:20:24.435689 tst mo_mt_call_osmux.py: using CellId 37870 02:20:24.553398 tst mo_mt_call_osmux.py: using BVCI 37871 02:20:24.665476 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:24.676452 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:24.687260 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:24.697987 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:24.708702 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:20:24.719563 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:20:24.840909 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:20:24.959992 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:25.432233 run create_hlr_db(pid=28807): Launched 02:20:25.558723 bus /sierra_2: Setting Powered False 02:20:26.622803 run create_hlr_db(pid=28807): Terminated: ok {rc=0} 02:20:27.057280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28809): Launched 02:20:27.361926 run osmo-hlr_10.42.42.2(pid=28810): Launched 02:20:27.479379 run osmo-stp_10.42.42.5: Starting osmo-stp 02:20:28.001503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28812): Launched 02:20:28.305429 run osmo-stp_10.42.42.5(pid=28813): Launched 02:20:28.421258 run osmo-msc_10.42.42.6: Starting osmo-msc 02:20:28.972072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28815): Launched 02:20:29.276073 run osmo-msc_10.42.42.6(pid=28816): Launched 02:20:29.445481 run osmo-stp_10.42.42.5(pid=28813): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28813)] 02:20:29.573985 run osmo-stp_10.42.42.5(pid=28813): stdout: | (launched: 2022-12-14_02:20:28.249168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:29.702102 run osmo-stp_10.42.42.5(pid=28813): stderr: | [0;m[38;5;43m20221214022028420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022028420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022028421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022028421 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022028422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022028422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022028422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:29.828353 run osmo-stp_10.42.42.5(pid=28813): stdout: | (launched: 2022-12-14_02:20:28.249168) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:29.949253 run osmo-stp_10.42.42.5(pid=28813): stderr: | [0;m[38;5;43m20221214022028420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022028420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022028421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022028421 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022028422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022028422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022028422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:30.093661 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28813): Process ended prematurely: osmo-stp_10.42.42.5(pid=28813) [trial-2398↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28813)] [trial-2398↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:20:30.102430 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:20:30.128598 run osmo-hlr_10.42.42.2(pid=28810): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28810)] 02:20:30.176330 run osmo-hlr_10.42.42.2(pid=28810): stdout: | (launched: 2022-12-14_02:20:27.305782) 02:20:30.225573 run osmo-hlr_10.42.42.2(pid=28810): stderr: | [0;m[1;31m20221214022027486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022027486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022027486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022027486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022027486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022027486 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022027501 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022027511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022027511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022027511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:20:30.294639 run osmo-msc_10.42.42.6(pid=28816): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28816)] 02:20:30.342210 run osmo-msc_10.42.42.6(pid=28816): stdout: | (launched: 2022-12-14_02:20:29.219325) 02:20:30.391390 run osmo-msc_10.42.42.6(pid=28816): stderr: | [0;m[38;5;43m20221214022029493 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022029493 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe3030e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022029494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022029494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022029494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022029494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022029496 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022029496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022029496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022029496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:20:30.441282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28809): Terminating (SIGTERM) 02:20:30.480728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28812): Terminating (SIGTERM) 02:20:30.520557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28815): Terminating (SIGTERM) 02:20:30.560509 --- ParallelTerminationStrategy: PID 28809 died... 02:20:30.580070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28809): Terminated: ok {rc=0} 02:20:30.624138 --- ParallelTerminationStrategy: PID 28812 died... 02:20:30.642918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28812): Terminated: ok {rc=0} 02:20:30.686716 --- ParallelTerminationStrategy: PID 28815 died... 02:20:30.705255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28815): Terminated: ok {rc=0} 02:20:30.791053 bus /sierra_3: Setting Powered False 02:20:31.898023 bus /sierra_3: Setting Powered False 02:20:33.024223 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:20:34.260396 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:20:34.266865 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:20:34.287735 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:20:34.316264 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:20:34.368641 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:20:34.389459 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:20:34.416581 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:20:34.965861 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:20:35.018288 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:35.029587 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:20:35.087637 tst mo_mt_call.py: using LAC 37871 02:20:35.217740 tst mo_mt_call.py: using RAC 131 02:20:35.347071 tst mo_mt_call.py: using CellId 37871 02:20:35.476498 tst mo_mt_call.py: using BVCI 37872 02:20:35.595365 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:35.606780 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:35.617787 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:35.628726 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:35.640449 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:35.651833 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:20:35.767761 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:20:35.886853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:36.393616 run create_hlr_db(pid=28821): Launched 02:20:36.517436 bus /sierra_2: Setting Powered False 02:20:37.581980 run create_hlr_db(pid=28821): Terminated: ok {rc=0} 02:20:38.037238 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28823): Launched 02:20:38.363147 run osmo-hlr_10.42.42.2(pid=28824): Launched 02:20:38.488521 run osmo-stp_10.42.42.5: Starting osmo-stp 02:20:39.054219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28826): Launched 02:20:39.381948 run osmo-stp_10.42.42.5(pid=28827): Launched 02:20:39.507313 run osmo-msc_10.42.42.6: Starting osmo-msc 02:20:40.100884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28829): Launched 02:20:40.428610 run osmo-msc_10.42.42.6(pid=28830): Launched 02:20:40.611000 run osmo-stp_10.42.42.5(pid=28827): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28827)] 02:20:40.749222 run osmo-stp_10.42.42.5(pid=28827): stdout: | (launched: 2022-12-14_02:20:39.321648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:40.888135 run osmo-stp_10.42.42.5(pid=28827): stderr: | [0;m[38;5;43m20221214022039516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022039516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022039516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022039517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022039519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022039519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022039519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:41.025902 run osmo-stp_10.42.42.5(pid=28827): stdout: | (launched: 2022-12-14_02:20:39.321648) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:41.156444 run osmo-stp_10.42.42.5(pid=28827): stderr: | [0;m[38;5;43m20221214022039516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022039516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022039516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022039517 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022039519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022039519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022039519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:41.312373 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28827): Process ended prematurely: osmo-stp_10.42.42.5(pid=28827) [trial-2398↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28827)] [trial-2398↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:20:41.322225 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:20:41.350301 run osmo-hlr_10.42.42.2(pid=28824): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28824)] 02:20:41.401406 run osmo-hlr_10.42.42.2(pid=28824): stdout: | (launched: 2022-12-14_02:20:38.303299) 02:20:41.454130 run osmo-hlr_10.42.42.2(pid=28824): stderr: | [0;m[1;31m20221214022038504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022038504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022038504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022038504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022038504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022038504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022038517 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022038525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022038525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022038525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:20:41.527345 run osmo-msc_10.42.42.6(pid=28830): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28830)] 02:20:41.577745 run osmo-msc_10.42.42.6(pid=28830): stdout: | (launched: 2022-12-14_02:20:40.368328) 02:20:41.630417 run osmo-msc_10.42.42.6(pid=28830): stderr: | [0;m[38;5;43m20221214022040693 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022040693 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff865465c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022040693 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022040693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022040693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022040694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022040696 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022040696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022040696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022040696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:20:41.683297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28823): Terminating (SIGTERM) 02:20:41.725407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28826): Terminating (SIGTERM) 02:20:41.768112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28829): Terminating (SIGTERM) 02:20:41.810878 --- ParallelTerminationStrategy: PID 28823 died... 02:20:41.831716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28823): Terminated: ok {rc=0} 02:20:41.878813 --- ParallelTerminationStrategy: PID 28826 died... 02:20:41.899118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28826): Terminated: ok {rc=0} 02:20:41.946351 --- ParallelTerminationStrategy: PID 28829 died... 02:20:41.966874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28829): Terminated: ok {rc=0} 02:20:42.054571 bus /sierra_3: Setting Powered False 02:20:43.153981 bus /sierra_3: Setting Powered False 02:20:44.273196 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:20:45.419506 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:45.430854 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:20:45.487008 tst mo_mt_call_osmux.py: using LAC 37872 02:20:45.607906 tst mo_mt_call_osmux.py: using RAC 132 02:20:45.727042 tst mo_mt_call_osmux.py: using CellId 37872 02:20:45.860212 tst mo_mt_call_osmux.py: using BVCI 37873 02:20:46.007864 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:46.020250 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:46.032695 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:46.044852 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:46.058279 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:20:46.071616 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:20:46.193916 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:20:46.310468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:46.797389 run create_hlr_db(pid=28832): Launched 02:20:46.950859 bus /sierra_2: Setting Powered False 02:20:48.011145 run create_hlr_db(pid=28832): Terminated: ok {rc=0} 02:20:48.433623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28834): Launched 02:20:48.738140 run osmo-hlr_10.42.42.2(pid=28835): Launched 02:20:48.852556 run osmo-stp_10.42.42.5: Starting osmo-stp 02:20:49.389881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28837): Launched 02:20:49.692696 run osmo-stp_10.42.42.5(pid=28838): Launched 02:20:49.807497 run osmo-msc_10.42.42.6: Starting osmo-msc 02:20:50.378943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28840): Launched 02:20:50.683221 run osmo-msc_10.42.42.6(pid=28841): Launched 02:20:50.853791 run osmo-stp_10.42.42.5(pid=28838): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28838)] 02:20:50.982284 run osmo-stp_10.42.42.5(pid=28838): stdout: | (launched: 2022-12-14_02:20:49.636461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:51.110848 run osmo-stp_10.42.42.5(pid=28838): stderr: | [0;m[38;5;43m20221214022049810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022049810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022049810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022049811 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022049811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022049811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022049811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:51.237164 run osmo-stp_10.42.42.5(pid=28838): stdout: | (launched: 2022-12-14_02:20:49.636461) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:20:51.358073 run osmo-stp_10.42.42.5(pid=28838): stderr: | [0;m[38;5;43m20221214022049810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022049810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022049810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022049811 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022049811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022049811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022049811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:20:51.502999 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28838): Process ended prematurely: osmo-stp_10.42.42.5(pid=28838) [trial-2398↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28838)] [trial-2398↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:20:51.511847 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:20:51.538304 run osmo-hlr_10.42.42.2(pid=28835): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28835)] 02:20:51.586140 run osmo-hlr_10.42.42.2(pid=28835): stdout: | (launched: 2022-12-14_02:20:48.681125) 02:20:51.635604 run osmo-hlr_10.42.42.2(pid=28835): stderr: | [0;m[1;31m20221214022048859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022048859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022048859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022048859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022048859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022048859 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022048871 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022048880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022048881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022048881 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:20:51.704811 run osmo-msc_10.42.42.6(pid=28841): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28841)] 02:20:51.753130 run osmo-msc_10.42.42.6(pid=28841): stdout: | (launched: 2022-12-14_02:20:50.626523) 02:20:51.802698 run osmo-msc_10.42.42.6(pid=28841): stderr: | [0;m[38;5;43m20221214022050899 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022050900 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1bfe081c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022050900 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022050900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022050900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022050900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022050902 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022050902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022050902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022050902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:20:51.852663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28834): Terminating (SIGTERM) 02:20:51.892758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28837): Terminating (SIGTERM) 02:20:51.932482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28840): Terminating (SIGTERM) 02:20:51.972377 --- ParallelTerminationStrategy: PID 28834 died... 02:20:51.991609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28834): Terminated: ok {rc=0} 02:20:52.035416 --- ParallelTerminationStrategy: PID 28837 died... 02:20:52.054048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28837): Terminated: ok {rc=0} 02:20:52.097878 --- ParallelTerminationStrategy: PID 28840 died... 02:20:52.116521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28840): Terminated: ok {rc=0} 02:20:52.199462 bus /sierra_3: Setting Powered False 02:20:53.296750 bus /sierra_3: Setting Powered False 02:20:54.413548 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 emergency:oc2g --------------------------------------------------------------------- 02:20:55.647288 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:20:55.651814 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 02:20:55.672474 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 02:20:55.700018 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 02:20:55.785252 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 02:20:55.806130 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 02:20:55.833210 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 02:20:56.416846 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2398 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 02:20:56.422047 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:56.432687 tst emergency:oc2g: Using 1 x bts (candidates: 1) 02:20:56.471788 tst emergency_mo_mt_call.py: using LAC 37873 02:20:56.598068 tst emergency_mo_mt_call.py: using RAC 133 02:20:56.724525 tst emergency_mo_mt_call.py: using CellId 37873 02:20:56.849394 tst emergency_mo_mt_call.py: using BVCI 37874 02:20:56.966501 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:56.977525 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:56.988315 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:56.999032 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:57.010197 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:20:57.021239 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:20:57.139146 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:20:57.252355 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:20:57.714973 run create_hlr_db(pid=28850): Launched 02:20:57.837365 bus /sierra_2: Setting Powered False 02:20:58.896777 run create_hlr_db(pid=28850): Terminated: ok {rc=0} 02:20:59.315159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28852): Launched 02:20:59.613038 run osmo-hlr_10.42.42.2(pid=28853): Launched 02:20:59.725394 run osmo-stp_10.42.42.5: Starting osmo-stp 02:21:00.253699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28855): Launched 02:21:00.551546 run osmo-stp_10.42.42.5(pid=28856): Launched 02:21:00.677144 tst emergency_mo_mt_call.py: using MSISDN 8457 02:21:00.830394 run osmo-msc_10.42.42.6: Starting osmo-msc 02:21:01.396499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28858): Launched 02:21:01.716359 run osmo-msc_10.42.42.6(pid=28859): Launched 02:21:02.057310 run osmo-stp_10.42.42.5(pid=28856): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28856)] 02:21:02.244387 run osmo-stp_10.42.42.5(pid=28856): stdout: | (launched: 2022-12-14_02:21:00.495952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:02.388377 run osmo-stp_10.42.42.5(pid=28856): stderr: | [0;m[38;5;43m20221214022100668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022100668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022100668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022100668 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022100669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022100669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022100669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:02.527683 run osmo-stp_10.42.42.5(pid=28856): stdout: | (launched: 2022-12-14_02:21:00.495952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:02.656095 run osmo-stp_10.42.42.5(pid=28856): stderr: | [0;m[38;5;43m20221214022100668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022100668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022100668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022100668 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022100669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022100669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022100669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:02.809369 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28856): Process ended prematurely: osmo-stp_10.42.42.5(pid=28856) [trial-2398↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28856)] [trial-2398↪emergency:oc2g↪emergency_mo_mt_call.py:19] 02:21:02.818251 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 02:21:02.845553 run osmo-hlr_10.42.42.2(pid=28853): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28853)] 02:21:02.896581 run osmo-hlr_10.42.42.2(pid=28853): stdout: | (launched: 2022-12-14_02:20:59.557149) 02:21:02.948427 run osmo-hlr_10.42.42.2(pid=28853): stderr: | [0;m[1;31m20221214022059736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022059736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022059736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022059736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022059736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022059736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022059749 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022059757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022059757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022059757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:21:03.020773 run osmo-msc_10.42.42.6(pid=28859): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28859)] 02:21:03.070730 run osmo-msc_10.42.42.6(pid=28859): stdout: | (launched: 2022-12-14_02:21:01.653430) 02:21:03.122493 run osmo-msc_10.42.42.6(pid=28859): stderr: | [0;m[38;5;43m20221214022102237 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022102237 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb17114cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022102237 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022102237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022102238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022102238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022102239 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022102241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022102241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022102241 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:21:03.174502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28852): Terminating (SIGTERM) 02:21:03.216390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28855): Terminating (SIGTERM) 02:21:03.258766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28858): Terminating (SIGTERM) 02:21:03.301108 --- ParallelTerminationStrategy: PID 28852 died... 02:21:03.321439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28852): Terminated: ok {rc=0} 02:21:03.368004 --- ParallelTerminationStrategy: PID 28855 died... 02:21:03.387960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28855): Terminated: ok {rc=0} 02:21:03.434070 --- ParallelTerminationStrategy: PID 28858 died... 02:21:03.453998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28858): Terminated: ok {rc=0} 02:21:03.542318 bus /sierra_3: Setting Powered False 02:21:04.640498 bus /sierra_3: Setting Powered False 02:21:05.758809 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 02:21:06.846326 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:06.858324 tst emergency:oc2g: Using 1 x bts (candidates: 1) 02:21:06.895539 tst emergency_preemptive_call.py: using LAC 37874 02:21:07.012836 tst emergency_preemptive_call.py: using RAC 134 02:21:07.129639 tst emergency_preemptive_call.py: using CellId 37874 02:21:07.246322 tst emergency_preemptive_call.py: using BVCI 37875 02:21:07.363843 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:07.374920 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:07.385927 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:07.396692 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:07.408018 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 02:21:07.419185 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:21:07.537073 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:21:07.656147 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:21:07.773313 tst emergency:oc2g: Using 1 x modem (candidates: 4) 02:21:07.887341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:21:08.351833 run create_hlr_db(pid=28861): Launched 02:21:08.475223 bus /sierra_2: Setting Powered False 02:21:09.535383 run create_hlr_db(pid=28861): Terminated: ok {rc=0} 02:21:09.975054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28863): Launched 02:21:10.279410 run osmo-hlr_10.42.42.2(pid=28864): Launched 02:21:10.391937 run osmo-stp_10.42.42.5: Starting osmo-stp 02:21:10.920364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28866): Launched 02:21:11.218872 run osmo-stp_10.42.42.5(pid=28867): Launched 02:21:11.341398 tst emergency_preemptive_call.py: using MSISDN 8458 02:21:11.497419 run osmo-msc_10.42.42.6: Starting osmo-msc 02:21:12.031572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28869): Launched 02:21:12.329227 run osmo-msc_10.42.42.6(pid=28870): Launched 02:21:12.494771 run osmo-stp_10.42.42.5(pid=28867): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28867)] 02:21:12.620805 run osmo-stp_10.42.42.5(pid=28867): stdout: | (launched: 2022-12-14_02:21:11.163149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:12.747250 run osmo-stp_10.42.42.5(pid=28867): stderr: | [0;m[38;5;43m20221214022111332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022111332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022111333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022111334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022111336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022111336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022111336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:12.870632 run osmo-stp_10.42.42.5(pid=28867): stdout: | (launched: 2022-12-14_02:21:11.163149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:12.989325 run osmo-stp_10.42.42.5(pid=28867): stderr: | [0;m[38;5;43m20221214022111332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022111332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022111333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022111334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022111336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022111336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022111336 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:13.130100 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28867): Process ended prematurely: osmo-stp_10.42.42.5(pid=28867) [trial-2398↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28867)] [trial-2398↪emergency:oc2g↪emergency_preemptive_call.py:32] 02:21:13.138255 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 02:21:13.164223 run osmo-hlr_10.42.42.2(pid=28864): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28864)] 02:21:13.211843 run osmo-hlr_10.42.42.2(pid=28864): stdout: | (launched: 2022-12-14_02:21:10.223855) 02:21:13.260660 run osmo-hlr_10.42.42.2(pid=28864): stderr: | [0;m[1;31m20221214022110400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022110400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022110400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022110400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022110400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022110400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022110412 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022110423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022110423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022110423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:21:13.329075 run osmo-msc_10.42.42.6(pid=28870): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28870)] 02:21:13.376141 run osmo-msc_10.42.42.6(pid=28870): stdout: | (launched: 2022-12-14_02:21:12.273378) 02:21:13.424927 run osmo-msc_10.42.42.6(pid=28870): stderr: | [0;m[38;5;43m20221214022112547 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022112547 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f44ab1b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022112547 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022112547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022112547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022112547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022112549 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022112550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022112550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022112550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:21:13.474129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28863): Terminating (SIGTERM) 02:21:13.513424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28866): Terminating (SIGTERM) 02:21:13.552653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28869): Terminating (SIGTERM) 02:21:13.592223 --- ParallelTerminationStrategy: PID 28863 died... 02:21:13.611223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28863): Terminated: ok {rc=0} 02:21:13.654603 --- ParallelTerminationStrategy: PID 28866 died... 02:21:13.673527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28866): Terminated: ok {rc=0} 02:21:13.716942 --- ParallelTerminationStrategy: PID 28869 died... 02:21:13.735519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28869): Terminated: ok {rc=0} 02:21:13.820503 bus /sierra_9: Setting Powered False 02:21:14.918126 bus /sierra_9: Setting Powered False 02:21:16.039216 bus /sierra_8: Setting Powered False 02:21:17.159895 bus /sierra_8: Setting Powered False 02:21:18.271994 bus /sierra_3: Setting Powered False 02:21:19.369420 bus /sierra_3: Setting Powered False 02:21:20.484587 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:oc2g --------------------------------------------------------------------- 02:21:21.749267 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:21:21.753853 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 02:21:21.774571 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 02:21:21.813999 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 02:21:21.899778 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 02:21:21.920638 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 02:21:21.959757 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 02:21:22.551334 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 02:21:22.605149 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:22.615844 tst gprs:oc2g: Using 1 x bts (candidates: 1) 02:21:22.649187 tst cs_paging_gprs_active.py: using LAC 37875 02:21:22.775972 tst cs_paging_gprs_active.py: using RAC 135 02:21:22.903151 tst cs_paging_gprs_active.py: using CellId 37875 02:21:23.030375 tst cs_paging_gprs_active.py: using BVCI 37876 02:21:23.149708 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:23.160452 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:23.171175 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:23.181915 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:23.192678 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:23.203596 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:23.214675 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:23.225705 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:23.236690 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:23.351943 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:23.471404 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:21:23.692928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:24.023068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28875): Launched 02:21:24.308233 run iperf3-srv_10.42.42.10(pid=28876): Launched 02:21:24.431380 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:21:24.652485 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:24.981677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28877): Launched 02:21:25.267182 run iperf3-srv_10.42.42.10(pid=28878): Launched 02:21:25.390010 tst cs_paging_gprs_active.py:38: start network... 02:21:25.610889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:21:26.118020 run create_hlr_db(pid=28879): Launched 02:21:26.242872 bus /sierra_2: Setting Powered False 02:21:27.308055 run create_hlr_db(pid=28879): Terminated: ok {rc=0} 02:21:27.743437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28881): Launched 02:21:28.048304 run osmo-hlr_10.42.42.2(pid=28882): Launched 02:21:28.163944 run osmo-stp_10.42.42.5: Starting osmo-stp 02:21:28.700480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28884): Launched 02:21:29.005252 run osmo-stp_10.42.42.5(pid=28885): Launched 02:21:29.122149 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:21:29.647178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28887): Launched 02:21:29.762730 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:21:30.019729 run patchelf(pid=28888): Launched 02:21:30.188911 run osmo-stp_10.42.42.5(pid=28885): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28885)] 02:21:30.317347 run osmo-stp_10.42.42.5(pid=28885): stdout: | (launched: 2022-12-14_02:21:28.948051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:30.446813 run osmo-stp_10.42.42.5(pid=28885): stderr: | [0;m[38;5;43m20221214022129121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022129121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022129121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022129122 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022129122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022129122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022129122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:30.576177 run osmo-stp_10.42.42.5(pid=28885): stdout: | (launched: 2022-12-14_02:21:28.948051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:30.700070 run osmo-stp_10.42.42.5(pid=28885): stderr: | [0;m[38;5;43m20221214022129121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022129121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022129121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022129122 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022129122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022129122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022129122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:30.862941 run patchelf(pid=28888): Terminating (SIGINT) 02:21:31.062128 run patchelf(pid=28888): Terminated: ok {rc=0} 02:21:31.200526 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28885): Process ended prematurely: osmo-stp_10.42.42.5(pid=28885) [trial-2398↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28885)] [trial-2398↪gprs:oc2g↪cs_paging_gprs_active.py:38] 02:21:31.211938 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 02:21:31.243533 run osmo-hlr_10.42.42.2(pid=28882): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28882)] 02:21:31.299100 run osmo-hlr_10.42.42.2(pid=28882): stdout: | (launched: 2022-12-14_02:21:27.991038) 02:21:31.354864 run osmo-hlr_10.42.42.2(pid=28882): stderr: | [0;m[1;31m20221214022128168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022128168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022128168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022128168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022128168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022128168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022128180 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022128191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022128191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022128191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:21:31.410721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28875): Terminating (SIGTERM) 02:21:31.455450 run iperf3-srv_10.42.42.10(pid=28876): Terminating (SIGTERM) 02:21:31.501963 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28877): Terminating (SIGTERM) 02:21:31.547025 run iperf3-srv_10.42.42.10(pid=28878): Terminating (SIGTERM) 02:21:31.591814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28881): Terminating (SIGTERM) 02:21:31.637171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28884): Terminating (SIGTERM) 02:21:31.685355 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28887): Terminating (SIGTERM) 02:21:31.732521 --- ParallelTerminationStrategy: PID 28875 died... 02:21:31.755204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28875): Terminated: ok {rc=0} 02:21:31.806803 --- ParallelTerminationStrategy: PID 28876 died... 02:21:31.827739 run iperf3-srv_10.42.42.10(pid=28876): Terminated {rc=256} 02:21:31.878447 --- ParallelTerminationStrategy: PID 28877 died... 02:21:31.899420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28877): Terminated: ok {rc=0} 02:21:31.948520 --- ParallelTerminationStrategy: PID 28878 died... 02:21:31.970581 run iperf3-srv_10.42.42.10(pid=28878): Terminated {rc=256} 02:21:32.019887 --- ParallelTerminationStrategy: PID 28881 died... 02:21:32.042522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28881): Terminated: ok {rc=0} 02:21:32.091709 --- ParallelTerminationStrategy: PID 28884 died... 02:21:32.113780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28884): Terminated: ok {rc=0} 02:21:32.162734 --- ParallelTerminationStrategy: PID 28887 died... 02:21:32.183805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28887): Terminated: ok {rc=0} 02:21:32.274033 bus /gobi_0: Setting Powered False 02:21:33.371845 bus /gobi_0: Setting Powered False 02:21:34.489643 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:oc2g iperf3.py ---------------------------------------------- 02:21:35.637981 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:35.649529 tst gprs:oc2g: Using 1 x bts (candidates: 1) 02:21:35.684272 tst iperf3.py: using LAC 37876 02:21:35.802923 tst iperf3.py: using RAC 136 02:21:35.926709 tst iperf3.py: using CellId 37876 02:21:36.045952 tst iperf3.py: using BVCI 37877 02:21:36.155621 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:36.165996 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:36.176257 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:36.186431 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:36.196400 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:36.206480 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:36.216645 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:36.226827 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:36.237064 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:36.358855 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:21:36.580610 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:36.909488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28889): Launched 02:21:37.195766 run iperf3-srv_10.42.42.10(pid=28890): Launched 02:21:37.318703 tst iperf3.py:8: start network... 02:21:37.540248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:21:38.048801 run create_hlr_db(pid=28891): Launched 02:21:38.173525 bus /gobi_6: Setting Powered False 02:21:39.238327 run create_hlr_db(pid=28891): Terminated: ok {rc=0} 02:21:39.674149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28893): Launched 02:21:39.978037 run osmo-hlr_10.42.42.2(pid=28894): Launched 02:21:40.093707 run osmo-stp_10.42.42.5: Starting osmo-stp 02:21:40.633381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28896): Launched 02:21:40.936850 run osmo-stp_10.42.42.5(pid=28897): Launched 02:21:41.052010 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:21:41.579494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28899): Launched 02:21:41.694960 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:21:41.952096 run patchelf(pid=28900): Launched 02:21:42.120807 run osmo-stp_10.42.42.5(pid=28897): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28897)] 02:21:42.248654 run osmo-stp_10.42.42.5(pid=28897): stdout: | (launched: 2022-12-14_02:21:40.880050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:42.378158 run osmo-stp_10.42.42.5(pid=28897): stderr: | [0;m[38;5;43m20221214022141053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022141053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022141053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022141054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022141054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022141054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022141054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:42.507418 run osmo-stp_10.42.42.5(pid=28897): stdout: | (launched: 2022-12-14_02:21:40.880050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:42.632206 run osmo-stp_10.42.42.5(pid=28897): stderr: | [0;m[38;5;43m20221214022141053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022141053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022141053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022141054 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022141054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022141054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022141054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:42.779272 run patchelf(pid=28900): Terminating (SIGINT) 02:21:42.950245 run patchelf(pid=28900): Terminated: ok {rc=0} 02:21:43.073172 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28897): Process ended prematurely: osmo-stp_10.42.42.5(pid=28897) [trial-2398↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28897)] [trial-2398↪gprs:oc2g↪iperf3.py:8] 02:21:43.082530 tst iperf3.py:8: Test FAILED (7.5 sec) 02:21:43.109549 run osmo-hlr_10.42.42.2(pid=28894): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28894)] 02:21:43.157379 run osmo-hlr_10.42.42.2(pid=28894): stdout: | (launched: 2022-12-14_02:21:39.921453) 02:21:43.206787 run osmo-hlr_10.42.42.2(pid=28894): stderr: | [0;m[1;31m20221214022140098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022140098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022140098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022140098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022140098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022140098 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022140110 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022140119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022140119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022140119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:21:43.256467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28889): Terminating (SIGTERM) 02:21:43.296210 run iperf3-srv_10.42.42.10(pid=28890): Terminating (SIGTERM) 02:21:43.335856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28893): Terminating (SIGTERM) 02:21:43.375489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28896): Terminating (SIGTERM) 02:21:43.414993 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28899): Terminating (SIGTERM) 02:21:43.454953 --- ParallelTerminationStrategy: PID 28889 died... 02:21:43.473993 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28889): Terminated: ok {rc=0} 02:21:43.517953 --- ParallelTerminationStrategy: PID 28890 died... 02:21:43.536529 run iperf3-srv_10.42.42.10(pid=28890): Terminated {rc=256} 02:21:43.580317 --- ParallelTerminationStrategy: PID 28893 died... 02:21:43.599049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28893): Terminated: ok {rc=0} 02:21:43.642797 --- ParallelTerminationStrategy: PID 28896 died... 02:21:43.661459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28896): Terminated: ok {rc=0} 02:21:43.705395 --- ParallelTerminationStrategy: PID 28899 died... 02:21:43.723942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28899): Terminated: ok {rc=0} 02:21:43.809983 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:oc2g iperf3m4.py ---------------------------------------------- 02:21:44.956744 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:44.967919 tst gprs:oc2g: Using 1 x bts (candidates: 1) 02:21:45.004506 tst iperf3m4.py: using LAC 37877 02:21:45.124767 tst iperf3m4.py: using RAC 137 02:21:45.246285 tst iperf3m4.py: using CellId 37877 02:21:45.368090 tst iperf3m4.py: using BVCI 37878 02:21:45.480164 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:45.490589 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:45.500781 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:45.511142 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:45.521247 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:45.531287 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:45.541565 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:45.551702 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:21:45.561984 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:45.684786 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:45.804673 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:45.952296 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:21:46.078926 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:21:46.292501 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:46.634848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28901): Launched 02:21:46.938741 run iperf3-srv_10.42.42.10(pid=28902): Launched 02:21:47.078352 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:21:47.303302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:47.632772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28903): Launched 02:21:47.918081 run iperf3-srv_10.42.42.10(pid=28904): Launched 02:21:48.041370 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:21:48.261890 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:48.590426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28905): Launched 02:21:48.875767 run iperf3-srv_10.42.42.10(pid=28906): Launched 02:21:48.998384 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:21:49.218061 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:21:49.546457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28907): Launched 02:21:49.831396 run iperf3-srv_10.42.42.10(pid=28908): Launched 02:21:49.954364 tst iperf3m4.py:8: start network... 02:21:50.174260 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:21:50.682016 run create_hlr_db(pid=28909): Launched 02:21:50.807644 bus /gobi_6: Setting Powered False 02:21:51.871788 run create_hlr_db(pid=28909): Terminated: ok {rc=0} 02:21:52.328421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28911): Launched 02:21:52.656250 run osmo-hlr_10.42.42.2(pid=28912): Launched 02:21:52.782229 run osmo-stp_10.42.42.5: Starting osmo-stp 02:21:53.348708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28914): Launched 02:21:53.675874 run osmo-stp_10.42.42.5(pid=28915): Launched 02:21:53.801445 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:21:54.367812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28917): Launched 02:21:54.493251 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:21:54.770558 run patchelf(pid=28918): Launched 02:21:54.952213 run osmo-stp_10.42.42.5(pid=28915): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28915)] 02:21:55.090194 run osmo-stp_10.42.42.5(pid=28915): stdout: | (launched: 2022-12-14_02:21:53.615728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:55.229763 run osmo-stp_10.42.42.5(pid=28915): stderr: | [0;m[38;5;43m20221214022153809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022153809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022153809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022153809 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022153810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022153810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022153810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:55.369509 run osmo-stp_10.42.42.5(pid=28915): stdout: | (launched: 2022-12-14_02:21:53.615728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:21:55.503646 run osmo-stp_10.42.42.5(pid=28915): stderr: | [0;m[38;5;43m20221214022153809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022153809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022153809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022153809 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022153810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022153810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022153810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:21:55.662372 run patchelf(pid=28918): Terminating (SIGINT) 02:21:55.846732 run patchelf(pid=28918): Terminated: ok {rc=0} 02:21:55.980506 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28915): Process ended prematurely: osmo-stp_10.42.42.5(pid=28915) [trial-2398↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28915)] [trial-2398↪gprs:oc2g↪iperf3m4.py:8] 02:21:55.990715 tst iperf3m4.py:8: Test FAILED (11.1 sec) 02:21:56.019372 run osmo-hlr_10.42.42.2(pid=28912): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28912)] 02:21:56.070150 run osmo-hlr_10.42.42.2(pid=28912): stdout: | (launched: 2022-12-14_02:21:52.595637) 02:21:56.122207 run osmo-hlr_10.42.42.2(pid=28912): stderr: | [0;m[1;31m20221214022152793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022152793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022152793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022152793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022152793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022152793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022152806 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022152814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022152814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022152814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:21:56.174966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28901): Terminating (SIGTERM) 02:21:56.217018 run iperf3-srv_10.42.42.10(pid=28902): Terminating (SIGTERM) 02:21:56.259043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28903): Terminating (SIGTERM) 02:21:56.301605 run iperf3-srv_10.42.42.10(pid=28904): Terminating (SIGTERM) 02:21:56.343402 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28905): Terminating (SIGTERM) 02:21:56.385381 run iperf3-srv_10.42.42.10(pid=28906): Terminating (SIGTERM) 02:21:56.427719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28907): Terminating (SIGTERM) 02:21:56.470278 run iperf3-srv_10.42.42.10(pid=28908): Terminating (SIGTERM) 02:21:56.512071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28911): Terminating (SIGTERM) 02:21:56.554212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28914): Terminating (SIGTERM) 02:21:56.596659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28917): Terminating (SIGTERM) 02:21:56.639032 --- ParallelTerminationStrategy: PID 28901 died... 02:21:56.659846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28901): Terminated: ok {rc=0} 02:21:56.706418 --- ParallelTerminationStrategy: PID 28902 died... 02:21:56.726258 run iperf3-srv_10.42.42.10(pid=28902): Terminated {rc=256} 02:21:56.772560 --- ParallelTerminationStrategy: PID 28903 died... 02:21:56.792534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28903): Terminated: ok {rc=0} 02:21:56.838756 --- ParallelTerminationStrategy: PID 28904 died... 02:21:56.858535 run iperf3-srv_10.42.42.10(pid=28904): Terminated {rc=256} 02:21:56.904656 --- ParallelTerminationStrategy: PID 28905 died... 02:21:56.924744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28905): Terminated: ok {rc=0} 02:21:56.971069 --- ParallelTerminationStrategy: PID 28906 died... 02:21:56.991035 run iperf3-srv_10.42.42.10(pid=28906): Terminated {rc=256} 02:21:57.037304 --- ParallelTerminationStrategy: PID 28907 died... 02:21:57.057144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28907): Terminated: ok {rc=0} 02:21:57.103519 --- ParallelTerminationStrategy: PID 28908 died... 02:21:57.123477 run iperf3-srv_10.42.42.10(pid=28908): Terminated {rc=256} 02:21:57.169789 --- ParallelTerminationStrategy: PID 28911 died... 02:21:57.189675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28911): Terminated: ok {rc=0} 02:21:57.235965 --- ParallelTerminationStrategy: PID 28914 died... 02:21:57.255887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28914): Terminated: ok {rc=0} 02:21:57.302413 --- ParallelTerminationStrategy: PID 28917 died... 02:21:57.322365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28917): Terminated: ok {rc=0} 02:21:57.410617 bus /gobi_4: Setting Powered False 02:21:58.508892 bus /gobi_4: Setting Powered False 02:21:59.625623 bus /gobi_1: Setting Powered False 02:22:00.723335 bus /gobi_1: Setting Powered False 02:22:01.858750 bus /gobi_0: Setting Powered False 02:22:02.978916 bus /gobi_0: Setting Powered False 02:22:04.096083 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:oc2g ping.py ---------------------------------------------- 02:22:05.198604 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:05.210040 tst gprs:oc2g: Using 1 x bts (candidates: 1) 02:22:05.249503 tst ping.py: using LAC 37878 02:22:05.366643 tst ping.py: using RAC 138 02:22:05.485381 tst ping.py: using CellId 37878 02:22:05.602720 tst ping.py: using BVCI 37879 02:22:05.711822 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:05.722257 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:05.732409 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:05.742552 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:05.752533 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:05.762740 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:05.772934 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:05.783077 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:22:05.903505 tst ping.py:19: start network... 02:22:06.121810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:22:06.619254 run create_hlr_db(pid=28919): Launched 02:22:06.741939 bus /gobi_6: Setting Powered False 02:22:07.805954 run create_hlr_db(pid=28919): Terminated: ok {rc=0} 02:22:08.233999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28921): Launched 02:22:08.533677 run osmo-hlr_10.42.42.2(pid=28922): Launched 02:22:08.647472 run osmo-stp_10.42.42.5: Starting osmo-stp 02:22:09.181318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28924): Launched 02:22:09.481592 run osmo-stp_10.42.42.5(pid=28925): Launched 02:22:09.596550 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:22:10.111497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28927): Launched 02:22:10.225815 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:22:10.478715 run patchelf(pid=28928): Launched 02:22:10.644631 run osmo-stp_10.42.42.5(pid=28925): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28925)] 02:22:10.770785 run osmo-stp_10.42.42.5(pid=28925): stdout: | (launched: 2022-12-14_02:22:09.425459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:10.898799 run osmo-stp_10.42.42.5(pid=28925): stderr: | [0;m[38;5;43m20221214022209596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022209596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022209596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022209597 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022209597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022209597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022209597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:11.027049 run osmo-stp_10.42.42.5(pid=28925): stdout: | (launched: 2022-12-14_02:22:09.425459) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:11.149648 run osmo-stp_10.42.42.5(pid=28925): stderr: | [0;m[38;5;43m20221214022209596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022209596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022209596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022209597 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022209597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022209597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022209597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:11.295370 run patchelf(pid=28928): Terminating (SIGINT) 02:22:11.464890 run patchelf(pid=28928): Terminated: ok {rc=0} 02:22:11.587039 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28925): Process ended prematurely: osmo-stp_10.42.42.5(pid=28925) [trial-2398↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28925)] [trial-2398↪gprs:oc2g↪ping.py:22] 02:22:11.595677 tst ping.py:22: Test FAILED (6.4 sec) 02:22:11.622602 run osmo-hlr_10.42.42.2(pid=28922): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28922)] 02:22:11.670371 run osmo-hlr_10.42.42.2(pid=28922): stdout: | (launched: 2022-12-14_02:22:08.477656) 02:22:11.719656 run osmo-hlr_10.42.42.2(pid=28922): stderr: | [0;m[1;31m20221214022208655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022208655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022208655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022208655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022208655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022208655 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022208667 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022208677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022208678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022208678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:22:11.769409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28921): Terminating (SIGTERM) 02:22:11.809468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28924): Terminating (SIGTERM) 02:22:11.849279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28927): Terminating (SIGTERM) 02:22:11.890152 --- ParallelTerminationStrategy: PID 28921 died... 02:22:11.909372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28921): Terminated: ok {rc=0} 02:22:11.953536 --- ParallelTerminationStrategy: PID 28924 died... 02:22:11.972061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28924): Terminated: ok {rc=0} 02:22:12.016107 --- ParallelTerminationStrategy: PID 28927 died... 02:22:12.034850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28927): Terminated: ok {rc=0} 02:22:12.117766 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 02:22:13.205326 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:13.217403 tst gprs:oc2g: Using 1 x bts (candidates: 1) 02:22:13.254207 tst ping_idle_ping.py: using LAC 37879 02:22:13.372753 tst ping_idle_ping.py: using RAC 139 02:22:13.491503 tst ping_idle_ping.py: using CellId 37879 02:22:13.611153 tst ping_idle_ping.py: using BVCI 37880 02:22:13.721547 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:13.731854 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:13.742162 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:13.752288 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:13.762969 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:13.773650 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:13.784060 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 02:22:13.795570 tst gprs:oc2g: Using 1 x modem (candidates: 4) 02:22:13.914252 tst ping_idle_ping.py:24: start network... 02:22:14.132310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:22:14.634119 run create_hlr_db(pid=28929): Launched 02:22:14.757087 bus /gobi_6: Setting Powered False 02:22:15.820716 run create_hlr_db(pid=28929): Terminated: ok {rc=0} 02:22:16.310993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28931): Launched 02:22:16.627787 run osmo-hlr_10.42.42.2(pid=28932): Launched 02:22:16.871383 run osmo-stp_10.42.42.5: Starting osmo-stp 02:22:17.543079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28934): Launched 02:22:17.843204 run osmo-stp_10.42.42.5(pid=28935): Launched 02:22:17.956734 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:22:18.474333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28937): Launched 02:22:18.588721 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:22:18.842073 run patchelf(pid=28938): Launched 02:22:19.007892 run osmo-stp_10.42.42.5(pid=28935): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28935)] 02:22:19.133974 run osmo-stp_10.42.42.5(pid=28935): stdout: | (launched: 2022-12-14_02:22:17.787101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:19.261439 run osmo-stp_10.42.42.5(pid=28935): stderr: | [0;m[38;5;43m20221214022217959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022217959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022217959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022217959 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022217960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022217960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022217960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:19.389313 run osmo-stp_10.42.42.5(pid=28935): stdout: | (launched: 2022-12-14_02:22:17.787101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:19.512096 run osmo-stp_10.42.42.5(pid=28935): stderr: | [0;m[38;5;43m20221214022217959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022217959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022217959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022217959 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022217960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022217960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022217960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:19.657237 run patchelf(pid=28938): Terminating (SIGINT) 02:22:19.826062 run patchelf(pid=28938): Terminated: ok {rc=0} 02:22:19.947860 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28935): Process ended prematurely: osmo-stp_10.42.42.5(pid=28935) [trial-2398↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28935)] [trial-2398↪gprs:oc2g↪ping_idle_ping.py:27] 02:22:19.956740 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 02:22:19.983547 run osmo-hlr_10.42.42.2(pid=28932): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28932)] 02:22:20.031532 run osmo-hlr_10.42.42.2(pid=28932): stdout: | (launched: 2022-12-14_02:22:16.563606) 02:22:20.080512 run osmo-hlr_10.42.42.2(pid=28932): stderr: | [0;m[1;31m20221214022216906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022216906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022216906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022216906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022216906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022216906 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022216922 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022216938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022216939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022216939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:22:20.130093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28931): Terminating (SIGTERM) 02:22:20.169657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28934): Terminating (SIGTERM) 02:22:20.209258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28937): Terminating (SIGTERM) 02:22:20.249198 --- ParallelTerminationStrategy: PID 28931 died... 02:22:20.268328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28931): Terminated: ok {rc=0} 02:22:20.312086 --- ParallelTerminationStrategy: PID 28934 died... 02:22:20.330728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28934): Terminated: ok {rc=0} 02:22:20.374371 --- ParallelTerminationStrategy: PID 28937 died... 02:22:20.393092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28937): Terminated: ok {rc=0} 02:22:20.476280 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 02:22:21.761882 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:22:21.766952 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:22:21.786725 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:22:21.824337 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:22:21.909383 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:22:21.929284 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:22:21.966392 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:22:22.557648 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:22:22.605262 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:22.615710 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:22:22.651146 tst cs_paging_gprs_active.py: using LAC 37880 02:22:22.769009 tst cs_paging_gprs_active.py: using RAC 140 02:22:22.885712 tst cs_paging_gprs_active.py: using CellId 37880 02:22:23.004178 tst cs_paging_gprs_active.py: using BVCI 37881 02:22:23.123331 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:23.134534 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:23.145588 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:23.156615 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:23.168321 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:23.180077 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:23.192002 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:23.203847 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:23.215799 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:23.333844 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:23.453392 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:22:23.654967 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:23.955580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28942): Launched 02:22:24.216091 run iperf3-srv_10.42.42.10(pid=28943): Launched 02:22:24.327478 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:22:24.526208 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:24.825248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28944): Launched 02:22:25.085998 run iperf3-srv_10.42.42.10(pid=28945): Launched 02:22:25.197309 tst cs_paging_gprs_active.py:38: start network... 02:22:25.395959 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:22:25.860680 run create_hlr_db(pid=28946): Launched 02:22:25.983395 bus /gobi_6: Setting Powered False 02:22:27.043148 run create_hlr_db(pid=28946): Terminated: ok {rc=0} 02:22:27.482442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28948): Launched 02:22:27.804455 run osmo-hlr_10.42.42.2(pid=28949): Launched 02:22:27.928487 run osmo-stp_10.42.42.5: Starting osmo-stp 02:22:28.482701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28951): Launched 02:22:28.805151 run osmo-stp_10.42.42.5(pid=28952): Launched 02:22:28.929097 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:22:29.484217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28954): Launched 02:22:29.607257 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:22:29.878869 run patchelf(pid=28955): Launched 02:22:30.057720 run osmo-stp_10.42.42.5(pid=28952): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28952)] 02:22:30.193975 run osmo-stp_10.42.42.5(pid=28952): stdout: | (launched: 2022-12-14_02:22:28.745832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:30.331772 run osmo-stp_10.42.42.5(pid=28952): stderr: | [0;m[38;5;43m20221214022228940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022228940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022228941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022228941 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022228941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022228942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022228942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:30.469959 run osmo-stp_10.42.42.5(pid=28952): stdout: | (launched: 2022-12-14_02:22:28.745832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:30.601821 run osmo-stp_10.42.42.5(pid=28952): stderr: | [0;m[38;5;43m20221214022228940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022228940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022228941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022228941 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022228941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022228942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022228942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:30.758379 run patchelf(pid=28955): Terminating (SIGINT) 02:22:30.957755 run patchelf(pid=28955): Terminated: ok {rc=0} 02:22:31.091474 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28952): Process ended prematurely: osmo-stp_10.42.42.5(pid=28952) [trial-2398↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28952)] [trial-2398↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:22:31.102718 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 02:22:31.132138 run osmo-hlr_10.42.42.2(pid=28949): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28949)] 02:22:31.186942 run osmo-hlr_10.42.42.2(pid=28949): stdout: | (launched: 2022-12-14_02:22:27.745403) 02:22:31.241834 run osmo-hlr_10.42.42.2(pid=28949): stderr: | [0;m[1;31m20221214022227945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022227945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022227945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022227945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022227945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022227945 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022227957 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022227966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022227966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022227966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:22:31.297224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28942): Terminating (SIGTERM) 02:22:31.341118 run iperf3-srv_10.42.42.10(pid=28943): Terminating (SIGTERM) 02:22:31.388328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28944): Terminating (SIGTERM) 02:22:31.433728 run iperf3-srv_10.42.42.10(pid=28945): Terminating (SIGTERM) 02:22:31.481261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28948): Terminating (SIGTERM) 02:22:31.525817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28951): Terminating (SIGTERM) 02:22:31.570358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28954): Terminating (SIGTERM) 02:22:31.615186 --- ParallelTerminationStrategy: PID 28942 died... 02:22:31.637071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28942): Terminated: ok {rc=0} 02:22:31.685723 --- ParallelTerminationStrategy: PID 28943 died... 02:22:31.706854 run iperf3-srv_10.42.42.10(pid=28943): Terminated {rc=256} 02:22:31.755098 --- ParallelTerminationStrategy: PID 28944 died... 02:22:31.776506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28944): Terminated: ok {rc=0} 02:22:31.824846 --- ParallelTerminationStrategy: PID 28945 died... 02:22:31.846185 run iperf3-srv_10.42.42.10(pid=28945): Terminated {rc=256} 02:22:31.894911 --- ParallelTerminationStrategy: PID 28948 died... 02:22:31.916300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28948): Terminated: ok {rc=0} 02:22:31.965088 --- ParallelTerminationStrategy: PID 28951 died... 02:22:31.986900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28951): Terminated: ok {rc=0} 02:22:32.035476 --- ParallelTerminationStrategy: PID 28954 died... 02:22:32.057317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28954): Terminated: ok {rc=0} 02:22:32.149538 bus /gobi_0: Setting Powered False 02:22:33.249846 bus /gobi_0: Setting Powered False 02:22:34.365128 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:22:35.513981 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:35.525668 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:22:35.562898 tst iperf3.py: using LAC 37881 02:22:35.682556 tst iperf3.py: using RAC 141 02:22:35.801071 tst iperf3.py: using CellId 37881 02:22:35.918587 tst iperf3.py: using BVCI 37882 02:22:36.028512 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:36.039249 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:36.049802 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:36.060324 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:36.071192 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:36.082984 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:36.094168 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:36.105206 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:36.117365 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:36.237641 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:22:36.437575 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:36.737672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28956): Launched 02:22:36.997597 run iperf3-srv_10.42.42.10(pid=28957): Launched 02:22:37.109711 tst iperf3.py:8: start network... 02:22:37.308610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:22:37.771559 run create_hlr_db(pid=28958): Launched 02:22:37.894618 bus /gobi_6: Setting Powered False 02:22:38.955129 run create_hlr_db(pid=28958): Terminated: ok {rc=0} 02:22:39.391188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28960): Launched 02:22:39.711832 run osmo-hlr_10.42.42.2(pid=28961): Launched 02:22:39.833735 run osmo-stp_10.42.42.5: Starting osmo-stp 02:22:40.391102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28963): Launched 02:22:40.712164 run osmo-stp_10.42.42.5(pid=28964): Launched 02:22:40.835030 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:22:41.389447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28966): Launched 02:22:41.511606 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:22:41.782987 run patchelf(pid=28967): Launched 02:22:41.961395 run osmo-stp_10.42.42.5(pid=28964): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28964)] 02:22:42.097459 run osmo-stp_10.42.42.5(pid=28964): stdout: | (launched: 2022-12-14_02:22:40.653294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:42.235067 run osmo-stp_10.42.42.5(pid=28964): stderr: | [0;m[38;5;43m20221214022240848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022240848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022240849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022240849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022240850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022240850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022240850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:42.372814 run osmo-stp_10.42.42.5(pid=28964): stdout: | (launched: 2022-12-14_02:22:40.653294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:42.504933 run osmo-stp_10.42.42.5(pid=28964): stderr: | [0;m[38;5;43m20221214022240848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022240848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022240849 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022240849 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022240850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022240850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022240850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:42.661455 run patchelf(pid=28967): Terminating (SIGINT) 02:22:42.842228 run patchelf(pid=28967): Terminated: ok {rc=0} 02:22:42.973648 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28964): Process ended prematurely: osmo-stp_10.42.42.5(pid=28964) [trial-2398↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28964)] [trial-2398↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 02:22:42.984044 tst iperf3.py:8: Test FAILED (7.5 sec) 02:22:43.012554 run osmo-hlr_10.42.42.2(pid=28961): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28961)] 02:22:43.063441 run osmo-hlr_10.42.42.2(pid=28961): stdout: | (launched: 2022-12-14_02:22:39.652936) 02:22:43.116256 run osmo-hlr_10.42.42.2(pid=28961): stderr: | [0;m[1;31m20221214022239852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022239852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022239852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022239852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022239852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022239852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022239864 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022239872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022239873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022239873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:22:43.169328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28956): Terminating (SIGTERM) 02:22:43.211292 run iperf3-srv_10.42.42.10(pid=28957): Terminating (SIGTERM) 02:22:43.253800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28960): Terminating (SIGTERM) 02:22:43.296305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28963): Terminating (SIGTERM) 02:22:43.338705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28966): Terminating (SIGTERM) 02:22:43.381767 --- ParallelTerminationStrategy: PID 28956 died... 02:22:43.402174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28956): Terminated: ok {rc=0} 02:22:43.448842 --- ParallelTerminationStrategy: PID 28957 died... 02:22:43.468693 run iperf3-srv_10.42.42.10(pid=28957): Terminated {rc=256} 02:22:43.515366 --- ParallelTerminationStrategy: PID 28960 died... 02:22:43.535734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28960): Terminated: ok {rc=0} 02:22:43.582434 --- ParallelTerminationStrategy: PID 28963 died... 02:22:43.602418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28963): Terminated: ok {rc=0} 02:22:43.649266 --- ParallelTerminationStrategy: PID 28966 died... 02:22:43.669177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28966): Terminated: ok {rc=0} 02:22:43.758735 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:22:44.908193 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:44.919903 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:22:44.955699 tst iperf3m4.py: using LAC 37882 02:22:45.082826 tst iperf3m4.py: using RAC 142 02:22:45.212029 tst iperf3m4.py: using CellId 37882 02:22:45.330563 tst iperf3m4.py: using BVCI 37883 02:22:45.440704 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:45.451434 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:45.462009 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:45.472496 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:45.482879 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:45.493744 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:45.505078 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:45.515488 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:22:45.526333 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:45.646899 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:45.763761 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:45.896466 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:22:46.021792 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:22:46.233522 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:46.557375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28968): Launched 02:22:46.891931 run iperf3-srv_10.42.42.10(pid=28969): Launched 02:22:47.019447 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:22:47.222144 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:47.526592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28970): Launched 02:22:47.787405 run iperf3-srv_10.42.42.10(pid=28971): Launched 02:22:47.898580 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:22:48.097246 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:48.396655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28972): Launched 02:22:48.657745 run iperf3-srv_10.42.42.10(pid=28973): Launched 02:22:48.769269 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:22:48.967600 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:22:49.267340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28974): Launched 02:22:49.528353 run iperf3-srv_10.42.42.10(pid=28975): Launched 02:22:49.639198 tst iperf3m4.py:8: start network... 02:22:49.837652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:22:50.299422 run create_hlr_db(pid=28976): Launched 02:22:50.421432 bus /gobi_6: Setting Powered False 02:22:51.481272 run create_hlr_db(pid=28976): Terminated: ok {rc=0} 02:22:51.901664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28978): Launched 02:22:52.229855 run osmo-hlr_10.42.42.2(pid=28979): Launched 02:22:52.352808 run osmo-stp_10.42.42.5: Starting osmo-stp 02:22:52.908756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28981): Launched 02:22:53.230040 run osmo-stp_10.42.42.5(pid=28982): Launched 02:22:53.351914 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:22:53.903962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28984): Launched 02:22:54.027911 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:22:54.299543 run patchelf(pid=28985): Launched 02:22:54.478417 run osmo-stp_10.42.42.5(pid=28982): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28982)] 02:22:54.614101 run osmo-stp_10.42.42.5(pid=28982): stdout: | (launched: 2022-12-14_02:22:53.170735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:54.751569 run osmo-stp_10.42.42.5(pid=28982): stderr: | [0;m[38;5;43m20221214022253365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022253365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022253366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022253366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022253366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022253367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022253367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:54.889169 run osmo-stp_10.42.42.5(pid=28982): stdout: | (launched: 2022-12-14_02:22:53.170735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:22:55.021389 run osmo-stp_10.42.42.5(pid=28982): stderr: | [0;m[38;5;43m20221214022253365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022253365 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022253366 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022253366 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022253366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022253367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022253367 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:22:55.177842 run patchelf(pid=28985): Terminating (SIGINT) 02:22:55.358685 run patchelf(pid=28985): Terminated: ok {rc=0} 02:22:55.489439 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28982): Process ended prematurely: osmo-stp_10.42.42.5(pid=28982) [trial-2398↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28982)] [trial-2398↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 02:22:55.499657 tst iperf3m4.py:8: Test FAILED (10.6 sec) 02:22:55.528339 run osmo-hlr_10.42.42.2(pid=28979): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28979)] 02:22:55.579241 run osmo-hlr_10.42.42.2(pid=28979): stdout: | (launched: 2022-12-14_02:22:52.170710) 02:22:55.631969 run osmo-hlr_10.42.42.2(pid=28979): stderr: | [0;m[1;31m20221214022252370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022252370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022252370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022252370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022252370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022252370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022252382 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022252390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022252390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022252390 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:22:55.684741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28968): Terminating (SIGTERM) 02:22:55.726621 run iperf3-srv_10.42.42.10(pid=28969): Terminating (SIGTERM) 02:22:55.769468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28970): Terminating (SIGTERM) 02:22:55.811554 run iperf3-srv_10.42.42.10(pid=28971): Terminating (SIGTERM) 02:22:55.853726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28972): Terminating (SIGTERM) 02:22:55.895892 run iperf3-srv_10.42.42.10(pid=28973): Terminating (SIGTERM) 02:22:55.938134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28974): Terminating (SIGTERM) 02:22:55.980185 run iperf3-srv_10.42.42.10(pid=28975): Terminating (SIGTERM) 02:22:56.023058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28978): Terminating (SIGTERM) 02:22:56.065394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28981): Terminating (SIGTERM) 02:22:56.107663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28984): Terminating (SIGTERM) 02:22:56.150046 --- ParallelTerminationStrategy: PID 28968 died... 02:22:56.170461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28968): Terminated: ok {rc=0} 02:22:56.217345 --- ParallelTerminationStrategy: PID 28969 died... 02:22:56.237148 run iperf3-srv_10.42.42.10(pid=28969): Terminated {rc=256} 02:22:56.283606 --- ParallelTerminationStrategy: PID 28970 died... 02:22:56.303476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28970): Terminated: ok {rc=0} 02:22:56.349973 --- ParallelTerminationStrategy: PID 28971 died... 02:22:56.369842 run iperf3-srv_10.42.42.10(pid=28971): Terminated {rc=256} 02:22:56.415989 --- ParallelTerminationStrategy: PID 28972 died... 02:22:56.435794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28972): Terminated: ok {rc=0} 02:22:56.482068 --- ParallelTerminationStrategy: PID 28973 died... 02:22:56.501835 run iperf3-srv_10.42.42.10(pid=28973): Terminated {rc=256} 02:22:56.548095 --- ParallelTerminationStrategy: PID 28974 died... 02:22:56.567859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28974): Terminated: ok {rc=0} 02:22:56.614197 --- ParallelTerminationStrategy: PID 28975 died... 02:22:56.634101 run iperf3-srv_10.42.42.10(pid=28975): Terminated {rc=256} 02:22:56.680486 --- ParallelTerminationStrategy: PID 28978 died... 02:22:56.700458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28978): Terminated: ok {rc=0} 02:22:56.747018 --- ParallelTerminationStrategy: PID 28981 died... 02:22:56.766828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28981): Terminated: ok {rc=0} 02:22:56.813302 --- ParallelTerminationStrategy: PID 28984 died... 02:22:56.833305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28984): Terminated: ok {rc=0} 02:22:56.922562 bus /gobi_4: Setting Powered False 02:22:58.022033 bus /gobi_4: Setting Powered False 02:22:59.140384 bus /gobi_1: Setting Powered False 02:23:00.238412 bus /gobi_1: Setting Powered False 02:23:01.355001 bus /gobi_0: Setting Powered False 02:23:02.454875 bus /gobi_0: Setting Powered False 02:23:03.572230 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 02:23:04.673630 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:04.685514 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:23:04.722650 tst ping.py: using LAC 37883 02:23:04.847901 tst ping.py: using RAC 143 02:23:04.972667 tst ping.py: using CellId 37883 02:23:05.087985 tst ping.py: using BVCI 37884 02:23:05.193287 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:05.203879 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:05.214403 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:05.224838 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:05.235250 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:05.246028 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:05.256518 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:05.267065 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:23:05.384411 tst ping.py:19: start network... 02:23:05.596564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:23:06.084513 run create_hlr_db(pid=28986): Launched 02:23:06.204311 bus /gobi_6: Setting Powered False 02:23:07.266798 run create_hlr_db(pid=28986): Terminated: ok {rc=0} 02:23:07.687885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28988): Launched 02:23:07.982191 run osmo-hlr_10.42.42.2(pid=28989): Launched 02:23:08.093276 run osmo-stp_10.42.42.5: Starting osmo-stp 02:23:08.602401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28991): Launched 02:23:08.895009 run osmo-stp_10.42.42.5(pid=28992): Launched 02:23:09.005875 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:23:09.510830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28994): Launched 02:23:09.622346 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:23:09.870502 run patchelf(pid=28995): Launched 02:23:10.033384 run osmo-stp_10.42.42.5(pid=28992): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28992)] 02:23:10.157263 run osmo-stp_10.42.42.5(pid=28992): stdout: | (launched: 2022-12-14_02:23:08.840214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:10.282303 run osmo-stp_10.42.42.5(pid=28992): stderr: | [0;m[38;5;43m20221214022309009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022309009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022309009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022309010 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022309010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022309010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022309010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:10.407223 run osmo-stp_10.42.42.5(pid=28992): stdout: | (launched: 2022-12-14_02:23:08.840214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:10.527245 run osmo-stp_10.42.42.5(pid=28992): stderr: | [0;m[38;5;43m20221214022309009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022309009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022309009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022309010 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022309010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022309010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022309010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:10.670098 run patchelf(pid=28995): Terminating (SIGINT) 02:23:10.835822 run patchelf(pid=28995): Terminated: ok {rc=0} 02:23:10.955417 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28992): Process ended prematurely: osmo-stp_10.42.42.5(pid=28992) [trial-2398↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28992)] [trial-2398↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 02:23:10.964263 tst ping.py:22: Test FAILED (6.3 sec) 02:23:10.990831 run osmo-hlr_10.42.42.2(pid=28989): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28989)] 02:23:11.038334 run osmo-hlr_10.42.42.2(pid=28989): stdout: | (launched: 2022-12-14_02:23:07.927383) 02:23:11.087489 run osmo-hlr_10.42.42.2(pid=28989): stderr: | [0;m[1;31m20221214022308104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022308104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022308104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022308104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022308104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022308104 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022308116 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022308124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022308124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022308124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:23:11.137230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28988): Terminating (SIGTERM) 02:23:11.176840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28991): Terminating (SIGTERM) 02:23:11.216472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28994): Terminating (SIGTERM) 02:23:11.256362 --- ParallelTerminationStrategy: PID 28988 died... 02:23:11.275613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28988): Terminated: ok {rc=0} 02:23:11.319398 --- ParallelTerminationStrategy: PID 28991 died... 02:23:11.337899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28991): Terminated: ok {rc=0} 02:23:11.381506 --- ParallelTerminationStrategy: PID 28994 died... 02:23:11.400008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28994): Terminated: ok {rc=0} 02:23:11.482652 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:23:12.566621 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:12.577877 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:23:12.615529 tst ping_idle_ping.py: using LAC 37884 02:23:12.740160 tst ping_idle_ping.py: using RAC 144 02:23:12.864023 tst ping_idle_ping.py: using CellId 37884 02:23:12.987703 tst ping_idle_ping.py: using BVCI 37885 02:23:13.094942 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:13.105740 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:13.116348 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:13.127048 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:13.137794 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:13.148172 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:13.159355 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:23:13.170255 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:23:13.283891 tst ping_idle_ping.py:24: start network... 02:23:13.479298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:23:13.938577 run create_hlr_db(pid=28996): Launched 02:23:14.058745 bus /gobi_6: Setting Powered False 02:23:15.117820 run create_hlr_db(pid=28996): Terminated: ok {rc=0} 02:23:15.551016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28998): Launched 02:23:15.873650 run osmo-hlr_10.42.42.2(pid=28999): Launched 02:23:16.113565 run osmo-stp_10.42.42.5: Starting osmo-stp 02:23:16.766655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29001): Launched 02:23:17.101511 run osmo-stp_10.42.42.5(pid=29002): Launched 02:23:17.264572 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:23:17.775991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29004): Launched 02:23:17.888413 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:23:18.139058 run patchelf(pid=29005): Launched 02:23:18.302589 run osmo-stp_10.42.42.5(pid=29002): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29002)] 02:23:18.427824 run osmo-stp_10.42.42.5(pid=29002): stdout: | (launched: 2022-12-14_02:23:17.037478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:18.554556 run osmo-stp_10.42.42.5(pid=29002): stderr: | [0;m[38;5;43m20221214022317303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022317303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022317303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022317304 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022317304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022317304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022317304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:18.681240 run osmo-stp_10.42.42.5(pid=29002): stdout: | (launched: 2022-12-14_02:23:17.037478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:18.802492 run osmo-stp_10.42.42.5(pid=29002): stderr: | [0;m[38;5;43m20221214022317303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022317303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022317303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022317304 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022317304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022317304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022317304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:18.946138 run patchelf(pid=29005): Terminating (SIGINT) 02:23:19.113537 run patchelf(pid=29005): Terminated: ok {rc=0} 02:23:19.234063 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29002): Process ended prematurely: osmo-stp_10.42.42.5(pid=29002) [trial-2398↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29002)] [trial-2398↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 02:23:19.242912 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 02:23:19.269412 run osmo-hlr_10.42.42.2(pid=28999): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28999)] 02:23:19.317187 run osmo-hlr_10.42.42.2(pid=28999): stdout: | (launched: 2022-12-14_02:23:15.811218) 02:23:19.366393 run osmo-hlr_10.42.42.2(pid=28999): stderr: | [0;m[1;31m20221214022316130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022316130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022316130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022316130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022316130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022316131 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022316159 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022316179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022316179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022316179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:23:19.416105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28998): Terminating (SIGTERM) 02:23:19.456221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29001): Terminating (SIGTERM) 02:23:19.496142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29004): Terminating (SIGTERM) 02:23:19.536399 --- ParallelTerminationStrategy: PID 28998 died... 02:23:19.555800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28998): Terminated: ok {rc=0} 02:23:19.600095 --- ParallelTerminationStrategy: PID 29001 died... 02:23:19.619016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29001): Terminated: ok {rc=0} 02:23:19.663150 --- ParallelTerminationStrategy: PID 29004 died... 02:23:19.682135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29004): Terminated: ok {rc=0} 02:23:19.768202 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:23:21.057982 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:23:21.063792 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:23:21.083715 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:23:21.121413 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:23:21.205810 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:23:21.225804 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:23:21.262856 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:23:21.855266 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:23:21.903545 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:21.914435 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:23:21.970088 tst cs_paging_gprs_active.py: using LAC 37885 02:23:22.088337 tst cs_paging_gprs_active.py: using RAC 145 02:23:22.211448 tst cs_paging_gprs_active.py: using CellId 37885 02:23:22.330509 tst cs_paging_gprs_active.py: using BVCI 37886 02:23:22.441215 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:22.451913 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:22.462350 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:22.472617 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:22.482905 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:22.493238 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:22.503684 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:22.513961 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:22.524370 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:22.643913 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:22.763714 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:23:22.982304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:23.306393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29010): Launched 02:23:23.587614 run iperf3-srv_10.42.42.10(pid=29011): Launched 02:23:23.708396 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:23:23.926335 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:24.251652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29012): Launched 02:23:24.533435 run iperf3-srv_10.42.42.10(pid=29013): Launched 02:23:24.654281 tst cs_paging_gprs_active.py:38: start network... 02:23:24.871440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:23:25.371954 run create_hlr_db(pid=29014): Launched 02:23:25.495353 bus /gobi_6: Setting Powered False 02:23:26.560130 run create_hlr_db(pid=29014): Terminated: ok {rc=0} 02:23:26.990371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29016): Launched 02:23:27.290939 run osmo-hlr_10.42.42.2(pid=29017): Launched 02:23:27.406003 run osmo-stp_10.42.42.5: Starting osmo-stp 02:23:27.926973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29019): Launched 02:23:28.227494 run osmo-stp_10.42.42.5(pid=29020): Launched 02:23:28.341744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:23:28.858566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29022): Launched 02:23:28.973231 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:23:29.227210 run patchelf(pid=29023): Launched 02:23:29.393295 run osmo-stp_10.42.42.5(pid=29020): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29020)] 02:23:29.519594 run osmo-stp_10.42.42.5(pid=29020): stdout: | (launched: 2022-12-14_02:23:28.171781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:29.647830 run osmo-stp_10.42.42.5(pid=29020): stderr: | [0;m[38;5;43m20221214022328342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022328343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022328343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022328343 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022328344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022328344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022328344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:29.776054 run osmo-stp_10.42.42.5(pid=29020): stdout: | (launched: 2022-12-14_02:23:28.171781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:29.898761 run osmo-stp_10.42.42.5(pid=29020): stderr: | [0;m[38;5;43m20221214022328342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022328343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022328343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022328343 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022328344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022328344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022328344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:30.044701 run patchelf(pid=29023): Terminating (SIGINT) 02:23:30.214584 run patchelf(pid=29023): Terminated: ok {rc=0} 02:23:30.337372 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29020): Process ended prematurely: osmo-stp_10.42.42.5(pid=29020) [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29020)] [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:23:30.346585 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 02:23:30.373377 run osmo-hlr_10.42.42.2(pid=29017): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29017)] 02:23:30.420698 run osmo-hlr_10.42.42.2(pid=29017): stdout: | (launched: 2022-12-14_02:23:27.235126) 02:23:30.469786 run osmo-hlr_10.42.42.2(pid=29017): stderr: | [0;m[1;31m20221214022327410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022327410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022327410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022327410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022327410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022327410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022327422 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022327431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022327431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022327431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:23:30.519178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29010): Terminating (SIGTERM) 02:23:30.558909 run iperf3-srv_10.42.42.10(pid=29011): Terminating (SIGTERM) 02:23:30.598444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29012): Terminating (SIGTERM) 02:23:30.638180 run iperf3-srv_10.42.42.10(pid=29013): Terminating (SIGTERM) 02:23:30.677852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29016): Terminating (SIGTERM) 02:23:30.717737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29019): Terminating (SIGTERM) 02:23:30.757291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29022): Terminating (SIGTERM) 02:23:30.797132 --- ParallelTerminationStrategy: PID 29010 died... 02:23:30.816042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29010): Terminated: ok {rc=0} 02:23:30.864278 --- ParallelTerminationStrategy: PID 29011 died... 02:23:30.887960 run iperf3-srv_10.42.42.10(pid=29011): Terminated {rc=256} 02:23:30.947301 --- ParallelTerminationStrategy: PID 29012 died... 02:23:30.966378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29012): Terminated: ok {rc=0} 02:23:31.010956 --- ParallelTerminationStrategy: PID 29013 died... 02:23:31.032265 run iperf3-srv_10.42.42.10(pid=29013): Terminated {rc=256} 02:23:31.078225 --- ParallelTerminationStrategy: PID 29016 died... 02:23:31.097884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29016): Terminated: ok {rc=0} 02:23:31.142855 --- ParallelTerminationStrategy: PID 29019 died... 02:23:31.162462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29019): Terminated: ok {rc=0} 02:23:31.207872 --- ParallelTerminationStrategy: PID 29022 died... 02:23:31.227515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29022): Terminated: ok {rc=0} 02:23:31.313220 bus /gobi_0: Setting Powered False 02:23:32.407535 bus /gobi_0: Setting Powered False 02:23:33.522439 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:23:34.667180 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:34.678534 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:23:34.737204 tst iperf3.py: using LAC 37886 02:23:34.856568 tst iperf3.py: using RAC 146 02:23:34.984278 tst iperf3.py: using CellId 37886 02:23:35.112739 tst iperf3.py: using BVCI 37887 02:23:35.230733 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:35.242030 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:35.252853 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:35.263816 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:35.275548 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:35.287261 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:35.299392 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:35.311198 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:35.323139 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:35.439551 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:23:35.639963 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:35.940300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29024): Launched 02:23:36.202917 run iperf3-srv_10.42.42.10(pid=29025): Launched 02:23:36.315310 tst iperf3.py:8: start network... 02:23:36.514890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:23:36.978174 run create_hlr_db(pid=29026): Launched 02:23:37.100353 bus /gobi_6: Setting Powered False 02:23:38.159914 run create_hlr_db(pid=29026): Terminated: ok {rc=0} 02:23:38.597031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29028): Launched 02:23:38.918903 run osmo-hlr_10.42.42.2(pid=29029): Launched 02:23:39.042039 run osmo-stp_10.42.42.5: Starting osmo-stp 02:23:39.595587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29031): Launched 02:23:39.917912 run osmo-stp_10.42.42.5(pid=29032): Launched 02:23:40.042606 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:23:40.597294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29034): Launched 02:23:40.720223 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:23:40.992551 run patchelf(pid=29035): Launched 02:23:41.170931 run osmo-stp_10.42.42.5(pid=29032): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29032)] 02:23:41.306973 run osmo-stp_10.42.42.5(pid=29032): stdout: | (launched: 2022-12-14_02:23:39.858492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:41.444521 run osmo-stp_10.42.42.5(pid=29032): stderr: | [0;m[38;5;43m20221214022340050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022340051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022340051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022340051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022340052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022340052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022340052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:41.582654 run osmo-stp_10.42.42.5(pid=29032): stdout: | (launched: 2022-12-14_02:23:39.858492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:41.714936 run osmo-stp_10.42.42.5(pid=29032): stderr: | [0;m[38;5;43m20221214022340050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022340051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022340051 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022340051 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022340052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022340052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022340052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:41.871665 run patchelf(pid=29035): Terminating (SIGINT) 02:23:42.053874 run patchelf(pid=29035): Terminated: ok {rc=0} 02:23:42.185382 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29032): Process ended prematurely: osmo-stp_10.42.42.5(pid=29032) [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29032)] [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 02:23:42.195513 tst iperf3.py:8: Test FAILED (7.6 sec) 02:23:42.223840 run osmo-hlr_10.42.42.2(pid=29029): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29029)] 02:23:42.274608 run osmo-hlr_10.42.42.2(pid=29029): stdout: | (launched: 2022-12-14_02:23:38.860062) 02:23:42.327017 run osmo-hlr_10.42.42.2(pid=29029): stderr: | [0;m[1;31m20221214022339057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022339057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022339057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022339057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022339057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022339057 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022339069 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022339077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022339077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022339077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:23:42.379813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29024): Terminating (SIGTERM) 02:23:42.421932 run iperf3-srv_10.42.42.10(pid=29025): Terminating (SIGTERM) 02:23:42.464384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29028): Terminating (SIGTERM) 02:23:42.506827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29031): Terminating (SIGTERM) 02:23:42.549225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29034): Terminating (SIGTERM) 02:23:42.591836 --- ParallelTerminationStrategy: PID 29024 died... 02:23:42.612122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29024): Terminated: ok {rc=0} 02:23:42.658922 --- ParallelTerminationStrategy: PID 29025 died... 02:23:42.678914 run iperf3-srv_10.42.42.10(pid=29025): Terminated {rc=256} 02:23:42.725208 --- ParallelTerminationStrategy: PID 29028 died... 02:23:42.744784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29028): Terminated: ok {rc=0} 02:23:42.790852 --- ParallelTerminationStrategy: PID 29031 died... 02:23:42.810644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29031): Terminated: ok {rc=0} 02:23:42.857175 --- ParallelTerminationStrategy: PID 29034 died... 02:23:42.877064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29034): Terminated: ok {rc=0} 02:23:42.965909 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:23:44.119045 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:44.130764 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:23:44.188062 tst iperf3m4.py: using LAC 37887 02:23:44.313830 tst iperf3m4.py: using RAC 147 02:23:44.440644 tst iperf3m4.py: using CellId 37887 02:23:44.569108 tst iperf3m4.py: using BVCI 37888 02:23:44.685906 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:44.697243 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:44.708071 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:44.718989 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:44.730223 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:44.741403 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:44.752795 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:44.764003 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:23:44.775337 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:44.891375 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:45.014002 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:45.128789 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:23:45.248366 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:23:45.465523 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:45.789297 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29036): Launched 02:23:46.097646 run iperf3-srv_10.42.42.10(pid=29037): Launched 02:23:46.222545 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:23:46.428477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:46.754424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29038): Launched 02:23:47.035284 run iperf3-srv_10.42.42.10(pid=29039): Launched 02:23:47.172313 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:23:47.392603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:47.717103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29040): Launched 02:23:47.998047 run iperf3-srv_10.42.42.10(pid=29041): Launched 02:23:48.118988 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:23:48.335574 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:23:48.659493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29042): Launched 02:23:48.941228 run iperf3-srv_10.42.42.10(pid=29043): Launched 02:23:49.062608 tst iperf3m4.py:8: start network... 02:23:49.279360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:23:49.780070 run create_hlr_db(pid=29044): Launched 02:23:49.901747 bus /gobi_6: Setting Powered False 02:23:50.966399 run create_hlr_db(pid=29044): Terminated: ok {rc=0} 02:23:51.415665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29046): Launched 02:23:51.738222 run osmo-hlr_10.42.42.2(pid=29047): Launched 02:23:51.861814 run osmo-stp_10.42.42.5: Starting osmo-stp 02:23:52.415569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29049): Launched 02:23:52.721893 run osmo-stp_10.42.42.5(pid=29050): Launched 02:23:52.836278 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:23:53.353316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29052): Launched 02:23:53.467743 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:23:53.722195 run patchelf(pid=29053): Launched 02:23:53.888493 run osmo-stp_10.42.42.5(pid=29050): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29050)] 02:23:54.015542 run osmo-stp_10.42.42.5(pid=29050): stdout: | (launched: 2022-12-14_02:23:52.665796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:54.143656 run osmo-stp_10.42.42.5(pid=29050): stderr: | [0;m[38;5;43m20221214022352836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022352836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022352837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022352837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022352838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022352838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022352838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:54.272263 run osmo-stp_10.42.42.5(pid=29050): stdout: | (launched: 2022-12-14_02:23:52.665796) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:23:54.394918 run osmo-stp_10.42.42.5(pid=29050): stderr: | [0;m[38;5;43m20221214022352836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022352836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022352837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022352837 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022352838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022352838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022352838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:23:54.540145 run patchelf(pid=29053): Terminating (SIGINT) 02:23:54.709513 run patchelf(pid=29053): Terminated: ok {rc=0} 02:23:54.831516 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29050): Process ended prematurely: osmo-stp_10.42.42.5(pid=29050) [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29050)] [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:23:54.841001 tst iperf3m4.py:8: Test FAILED (10.8 sec) 02:23:54.868204 run osmo-hlr_10.42.42.2(pid=29047): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29047)] 02:23:54.915831 run osmo-hlr_10.42.42.2(pid=29047): stdout: | (launched: 2022-12-14_02:23:51.679058) 02:23:54.964901 run osmo-hlr_10.42.42.2(pid=29047): stderr: | [0;m[1;31m20221214022351877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022351877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022351877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022351877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022351877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022351877 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022351889 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022351897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022351897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022351897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:23:55.014468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29036): Terminating (SIGTERM) 02:23:55.054132 run iperf3-srv_10.42.42.10(pid=29037): Terminating (SIGTERM) 02:23:55.093802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29038): Terminating (SIGTERM) 02:23:55.133671 run iperf3-srv_10.42.42.10(pid=29039): Terminating (SIGTERM) 02:23:55.173266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29040): Terminating (SIGTERM) 02:23:55.213614 run iperf3-srv_10.42.42.10(pid=29041): Terminating (SIGTERM) 02:23:55.253278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29042): Terminating (SIGTERM) 02:23:55.293460 run iperf3-srv_10.42.42.10(pid=29043): Terminating (SIGTERM) 02:23:55.333082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29046): Terminating (SIGTERM) 02:23:55.372651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29049): Terminating (SIGTERM) 02:23:55.412242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29052): Terminating (SIGTERM) 02:23:55.452100 --- ParallelTerminationStrategy: PID 29036 died... 02:23:55.471320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29036): Terminated: ok {rc=0} 02:23:55.515204 --- ParallelTerminationStrategy: PID 29037 died... 02:23:55.533786 run iperf3-srv_10.42.42.10(pid=29037): Terminated {rc=256} 02:23:55.577263 --- ParallelTerminationStrategy: PID 29038 died... 02:23:55.595995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29038): Terminated: ok {rc=0} 02:23:55.639566 --- ParallelTerminationStrategy: PID 29039 died... 02:23:55.658299 run iperf3-srv_10.42.42.10(pid=29039): Terminated {rc=256} 02:23:55.701658 --- ParallelTerminationStrategy: PID 29040 died... 02:23:55.720153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29040): Terminated: ok {rc=0} 02:23:55.763707 --- ParallelTerminationStrategy: PID 29041 died... 02:23:55.782103 run iperf3-srv_10.42.42.10(pid=29041): Terminated {rc=256} 02:23:55.825633 --- ParallelTerminationStrategy: PID 29042 died... 02:23:55.843968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29042): Terminated: ok {rc=0} 02:23:55.887518 --- ParallelTerminationStrategy: PID 29043 died... 02:23:55.905988 run iperf3-srv_10.42.42.10(pid=29043): Terminated {rc=256} 02:23:55.949345 --- ParallelTerminationStrategy: PID 29046 died... 02:23:55.967963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29046): Terminated: ok {rc=0} 02:23:56.011529 --- ParallelTerminationStrategy: PID 29049 died... 02:23:56.030242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29049): Terminated: ok {rc=0} 02:23:56.073745 --- ParallelTerminationStrategy: PID 29052 died... 02:23:56.092411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29052): Terminated: ok {rc=0} 02:23:56.175751 bus /gobi_4: Setting Powered False 02:23:57.274526 bus /gobi_4: Setting Powered False 02:23:58.392244 bus /gobi_1: Setting Powered False 02:23:59.490336 bus /gobi_1: Setting Powered False 02:24:00.605009 bus /gobi_0: Setting Powered False 02:24:01.734278 bus /gobi_0: Setting Powered False 02:24:02.884373 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:24:04.008868 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:04.022404 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:24:04.085455 tst ping.py: using LAC 37888 02:24:04.207420 tst ping.py: using RAC 148 02:24:04.325912 tst ping.py: using CellId 37888 02:24:04.441088 tst ping.py: using BVCI 37889 02:24:04.548741 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:04.560518 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:04.572142 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:04.583757 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:04.595488 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:04.607188 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:04.619109 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:04.630899 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:24:04.752186 tst ping.py:19: start network... 02:24:04.972310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:24:05.484436 run create_hlr_db(pid=29325): Launched 02:24:05.640270 bus /gobi_6: Setting Powered False 02:24:06.701316 run create_hlr_db(pid=29325): Terminated: ok {rc=0} 02:24:07.131549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29328): Launched 02:24:07.447345 run osmo-hlr_10.42.42.2(pid=29329): Launched 02:24:07.682353 run osmo-stp_10.42.42.5: Starting osmo-stp 02:24:08.383995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29331): Launched 02:24:08.710994 run osmo-stp_10.42.42.5(pid=29332): Launched 02:24:08.954606 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:24:09.653465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29334): Launched 02:24:09.781992 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:24:10.043047 run patchelf(pid=29335): Launched 02:24:10.229890 run osmo-stp_10.42.42.5(pid=29332): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29332)] 02:24:10.362736 run osmo-stp_10.42.42.5(pid=29332): stdout: | (launched: 2022-12-14_02:24:08.649976) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:10.496429 run osmo-stp_10.42.42.5(pid=29332): stderr: | [0;m[38;5;43m20221214022408984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022408984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022408984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022408984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022408985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022408985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022408985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:10.631300 run osmo-stp_10.42.42.5(pid=29332): stdout: | (launched: 2022-12-14_02:24:08.649976) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:10.759594 run osmo-stp_10.42.42.5(pid=29332): stderr: | [0;m[38;5;43m20221214022408984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022408984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022408984 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022408984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022408985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022408985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022408985 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:10.911759 run patchelf(pid=29335): Terminating (SIGINT) 02:24:11.087383 run patchelf(pid=29335): Terminated: ok {rc=0} 02:24:11.213260 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29332): Process ended prematurely: osmo-stp_10.42.42.5(pid=29332) [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29332)] [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 02:24:11.223636 tst ping.py:22: Test FAILED (7.2 sec) 02:24:11.252942 run osmo-hlr_10.42.42.2(pid=29329): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29329)] 02:24:11.303013 run osmo-hlr_10.42.42.2(pid=29329): stdout: | (launched: 2022-12-14_02:24:07.390788) 02:24:11.355395 run osmo-hlr_10.42.42.2(pid=29329): stderr: | [0;m[1;31m20221214022407724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022407724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022407724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022407724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022407724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022407724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022407745 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022407758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022407758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022407758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:24:11.408295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29328): Terminating (SIGTERM) 02:24:11.450904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29331): Terminating (SIGTERM) 02:24:11.496529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29334): Terminating (SIGTERM) 02:24:11.541791 --- ParallelTerminationStrategy: PID 29328 died... 02:24:11.562369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29328): Terminated: ok {rc=0} 02:24:11.612095 --- ParallelTerminationStrategy: PID 29331 died... 02:24:11.632436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29331): Terminated: ok {rc=0} 02:24:11.680174 --- ParallelTerminationStrategy: PID 29334 died... 02:24:11.700178 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29334): Terminated: ok {rc=0} 02:24:11.787400 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:24:12.877800 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:12.890461 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:24:12.949541 tst ping_idle_ping.py: using LAC 37889 02:24:13.070712 tst ping_idle_ping.py: using RAC 149 02:24:13.191027 tst ping_idle_ping.py: using CellId 37889 02:24:13.312294 tst ping_idle_ping.py: using BVCI 37890 02:24:13.424845 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:13.436869 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:13.448780 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:13.461512 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:13.472932 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:13.484786 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:13.496912 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:24:13.508750 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:24:13.629142 tst ping_idle_ping.py:24: start network... 02:24:13.835512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:24:14.318305 run create_hlr_db(pid=29336): Launched 02:24:14.481872 bus /gobi_6: Setting Powered False 02:24:15.545218 run create_hlr_db(pid=29336): Terminated: ok {rc=0} 02:24:16.005719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29338): Launched 02:24:16.394937 run osmo-hlr_10.42.42.2(pid=29339): Launched 02:24:16.648554 run osmo-stp_10.42.42.5: Starting osmo-stp 02:24:17.398055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29341): Launched 02:24:17.747326 run osmo-stp_10.42.42.5(pid=29342): Launched 02:24:18.059143 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:24:18.674219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29344): Launched 02:24:18.803711 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:24:19.069475 run patchelf(pid=29345): Launched 02:24:19.254729 run osmo-stp_10.42.42.5(pid=29342): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29342)] 02:24:19.386729 run osmo-stp_10.42.42.5(pid=29342): stdout: | (launched: 2022-12-14_02:24:17.682326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:19.520440 run osmo-stp_10.42.42.5(pid=29342): stderr: | [0;m[38;5;43m20221214022417886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022417886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022417886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022417887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022417887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022417887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022417887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:19.655516 run osmo-stp_10.42.42.5(pid=29342): stdout: | (launched: 2022-12-14_02:24:17.682326) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:19.784253 run osmo-stp_10.42.42.5(pid=29342): stderr: | [0;m[38;5;43m20221214022417886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022417886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022417886 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022417887 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022417887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022417887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022417887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:19.934734 run patchelf(pid=29345): Terminating (SIGINT) 02:24:20.111679 run patchelf(pid=29345): Terminated: ok {rc=0} 02:24:20.237716 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29342): Process ended prematurely: osmo-stp_10.42.42.5(pid=29342) [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29342)] [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:24:20.247985 tst ping_idle_ping.py:27: Test FAILED (7.4 sec) 02:24:20.277257 run osmo-hlr_10.42.42.2(pid=29339): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29339)] 02:24:20.327571 run osmo-hlr_10.42.42.2(pid=29339): stdout: | (launched: 2022-12-14_02:24:16.326489) 02:24:20.379407 run osmo-hlr_10.42.42.2(pid=29339): stderr: | [0;m[1;31m20221214022416636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022416636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022416636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022416636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022416636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022416636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022416663 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022416681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022416682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022416682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:24:20.431986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29338): Terminating (SIGTERM) 02:24:20.475057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29341): Terminating (SIGTERM) 02:24:20.519188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29344): Terminating (SIGTERM) 02:24:20.564911 --- ParallelTerminationStrategy: PID 29338 died... 02:24:20.586515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29338): Terminated: ok {rc=0} 02:24:20.634276 --- ParallelTerminationStrategy: PID 29341 died... 02:24:20.654906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29341): Terminated: ok {rc=0} 02:24:20.702424 --- ParallelTerminationStrategy: PID 29344 died... 02:24:20.722460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29344): Terminated: ok {rc=0} 02:24:20.811896 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:24:22.109554 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:24:22.116385 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:24:22.137685 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:24:22.178020 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:24:22.266573 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:24:22.288266 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:24:22.328255 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:24:22.921060 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:24:22.973279 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:22.984649 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:24:23.041313 tst cs_paging_gprs_active.py: using LAC 37890 02:24:23.165767 tst cs_paging_gprs_active.py: using RAC 150 02:24:23.290613 tst cs_paging_gprs_active.py: using CellId 37890 02:24:23.414310 tst cs_paging_gprs_active.py: using BVCI 37891 02:24:23.530550 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:23.543470 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:23.554972 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:23.567002 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:23.578929 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:23.592808 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:23.604732 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:23.616526 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:23.628630 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:23.752350 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:23.874980 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:24:24.088581 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:24.423968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29349): Launched 02:24:24.709146 run iperf3-srv_10.42.42.10(pid=29350): Launched 02:24:24.833256 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:24:25.054185 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:25.382766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29351): Launched 02:24:25.667209 run iperf3-srv_10.42.42.10(pid=29352): Launched 02:24:25.791025 tst cs_paging_gprs_active.py:38: start network... 02:24:26.011211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:24:26.518937 run create_hlr_db(pid=29353): Launched 02:24:26.643754 bus /gobi_6: Setting Powered False 02:24:27.708646 run create_hlr_db(pid=29353): Terminated: ok {rc=0} 02:24:28.143938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29355): Launched 02:24:28.450456 run osmo-hlr_10.42.42.2(pid=29356): Launched 02:24:28.568922 run osmo-stp_10.42.42.5: Starting osmo-stp 02:24:29.096696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29358): Launched 02:24:29.403160 run osmo-stp_10.42.42.5(pid=29359): Launched 02:24:29.519413 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:24:30.046916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29361): Launched 02:24:30.163106 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:24:30.421376 run patchelf(pid=29362): Launched 02:24:30.590848 run osmo-stp_10.42.42.5(pid=29359): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29359)] 02:24:30.719343 run osmo-stp_10.42.42.5(pid=29359): stdout: | (launched: 2022-12-14_02:24:29.346142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:30.865834 run osmo-stp_10.42.42.5(pid=29359): stderr: | [0;m[38;5;43m20221214022429519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022429519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022429520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022429520 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022429521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022429521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022429521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:31.013895 run osmo-stp_10.42.42.5(pid=29359): stdout: | (launched: 2022-12-14_02:24:29.346142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:31.152623 run osmo-stp_10.42.42.5(pid=29359): stderr: | [0;m[38;5;43m20221214022429519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022429519 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022429520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022429520 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022429521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022429521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022429521 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:31.317053 run patchelf(pid=29362): Terminating (SIGINT) 02:24:31.507332 run patchelf(pid=29362): Terminated: ok {rc=0} 02:24:31.645918 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29359): Process ended prematurely: osmo-stp_10.42.42.5(pid=29359) [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29359)] [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:24:31.658686 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:24:31.690106 run osmo-hlr_10.42.42.2(pid=29356): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29356)] 02:24:31.744168 run osmo-hlr_10.42.42.2(pid=29356): stdout: | (launched: 2022-12-14_02:24:28.393241) 02:24:31.799533 run osmo-hlr_10.42.42.2(pid=29356): stderr: | [0;m[1;31m20221214022428569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022428569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022428569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022428569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022428569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022428569 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022428581 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022428589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022428590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022428590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:24:31.855022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29349): Terminating (SIGTERM) 02:24:31.900129 run iperf3-srv_10.42.42.10(pid=29350): Terminating (SIGTERM) 02:24:31.946078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29351): Terminating (SIGTERM) 02:24:31.991353 run iperf3-srv_10.42.42.10(pid=29352): Terminating (SIGTERM) 02:24:32.037197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29355): Terminating (SIGTERM) 02:24:32.083756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29358): Terminating (SIGTERM) 02:24:32.130046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29361): Terminating (SIGTERM) 02:24:32.174518 --- ParallelTerminationStrategy: PID 29349 died... 02:24:32.195438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29349): Terminated: ok {rc=0} 02:24:32.242963 --- ParallelTerminationStrategy: PID 29350 died... 02:24:32.263327 run iperf3-srv_10.42.42.10(pid=29350): Terminated {rc=256} 02:24:32.310087 --- ParallelTerminationStrategy: PID 29351 died... 02:24:32.330494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29351): Terminated: ok {rc=0} 02:24:32.377512 --- ParallelTerminationStrategy: PID 29352 died... 02:24:32.397818 run iperf3-srv_10.42.42.10(pid=29352): Terminated {rc=256} 02:24:32.444583 --- ParallelTerminationStrategy: PID 29355 died... 02:24:32.465036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29355): Terminated: ok {rc=0} 02:24:32.512281 --- ParallelTerminationStrategy: PID 29358 died... 02:24:32.532755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29358): Terminated: ok {rc=0} 02:24:32.579724 --- ParallelTerminationStrategy: PID 29361 died... 02:24:32.600169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29361): Terminated: ok {rc=0} 02:24:32.690029 bus /gobi_0: Setting Powered False 02:24:33.789283 bus /gobi_0: Setting Powered False 02:24:34.905034 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:24:36.053993 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:36.066054 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:24:36.126767 tst iperf3.py: using LAC 37891 02:24:36.255020 tst iperf3.py: using RAC 151 02:24:36.381941 tst iperf3.py: using CellId 37891 02:24:36.510964 tst iperf3.py: using BVCI 37892 02:24:36.631193 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:36.642645 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:36.653691 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:36.664678 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:36.675993 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:36.687333 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:36.698866 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:36.710176 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:36.721639 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:36.842313 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:24:37.062670 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:37.388365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29363): Launched 02:24:37.671614 run iperf3-srv_10.42.42.10(pid=29364): Launched 02:24:37.793538 tst iperf3.py:8: start network... 02:24:38.012540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:24:38.519862 run create_hlr_db(pid=29365): Launched 02:24:38.643179 bus /gobi_6: Setting Powered False 02:24:39.706532 run create_hlr_db(pid=29365): Terminated: ok {rc=0} 02:24:40.156114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29367): Launched 02:24:40.479176 run osmo-hlr_10.42.42.2(pid=29368): Launched 02:24:40.603402 run osmo-stp_10.42.42.5: Starting osmo-stp 02:24:41.166478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29370): Launched 02:24:41.489332 run osmo-stp_10.42.42.5(pid=29371): Launched 02:24:41.612443 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:24:42.170008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29373): Launched 02:24:42.293908 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:24:42.567822 run patchelf(pid=29374): Launched 02:24:42.747256 run osmo-stp_10.42.42.5(pid=29371): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29371)] 02:24:42.884250 run osmo-stp_10.42.42.5(pid=29371): stdout: | (launched: 2022-12-14_02:24:41.429993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:43.023302 run osmo-stp_10.42.42.5(pid=29371): stderr: | [0;m[38;5;43m20221214022441625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022441625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022441625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022441626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022441626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022441626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022441626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:43.162762 run osmo-stp_10.42.42.5(pid=29371): stdout: | (launched: 2022-12-14_02:24:41.429993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:43.295975 run osmo-stp_10.42.42.5(pid=29371): stderr: | [0;m[38;5;43m20221214022441625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022441625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022441625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022441626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022441626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022441626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022441626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:43.453727 run patchelf(pid=29374): Terminating (SIGINT) 02:24:43.635453 run patchelf(pid=29374): Terminated: ok {rc=0} 02:24:43.767088 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29371): Process ended prematurely: osmo-stp_10.42.42.5(pid=29371) [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29371)] [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 02:24:43.777513 tst iperf3.py:8: Test FAILED (7.8 sec) 02:24:43.805840 run osmo-hlr_10.42.42.2(pid=29368): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29368)] 02:24:43.856705 run osmo-hlr_10.42.42.2(pid=29368): stdout: | (launched: 2022-12-14_02:24:40.419685) 02:24:43.909414 run osmo-hlr_10.42.42.2(pid=29368): stderr: | [0;m[1;31m20221214022440620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022440620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022440621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022440621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022440621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022440621 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022440636 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022440645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022440646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022440646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:24:43.962539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29363): Terminating (SIGTERM) 02:24:44.004911 run iperf3-srv_10.42.42.10(pid=29364): Terminating (SIGTERM) 02:24:44.047307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29367): Terminating (SIGTERM) 02:24:44.089767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29370): Terminating (SIGTERM) 02:24:44.131966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29373): Terminating (SIGTERM) 02:24:44.174178 --- ParallelTerminationStrategy: PID 29363 died... 02:24:44.194610 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29363): Terminated: ok {rc=0} 02:24:44.241412 --- ParallelTerminationStrategy: PID 29364 died... 02:24:44.261246 run iperf3-srv_10.42.42.10(pid=29364): Terminated {rc=256} 02:24:44.307494 --- ParallelTerminationStrategy: PID 29367 died... 02:24:44.327494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29367): Terminated: ok {rc=0} 02:24:44.373872 --- ParallelTerminationStrategy: PID 29370 died... 02:24:44.393858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29370): Terminated: ok {rc=0} 02:24:44.440094 --- ParallelTerminationStrategy: PID 29373 died... 02:24:44.460073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29373): Terminated: ok {rc=0} 02:24:44.548074 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:24:45.696238 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:45.708217 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:24:45.765618 tst iperf3m4.py: using LAC 37892 02:24:45.897532 tst iperf3m4.py: using RAC 152 02:24:46.040397 tst iperf3m4.py: using CellId 37892 02:24:46.168219 tst iperf3m4.py: using BVCI 37893 02:24:46.287804 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:46.299821 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:46.311512 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:46.323327 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:46.335404 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:46.347549 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:46.359852 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:46.371825 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:24:46.384205 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:46.506771 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:46.633004 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:46.771690 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:24:46.919560 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:24:47.218285 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:47.534463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29375): Launched 02:24:47.798971 run iperf3-srv_10.42.42.10(pid=29376): Launched 02:24:47.912203 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:24:48.113835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:48.416930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29377): Launched 02:24:48.683549 run iperf3-srv_10.42.42.10(pid=29378): Launched 02:24:48.796705 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:24:48.997372 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:49.298245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29379): Launched 02:24:49.560108 run iperf3-srv_10.42.42.10(pid=29380): Launched 02:24:49.672371 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:24:49.873410 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:24:50.174945 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29381): Launched 02:24:50.437314 run iperf3-srv_10.42.42.10(pid=29382): Launched 02:24:50.549599 tst iperf3m4.py:8: start network... 02:24:50.750346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:24:51.215584 run create_hlr_db(pid=29383): Launched 02:24:51.340902 bus /gobi_6: Setting Powered False 02:24:52.401245 run create_hlr_db(pid=29383): Terminated: ok {rc=0} 02:24:52.820744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29385): Launched 02:24:53.121841 run osmo-hlr_10.42.42.2(pid=29386): Launched 02:24:53.235140 run osmo-stp_10.42.42.5: Starting osmo-stp 02:24:53.768907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29388): Launched 02:24:54.069935 run osmo-stp_10.42.42.5(pid=29389): Launched 02:24:54.183237 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:24:54.699903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29391): Launched 02:24:54.813998 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:24:55.067334 run patchelf(pid=29392): Launched 02:24:55.233880 run osmo-stp_10.42.42.5(pid=29389): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29389)] 02:24:55.360335 run osmo-stp_10.42.42.5(pid=29389): stdout: | (launched: 2022-12-14_02:24:54.013638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:55.488165 run osmo-stp_10.42.42.5(pid=29389): stderr: | [0;m[38;5;43m20221214022454185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022454185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022454186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022454186 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022454186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022454186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022454186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:55.616345 run osmo-stp_10.42.42.5(pid=29389): stdout: | (launched: 2022-12-14_02:24:54.013638) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:24:55.739026 run osmo-stp_10.42.42.5(pid=29389): stderr: | [0;m[38;5;43m20221214022454185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022454185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022454186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022454186 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022454186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022454186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022454186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:24:55.884590 run patchelf(pid=29392): Terminating (SIGINT) 02:24:56.053761 run patchelf(pid=29392): Terminated: ok {rc=0} 02:24:56.175796 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29389): Process ended prematurely: osmo-stp_10.42.42.5(pid=29389) [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29389)] [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:24:56.185363 tst iperf3m4.py:8: Test FAILED (10.5 sec) 02:24:56.212685 run osmo-hlr_10.42.42.2(pid=29386): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29386)] 02:24:56.260484 run osmo-hlr_10.42.42.2(pid=29386): stdout: | (launched: 2022-12-14_02:24:53.065979) 02:24:56.310184 run osmo-hlr_10.42.42.2(pid=29386): stderr: | [0;m[1;31m20221214022453244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022453244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022453244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022453244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022453244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022453244 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022453256 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022453266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022453266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022453266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:24:56.359944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29375): Terminating (SIGTERM) 02:24:56.399613 run iperf3-srv_10.42.42.10(pid=29376): Terminating (SIGTERM) 02:24:56.439078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29377): Terminating (SIGTERM) 02:24:56.478677 run iperf3-srv_10.42.42.10(pid=29378): Terminating (SIGTERM) 02:24:56.518341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29379): Terminating (SIGTERM) 02:24:56.558064 run iperf3-srv_10.42.42.10(pid=29380): Terminating (SIGTERM) 02:24:56.597561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29381): Terminating (SIGTERM) 02:24:56.637187 run iperf3-srv_10.42.42.10(pid=29382): Terminating (SIGTERM) 02:24:56.676629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29385): Terminating (SIGTERM) 02:24:56.717025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29388): Terminating (SIGTERM) 02:24:56.756564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29391): Terminating (SIGTERM) 02:24:56.796330 --- ParallelTerminationStrategy: PID 29375 died... 02:24:56.815442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29375): Terminated: ok {rc=0} 02:24:56.859258 --- ParallelTerminationStrategy: PID 29376 died... 02:24:56.877656 run iperf3-srv_10.42.42.10(pid=29376): Terminated {rc=256} 02:24:56.921240 --- ParallelTerminationStrategy: PID 29377 died... 02:24:56.939691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29377): Terminated: ok {rc=0} 02:24:56.983354 --- ParallelTerminationStrategy: PID 29378 died... 02:24:57.001743 run iperf3-srv_10.42.42.10(pid=29378): Terminated {rc=256} 02:24:57.045001 --- ParallelTerminationStrategy: PID 29379 died... 02:24:57.063342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29379): Terminated: ok {rc=0} 02:24:57.106925 --- ParallelTerminationStrategy: PID 29380 died... 02:24:57.125202 run iperf3-srv_10.42.42.10(pid=29380): Terminated {rc=256} 02:24:57.168584 --- ParallelTerminationStrategy: PID 29381 died... 02:24:57.186912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29381): Terminated: ok {rc=0} 02:24:57.230297 --- ParallelTerminationStrategy: PID 29382 died... 02:24:57.248662 run iperf3-srv_10.42.42.10(pid=29382): Terminated {rc=256} 02:24:57.292400 --- ParallelTerminationStrategy: PID 29385 died... 02:24:57.310963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29385): Terminated: ok {rc=0} 02:24:57.354634 --- ParallelTerminationStrategy: PID 29388 died... 02:24:57.372926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29388): Terminated: ok {rc=0} 02:24:57.416581 --- ParallelTerminationStrategy: PID 29391 died... 02:24:57.435072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29391): Terminated: ok {rc=0} 02:24:57.520088 bus /gobi_4: Setting Powered False 02:24:58.620095 bus /gobi_4: Setting Powered False 02:24:59.733388 bus /gobi_1: Setting Powered False 02:25:00.838596 bus /gobi_1: Setting Powered False 02:25:01.967594 bus /gobi_0: Setting Powered False 02:25:03.077512 bus /gobi_0: Setting Powered False 02:25:04.195436 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:25:05.300135 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:05.311600 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:25:05.368846 tst ping.py: using LAC 37893 02:25:05.497807 tst ping.py: using RAC 153 02:25:05.621902 tst ping.py: using CellId 37893 02:25:05.744222 tst ping.py: using BVCI 37894 02:25:05.859592 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:05.870969 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:05.882017 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:05.893044 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:05.904362 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:05.915597 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:05.927110 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:05.938414 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:25:06.054113 tst ping.py:19: start network... 02:25:06.251738 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:25:06.707619 run create_hlr_db(pid=29397): Launched 02:25:06.829559 bus /gobi_6: Setting Powered False 02:25:07.888285 run create_hlr_db(pid=29397): Terminated: ok {rc=0} 02:25:08.320878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29399): Launched 02:25:08.638517 run osmo-hlr_10.42.42.2(pid=29400): Launched 02:25:08.759276 run osmo-stp_10.42.42.5: Starting osmo-stp 02:25:09.313437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29402): Launched 02:25:09.630336 run osmo-stp_10.42.42.5(pid=29403): Launched 02:25:09.750670 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:25:10.297761 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29405): Launched 02:25:10.421372 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:25:10.689996 run patchelf(pid=29406): Launched 02:25:10.866413 run osmo-stp_10.42.42.5(pid=29403): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29403)] 02:25:11.000517 run osmo-stp_10.42.42.5(pid=29403): stdout: | (launched: 2022-12-14_02:25:09.571565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:11.136644 run osmo-stp_10.42.42.5(pid=29403): stderr: | [0;m[38;5;43m20221214022509764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022509764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022509764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022509765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022509765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022509765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022509765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:11.272395 run osmo-stp_10.42.42.5(pid=29403): stdout: | (launched: 2022-12-14_02:25:09.571565) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:11.403016 run osmo-stp_10.42.42.5(pid=29403): stderr: | [0;m[38;5;43m20221214022509764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022509764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022509764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022509765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022509765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022509765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022509765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:11.557268 run patchelf(pid=29406): Terminating (SIGINT) 02:25:11.735707 run patchelf(pid=29406): Terminated: ok {rc=0} 02:25:11.864519 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29403): Process ended prematurely: osmo-stp_10.42.42.5(pid=29403) [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29403)] [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 02:25:11.874099 tst ping.py:22: Test FAILED (6.6 sec) 02:25:11.902038 run osmo-hlr_10.42.42.2(pid=29400): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29400)] 02:25:11.953086 run osmo-hlr_10.42.42.2(pid=29400): stdout: | (launched: 2022-12-14_02:25:08.580071) 02:25:12.006297 run osmo-hlr_10.42.42.2(pid=29400): stderr: | [0;m[1;31m20221214022508779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022508779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022508779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022508779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022508779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022508779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022508792 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022508800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022508800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022508800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:25:12.058964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29399): Terminating (SIGTERM) 02:25:12.101610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29402): Terminating (SIGTERM) 02:25:12.144579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29405): Terminating (SIGTERM) 02:25:12.187220 --- ParallelTerminationStrategy: PID 29399 died... 02:25:12.207643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29399): Terminated: ok {rc=0} 02:25:12.254379 --- ParallelTerminationStrategy: PID 29402 died... 02:25:12.274436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29402): Terminated: ok {rc=0} 02:25:12.321221 --- ParallelTerminationStrategy: PID 29405 died... 02:25:12.341181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29405): Terminated: ok {rc=0} 02:25:12.429368 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:25:13.516910 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:13.528911 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:25:13.589413 tst ping_idle_ping.py: using LAC 37894 02:25:13.716653 tst ping_idle_ping.py: using RAC 154 02:25:13.834480 tst ping_idle_ping.py: using CellId 37894 02:25:13.961976 tst ping_idle_ping.py: using BVCI 37895 02:25:14.079875 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:14.091169 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:14.102327 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:14.113446 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:14.124654 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:14.136078 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:14.147548 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:25:14.158885 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:25:14.276389 tst ping_idle_ping.py:24: start network... 02:25:14.474133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:25:14.940488 run create_hlr_db(pid=29408): Launched 02:25:15.061862 bus /gobi_6: Setting Powered False 02:25:16.144277 run create_hlr_db(pid=29408): Terminated: ok {rc=0} 02:25:16.624891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29410): Launched 02:25:17.004940 run osmo-hlr_10.42.42.2(pid=29411): Launched 02:25:17.288026 run osmo-stp_10.42.42.5: Starting osmo-stp 02:25:17.851466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29413): Launched 02:25:18.170569 run osmo-stp_10.42.42.5(pid=29414): Launched 02:25:18.292781 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:25:18.842228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29416): Launched 02:25:18.964543 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:25:19.248707 run patchelf(pid=29417): Launched 02:25:19.423867 run osmo-stp_10.42.42.5(pid=29414): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29414)] 02:25:19.557866 run osmo-stp_10.42.42.5(pid=29414): stdout: | (launched: 2022-12-14_02:25:18.112038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:19.693244 run osmo-stp_10.42.42.5(pid=29414): stderr: | [0;m[38;5;43m20221214022518303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022518303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022518304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022518304 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022518305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022518305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022518305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:19.828579 run osmo-stp_10.42.42.5(pid=29414): stdout: | (launched: 2022-12-14_02:25:18.112038) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:19.958484 run osmo-stp_10.42.42.5(pid=29414): stderr: | [0;m[38;5;43m20221214022518303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022518303 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022518304 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022518304 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022518305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022518305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022518305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:20.112509 run patchelf(pid=29417): Terminating (SIGINT) 02:25:20.290715 run patchelf(pid=29417): Terminated: ok {rc=0} 02:25:20.419064 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29414): Process ended prematurely: osmo-stp_10.42.42.5(pid=29414) [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29414)] [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:25:20.428483 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 02:25:20.456393 run osmo-hlr_10.42.42.2(pid=29411): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29411)] 02:25:20.507309 run osmo-hlr_10.42.42.2(pid=29411): stdout: | (launched: 2022-12-14_02:25:16.937977) 02:25:20.559624 run osmo-hlr_10.42.42.2(pid=29411): stderr: | [0;m[1;31m20221214022517173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022517173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022517173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022517173 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022517174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022517174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022517195 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022517211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022517211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022517211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:25:20.612575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29410): Terminating (SIGTERM) 02:25:20.654615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29413): Terminating (SIGTERM) 02:25:20.697197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29416): Terminating (SIGTERM) 02:25:20.739719 --- ParallelTerminationStrategy: PID 29410 died... 02:25:20.760058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29410): Terminated: ok {rc=0} 02:25:20.806613 --- ParallelTerminationStrategy: PID 29413 died... 02:25:20.826510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29413): Terminated: ok {rc=0} 02:25:20.873171 --- ParallelTerminationStrategy: PID 29416 died... 02:25:20.892866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29416): Terminated: ok {rc=0} 02:25:20.981698 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:25:22.274543 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:25:22.281790 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:25:22.302603 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:25:22.338602 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:25:22.391367 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:25:22.411419 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:25:22.444616 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:25:23.002909 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2398 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:25:23.007831 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:23.018752 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:25:23.072242 tst switch_tch_pdch.py: using LAC 37895 02:25:23.187220 tst switch_tch_pdch.py: using RAC 155 02:25:23.300272 tst switch_tch_pdch.py: using CellId 37895 02:25:23.413517 tst switch_tch_pdch.py: using BVCI 37896 02:25:23.519422 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:23.530602 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:23.541404 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:23.552104 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:23.562816 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:23.574094 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:23.585660 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:25:23.596386 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:25:23.714181 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:25:23.830774 tst switch_tch_pdch.py:51: start network... 02:25:24.026014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:25:24.477292 run create_hlr_db(pid=29421): Launched 02:25:24.597078 bus /gobi_6: Setting Powered False 02:25:25.656288 run create_hlr_db(pid=29421): Terminated: ok {rc=0} 02:25:26.063849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29423): Launched 02:25:26.353648 run osmo-hlr_10.42.42.2(pid=29424): Launched 02:25:26.463480 run osmo-stp_10.42.42.5: Starting osmo-stp 02:25:26.981929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29426): Launched 02:25:27.272911 run osmo-stp_10.42.42.5(pid=29427): Launched 02:25:27.383349 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:25:27.887572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29429): Launched 02:25:27.998974 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:25:28.244877 run patchelf(pid=29430): Launched 02:25:28.406632 run osmo-stp_10.42.42.5(pid=29427): ERR: Terminated: ERROR {rc=1} [trial-2398↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29427)] 02:25:28.530224 run osmo-stp_10.42.42.5(pid=29427): stdout: | (launched: 2022-12-14_02:25:27.219754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:28.655386 run osmo-stp_10.42.42.5(pid=29427): stderr: | [0;m[38;5;43m20221214022527389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022527390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022527390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022527390 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022527391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022527391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022527391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:28.780211 run osmo-stp_10.42.42.5(pid=29427): stdout: | (launched: 2022-12-14_02:25:27.219754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:28.899948 run osmo-stp_10.42.42.5(pid=29427): stderr: | [0;m[38;5;43m20221214022527389 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022527390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022527390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022527390 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022527391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022527391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022527391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:29.042575 run patchelf(pid=29430): Terminating (SIGINT) 02:25:29.207520 run patchelf(pid=29430): Terminated: ok {rc=0} 02:25:29.326422 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29427): Process ended prematurely: osmo-stp_10.42.42.5(pid=29427) [trial-2398↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29427)] [trial-2398↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:25:29.335024 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 02:25:29.361311 run osmo-hlr_10.42.42.2(pid=29424): ERR: Terminated: ERROR {rc=237} [trial-2398↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29424)] 02:25:29.408434 run osmo-hlr_10.42.42.2(pid=29424): stdout: | (launched: 2022-12-14_02:25:26.301122) 02:25:29.457274 run osmo-hlr_10.42.42.2(pid=29424): stderr: | [0;m[1;31m20221214022526475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022526475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022526475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022526475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022526475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022526475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022526489 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022526499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022526499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022526499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:25:29.506513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29423): Terminating (SIGTERM) 02:25:29.545852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29426): Terminating (SIGTERM) 02:25:29.585231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29429): Terminating (SIGTERM) 02:25:29.624624 --- ParallelTerminationStrategy: PID 29423 died... 02:25:29.643574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29423): Terminated: ok {rc=0} 02:25:29.686841 --- ParallelTerminationStrategy: PID 29426 died... 02:25:29.705077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29426): Terminated: ok {rc=0} 02:25:29.748281 --- ParallelTerminationStrategy: PID 29429 died... 02:25:29.766506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29429): Terminated: ok {rc=0} 02:25:29.849178 bus /gobi_0: Setting Powered False 02:25:30.942480 bus /gobi_0: Setting Powered False 02:25:32.061939 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:25:33.304398 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:25:33.309982 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:25:33.329919 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:25:33.363338 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:25:33.414868 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:25:33.435244 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:25:33.469590 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:25:34.022244 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2398 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:25:34.027453 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:34.038251 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:25:34.094874 tst switch_tch_pdch.py: using LAC 37896 02:25:34.211675 tst switch_tch_pdch.py: using RAC 156 02:25:34.326106 tst switch_tch_pdch.py: using CellId 37896 02:25:34.440233 tst switch_tch_pdch.py: using BVCI 37897 02:25:34.545166 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:34.555819 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:34.566337 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:34.576743 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:34.587058 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:34.597818 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:34.608736 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:25:34.619664 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:25:34.738589 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:25:34.854705 tst switch_tch_pdch.py:51: start network... 02:25:35.050830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:25:35.477349 run create_hlr_db(pid=29436): Launched 02:25:35.595905 bus /gobi_6: Setting Powered False 02:25:36.655117 run create_hlr_db(pid=29436): Terminated: ok {rc=0} 02:25:37.056578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29438): Launched 02:25:37.369485 run osmo-hlr_10.42.42.2(pid=29439): Launched 02:25:37.489637 run osmo-stp_10.42.42.5: Starting osmo-stp 02:25:37.999655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29441): Launched 02:25:38.311802 run osmo-stp_10.42.42.5(pid=29442): Launched 02:25:38.431763 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:25:38.944741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29444): Launched 02:25:39.065528 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:25:39.329152 run patchelf(pid=29445): Launched 02:25:39.503994 run osmo-stp_10.42.42.5(pid=29442): ERR: Terminated: ERROR {rc=1} [trial-2398↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29442)] 02:25:39.636766 run osmo-stp_10.42.42.5(pid=29442): stdout: | (launched: 2022-12-14_02:25:38.255583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:39.770855 run osmo-stp_10.42.42.5(pid=29442): stderr: | [0;m[38;5;43m20221214022538446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022538446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022538447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022538447 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022538448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022538448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022538448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:39.904851 run osmo-stp_10.42.42.5(pid=29442): stdout: | (launched: 2022-12-14_02:25:38.255583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:40.034822 run osmo-stp_10.42.42.5(pid=29442): stderr: | [0;m[38;5;43m20221214022538446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022538446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022538447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022538447 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022538448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022538448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022538448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:40.187391 run patchelf(pid=29445): Terminating (SIGINT) 02:25:40.363826 run patchelf(pid=29445): Terminated: ok {rc=0} 02:25:40.491357 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29442): Process ended prematurely: osmo-stp_10.42.42.5(pid=29442) [trial-2398↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29442)] [trial-2398↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 02:25:40.500758 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 02:25:40.528262 run osmo-hlr_10.42.42.2(pid=29439): ERR: Terminated: ERROR {rc=237} [trial-2398↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29439)] 02:25:40.578720 run osmo-hlr_10.42.42.2(pid=29439): stdout: | (launched: 2022-12-14_02:25:37.313205) 02:25:40.630615 run osmo-hlr_10.42.42.2(pid=29439): stderr: | [0;m[1;31m20221214022537508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022537508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022537508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022537509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022537509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022537509 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022537522 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022537532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022537532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022537532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:25:40.683412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29438): Terminating (SIGTERM) 02:25:40.725488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29441): Terminating (SIGTERM) 02:25:40.767348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29444): Terminating (SIGTERM) 02:25:40.809953 --- ParallelTerminationStrategy: PID 29438 died... 02:25:40.829979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29438): Terminated: ok {rc=0} 02:25:40.876092 --- ParallelTerminationStrategy: PID 29441 died... 02:25:40.895724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29441): Terminated: ok {rc=0} 02:25:40.941719 --- ParallelTerminationStrategy: PID 29444 died... 02:25:40.961457 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29444): Terminated: ok {rc=0} 02:25:41.050302 bus /gobi_0: Setting Powered False 02:25:42.147979 bus /gobi_0: Setting Powered False 02:25:43.262130 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_sms:trx-b200 --------------------------------------------------------------------- 02:25:44.492480 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:25:44.496511 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 02:25:44.528405 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 02:25:44.534951 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 02:25:44.590970 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 02:25:44.624604 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 02:25:44.631636 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 02:25:45.169271 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 02:25:45.174427 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 02:25:45.185626 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 02:25:45.235678 tst mo_mt_sms.py: using LAC 37897 02:25:45.357930 tst mo_mt_sms.py: using RAC 157 02:25:45.479093 tst mo_mt_sms.py: using CellId 37897 02:25:45.601120 tst mo_mt_sms.py: using BVCI 37898 02:25:45.715225 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 02:25:45.829888 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 02:25:45.958246 tst mo_mt_sms.py:9: start nitb and bts... 02:25:46.175496 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:25:46.831306 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29450): Launched 02:25:47.172277 run osmo-nitb_10.42.42.2(pid=29451): Launched 02:25:47.370649 run osmo-nitb_10.42.42.2(pid=29451): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29451)] 02:25:47.512394 run osmo-nitb_10.42.42.2(pid=29451): stdout: | (launched: 2022-12-14_02:25:47.111440) 02:25:47.655566 run osmo-nitb_10.42.42.2(pid=29451): stderr: | (launched: 2022-12-14_02:25:47.155372) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:25:47.798750 run osmo-nitb_10.42.42.2(pid=29451): stdout: | (launched: 2022-12-14_02:25:47.111440) 02:25:47.936373 run osmo-nitb_10.42.42.2(pid=29451): stderr: | (launched: 2022-12-14_02:25:47.155372) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29451): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29451) [trial-2398↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29451)] 02:25:48.315485 tst osmo-nitb_10.42.42.2(pid=29451): stdout: | (launched: 2022-12-14_02:25:47.111440) 02:25:48.442363 tst osmo-nitb_10.42.42.2(pid=29451): stderr: | (launched: 2022-12-14_02:25:47.155372) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:25:48.591999 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=29451): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29451) [trial-2398↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29451)] [trial-2398↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 02:25:48.601198 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 02:25:48.608406 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29450): Terminating (SIGTERM) 02:25:48.819278 --- ParallelTerminationStrategy: PID 29450 died... 02:25:48.840850 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29450): Terminated: ok {rc=0} 02:25:48.928665 bus /sierra_3: Setting Powered False 02:25:50.027731 bus /sierra_3: Setting Powered False 02:25:51.146777 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 sms:trx-b200 --------------------------------------------------------------------- 02:25:52.342615 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:25:52.346726 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 02:25:52.378686 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 02:25:52.404527 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 02:25:52.455807 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 02:25:52.487786 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 02:25:52.513423 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 02:25:53.058742 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 02:25:53.063598 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:53.074213 tst sms:trx-b200: Using 1 x bts (candidates: 1) 02:25:53.124879 tst mo_mt_sms.py: using LAC 37898 02:25:53.239483 tst mo_mt_sms.py: using RAC 158 02:25:53.352703 tst mo_mt_sms.py: using CellId 37898 02:25:53.465750 tst mo_mt_sms.py: using BVCI 37899 02:25:53.581419 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:53.592124 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:53.602891 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:53.613570 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:53.624577 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 02:25:53.636051 tst sms:trx-b200: Using 1 x modem (candidates: 2) 02:25:53.750596 tst sms:trx-b200: Using 1 x modem (candidates: 2) 02:25:53.868258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:25:54.353872 run create_hlr_db(pid=29455): Launched 02:25:54.473958 bus /sierra_2: Setting Powered False 02:25:55.535879 run create_hlr_db(pid=29455): Terminated: ok {rc=0} 02:25:55.954388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29457): Launched 02:25:56.244726 run osmo-hlr_10.42.42.2(pid=29458): Launched 02:25:56.357187 run osmo-stp_10.42.42.5: Starting osmo-stp 02:25:56.856648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29460): Launched 02:25:57.146803 run osmo-stp_10.42.42.5(pid=29461): Launched 02:25:57.257655 run osmo-msc_10.42.42.6: Starting osmo-msc 02:25:57.782962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29463): Launched 02:25:58.073030 run osmo-msc_10.42.42.6(pid=29464): Launched 02:25:58.235015 run osmo-stp_10.42.42.5(pid=29461): ERR: Terminated: ERROR {rc=1} [trial-2398↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29461)] 02:25:58.358149 run osmo-stp_10.42.42.5(pid=29461): stdout: | (launched: 2022-12-14_02:25:57.093664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:58.481257 run osmo-stp_10.42.42.5(pid=29461): stderr: | [0;m[38;5;43m20221214022557262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022557262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022557262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022557263 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022557263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022557263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022557263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:58.602352 run osmo-stp_10.42.42.5(pid=29461): stdout: | (launched: 2022-12-14_02:25:57.093664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:25:58.718205 run osmo-stp_10.42.42.5(pid=29461): stderr: | [0;m[38;5;43m20221214022557262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022557262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022557262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022557263 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022557263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022557263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022557263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:25:58.856651 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29461): Process ended prematurely: osmo-stp_10.42.42.5(pid=29461) [trial-2398↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29461)] [trial-2398↪sms:trx-b200↪mo_mt_sms.py:16] 02:25:58.865286 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 02:25:58.890600 run osmo-hlr_10.42.42.2(pid=29458): ERR: Terminated: ERROR {rc=237} [trial-2398↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29458)] 02:25:58.938344 run osmo-hlr_10.42.42.2(pid=29458): stdout: | (launched: 2022-12-14_02:25:56.192051) 02:25:58.987117 run osmo-hlr_10.42.42.2(pid=29458): stderr: | [0;m[1;31m20221214022556365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022556365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022556365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022556365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022556365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022556365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022556382 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022556391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022556391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022556392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:25:59.054938 run osmo-msc_10.42.42.6(pid=29464): ERR: Terminated: ERROR {rc=2} [trial-2398↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29464)] 02:25:59.101728 run osmo-msc_10.42.42.6(pid=29464): stdout: | (launched: 2022-12-14_02:25:58.019625) 02:25:59.150191 run osmo-msc_10.42.42.6(pid=29464): stderr: | [0;m[38;5;43m20221214022558289 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022558289 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdfeba29c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022558289 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022558289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022558289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022558290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022558291 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022558292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022558292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022558292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:25:59.199952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29457): Terminating (SIGTERM) 02:25:59.238988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29460): Terminating (SIGTERM) 02:25:59.278095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29463): Terminating (SIGTERM) 02:25:59.317428 --- ParallelTerminationStrategy: PID 29457 died... 02:25:59.336228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29457): Terminated: ok {rc=0} 02:25:59.379223 --- ParallelTerminationStrategy: PID 29460 died... 02:25:59.397415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29460): Terminated: ok {rc=0} 02:25:59.440422 --- ParallelTerminationStrategy: PID 29463 died... 02:25:59.458611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29463): Terminated: ok {rc=0} 02:25:59.542822 bus /sierra_3: Setting Powered False 02:26:00.639983 bus /sierra_3: Setting Powered False 02:26:01.772594 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_ussd:trx-b200 --------------------------------------------------------------------- 02:26:03.001406 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:26:03.005818 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 02:26:03.039320 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 02:26:03.046775 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 02:26:03.082006 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 02:26:03.116049 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 02:26:03.123326 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 02:26:03.641776 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2398 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 02:26:03.646882 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 02:26:03.657917 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 02:26:03.707720 tst assert_extension.py: using LAC 37899 02:26:03.830744 tst assert_extension.py: using RAC 159 02:26:03.953121 tst assert_extension.py: using CellId 37899 02:26:04.077771 tst assert_extension.py: using BVCI 37900 02:26:04.193797 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 02:26:04.309177 tst assert_extension.py:10: start nitb and bts... 02:26:04.503406 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:26:05.099809 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29469): Launched 02:26:05.390518 run osmo-nitb_10.42.42.2(pid=29470): Launched 02:26:05.551796 run osmo-nitb_10.42.42.2(pid=29470): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29470)] 02:26:05.682677 run osmo-nitb_10.42.42.2(pid=29470): stdout: | (launched: 2022-12-14_02:26:05.337943) 02:26:05.814861 run osmo-nitb_10.42.42.2(pid=29470): stderr: | (launched: 2022-12-14_02:26:05.381242) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:26:05.946848 run osmo-nitb_10.42.42.2(pid=29470): stdout: | (launched: 2022-12-14_02:26:05.337943) 02:26:06.074098 run osmo-nitb_10.42.42.2(pid=29470): stderr: | (launched: 2022-12-14_02:26:05.381242) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29470): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29470) [trial-2398↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29470)] 02:26:06.500296 tst osmo-nitb_10.42.42.2(pid=29470): stdout: | (launched: 2022-12-14_02:26:05.337943) 02:26:06.618320 tst osmo-nitb_10.42.42.2(pid=29470): stderr: | (launched: 2022-12-14_02:26:05.381242) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:26:06.756330 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29470): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29470) [trial-2398↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29470)] [trial-2398↪nitb_ussd:trx-b200↪assert_extension.py:12] 02:26:06.764712 tst assert_extension.py:12: Test FAILED (3.1 sec) 02:26:06.771181 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29469): Terminating (SIGTERM) 02:26:06.979263 --- ParallelTerminationStrategy: PID 29469 died... 02:26:06.999845 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29469): Terminated: ok {rc=0} 02:26:07.085132 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 ussd:trx-b200 --------------------------------------------------------------------- 02:26:08.261427 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:26:08.265239 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 02:26:08.297184 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 02:26:08.323265 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 02:26:08.357465 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 02:26:08.389413 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 02:26:08.415082 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 02:26:08.945291 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2398 ussd:trx-b200 assert_extension.py ---------------------------------------------- 02:26:08.950074 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:08.960320 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 02:26:09.007418 tst assert_extension.py: using LAC 37900 02:26:09.122617 tst assert_extension.py: using RAC 160 02:26:09.237686 tst assert_extension.py: using CellId 37900 02:26:09.363591 tst assert_extension.py: using BVCI 37901 02:26:09.479452 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:09.490701 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:09.501641 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:09.512341 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:09.523904 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 02:26:09.534992 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 02:26:09.651869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:26:10.102487 run create_hlr_db(pid=29474): Launched 02:26:10.222224 bus /sierra_2: Setting Powered False 02:26:11.281780 run create_hlr_db(pid=29474): Terminated: ok {rc=0} 02:26:11.709548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29476): Launched 02:26:12.022327 run osmo-hlr_10.42.42.2(pid=29477): Launched 02:26:12.142719 run osmo-stp_10.42.42.5: Starting osmo-stp 02:26:12.683259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29479): Launched 02:26:12.996728 run osmo-stp_10.42.42.5(pid=29480): Launched 02:26:13.117595 run osmo-msc_10.42.42.6: Starting osmo-msc 02:26:13.681485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29482): Launched 02:26:13.992366 run osmo-msc_10.42.42.6(pid=29483): Launched 02:26:14.167935 run osmo-stp_10.42.42.5(pid=29480): ERR: Terminated: ERROR {rc=1} [trial-2398↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29480)] 02:26:14.301295 run osmo-stp_10.42.42.5(pid=29480): stdout: | (launched: 2022-12-14_02:26:12.940027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:14.435146 run osmo-stp_10.42.42.5(pid=29480): stderr: | [0;m[38;5;43m20221214022613130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022613130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022613130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022613131 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022613131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022613131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022613131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:14.567590 run osmo-stp_10.42.42.5(pid=29480): stdout: | (launched: 2022-12-14_02:26:12.940027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:14.692404 run osmo-stp_10.42.42.5(pid=29480): stderr: | [0;m[38;5;43m20221214022613130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022613130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022613130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022613131 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022613131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022613131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022613131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:14.841927 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29480): Process ended prematurely: osmo-stp_10.42.42.5(pid=29480) [trial-2398↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29480)] [trial-2398↪ussd:trx-b200↪assert_extension.py:17] 02:26:14.850788 tst assert_extension.py:17: Test FAILED (5.9 sec) 02:26:14.877889 run osmo-hlr_10.42.42.2(pid=29477): ERR: Terminated: ERROR {rc=237} [trial-2398↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29477)] 02:26:14.928748 run osmo-hlr_10.42.42.2(pid=29477): stdout: | (launched: 2022-12-14_02:26:11.965925) 02:26:14.981143 run osmo-hlr_10.42.42.2(pid=29477): stderr: | [0;m[1;31m20221214022612163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022612163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022612163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022612163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022612163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022612163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022612175 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022612185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022612185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022612185 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:26:15.054134 run osmo-msc_10.42.42.6(pid=29483): ERR: Terminated: ERROR {rc=2} [trial-2398↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29483)] 02:26:15.104473 run osmo-msc_10.42.42.6(pid=29483): stdout: | (launched: 2022-12-14_02:26:13.935855) 02:26:15.157232 run osmo-msc_10.42.42.6(pid=29483): stderr: | [0;m[38;5;43m20221214022614253 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022614254 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc6597ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022614254 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022614254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022614254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022614254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022614256 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022614256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022614256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022614256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:26:15.209524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29476): Terminating (SIGTERM) 02:26:15.251394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29479): Terminating (SIGTERM) 02:26:15.293347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29482): Terminating (SIGTERM) 02:26:15.335807 --- ParallelTerminationStrategy: PID 29476 died... 02:26:15.355816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29476): Terminated: ok {rc=0} 02:26:15.402260 --- ParallelTerminationStrategy: PID 29479 died... 02:26:15.422100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29479): Terminated: ok {rc=0} 02:26:15.468356 --- ParallelTerminationStrategy: PID 29482 died... 02:26:15.488255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29482): Terminated: ok {rc=0} 02:26:15.576170 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:26:16.787919 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:26:16.798234 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:26:16.841515 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:26:16.871269 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:26:16.922949 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:26:16.957403 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:26:16.985874 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:26:17.536256 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:26:17.589579 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:17.601058 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:26:17.674383 tst mo_mt_call.py: using LAC 37901 02:26:17.792897 tst mo_mt_call.py: using RAC 161 02:26:17.908881 tst mo_mt_call.py: using CellId 37901 02:26:18.027162 tst mo_mt_call.py: using BVCI 37902 02:26:18.135500 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:18.146408 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:18.156942 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:18.167665 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:18.178381 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:18.189453 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:26:18.309566 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:26:18.425426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:26:18.886110 run create_hlr_db(pid=29488): Launched 02:26:19.007518 bus /sierra_2: Setting Powered False 02:26:20.070484 run create_hlr_db(pid=29488): Terminated: ok {rc=0} 02:26:20.514127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29490): Launched 02:26:20.831651 run osmo-hlr_10.42.42.2(pid=29491): Launched 02:26:20.952631 run osmo-stp_10.42.42.5: Starting osmo-stp 02:26:21.505413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29493): Launched 02:26:21.822313 run osmo-stp_10.42.42.5(pid=29494): Launched 02:26:21.943008 run osmo-msc_10.42.42.6: Starting osmo-msc 02:26:22.521643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29496): Launched 02:26:22.839141 run osmo-msc_10.42.42.6(pid=29497): Launched 02:26:23.016211 run osmo-stp_10.42.42.5(pid=29494): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29494)] 02:26:23.151648 run osmo-stp_10.42.42.5(pid=29494): stdout: | (launched: 2022-12-14_02:26:21.765369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:23.286768 run osmo-stp_10.42.42.5(pid=29494): stderr: | [0;m[38;5;43m20221214022621960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022621960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022621960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022621961 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022621961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022621961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022621961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:23.421657 run osmo-stp_10.42.42.5(pid=29494): stdout: | (launched: 2022-12-14_02:26:21.765369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:23.549601 run osmo-stp_10.42.42.5(pid=29494): stderr: | [0;m[38;5;43m20221214022621960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022621960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022621960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022621961 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022621961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022621961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022621961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:23.702312 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29494): Process ended prematurely: osmo-stp_10.42.42.5(pid=29494) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29494)] [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:26:23.711820 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:26:23.739248 run osmo-hlr_10.42.42.2(pid=29491): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29491)] 02:26:23.789769 run osmo-hlr_10.42.42.2(pid=29491): stdout: | (launched: 2022-12-14_02:26:20.774428) 02:26:23.841761 run osmo-hlr_10.42.42.2(pid=29491): stderr: | [0;m[1;31m20221214022620972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022620972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022620972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022620972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022620972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022620972 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022620984 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022620992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022620993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022620993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:26:23.914305 run osmo-msc_10.42.42.6(pid=29497): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29497)] 02:26:23.964260 run osmo-msc_10.42.42.6(pid=29497): stdout: | (launched: 2022-12-14_02:26:22.781712) 02:26:24.016010 run osmo-msc_10.42.42.6(pid=29497): stderr: | [0;m[38;5;43m20221214022623103 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022623103 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f798d418c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022623103 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022623103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022623103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022623104 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022623106 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022623106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022623106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022623106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:26:24.068862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29490): Terminating (SIGTERM) 02:26:24.110796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29493): Terminating (SIGTERM) 02:26:24.153302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29496): Terminating (SIGTERM) 02:26:24.195988 --- ParallelTerminationStrategy: PID 29490 died... 02:26:24.216175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29490): Terminated: ok {rc=0} 02:26:24.262571 --- ParallelTerminationStrategy: PID 29493 died... 02:26:24.282266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29493): Terminated: ok {rc=0} 02:26:24.328468 --- ParallelTerminationStrategy: PID 29496 died... 02:26:24.348265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29496): Terminated: ok {rc=0} 02:26:24.435591 bus /sierra_3: Setting Powered False 02:26:25.533695 bus /sierra_3: Setting Powered False 02:26:26.649942 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:26:27.798688 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:27.810692 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:26:27.884261 tst mo_mt_call_osmux.py: using LAC 37902 02:26:28.010087 tst mo_mt_call_osmux.py: using RAC 162 02:26:28.137376 tst mo_mt_call_osmux.py: using CellId 37902 02:26:28.262288 tst mo_mt_call_osmux.py: using BVCI 37903 02:26:28.378716 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:28.390198 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:28.401584 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:28.412708 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:28.424357 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:26:28.435869 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:26:28.554571 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:26:28.673245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:26:29.167842 run create_hlr_db(pid=29499): Launched 02:26:29.289540 bus /sierra_2: Setting Powered False 02:26:30.353577 run create_hlr_db(pid=29499): Terminated: ok {rc=0} 02:26:30.779063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29501): Launched 02:26:31.115198 run osmo-hlr_10.42.42.2(pid=29502): Launched 02:26:31.347324 run osmo-stp_10.42.42.5: Starting osmo-stp 02:26:32.007740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29504): Launched 02:26:32.326506 run osmo-stp_10.42.42.5(pid=29505): Launched 02:26:32.464576 run osmo-msc_10.42.42.6: Starting osmo-msc 02:26:33.043655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29507): Launched 02:26:33.345421 run osmo-msc_10.42.42.6(pid=29508): Launched 02:26:33.512031 run osmo-stp_10.42.42.5(pid=29505): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29505)] 02:26:33.638127 run osmo-stp_10.42.42.5(pid=29505): stdout: | (launched: 2022-12-14_02:26:32.258413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:33.765346 run osmo-stp_10.42.42.5(pid=29505): stderr: | [0;m[38;5;43m20221214022632471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022632472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022632472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022632472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022632473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022632473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022632473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:33.889759 run osmo-stp_10.42.42.5(pid=29505): stdout: | (launched: 2022-12-14_02:26:32.258413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:34.007907 run osmo-stp_10.42.42.5(pid=29505): stderr: | [0;m[38;5;43m20221214022632471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022632472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022632472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022632472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022632473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022632473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022632473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:34.149743 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29505): Process ended prematurely: osmo-stp_10.42.42.5(pid=29505) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29505)] [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:26:34.158753 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 02:26:34.184758 run osmo-hlr_10.42.42.2(pid=29502): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29502)] 02:26:34.232636 run osmo-hlr_10.42.42.2(pid=29502): stdout: | (launched: 2022-12-14_02:26:31.045914) 02:26:34.282609 run osmo-hlr_10.42.42.2(pid=29502): stderr: | [0;m[1;31m20221214022631354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022631354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022631354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022631354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022631354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022631354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022631366 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022631375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022631375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022631375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:26:34.351623 run osmo-msc_10.42.42.6(pid=29508): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29508)] 02:26:34.398859 run osmo-msc_10.42.42.6(pid=29508): stdout: | (launched: 2022-12-14_02:26:33.291407) 02:26:34.447893 run osmo-msc_10.42.42.6(pid=29508): stderr: | [0;m[38;5;43m20221214022633562 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022633562 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff59da4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022633562 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022633562 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022633563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022633563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022633564 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022633565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022633565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022633565 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:26:34.497338 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29501): Terminating (SIGTERM) 02:26:34.536859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29504): Terminating (SIGTERM) 02:26:34.576384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29507): Terminating (SIGTERM) 02:26:34.616315 --- ParallelTerminationStrategy: PID 29501 died... 02:26:34.635575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29501): Terminated: ok {rc=0} 02:26:34.679278 --- ParallelTerminationStrategy: PID 29504 died... 02:26:34.698017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29504): Terminated: ok {rc=0} 02:26:34.741623 --- ParallelTerminationStrategy: PID 29507 died... 02:26:34.760480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29507): Terminated: ok {rc=0} 02:26:34.846242 bus /sierra_3: Setting Powered False 02:26:35.943176 bus /sierra_3: Setting Powered False 02:26:37.059010 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:26:38.310041 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:26:38.316686 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:26:38.348834 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:26:38.375267 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:26:38.424026 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:26:38.456314 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:26:38.482271 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:26:39.035915 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:26:39.087743 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:39.099164 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:26:39.166517 tst mo_mt_call.py: using LAC 37903 02:26:39.289597 tst mo_mt_call.py: using RAC 163 02:26:39.405943 tst mo_mt_call.py: using CellId 37903 02:26:39.521705 tst mo_mt_call.py: using BVCI 37904 02:26:39.629626 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:39.640600 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:39.651522 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:39.662393 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:39.673429 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:39.684752 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:26:39.800156 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:26:39.918888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:26:40.412283 run create_hlr_db(pid=29513): Launched 02:26:40.534575 bus /sierra_2: Setting Powered False 02:26:41.597698 run create_hlr_db(pid=29513): Terminated: ok {rc=0} 02:26:42.022719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29515): Launched 02:26:42.318678 run osmo-hlr_10.42.42.2(pid=29516): Launched 02:26:42.433956 run osmo-stp_10.42.42.5: Starting osmo-stp 02:26:42.944316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29518): Launched 02:26:43.241834 run osmo-stp_10.42.42.5(pid=29519): Launched 02:26:43.355617 run osmo-msc_10.42.42.6: Starting osmo-msc 02:26:43.892714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29521): Launched 02:26:44.188513 run osmo-msc_10.42.42.6(pid=29522): Launched 02:26:44.354578 run osmo-stp_10.42.42.5(pid=29519): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29519)] 02:26:44.480755 run osmo-stp_10.42.42.5(pid=29519): stdout: | (launched: 2022-12-14_02:26:43.186632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:44.606749 run osmo-stp_10.42.42.5(pid=29519): stderr: | [0;m[38;5;43m20221214022643356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022643356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022643356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022643357 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022643357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022643357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022643357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:44.731017 run osmo-stp_10.42.42.5(pid=29519): stdout: | (launched: 2022-12-14_02:26:43.186632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:44.850025 run osmo-stp_10.42.42.5(pid=29519): stderr: | [0;m[38;5;43m20221214022643356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022643356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022643356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022643357 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022643357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022643357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022643357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:44.991903 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29519): Process ended prematurely: osmo-stp_10.42.42.5(pid=29519) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29519)] [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:26:45.000936 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:26:45.027376 run osmo-hlr_10.42.42.2(pid=29516): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29516)] 02:26:45.075428 run osmo-hlr_10.42.42.2(pid=29516): stdout: | (launched: 2022-12-14_02:26:42.264785) 02:26:45.125337 run osmo-hlr_10.42.42.2(pid=29516): stderr: | [0;m[1;31m20221214022642439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022642439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022642439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022642439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022642439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022642439 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022642451 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022642461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022642461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022642461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:26:45.194485 run osmo-msc_10.42.42.6(pid=29522): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29522)] 02:26:45.241874 run osmo-msc_10.42.42.6(pid=29522): stdout: | (launched: 2022-12-14_02:26:44.134605) 02:26:45.291211 run osmo-msc_10.42.42.6(pid=29522): stderr: | [0;m[38;5;43m20221214022644403 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022644403 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3049549c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022644403 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022644403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022644404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022644404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022644406 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022644406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022644406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022644406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:26:45.341566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29515): Terminating (SIGTERM) 02:26:45.381694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29518): Terminating (SIGTERM) 02:26:45.421652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29521): Terminating (SIGTERM) 02:26:45.461785 --- ParallelTerminationStrategy: PID 29515 died... 02:26:45.481119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29515): Terminated: ok {rc=0} 02:26:45.525281 --- ParallelTerminationStrategy: PID 29518 died... 02:26:45.544167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29518): Terminated: ok {rc=0} 02:26:45.589228 --- ParallelTerminationStrategy: PID 29521 died... 02:26:45.608145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29521): Terminated: ok {rc=0} 02:26:45.695819 bus /sierra_3: Setting Powered False 02:26:46.805099 bus /sierra_3: Setting Powered False 02:26:47.941711 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:26:49.087028 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:49.098883 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:26:49.183850 tst mo_mt_call_osmux.py: using LAC 37904 02:26:49.306268 tst mo_mt_call_osmux.py: using RAC 164 02:26:49.422740 tst mo_mt_call_osmux.py: using CellId 37904 02:26:49.539904 tst mo_mt_call_osmux.py: using BVCI 37905 02:26:49.658565 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:49.670509 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:49.681988 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:49.693467 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:49.705382 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:26:49.717103 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:26:49.834026 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:26:49.952904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:26:50.448941 run create_hlr_db(pid=29524): Launched 02:26:50.570623 bus /sierra_2: Setting Powered False 02:26:51.634496 run create_hlr_db(pid=29524): Terminated: ok {rc=0} 02:26:52.063220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29526): Launched 02:26:52.360910 run osmo-hlr_10.42.42.2(pid=29527): Launched 02:26:52.474746 run osmo-stp_10.42.42.5: Starting osmo-stp 02:26:52.988579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29529): Launched 02:26:53.284608 run osmo-stp_10.42.42.5(pid=29530): Launched 02:26:53.397554 run osmo-msc_10.42.42.6: Starting osmo-msc 02:26:53.940489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29532): Launched 02:26:54.237302 run osmo-msc_10.42.42.6(pid=29533): Launched 02:26:54.403554 run osmo-stp_10.42.42.5(pid=29530): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29530)] 02:26:54.529442 run osmo-stp_10.42.42.5(pid=29530): stdout: | (launched: 2022-12-14_02:26:53.230940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:54.655263 run osmo-stp_10.42.42.5(pid=29530): stderr: | [0;m[38;5;43m20221214022653400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022653400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022653401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022653401 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022653402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022653402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022653402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:54.779249 run osmo-stp_10.42.42.5(pid=29530): stdout: | (launched: 2022-12-14_02:26:53.230940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:26:54.897731 run osmo-stp_10.42.42.5(pid=29530): stderr: | [0;m[38;5;43m20221214022653400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022653400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022653401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022653401 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022653402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022653402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022653402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:26:55.039215 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29530): Process ended prematurely: osmo-stp_10.42.42.5(pid=29530) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29530)] [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:26:55.048183 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:26:55.074610 run osmo-hlr_10.42.42.2(pid=29527): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29527)] 02:26:55.122449 run osmo-hlr_10.42.42.2(pid=29527): stdout: | (launched: 2022-12-14_02:26:52.306570) 02:26:55.171836 run osmo-hlr_10.42.42.2(pid=29527): stderr: | [0;m[1;31m20221214022652481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022652481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022652481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022652481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022652481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022652481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022652494 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022652502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022652503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022652503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:26:55.240432 run osmo-msc_10.42.42.6(pid=29533): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29533)] 02:26:55.287738 run osmo-msc_10.42.42.6(pid=29533): stdout: | (launched: 2022-12-14_02:26:54.183135) 02:26:55.336705 run osmo-msc_10.42.42.6(pid=29533): stderr: | [0;m[38;5;43m20221214022654455 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022654455 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd05346ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022654455 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022654455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022654455 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022654456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022654457 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022654459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022654459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022654459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:26:55.386123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29526): Terminating (SIGTERM) 02:26:55.425563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29529): Terminating (SIGTERM) 02:26:55.464913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29532): Terminating (SIGTERM) 02:26:55.504434 --- ParallelTerminationStrategy: PID 29526 died... 02:26:55.523431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29526): Terminated: ok {rc=0} 02:26:55.567272 --- ParallelTerminationStrategy: PID 29529 died... 02:26:55.585833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29529): Terminated: ok {rc=0} 02:26:55.629355 --- ParallelTerminationStrategy: PID 29532 died... 02:26:55.647999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29532): Terminated: ok {rc=0} 02:26:55.734017 bus /sierra_3: Setting Powered False 02:26:56.832864 bus /sierra_3: Setting Powered False 02:26:57.947555 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:26:59.193722 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:26:59.200087 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:26:59.232016 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:26:59.259216 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:26:59.311149 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:26:59.344797 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:26:59.371106 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:26:59.917943 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:26:59.966216 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:26:59.977115 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:27:00.045133 tst mo_mt_call.py: using LAC 37905 02:27:00.163529 tst mo_mt_call.py: using RAC 165 02:27:00.287174 tst mo_mt_call.py: using CellId 37905 02:27:00.406808 tst mo_mt_call.py: using BVCI 37906 02:27:00.517139 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:00.527941 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:00.538611 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:00.549309 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:00.559981 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:00.570726 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:27:00.691573 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:27:00.811112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:01.324501 run create_hlr_db(pid=29538): Launched 02:27:01.471665 bus /sierra_2: Setting Powered False 02:27:02.530984 run create_hlr_db(pid=29538): Terminated: ok {rc=0} 02:27:02.965984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29540): Launched 02:27:03.284815 run osmo-hlr_10.42.42.2(pid=29541): Launched 02:27:03.439059 run osmo-stp_10.42.42.5: Starting osmo-stp 02:27:03.986976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29543): Launched 02:27:04.305377 run osmo-stp_10.42.42.5(pid=29544): Launched 02:27:04.427552 run osmo-msc_10.42.42.6: Starting osmo-msc 02:27:05.004753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29546): Launched 02:27:05.323632 run osmo-msc_10.42.42.6(pid=29547): Launched 02:27:05.501517 run osmo-stp_10.42.42.5(pid=29544): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29544)] 02:27:05.637192 run osmo-stp_10.42.42.5(pid=29544): stdout: | (launched: 2022-12-14_02:27:04.248089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:05.772338 run osmo-stp_10.42.42.5(pid=29544): stderr: | [0;m[38;5;43m20221214022704436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022704436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022704436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022704437 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022704439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022704439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022704439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:05.907294 run osmo-stp_10.42.42.5(pid=29544): stdout: | (launched: 2022-12-14_02:27:04.248089) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:06.035254 run osmo-stp_10.42.42.5(pid=29544): stderr: | [0;m[38;5;43m20221214022704436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022704436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022704436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022704437 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022704439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022704439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022704439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:06.188712 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29544): Process ended prematurely: osmo-stp_10.42.42.5(pid=29544) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29544)] [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:27:06.198435 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:27:06.225976 run osmo-hlr_10.42.42.2(pid=29541): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29541)] 02:27:06.276240 run osmo-hlr_10.42.42.2(pid=29541): stdout: | (launched: 2022-12-14_02:27:03.227777) 02:27:06.328279 run osmo-hlr_10.42.42.2(pid=29541): stderr: | [0;m[1;31m20221214022703460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022703460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022703460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022703460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022703460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022703460 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022703478 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022703487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022703487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022703487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:27:06.400320 run osmo-msc_10.42.42.6(pid=29547): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29547)] 02:27:06.450544 run osmo-msc_10.42.42.6(pid=29547): stdout: | (launched: 2022-12-14_02:27:05.266282) 02:27:06.506548 run osmo-msc_10.42.42.6(pid=29547): stderr: | [0;m[38;5;43m20221214022705586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022705586 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbdbe6a5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022705586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022705586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022705586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022705586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022705590 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022705590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022705590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022705590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:27:06.560039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29540): Terminating (SIGTERM) 02:27:06.601542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29543): Terminating (SIGTERM) 02:27:06.643752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29546): Terminating (SIGTERM) 02:27:06.685687 --- ParallelTerminationStrategy: PID 29540 died... 02:27:06.705797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29540): Terminated: ok {rc=0} 02:27:06.751792 --- ParallelTerminationStrategy: PID 29543 died... 02:27:06.771373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29543): Terminated: ok {rc=0} 02:27:06.817479 --- ParallelTerminationStrategy: PID 29546 died... 02:27:06.837206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29546): Terminated: ok {rc=0} 02:27:06.924600 bus /sierra_3: Setting Powered False 02:27:08.022960 bus /sierra_3: Setting Powered False 02:27:09.138947 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:27:10.287387 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:10.299412 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:27:10.370210 tst mo_mt_call_osmux.py: using LAC 37906 02:27:10.495150 tst mo_mt_call_osmux.py: using RAC 166 02:27:10.622316 tst mo_mt_call_osmux.py: using CellId 37906 02:27:10.747219 tst mo_mt_call_osmux.py: using BVCI 37907 02:27:10.863139 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:10.874534 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:10.885817 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:10.896775 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:10.908332 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:27:10.919751 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:27:11.037648 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:27:11.158531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:11.652016 run create_hlr_db(pid=29559): Launched 02:27:11.773290 bus /sierra_2: Setting Powered False 02:27:12.836013 run create_hlr_db(pid=29559): Terminated: ok {rc=0} 02:27:13.260044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29561): Launched 02:27:13.556177 run osmo-hlr_10.42.42.2(pid=29562): Launched 02:27:13.670892 run osmo-stp_10.42.42.5: Starting osmo-stp 02:27:14.203556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29564): Launched 02:27:14.499482 run osmo-stp_10.42.42.5(pid=29565): Launched 02:27:14.613302 run osmo-msc_10.42.42.6: Starting osmo-msc 02:27:15.152101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29567): Launched 02:27:15.449268 run osmo-msc_10.42.42.6(pid=29568): Launched 02:27:15.615971 run osmo-stp_10.42.42.5(pid=29565): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29565)] 02:27:15.743406 run osmo-stp_10.42.42.5(pid=29565): stdout: | (launched: 2022-12-14_02:27:14.445845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:15.891553 run osmo-stp_10.42.42.5(pid=29565): stderr: | [0;m[38;5;43m20221214022714614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022714614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022714615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022714615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022714617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022714618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022714618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:16.025704 run osmo-stp_10.42.42.5(pid=29565): stdout: | (launched: 2022-12-14_02:27:14.445845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:16.147905 run osmo-stp_10.42.42.5(pid=29565): stderr: | [0;m[38;5;43m20221214022714614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022714614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022714615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022714615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022714617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022714618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022714618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:16.294216 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29565): Process ended prematurely: osmo-stp_10.42.42.5(pid=29565) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29565)] [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:27:16.303591 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:27:16.330525 run osmo-hlr_10.42.42.2(pid=29562): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29562)] 02:27:16.378670 run osmo-hlr_10.42.42.2(pid=29562): stdout: | (launched: 2022-12-14_02:27:13.502539) 02:27:16.428403 run osmo-hlr_10.42.42.2(pid=29562): stderr: | [0;m[1;31m20221214022713676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022713676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022713676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022713676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022713676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022713676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022713689 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022713697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022713698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022713698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:27:16.497998 run osmo-msc_10.42.42.6(pid=29568): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29568)] 02:27:16.545987 run osmo-msc_10.42.42.6(pid=29568): stdout: | (launched: 2022-12-14_02:27:15.394932) 02:27:16.596783 run osmo-msc_10.42.42.6(pid=29568): stderr: | [0;m[38;5;43m20221214022715664 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022715665 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f192e3a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022715665 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022715665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022715665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022715665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022715667 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022715667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022715667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022715667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:27:16.647524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29561): Terminating (SIGTERM) 02:27:16.689038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29564): Terminating (SIGTERM) 02:27:16.730617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29567): Terminating (SIGTERM) 02:27:16.770928 --- ParallelTerminationStrategy: PID 29561 died... 02:27:16.790272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29561): Terminated: ok {rc=0} 02:27:16.834690 --- ParallelTerminationStrategy: PID 29564 died... 02:27:16.853842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29564): Terminated: ok {rc=0} 02:27:16.898115 --- ParallelTerminationStrategy: PID 29567 died... 02:27:16.917268 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29567): Terminated: ok {rc=0} 02:27:17.000538 bus /sierra_3: Setting Powered False 02:27:18.096272 bus /sierra_3: Setting Powered False 02:27:19.210712 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:27:20.456734 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:27:20.463295 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:27:20.495218 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:27:20.521493 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:27:20.571448 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:27:20.603380 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:27:20.629272 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:27:21.181286 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:27:21.228482 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:21.239328 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:27:21.307307 tst mo_mt_call.py: using LAC 37907 02:27:21.423753 tst mo_mt_call.py: using RAC 167 02:27:21.555595 tst mo_mt_call.py: using CellId 37907 02:27:21.681248 tst mo_mt_call.py: using BVCI 37908 02:27:21.796800 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:21.808142 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:21.819272 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:21.830480 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:21.842090 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:21.853653 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:27:21.968463 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:27:22.087016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:22.582003 run create_hlr_db(pid=29573): Launched 02:27:22.703538 bus /sierra_2: Setting Powered False 02:27:23.766523 run create_hlr_db(pid=29573): Terminated: ok {rc=0} 02:27:24.192620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29575): Launched 02:27:24.490750 run osmo-hlr_10.42.42.2(pid=29576): Launched 02:27:24.604768 run osmo-stp_10.42.42.5: Starting osmo-stp 02:27:25.118501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29578): Launched 02:27:25.414490 run osmo-stp_10.42.42.5(pid=29579): Launched 02:27:25.527824 run osmo-msc_10.42.42.6: Starting osmo-msc 02:27:26.069941 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29581): Launched 02:27:26.367072 run osmo-msc_10.42.42.6(pid=29582): Launched 02:27:26.533935 run osmo-stp_10.42.42.5(pid=29579): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29579)] 02:27:26.660598 run osmo-stp_10.42.42.5(pid=29579): stdout: | (launched: 2022-12-14_02:27:25.360300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:26.786963 run osmo-stp_10.42.42.5(pid=29579): stderr: | [0;m[38;5;43m20221214022725530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022725530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022725531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022725531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022725531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022725531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022725532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:26.911135 run osmo-stp_10.42.42.5(pid=29579): stdout: | (launched: 2022-12-14_02:27:25.360300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:27.029964 run osmo-stp_10.42.42.5(pid=29579): stderr: | [0;m[38;5;43m20221214022725530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022725530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022725531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022725531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022725531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022725531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022725532 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:27.171878 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29579): Process ended prematurely: osmo-stp_10.42.42.5(pid=29579) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29579)] [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:27:27.180740 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:27:27.206898 run osmo-hlr_10.42.42.2(pid=29576): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29576)] 02:27:27.254721 run osmo-hlr_10.42.42.2(pid=29576): stdout: | (launched: 2022-12-14_02:27:24.436080) 02:27:27.303877 run osmo-hlr_10.42.42.2(pid=29576): stderr: | [0;m[1;31m20221214022724610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022724610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022724610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022724610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022724610 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022724611 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022724623 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022724631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022724632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022724632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:27:27.372042 run osmo-msc_10.42.42.6(pid=29582): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29582)] 02:27:27.419285 run osmo-msc_10.42.42.6(pid=29582): stdout: | (launched: 2022-12-14_02:27:26.312679) 02:27:27.468398 run osmo-msc_10.42.42.6(pid=29582): stderr: | [0;m[38;5;43m20221214022726580 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022726580 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4feb5fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022726580 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022726580 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022726581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022726581 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022726583 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022726583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022726583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022726583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:27:27.517802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29575): Terminating (SIGTERM) 02:27:27.557509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29578): Terminating (SIGTERM) 02:27:27.597303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29581): Terminating (SIGTERM) 02:27:27.637412 --- ParallelTerminationStrategy: PID 29575 died... 02:27:27.656305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29575): Terminated: ok {rc=0} 02:27:27.699679 --- ParallelTerminationStrategy: PID 29578 died... 02:27:27.718285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29578): Terminated: ok {rc=0} 02:27:27.761721 --- ParallelTerminationStrategy: PID 29581 died... 02:27:27.780058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29581): Terminated: ok {rc=0} 02:27:27.865160 bus /sierra_3: Setting Powered False 02:27:28.963643 bus /sierra_3: Setting Powered False 02:27:30.078667 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:27:31.250930 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:31.266404 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:27:31.347942 tst mo_mt_call_osmux.py: using LAC 37908 02:27:31.502600 tst mo_mt_call_osmux.py: using RAC 168 02:27:31.630772 tst mo_mt_call_osmux.py: using CellId 37908 02:27:31.751476 tst mo_mt_call_osmux.py: using BVCI 37909 02:27:31.863002 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:31.874602 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:31.886387 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:31.897960 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:31.909566 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:27:31.921803 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:27:32.035636 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:27:32.177333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:32.658716 run create_hlr_db(pid=29584): Launched 02:27:32.781969 bus /sierra_2: Setting Powered False 02:27:33.841652 run create_hlr_db(pid=29584): Terminated: ok {rc=0} 02:27:34.256684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29586): Launched 02:27:34.552443 run osmo-hlr_10.42.42.2(pid=29587): Launched 02:27:34.664670 run osmo-stp_10.42.42.5: Starting osmo-stp 02:27:35.173655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29589): Launched 02:27:35.470139 run osmo-stp_10.42.42.5(pid=29590): Launched 02:27:35.583488 run osmo-msc_10.42.42.6: Starting osmo-msc 02:27:36.121665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29592): Launched 02:27:36.417966 run osmo-msc_10.42.42.6(pid=29593): Launched 02:27:36.583435 run osmo-stp_10.42.42.5(pid=29590): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29590)] 02:27:36.709230 run osmo-stp_10.42.42.5(pid=29590): stdout: | (launched: 2022-12-14_02:27:35.416037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:36.835243 run osmo-stp_10.42.42.5(pid=29590): stderr: | [0;m[38;5;43m20221214022735586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022735586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022735587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022735587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022735587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022735587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022735588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:36.959146 run osmo-stp_10.42.42.5(pid=29590): stdout: | (launched: 2022-12-14_02:27:35.416037) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:37.077722 run osmo-stp_10.42.42.5(pid=29590): stderr: | [0;m[38;5;43m20221214022735586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022735586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022735587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022735587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022735587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022735587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022735588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:37.219361 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29590): Process ended prematurely: osmo-stp_10.42.42.5(pid=29590) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29590)] [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:27:37.228031 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:27:37.254100 run osmo-hlr_10.42.42.2(pid=29587): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29587)] 02:27:37.301970 run osmo-hlr_10.42.42.2(pid=29587): stdout: | (launched: 2022-12-14_02:27:34.498889) 02:27:37.351324 run osmo-hlr_10.42.42.2(pid=29587): stderr: | [0;m[1;31m20221214022734672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022734672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022734672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022734672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022734672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022734672 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022734685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022734694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022734695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022734695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:27:37.420072 run osmo-msc_10.42.42.6(pid=29593): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29593)] 02:27:37.467588 run osmo-msc_10.42.42.6(pid=29593): stdout: | (launched: 2022-12-14_02:27:36.363769) 02:27:37.516776 run osmo-msc_10.42.42.6(pid=29593): stderr: | [0;m[38;5;43m20221214022736633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022736633 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb474bd6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022736633 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022736633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022736633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022736633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022736635 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022736635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022736636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022736636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:27:37.566567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29586): Terminating (SIGTERM) 02:27:37.606246 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29589): Terminating (SIGTERM) 02:27:37.645846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29592): Terminating (SIGTERM) 02:27:37.685559 --- ParallelTerminationStrategy: PID 29586 died... 02:27:37.704477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29586): Terminated: ok {rc=0} 02:27:37.748210 --- ParallelTerminationStrategy: PID 29589 died... 02:27:37.766610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29589): Terminated: ok {rc=0} 02:27:37.810233 --- ParallelTerminationStrategy: PID 29592 died... 02:27:37.828636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29592): Terminated: ok {rc=0} 02:27:37.914273 bus /sierra_3: Setting Powered False 02:27:39.012291 bus /sierra_3: Setting Powered False 02:27:40.127891 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:27:41.382922 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:27:41.389959 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:27:41.423216 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:27:41.451468 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:27:41.504276 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:27:41.537226 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:27:41.563531 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:27:42.116160 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:27:42.168659 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:42.180024 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:27:42.249882 tst mo_mt_call.py: using LAC 37909 02:27:42.369791 tst mo_mt_call.py: using RAC 169 02:27:42.486332 tst mo_mt_call.py: using CellId 37909 02:27:42.604498 tst mo_mt_call.py: using BVCI 37910 02:27:42.712021 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:42.723023 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:42.733801 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:42.744466 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:42.755220 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:42.766362 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:27:42.885891 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:27:43.002332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:43.461697 run create_hlr_db(pid=29598): Launched 02:27:43.582491 bus /sierra_2: Setting Powered False 02:27:44.641648 run create_hlr_db(pid=29598): Terminated: ok {rc=0} 02:27:45.076402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29600): Launched 02:27:45.395997 run osmo-hlr_10.42.42.2(pid=29601): Launched 02:27:45.518410 run osmo-stp_10.42.42.5: Starting osmo-stp 02:27:46.105639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29603): Launched 02:27:46.428338 run osmo-stp_10.42.42.5(pid=29604): Launched 02:27:46.592918 run osmo-msc_10.42.42.6: Starting osmo-msc 02:27:47.336084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29606): Launched 02:27:47.654612 run osmo-msc_10.42.42.6(pid=29607): Launched 02:27:47.834711 run osmo-stp_10.42.42.5(pid=29604): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29604)] 02:27:47.969896 run osmo-stp_10.42.42.5(pid=29604): stdout: | (launched: 2022-12-14_02:27:46.357094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:48.106020 run osmo-stp_10.42.42.5(pid=29604): stderr: | [0;m[38;5;43m20221214022746691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022746692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022746693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022746693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022746695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022746695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022746695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:48.240225 run osmo-stp_10.42.42.5(pid=29604): stdout: | (launched: 2022-12-14_02:27:46.357094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:48.367769 run osmo-stp_10.42.42.5(pid=29604): stderr: | [0;m[38;5;43m20221214022746691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022746692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022746693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022746693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022746695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022746695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022746695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:48.520580 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29604): Process ended prematurely: osmo-stp_10.42.42.5(pid=29604) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29604)] [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:27:48.530312 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 02:27:48.557937 run osmo-hlr_10.42.42.2(pid=29601): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29601)] 02:27:48.608371 run osmo-hlr_10.42.42.2(pid=29601): stdout: | (launched: 2022-12-14_02:27:45.338464) 02:27:48.660332 run osmo-hlr_10.42.42.2(pid=29601): stderr: | [0;m[1;31m20221214022745538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022745538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022745538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022745538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022745538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022745539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022745551 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022745561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022745561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022745561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:27:48.733002 run osmo-msc_10.42.42.6(pid=29607): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29607)] 02:27:48.782657 run osmo-msc_10.42.42.6(pid=29607): stdout: | (launched: 2022-12-14_02:27:47.597271) 02:27:48.834413 run osmo-msc_10.42.42.6(pid=29607): stderr: | [0;m[38;5;43m20221214022747916 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022747917 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa0bfe06c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022747917 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022747917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022747917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022747917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022747919 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022747919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022747919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022747919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:27:48.886627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29600): Terminating (SIGTERM) 02:27:48.928638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29603): Terminating (SIGTERM) 02:27:48.970708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29606): Terminating (SIGTERM) 02:27:49.012901 --- ParallelTerminationStrategy: PID 29600 died... 02:27:49.033395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29600): Terminated: ok {rc=0} 02:27:49.079765 --- ParallelTerminationStrategy: PID 29603 died... 02:27:49.099719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29603): Terminated: ok {rc=0} 02:27:49.146392 --- ParallelTerminationStrategy: PID 29606 died... 02:27:49.166347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29606): Terminated: ok {rc=0} 02:27:49.255036 bus /sierra_3: Setting Powered False 02:27:50.353715 bus /sierra_3: Setting Powered False 02:27:51.469470 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:27:52.618611 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:52.630809 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:27:52.702701 tst mo_mt_call_osmux.py: using LAC 37910 02:27:52.827839 tst mo_mt_call_osmux.py: using RAC 170 02:27:52.954866 tst mo_mt_call_osmux.py: using CellId 37910 02:27:53.074266 tst mo_mt_call_osmux.py: using BVCI 37911 02:27:53.184329 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:53.195436 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:53.206432 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:53.217313 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:53.228144 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:27:53.239253 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:27:53.352922 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:27:53.473914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:27:53.936480 run create_hlr_db(pid=29609): Launched 02:27:54.058187 bus /sierra_2: Setting Powered False 02:27:55.117997 run create_hlr_db(pid=29609): Terminated: ok {rc=0} 02:27:55.534182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29611): Launched 02:27:55.831261 run osmo-hlr_10.42.42.2(pid=29612): Launched 02:27:55.943941 run osmo-stp_10.42.42.5: Starting osmo-stp 02:27:56.472705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29614): Launched 02:27:56.769546 run osmo-stp_10.42.42.5(pid=29615): Launched 02:27:56.882227 run osmo-msc_10.42.42.6: Starting osmo-msc 02:27:57.418449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29617): Launched 02:27:57.715812 run osmo-msc_10.42.42.6(pid=29618): Launched 02:27:57.882509 run osmo-stp_10.42.42.5(pid=29615): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29615)] 02:27:58.008734 run osmo-stp_10.42.42.5(pid=29615): stdout: | (launched: 2022-12-14_02:27:56.715409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:58.135623 run osmo-stp_10.42.42.5(pid=29615): stderr: | [0;m[38;5;43m20221214022756883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022756883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022756884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022756884 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022756884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022756885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022756885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:58.260667 run osmo-stp_10.42.42.5(pid=29615): stdout: | (launched: 2022-12-14_02:27:56.715409) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:27:58.379676 run osmo-stp_10.42.42.5(pid=29615): stderr: | [0;m[38;5;43m20221214022756883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022756883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022756884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022756884 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022756884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022756885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022756885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:27:58.522127 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29615): Process ended prematurely: osmo-stp_10.42.42.5(pid=29615) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29615)] [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:27:58.531149 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:27:58.557270 run osmo-hlr_10.42.42.2(pid=29612): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29612)] 02:27:58.605479 run osmo-hlr_10.42.42.2(pid=29612): stdout: | (launched: 2022-12-14_02:27:55.777430) 02:27:58.654700 run osmo-hlr_10.42.42.2(pid=29612): stderr: | [0;m[1;31m20221214022755953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022755953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022755953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022755953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022755953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022755953 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022755965 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022755974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022755974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022755974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:27:58.723690 run osmo-msc_10.42.42.6(pid=29618): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29618)] 02:27:58.770883 run osmo-msc_10.42.42.6(pid=29618): stdout: | (launched: 2022-12-14_02:27:57.661512) 02:27:58.819868 run osmo-msc_10.42.42.6(pid=29618): stderr: | [0;m[38;5;43m20221214022757933 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022757933 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc0fe3c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022757933 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022757933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022757933 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022757934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022757935 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022757936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022757936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022757936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:27:58.869246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29611): Terminating (SIGTERM) 02:27:58.908927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29614): Terminating (SIGTERM) 02:27:58.948626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29617): Terminating (SIGTERM) 02:27:58.988442 --- ParallelTerminationStrategy: PID 29611 died... 02:27:59.007625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29611): Terminated: ok {rc=0} 02:27:59.051346 --- ParallelTerminationStrategy: PID 29614 died... 02:27:59.069841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29614): Terminated: ok {rc=0} 02:27:59.113459 --- ParallelTerminationStrategy: PID 29617 died... 02:27:59.131973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29617): Terminated: ok {rc=0} 02:27:59.216047 bus /sierra_3: Setting Powered False 02:28:00.313536 bus /sierra_3: Setting Powered False 02:28:01.427670 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:28:02.678444 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:28:02.685874 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:28:02.719367 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:28:02.747681 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:28:02.799817 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:28:02.832227 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:28:02.858508 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:28:03.414767 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:28:03.466498 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:03.478316 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:28:03.549558 tst mo_mt_call.py: using LAC 37911 02:28:03.676827 tst mo_mt_call.py: using RAC 171 02:28:03.805852 tst mo_mt_call.py: using CellId 37911 02:28:03.932158 tst mo_mt_call.py: using BVCI 37912 02:28:04.049011 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:04.060632 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:04.072006 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:04.083200 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:04.095204 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:04.106779 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:28:04.224253 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:28:04.343073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:28:04.838299 run create_hlr_db(pid=29623): Launched 02:28:04.960017 bus /sierra_2: Setting Powered False 02:28:06.022647 run create_hlr_db(pid=29623): Terminated: ok {rc=0} 02:28:06.467962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29625): Launched 02:28:06.787168 run osmo-hlr_10.42.42.2(pid=29626): Launched 02:28:06.909162 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:07.454126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29628): Launched 02:28:07.773744 run osmo-stp_10.42.42.5(pid=29629): Launched 02:28:07.895601 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:08.472911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29631): Launched 02:28:08.791490 run osmo-msc_10.42.42.6(pid=29632): Launched 02:28:08.969788 run osmo-stp_10.42.42.5(pid=29629): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29629)] 02:28:09.105049 run osmo-stp_10.42.42.5(pid=29629): stdout: | (launched: 2022-12-14_02:28:07.716285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:09.240582 run osmo-stp_10.42.42.5(pid=29629): stderr: | [0;m[38;5;43m20221214022807907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022807907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022807907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022807908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022807910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022807910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022807910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:09.375671 run osmo-stp_10.42.42.5(pid=29629): stdout: | (launched: 2022-12-14_02:28:07.716285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:09.503372 run osmo-stp_10.42.42.5(pid=29629): stderr: | [0;m[38;5;43m20221214022807907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022807907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022807907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022807908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022807910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022807910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022807910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:09.656477 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29629): Process ended prematurely: osmo-stp_10.42.42.5(pid=29629) [trial-2398↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29629)] [trial-2398↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:28:09.665926 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:28:09.693303 run osmo-hlr_10.42.42.2(pid=29626): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29626)] 02:28:09.743738 run osmo-hlr_10.42.42.2(pid=29626): stdout: | (launched: 2022-12-14_02:28:06.729815) 02:28:09.795287 run osmo-hlr_10.42.42.2(pid=29626): stderr: | [0;m[1;31m20221214022806927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022806927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022806927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022806927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022806927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022806927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022806939 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022806947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022806947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022806947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:09.867608 run osmo-msc_10.42.42.6(pid=29632): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29632)] 02:28:09.917330 run osmo-msc_10.42.42.6(pid=29632): stdout: | (launched: 2022-12-14_02:28:08.733867) 02:28:09.968791 run osmo-msc_10.42.42.6(pid=29632): stderr: | [0;m[38;5;43m20221214022809052 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022809052 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f02e997fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022809052 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022809052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022809052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022809053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022809054 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022809055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022809055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022809055 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:10.020832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29625): Terminating (SIGTERM) 02:28:10.062508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29628): Terminating (SIGTERM) 02:28:10.104567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29631): Terminating (SIGTERM) 02:28:10.146713 --- ParallelTerminationStrategy: PID 29625 died... 02:28:10.166826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29625): Terminated: ok {rc=0} 02:28:10.213148 --- ParallelTerminationStrategy: PID 29628 died... 02:28:10.233021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29628): Terminated: ok {rc=0} 02:28:10.279021 --- ParallelTerminationStrategy: PID 29631 died... 02:28:10.298796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29631): Terminated: ok {rc=0} 02:28:10.386855 bus /sierra_3: Setting Powered False 02:28:11.484328 bus /sierra_3: Setting Powered False 02:28:12.599475 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:28:13.747326 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:13.759460 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:28:13.829904 tst mo_mt_call_osmux.py: using LAC 37912 02:28:13.955409 tst mo_mt_call_osmux.py: using RAC 172 02:28:14.083789 tst mo_mt_call_osmux.py: using CellId 37912 02:28:14.209573 tst mo_mt_call_osmux.py: using BVCI 37913 02:28:14.319446 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:14.330649 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:14.341763 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:14.352666 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:14.363908 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:28:14.375123 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:28:14.495311 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:28:14.610367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:28:15.072756 run create_hlr_db(pid=29634): Launched 02:28:15.195169 bus /sierra_2: Setting Powered False 02:28:16.273154 run create_hlr_db(pid=29634): Terminated: ok {rc=0} 02:28:16.772658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29636): Launched 02:28:17.113787 run osmo-hlr_10.42.42.2(pid=29637): Launched 02:28:17.301841 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:17.810787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29639): Launched 02:28:18.107106 run osmo-stp_10.42.42.5(pid=29640): Launched 02:28:18.219500 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:18.756173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29642): Launched 02:28:19.052769 run osmo-msc_10.42.42.6(pid=29643): Launched 02:28:19.218126 run osmo-stp_10.42.42.5(pid=29640): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29640)] 02:28:19.343561 run osmo-stp_10.42.42.5(pid=29640): stdout: | (launched: 2022-12-14_02:28:18.053211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:19.469848 run osmo-stp_10.42.42.5(pid=29640): stderr: | [0;m[38;5;43m20221214022818221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022818221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022818222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022818222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022818222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022818222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022818222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:19.594031 run osmo-stp_10.42.42.5(pid=29640): stdout: | (launched: 2022-12-14_02:28:18.053211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:19.712892 run osmo-stp_10.42.42.5(pid=29640): stderr: | [0;m[38;5;43m20221214022818221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022818221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022818222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022818222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022818222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022818222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022818222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:19.854824 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29640): Process ended prematurely: osmo-stp_10.42.42.5(pid=29640) [trial-2398↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29640)] [trial-2398↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:28:19.863752 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:28:19.889693 run osmo-hlr_10.42.42.2(pid=29637): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29637)] 02:28:19.936869 run osmo-hlr_10.42.42.2(pid=29637): stdout: | (launched: 2022-12-14_02:28:17.049274) 02:28:19.985698 run osmo-hlr_10.42.42.2(pid=29637): stderr: | [0;m[1;31m20221214022817272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022817272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022817272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022817272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022817272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022817272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022817287 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022817297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022817297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022817297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:20.054028 run osmo-msc_10.42.42.6(pid=29643): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29643)] 02:28:20.100812 run osmo-msc_10.42.42.6(pid=29643): stdout: | (launched: 2022-12-14_02:28:18.998767) 02:28:20.149603 run osmo-msc_10.42.42.6(pid=29643): stderr: | [0;m[38;5;43m20221214022819271 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022819271 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0a6f93bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022819271 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022819271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022819271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022819272 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022819273 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022819274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022819274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022819274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:20.198425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29636): Terminating (SIGTERM) 02:28:20.237423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29639): Terminating (SIGTERM) 02:28:20.276482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29642): Terminating (SIGTERM) 02:28:20.316443 --- ParallelTerminationStrategy: PID 29636 died... 02:28:20.335626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29636): Terminated: ok {rc=0} 02:28:20.378684 --- ParallelTerminationStrategy: PID 29639 died... 02:28:20.397073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29639): Terminated: ok {rc=0} 02:28:20.440099 --- ParallelTerminationStrategy: PID 29642 died... 02:28:20.458421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29642): Terminated: ok {rc=0} 02:28:20.540313 bus /sierra_3: Setting Powered False 02:28:21.633796 bus /sierra_3: Setting Powered False 02:28:22.746127 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:28:23.995321 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:28:24.001934 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:28:24.035114 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:28:24.062531 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:28:24.114285 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:28:24.147534 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:28:24.174900 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:28:24.724611 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:28:24.778059 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:24.789237 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:28:24.861442 tst mo_mt_call.py: using LAC 37913 02:28:24.991496 tst mo_mt_call.py: using RAC 173 02:28:25.117694 tst mo_mt_call.py: using CellId 37913 02:28:25.242245 tst mo_mt_call.py: using BVCI 37914 02:28:25.358975 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:25.370212 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:25.381256 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:25.392062 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:25.403976 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:25.415809 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:28:25.532365 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:28:25.650831 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:28:26.145804 run create_hlr_db(pid=29648): Launched 02:28:26.267220 bus /sierra_2: Setting Powered False 02:28:27.330450 run create_hlr_db(pid=29648): Terminated: ok {rc=0} 02:28:27.774553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29650): Launched 02:28:28.093764 run osmo-hlr_10.42.42.2(pid=29651): Launched 02:28:28.216595 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:28.769290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29653): Launched 02:28:29.088319 run osmo-stp_10.42.42.5(pid=29654): Launched 02:28:29.211775 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:29.791679 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29656): Launched 02:28:30.112364 run osmo-msc_10.42.42.6(pid=29657): Launched 02:28:30.291467 run osmo-stp_10.42.42.5(pid=29654): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29654)] 02:28:30.428204 run osmo-stp_10.42.42.5(pid=29654): stdout: | (launched: 2022-12-14_02:28:29.030718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:30.564732 run osmo-stp_10.42.42.5(pid=29654): stderr: | [0;m[38;5;43m20221214022829221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022829221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022829222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022829222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022829222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022829223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022829223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:30.700287 run osmo-stp_10.42.42.5(pid=29654): stdout: | (launched: 2022-12-14_02:28:29.030718) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:30.828273 run osmo-stp_10.42.42.5(pid=29654): stderr: | [0;m[38;5;43m20221214022829221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022829221 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022829222 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022829222 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022829222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022829223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022829223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:30.990392 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29654): Process ended prematurely: osmo-stp_10.42.42.5(pid=29654) [trial-2398↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29654)] [trial-2398↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:28:30.999234 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:28:31.026774 run osmo-hlr_10.42.42.2(pid=29651): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29651)] 02:28:31.077734 run osmo-hlr_10.42.42.2(pid=29651): stdout: | (launched: 2022-12-14_02:28:28.035494) 02:28:31.130846 run osmo-hlr_10.42.42.2(pid=29651): stderr: | [0;m[1;31m20221214022828231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022828231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022828231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022828231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022828231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022828231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022828243 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022828251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022828251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022828251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:31.204259 run osmo-msc_10.42.42.6(pid=29657): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29657)] 02:28:31.253605 run osmo-msc_10.42.42.6(pid=29657): stdout: | (launched: 2022-12-14_02:28:30.054170) 02:28:31.307307 run osmo-msc_10.42.42.6(pid=29657): stderr: | [0;m[38;5;43m20221214022830375 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022830375 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f106e590c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022830375 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022830375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022830375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022830376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022830377 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022830378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022830378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022830378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:31.359245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29650): Terminating (SIGTERM) 02:28:31.402137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29653): Terminating (SIGTERM) 02:28:31.446835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29656): Terminating (SIGTERM) 02:28:31.492678 --- ParallelTerminationStrategy: PID 29650 died... 02:28:31.513969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29650): Terminated: ok {rc=0} 02:28:31.562550 --- ParallelTerminationStrategy: PID 29653 died... 02:28:31.583838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29653): Terminated: ok {rc=0} 02:28:31.630360 --- ParallelTerminationStrategy: PID 29656 died... 02:28:31.650894 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29656): Terminated: ok {rc=0} 02:28:31.741676 bus /sierra_3: Setting Powered False 02:28:32.841496 bus /sierra_3: Setting Powered False 02:28:33.959860 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:28:35.104509 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:35.116038 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:28:35.184115 tst mo_mt_call_osmux.py: using LAC 37914 02:28:35.300534 tst mo_mt_call_osmux.py: using RAC 174 02:28:35.415835 tst mo_mt_call_osmux.py: using CellId 37914 02:28:35.532279 tst mo_mt_call_osmux.py: using BVCI 37915 02:28:35.640074 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:35.650930 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:35.661582 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:35.672531 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:35.683121 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:28:35.694204 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:28:35.809430 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:28:35.930430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:28:36.429309 run create_hlr_db(pid=29659): Launched 02:28:36.552570 bus /sierra_2: Setting Powered False 02:28:37.615867 run create_hlr_db(pid=29659): Terminated: ok {rc=0} 02:28:38.060552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29661): Launched 02:28:38.380069 run osmo-hlr_10.42.42.2(pid=29662): Launched 02:28:38.502829 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:39.055960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29664): Launched 02:28:39.376390 run osmo-stp_10.42.42.5(pid=29665): Launched 02:28:39.499107 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:40.078012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29667): Launched 02:28:40.397216 run osmo-msc_10.42.42.6(pid=29668): Launched 02:28:40.577130 run osmo-stp_10.42.42.5(pid=29665): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29665)] 02:28:40.712718 run osmo-stp_10.42.42.5(pid=29665): stdout: | (launched: 2022-12-14_02:28:39.318567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:40.848740 run osmo-stp_10.42.42.5(pid=29665): stderr: | [0;m[38;5;43m20221214022839509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022839509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022839509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022839510 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022839510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022839510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022839510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:40.983836 run osmo-stp_10.42.42.5(pid=29665): stdout: | (launched: 2022-12-14_02:28:39.318567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:41.112291 run osmo-stp_10.42.42.5(pid=29665): stderr: | [0;m[38;5;43m20221214022839509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022839509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022839509 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022839510 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022839510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022839510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022839510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:41.265688 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29665): Process ended prematurely: osmo-stp_10.42.42.5(pid=29665) [trial-2398↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29665)] [trial-2398↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:28:41.275125 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:28:41.302773 run osmo-hlr_10.42.42.2(pid=29662): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29662)] 02:28:41.353501 run osmo-hlr_10.42.42.2(pid=29662): stdout: | (launched: 2022-12-14_02:28:38.322632) 02:28:41.405307 run osmo-hlr_10.42.42.2(pid=29662): stderr: | [0;m[1;31m20221214022838519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022838519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022838519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022838520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022838520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022838520 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022838531 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022838539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022838540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022838540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:41.477951 run osmo-msc_10.42.42.6(pid=29668): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29668)] 02:28:41.527935 run osmo-msc_10.42.42.6(pid=29668): stdout: | (launched: 2022-12-14_02:28:40.339229) 02:28:41.579682 run osmo-msc_10.42.42.6(pid=29668): stderr: | [0;m[38;5;43m20221214022840659 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022840659 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdab5246c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022840660 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022840660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022840660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022840660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022840662 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022840662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022840663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022840663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:41.631739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29661): Terminating (SIGTERM) 02:28:41.673670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29664): Terminating (SIGTERM) 02:28:41.715632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29667): Terminating (SIGTERM) 02:28:41.757776 --- ParallelTerminationStrategy: PID 29661 died... 02:28:41.778000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29661): Terminated: ok {rc=0} 02:28:41.824362 --- ParallelTerminationStrategy: PID 29664 died... 02:28:41.844140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29664): Terminated: ok {rc=0} 02:28:41.890533 --- ParallelTerminationStrategy: PID 29667 died... 02:28:41.910392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29667): Terminated: ok {rc=0} 02:28:41.998510 bus /sierra_3: Setting Powered False 02:28:43.096111 bus /sierra_3: Setting Powered False 02:28:44.213674 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 02:28:45.471415 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:28:45.477116 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 02:28:45.510071 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 02:28:45.537398 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 02:28:45.587064 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 02:28:45.619984 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 02:28:45.646745 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 02:28:46.197853 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 02:28:46.251360 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:46.263175 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 02:28:46.315559 tst mo_mt_call.py: using LAC 37915 02:28:46.434500 tst mo_mt_call.py: using RAC 175 02:28:46.565777 tst mo_mt_call.py: using CellId 37915 02:28:46.695346 tst mo_mt_call.py: using BVCI 37916 02:28:46.816635 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:46.828896 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:46.840851 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:46.852787 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:46.865373 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:46.877823 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 02:28:47.003478 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 02:28:47.145881 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:28:47.648288 run create_hlr_db(pid=29674): Launched 02:28:47.770087 bus /sierra_2: Setting Powered False 02:28:48.832910 run create_hlr_db(pid=29674): Terminated: ok {rc=0} 02:28:49.277486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29676): Launched 02:28:49.595419 run osmo-hlr_10.42.42.2(pid=29677): Launched 02:28:49.716561 run osmo-stp_10.42.42.5: Starting osmo-stp 02:28:50.262286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29679): Launched 02:28:50.580604 run osmo-stp_10.42.42.5(pid=29680): Launched 02:28:50.703122 run osmo-msc_10.42.42.6: Starting osmo-msc 02:28:51.281732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29682): Launched 02:28:51.599921 run osmo-msc_10.42.42.6(pid=29683): Launched 02:28:51.777322 run osmo-stp_10.42.42.5(pid=29680): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29680)] 02:28:51.911652 run osmo-stp_10.42.42.5(pid=29680): stdout: | (launched: 2022-12-14_02:28:50.522832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:52.046704 run osmo-stp_10.42.42.5(pid=29680): stderr: | [0;m[38;5;43m20221214022850714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022850714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022850714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022850715 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022850715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022850715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022850715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:52.181930 run osmo-stp_10.42.42.5(pid=29680): stdout: | (launched: 2022-12-14_02:28:50.522832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:28:52.309945 run osmo-stp_10.42.42.5(pid=29680): stderr: | [0;m[38;5;43m20221214022850714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022850714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022850714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022850715 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022850715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022850715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022850715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:28:52.462968 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29680): Process ended prematurely: osmo-stp_10.42.42.5(pid=29680) [trial-2398↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29680)] [trial-2398↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 02:28:52.472596 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:28:52.500178 run osmo-hlr_10.42.42.2(pid=29677): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29677)] 02:28:52.550960 run osmo-hlr_10.42.42.2(pid=29677): stdout: | (launched: 2022-12-14_02:28:49.538024) 02:28:52.602669 run osmo-hlr_10.42.42.2(pid=29677): stderr: | [0;m[1;31m20221214022849736 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022849737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022849737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022849737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022849737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022849737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022849781 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022849791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022849791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022849791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:28:52.675195 run osmo-msc_10.42.42.6(pid=29683): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29683)] 02:28:52.725405 run osmo-msc_10.42.42.6(pid=29683): stdout: | (launched: 2022-12-14_02:28:51.542308) 02:28:52.777577 run osmo-msc_10.42.42.6(pid=29683): stderr: | [0;m[38;5;43m20221214022851866 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022851866 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8c2911dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022851866 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022851866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022851866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022851867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022851868 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022851869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022851869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022851869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:28:52.829366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29676): Terminating (SIGTERM) 02:28:52.871176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29679): Terminating (SIGTERM) 02:28:52.913334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29682): Terminating (SIGTERM) 02:28:52.955956 --- ParallelTerminationStrategy: PID 29676 died... 02:28:52.976099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29676): Terminated: ok {rc=0} 02:28:53.022322 --- ParallelTerminationStrategy: PID 29679 died... 02:28:53.042089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29679): Terminated: ok {rc=0} 02:28:53.088139 --- ParallelTerminationStrategy: PID 29682 died... 02:28:53.108288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29682): Terminated: ok {rc=0} 02:28:53.195968 bus /sierra_3: Setting Powered False 02:28:54.294660 bus /sierra_3: Setting Powered False 02:28:55.410668 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 02:28:56.558595 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:56.570388 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 02:28:56.622755 tst mo_mt_call_osmux.py: using LAC 37916 02:28:56.749377 tst mo_mt_call_osmux.py: using RAC 176 02:28:56.874973 tst mo_mt_call_osmux.py: using CellId 37916 02:28:57.001524 tst mo_mt_call_osmux.py: using BVCI 37917 02:28:57.111666 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:57.122658 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:57.133426 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:57.144067 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:57.154769 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 02:28:57.165850 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 02:28:57.286717 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 02:28:57.403421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:28:57.866004 run create_hlr_db(pid=29685): Launched 02:28:57.987457 bus /sierra_2: Setting Powered False 02:28:59.046987 run create_hlr_db(pid=29685): Terminated: ok {rc=0} 02:28:59.482801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29687): Launched 02:28:59.801599 run osmo-hlr_10.42.42.2(pid=29688): Launched 02:28:59.923280 run osmo-stp_10.42.42.5: Starting osmo-stp 02:29:00.477563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29690): Launched 02:29:00.796784 run osmo-stp_10.42.42.5(pid=29691): Launched 02:29:01.019775 run osmo-msc_10.42.42.6: Starting osmo-msc 02:29:01.740674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29693): Launched 02:29:02.063637 run osmo-msc_10.42.42.6(pid=29694): Launched 02:29:02.339504 run osmo-stp_10.42.42.5(pid=29691): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29691)] 02:29:02.474460 run osmo-stp_10.42.42.5(pid=29691): stdout: | (launched: 2022-12-14_02:29:00.739096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:02.604756 run osmo-stp_10.42.42.5(pid=29691): stderr: | [0;m[38;5;43m20221214022900989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022900989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022900990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022900990 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022900992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022900992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022900996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:02.731081 run osmo-stp_10.42.42.5(pid=29691): stdout: | (launched: 2022-12-14_02:29:00.739096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:02.851045 run osmo-stp_10.42.42.5(pid=29691): stderr: | [0;m[38;5;43m20221214022900989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022900989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022900990 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022900990 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022900992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022900992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022900996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:02.993319 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29691): Process ended prematurely: osmo-stp_10.42.42.5(pid=29691) [trial-2398↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29691)] [trial-2398↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 02:29:03.002260 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 02:29:03.028182 run osmo-hlr_10.42.42.2(pid=29688): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29688)] 02:29:03.075798 run osmo-hlr_10.42.42.2(pid=29688): stdout: | (launched: 2022-12-14_02:28:59.743956) 02:29:03.124911 run osmo-hlr_10.42.42.2(pid=29688): stderr: | [0;m[1;31m20221214022859941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022859941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022859941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022859941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022859941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022859941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022859954 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022859962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022859962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022859962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:29:03.193338 run osmo-msc_10.42.42.6(pid=29694): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29694)] 02:29:03.240602 run osmo-msc_10.42.42.6(pid=29694): stdout: | (launched: 2022-12-14_02:29:02.002177) 02:29:03.289568 run osmo-msc_10.42.42.6(pid=29694): stderr: | [0;m[38;5;43m20221214022902450 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022902450 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f25cc8dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022902451 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022902451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022902451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022902451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022902453 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022902453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022902453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022902453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:29:03.338958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29687): Terminating (SIGTERM) 02:29:03.378117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29690): Terminating (SIGTERM) 02:29:03.417367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29693): Terminating (SIGTERM) 02:29:03.457620 --- ParallelTerminationStrategy: PID 29687 died... 02:29:03.476532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29687): Terminated: ok {rc=0} 02:29:03.520157 --- ParallelTerminationStrategy: PID 29690 died... 02:29:03.538773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29690): Terminated: ok {rc=0} 02:29:03.582272 --- ParallelTerminationStrategy: PID 29693 died... 02:29:03.600743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29693): Terminated: ok {rc=0} 02:29:03.686329 bus /sierra_3: Setting Powered False 02:29:04.785229 bus /sierra_3: Setting Powered False 02:29:05.899396 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 02:29:07.146597 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:29:07.152340 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 02:29:07.184268 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 02:29:07.210298 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 02:29:07.262016 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 02:29:07.294711 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 02:29:07.320726 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 02:29:07.871245 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 02:29:07.919070 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:07.930245 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:29:07.983612 tst mo_mt_call.py: using LAC 37917 02:29:08.114272 tst mo_mt_call.py: using RAC 177 02:29:08.240535 tst mo_mt_call.py: using CellId 37917 02:29:08.365571 tst mo_mt_call.py: using BVCI 37918 02:29:08.475859 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:08.487151 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:08.501191 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:08.512640 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:08.524574 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:08.536259 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:29:08.653392 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:29:08.773689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:29:09.268706 run create_hlr_db(pid=29699): Launched 02:29:09.391126 bus /sierra_2: Setting Powered False 02:29:10.453871 run create_hlr_db(pid=29699): Terminated: ok {rc=0} 02:29:10.880675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29701): Launched 02:29:11.178521 run osmo-hlr_10.42.42.2(pid=29702): Launched 02:29:11.291318 run osmo-stp_10.42.42.5: Starting osmo-stp 02:29:11.803802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29704): Launched 02:29:12.144041 run osmo-stp_10.42.42.5(pid=29705): Launched 02:29:12.267814 run osmo-msc_10.42.42.6: Starting osmo-msc 02:29:12.847818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29707): Launched 02:29:13.168930 run osmo-msc_10.42.42.6(pid=29708): Launched 02:29:13.347873 run osmo-stp_10.42.42.5(pid=29705): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29705)] 02:29:13.484166 run osmo-stp_10.42.42.5(pid=29705): stdout: | (launched: 2022-12-14_02:29:12.085603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:13.621149 run osmo-stp_10.42.42.5(pid=29705): stderr: | [0;m[38;5;43m20221214022912275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022912275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022912275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022912276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022912278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022912278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022912278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:13.756884 run osmo-stp_10.42.42.5(pid=29705): stdout: | (launched: 2022-12-14_02:29:12.085603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:13.885250 run osmo-stp_10.42.42.5(pid=29705): stderr: | [0;m[38;5;43m20221214022912275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022912275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022912275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022912276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022912278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022912278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022912278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:14.038220 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29705): Process ended prematurely: osmo-stp_10.42.42.5(pid=29705) [trial-2398↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29705)] [trial-2398↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 02:29:14.047609 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:29:14.075024 run osmo-hlr_10.42.42.2(pid=29702): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29702)] 02:29:14.125546 run osmo-hlr_10.42.42.2(pid=29702): stdout: | (launched: 2022-12-14_02:29:11.124420) 02:29:14.177299 run osmo-hlr_10.42.42.2(pid=29702): stderr: | [0;m[1;31m20221214022911298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022911298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022911298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022911298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022911298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022911299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022911311 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022911319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022911320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022911320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:29:14.249550 run osmo-msc_10.42.42.6(pid=29708): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29708)] 02:29:14.299345 run osmo-msc_10.42.42.6(pid=29708): stdout: | (launched: 2022-12-14_02:29:13.110636) 02:29:14.350884 run osmo-msc_10.42.42.6(pid=29708): stderr: | [0;m[38;5;43m20221214022913430 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022913431 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7dfff91c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022913431 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022913431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022913431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022913431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022913433 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022913433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022913433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022913433 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:29:14.402830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29701): Terminating (SIGTERM) 02:29:14.444557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29704): Terminating (SIGTERM) 02:29:14.486212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29707): Terminating (SIGTERM) 02:29:14.528272 --- ParallelTerminationStrategy: PID 29701 died... 02:29:14.548480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29701): Terminated: ok {rc=0} 02:29:14.594610 --- ParallelTerminationStrategy: PID 29704 died... 02:29:14.614324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29704): Terminated: ok {rc=0} 02:29:14.660245 --- ParallelTerminationStrategy: PID 29707 died... 02:29:14.680003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29707): Terminated: ok {rc=0} 02:29:14.767719 bus /sierra_3: Setting Powered False 02:29:15.889481 bus /sierra_3: Setting Powered False 02:29:17.030507 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 02:29:18.200162 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:18.212357 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:29:18.267174 tst mo_mt_call_osmux.py: using LAC 37918 02:29:18.393189 tst mo_mt_call_osmux.py: using RAC 178 02:29:18.520169 tst mo_mt_call_osmux.py: using CellId 37918 02:29:18.645406 tst mo_mt_call_osmux.py: using BVCI 37919 02:29:18.755908 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:18.767532 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:18.778934 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:18.790387 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:18.801809 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:29:18.813087 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:29:18.933425 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:29:19.052152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:29:19.515344 run create_hlr_db(pid=29710): Launched 02:29:19.639178 bus /sierra_2: Setting Powered False 02:29:20.698883 run create_hlr_db(pid=29710): Terminated: ok {rc=0} 02:29:21.137111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29712): Launched 02:29:21.456205 run osmo-hlr_10.42.42.2(pid=29713): Launched 02:29:21.578161 run osmo-stp_10.42.42.5: Starting osmo-stp 02:29:22.131381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29715): Launched 02:29:22.451095 run osmo-stp_10.42.42.5(pid=29716): Launched 02:29:22.573156 run osmo-msc_10.42.42.6: Starting osmo-msc 02:29:23.151119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29718): Launched 02:29:23.470451 run osmo-msc_10.42.42.6(pid=29719): Launched 02:29:23.648794 run osmo-stp_10.42.42.5(pid=29716): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29716)] 02:29:23.785031 run osmo-stp_10.42.42.5(pid=29716): stdout: | (launched: 2022-12-14_02:29:22.393362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:23.921766 run osmo-stp_10.42.42.5(pid=29716): stderr: | [0;m[38;5;43m20221214022922585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022922585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022922586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022922586 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022922587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022922587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022922587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:24.056695 run osmo-stp_10.42.42.5(pid=29716): stdout: | (launched: 2022-12-14_02:29:22.393362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:24.185117 run osmo-stp_10.42.42.5(pid=29716): stderr: | [0;m[38;5;43m20221214022922585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022922585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022922586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022922586 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022922587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022922587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022922587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:24.337590 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29716): Process ended prematurely: osmo-stp_10.42.42.5(pid=29716) [trial-2398↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29716)] [trial-2398↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 02:29:24.347147 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:29:24.374496 run osmo-hlr_10.42.42.2(pid=29713): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29713)] 02:29:24.424576 run osmo-hlr_10.42.42.2(pid=29713): stdout: | (launched: 2022-12-14_02:29:21.398818) 02:29:24.476134 run osmo-hlr_10.42.42.2(pid=29713): stderr: | [0;m[1;31m20221214022921597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022921597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022921597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022921597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022921597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022921597 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022921609 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022921617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022921617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022921617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:29:24.548281 run osmo-msc_10.42.42.6(pid=29719): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29719)] 02:29:24.597654 run osmo-msc_10.42.42.6(pid=29719): stdout: | (launched: 2022-12-14_02:29:23.412827) 02:29:24.648810 run osmo-msc_10.42.42.6(pid=29719): stderr: | [0;m[38;5;43m20221214022923733 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022923734 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0feaf6dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022923734 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022923734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022923734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022923734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022923736 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022923736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022923736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022923736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:29:24.700514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29712): Terminating (SIGTERM) 02:29:24.742176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29715): Terminating (SIGTERM) 02:29:24.783765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29718): Terminating (SIGTERM) 02:29:24.825804 --- ParallelTerminationStrategy: PID 29712 died... 02:29:24.846056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29712): Terminated: ok {rc=0} 02:29:24.892050 --- ParallelTerminationStrategy: PID 29715 died... 02:29:24.911691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29715): Terminated: ok {rc=0} 02:29:24.957496 --- ParallelTerminationStrategy: PID 29718 died... 02:29:24.977187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29718): Terminated: ok {rc=0} 02:29:25.064678 bus /sierra_3: Setting Powered False 02:29:26.161603 bus /sierra_3: Setting Powered False 02:29:27.274919 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 emergency:trx-b200 --------------------------------------------------------------------- 02:29:28.521542 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:29:28.526238 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 02:29:28.558354 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 02:29:28.584496 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 02:29:28.667091 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 02:29:28.699083 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 02:29:28.724916 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 02:29:29.307037 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2398 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 02:29:29.312171 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:29.322604 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 02:29:29.370243 tst emergency_mo_mt_call.py: using LAC 37919 02:29:29.487075 tst emergency_mo_mt_call.py: using RAC 179 02:29:29.610951 tst emergency_mo_mt_call.py: using CellId 37919 02:29:29.734313 tst emergency_mo_mt_call.py: using BVCI 37920 02:29:29.848177 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:29.859393 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:29.870349 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:29.881324 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:29.892561 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:29.903624 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:29:30.019930 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:29:30.137248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:29:30.624582 run create_hlr_db(pid=29724): Launched 02:29:30.744841 bus /sierra_2: Setting Powered False 02:29:31.818213 run create_hlr_db(pid=29724): Terminated: ok {rc=0} 02:29:32.285129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29726): Launched 02:29:32.602349 run osmo-hlr_10.42.42.2(pid=29727): Launched 02:29:32.722386 run osmo-stp_10.42.42.5: Starting osmo-stp 02:29:33.263362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29729): Launched 02:29:33.578379 run osmo-stp_10.42.42.5(pid=29730): Launched 02:29:33.708286 tst emergency_mo_mt_call.py: using MSISDN 8459 02:29:33.875370 run osmo-msc_10.42.42.6: Starting osmo-msc 02:29:34.440652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29732): Launched 02:29:34.754237 run osmo-msc_10.42.42.6(pid=29733): Launched 02:29:34.929775 run osmo-stp_10.42.42.5(pid=29730): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29730)] 02:29:35.062885 run osmo-stp_10.42.42.5(pid=29730): stdout: | (launched: 2022-12-14_02:29:33.521554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:35.197208 run osmo-stp_10.42.42.5(pid=29730): stderr: | [0;m[38;5;43m20221214022933714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022933714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022933714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022933715 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022933717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022933717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022933717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:35.330022 run osmo-stp_10.42.42.5(pid=29730): stdout: | (launched: 2022-12-14_02:29:33.521554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:35.455328 run osmo-stp_10.42.42.5(pid=29730): stderr: | [0;m[38;5;43m20221214022933714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022933714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022933714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022933715 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022933717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022933717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022933717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:35.605239 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=29730): Process ended prematurely: osmo-stp_10.42.42.5(pid=29730) [trial-2398↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29730)] [trial-2398↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 02:29:35.614322 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 02:29:35.641563 run osmo-hlr_10.42.42.2(pid=29727): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29727)] 02:29:35.692307 run osmo-hlr_10.42.42.2(pid=29727): stdout: | (launched: 2022-12-14_02:29:32.545624) 02:29:35.744511 run osmo-hlr_10.42.42.2(pid=29727): stderr: | [0;m[1;31m20221214022932744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022932744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022932744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022932744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022932744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022932744 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022932758 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022932766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022932766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022932766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:29:35.817560 run osmo-msc_10.42.42.6(pid=29733): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29733)] 02:29:35.867221 run osmo-msc_10.42.42.6(pid=29733): stdout: | (launched: 2022-12-14_02:29:34.697482) 02:29:35.919399 run osmo-msc_10.42.42.6(pid=29733): stderr: | [0;m[38;5;43m20221214022935018 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022935018 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5e2b39cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022935018 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022935018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022935019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022935019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022935021 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022935021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022935021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022935021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:29:35.971685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29726): Terminating (SIGTERM) 02:29:36.013934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29729): Terminating (SIGTERM) 02:29:36.056555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29732): Terminating (SIGTERM) 02:29:36.099349 --- ParallelTerminationStrategy: PID 29726 died... 02:29:36.119948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29726): Terminated: ok {rc=0} 02:29:36.166989 --- ParallelTerminationStrategy: PID 29729 died... 02:29:36.187165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29729): Terminated: ok {rc=0} 02:29:36.233650 --- ParallelTerminationStrategy: PID 29732 died... 02:29:36.253768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29732): Terminated: ok {rc=0} 02:29:36.342602 bus /sierra_3: Setting Powered False 02:29:37.440579 bus /sierra_3: Setting Powered False 02:29:38.557138 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 02:29:39.643858 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:39.655655 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 02:29:39.707267 tst emergency_preemptive_call.py: using LAC 37920 02:29:39.832311 tst emergency_preemptive_call.py: using RAC 180 02:29:39.955225 tst emergency_preemptive_call.py: using CellId 37920 02:29:40.078639 tst emergency_preemptive_call.py: using BVCI 37921 02:29:40.193417 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:40.204385 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:40.215298 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:40.226176 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:40.237458 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 02:29:40.248488 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:29:40.364727 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:29:40.482772 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:29:40.597252 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 02:29:40.714132 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:29:41.205019 run create_hlr_db(pid=29735): Launched 02:29:41.324926 bus /sierra_2: Setting Powered False 02:29:42.387791 run create_hlr_db(pid=29735): Terminated: ok {rc=0} 02:29:42.806893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29737): Launched 02:29:43.100274 run osmo-hlr_10.42.42.2(pid=29738): Launched 02:29:43.211713 run osmo-stp_10.42.42.5: Starting osmo-stp 02:29:43.731686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29740): Launched 02:29:44.023071 run osmo-stp_10.42.42.5(pid=29741): Launched 02:29:44.146680 tst emergency_preemptive_call.py: using MSISDN 8460 02:29:44.295402 run osmo-msc_10.42.42.6: Starting osmo-msc 02:29:44.818022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29743): Launched 02:29:45.109310 run osmo-msc_10.42.42.6(pid=29744): Launched 02:29:45.271401 run osmo-stp_10.42.42.5(pid=29741): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29741)] 02:29:45.396292 run osmo-stp_10.42.42.5(pid=29741): stdout: | (launched: 2022-12-14_02:29:43.970209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:45.520293 run osmo-stp_10.42.42.5(pid=29741): stderr: | [0;m[38;5;43m20221214022944140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022944140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022944141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022944141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022944142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022944142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022944142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:45.641906 run osmo-stp_10.42.42.5(pid=29741): stdout: | (launched: 2022-12-14_02:29:43.970209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:29:45.757749 run osmo-stp_10.42.42.5(pid=29741): stderr: | [0;m[38;5;43m20221214022944140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214022944140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214022944141 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214022944141 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214022944142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214022944142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214022944142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:29:45.915546 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=29741): Process ended prematurely: osmo-stp_10.42.42.5(pid=29741) [trial-2398↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29741)] [trial-2398↪emergency:trx-b200↪emergency_preemptive_call.py:32] 02:29:45.924589 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 02:29:45.951031 run osmo-hlr_10.42.42.2(pid=29738): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29738)] 02:29:45.999233 run osmo-hlr_10.42.42.2(pid=29738): stdout: | (launched: 2022-12-14_02:29:43.046682) 02:29:46.049218 run osmo-hlr_10.42.42.2(pid=29738): stderr: | [0;m[1;31m20221214022943222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214022943222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214022943222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214022943222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214022943222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214022943222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214022943235 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214022943245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214022943245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214022943245 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:29:46.120171 run osmo-msc_10.42.42.6(pid=29744): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29744)] 02:29:46.168396 run osmo-msc_10.42.42.6(pid=29744): stdout: | (launched: 2022-12-14_02:29:45.056130) 02:29:46.218262 run osmo-msc_10.42.42.6(pid=29744): stderr: | [0;m[38;5;43m20221214022945327 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214022945327 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f95baabcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214022945327 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214022945328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214022945328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214022945328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214022945330 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214022945330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214022945330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214022945330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:29:46.268593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29737): Terminating (SIGTERM) 02:29:46.309418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29740): Terminating (SIGTERM) 02:29:46.351435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29743): Terminating (SIGTERM) 02:29:46.392682 --- ParallelTerminationStrategy: PID 29737 died... 02:29:46.411837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29737): Terminated: ok {rc=0} 02:29:46.458000 --- ParallelTerminationStrategy: PID 29740 died... 02:29:46.476982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29740): Terminated: ok {rc=0} 02:29:46.521369 --- ParallelTerminationStrategy: PID 29743 died... 02:29:46.540391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29743): Terminated: ok {rc=0} 02:29:46.629804 bus /sierra_9: Setting Powered False 02:29:47.737941 bus /sierra_9: Setting Powered False 02:29:48.852639 bus /sierra_8: Setting Powered False 02:29:49.950007 bus /sierra_8: Setting Powered False 02:29:51.066946 bus /sierra_3: Setting Powered False 02:29:52.164701 bus /sierra_3: Setting Powered False 02:29:53.279772 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-b200 --------------------------------------------------------------------- 02:29:54.564450 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:29:54.569195 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 02:29:54.602212 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 02:29:54.642083 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 02:29:54.730039 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 02:29:54.763158 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 02:29:54.801779 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 02:29:55.391553 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 02:29:55.444126 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:55.455029 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 02:29:55.504019 tst cs_paging_gprs_active.py: using LAC 37921 02:29:55.631546 tst cs_paging_gprs_active.py: using RAC 181 02:29:55.761340 tst cs_paging_gprs_active.py: using CellId 37921 02:29:55.886844 tst cs_paging_gprs_active.py: using BVCI 37922 02:29:56.003975 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:56.014938 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:56.025718 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:56.036314 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:56.047201 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:56.058512 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:56.070060 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:56.081089 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:29:56.092247 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:29:56.208036 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:29:56.322735 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:29:56.523211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:29:56.822231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29750): Launched 02:29:57.082566 run iperf3-srv_10.42.42.10(pid=29751): Launched 02:29:57.195135 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:29:57.394948 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:29:57.694872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29752): Launched 02:29:57.973819 run iperf3-srv_10.42.42.10(pid=29753): Launched 02:29:58.094142 tst cs_paging_gprs_active.py:38: start network... 02:29:58.310892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:29:58.807680 run create_hlr_db(pid=29754): Launched 02:29:58.930489 bus /sierra_2: Setting Powered False 02:29:59.993751 run create_hlr_db(pid=29754): Terminated: ok {rc=0} 02:30:00.421759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29756): Launched 02:30:00.719805 run osmo-hlr_10.42.42.2(pid=29757): Launched 02:30:00.843321 run osmo-stp_10.42.42.5: Starting osmo-stp 02:30:01.512393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29762): Launched 02:30:01.855202 run osmo-stp_10.42.42.5(pid=29763): Launched 02:30:02.114797 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:30:02.677666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29765): Launched 02:30:02.791580 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:30:03.043452 run patchelf(pid=29766): Launched 02:30:03.210617 run osmo-stp_10.42.42.5(pid=29763): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29763)] 02:30:03.337521 run osmo-stp_10.42.42.5(pid=29763): stdout: | (launched: 2022-12-14_02:30:01.789415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:03.465843 run osmo-stp_10.42.42.5(pid=29763): stderr: | [0;m[38;5;43m20221214023002064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023002064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023002064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023002065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023002065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023002065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023002066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:03.594380 run osmo-stp_10.42.42.5(pid=29763): stdout: | (launched: 2022-12-14_02:30:01.789415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:03.717301 run osmo-stp_10.42.42.5(pid=29763): stderr: | [0;m[38;5;43m20221214023002064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023002064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023002064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023002065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023002065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023002065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023002066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:03.863009 run patchelf(pid=29766): Terminating (SIGINT) 02:30:04.032078 run patchelf(pid=29766): Terminated: ok {rc=0} 02:30:04.154351 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29763): Process ended prematurely: osmo-stp_10.42.42.5(pid=29763) [trial-2398↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29763)] [trial-2398↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 02:30:04.163929 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 02:30:04.191089 run osmo-hlr_10.42.42.2(pid=29757): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29757)] 02:30:04.238779 run osmo-hlr_10.42.42.2(pid=29757): stdout: | (launched: 2022-12-14_02:30:00.665676) 02:30:04.288082 run osmo-hlr_10.42.42.2(pid=29757): stderr: | [0;m[1;31m20221214023000867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023000867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023000867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023000867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023000867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023000867 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023000879 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023000898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023000898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023000899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:30:04.337975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29750): Terminating (SIGTERM) 02:30:04.377889 run iperf3-srv_10.42.42.10(pid=29751): Terminating (SIGTERM) 02:30:04.417747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29752): Terminating (SIGTERM) 02:30:04.457788 run iperf3-srv_10.42.42.10(pid=29753): Terminating (SIGTERM) 02:30:04.497443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29756): Terminating (SIGTERM) 02:30:04.537302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29762): Terminating (SIGTERM) 02:30:04.577069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29765): Terminating (SIGTERM) 02:30:04.617120 --- ParallelTerminationStrategy: PID 29750 died... 02:30:04.636293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29750): Terminated: ok {rc=0} 02:30:04.680219 --- ParallelTerminationStrategy: PID 29751 died... 02:30:04.698754 run iperf3-srv_10.42.42.10(pid=29751): Terminated {rc=256} 02:30:04.742136 --- ParallelTerminationStrategy: PID 29752 died... 02:30:04.760545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29752): Terminated: ok {rc=0} 02:30:04.803699 --- ParallelTerminationStrategy: PID 29753 died... 02:30:04.822217 run iperf3-srv_10.42.42.10(pid=29753): Terminated {rc=256} 02:30:04.865458 --- ParallelTerminationStrategy: PID 29756 died... 02:30:04.883853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29756): Terminated: ok {rc=0} 02:30:04.927104 --- ParallelTerminationStrategy: PID 29762 died... 02:30:04.945568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29762): Terminated: ok {rc=0} 02:30:04.989098 --- ParallelTerminationStrategy: PID 29765 died... 02:30:05.007331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29765): Terminated: ok {rc=0} 02:30:05.092264 bus /gobi_0: Setting Powered False 02:30:06.190871 bus /gobi_0: Setting Powered False 02:30:07.305554 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200 iperf3.py ---------------------------------------------- 02:30:08.450806 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:08.461971 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 02:30:08.512139 tst iperf3.py: using LAC 37922 02:30:08.639061 tst iperf3.py: using RAC 182 02:30:08.764418 tst iperf3.py: using CellId 37922 02:30:08.889793 tst iperf3.py: using BVCI 37923 02:30:09.006340 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:09.017356 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:09.027953 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:09.038641 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:09.049622 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:09.060460 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:09.072139 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:09.083149 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:09.094339 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:09.212115 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:30:09.428585 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:09.748813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29768): Launched 02:30:10.025999 run iperf3-srv_10.42.42.10(pid=29769): Launched 02:30:10.146333 tst iperf3.py:8: start network... 02:30:10.362421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:30:10.856529 run create_hlr_db(pid=29770): Launched 02:30:10.978214 bus /gobi_6: Setting Powered False 02:30:12.041700 run create_hlr_db(pid=29770): Terminated: ok {rc=0} 02:30:12.468061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29772): Launched 02:30:12.766322 run osmo-hlr_10.42.42.2(pid=29773): Launched 02:30:12.880471 run osmo-stp_10.42.42.5: Starting osmo-stp 02:30:13.395789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29775): Launched 02:30:13.694344 run osmo-stp_10.42.42.5(pid=29776): Launched 02:30:13.808202 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:30:14.320800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29778): Launched 02:30:14.434490 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:30:14.685640 run patchelf(pid=29779): Launched 02:30:14.851434 run osmo-stp_10.42.42.5(pid=29776): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29776)] 02:30:14.977264 run osmo-stp_10.42.42.5(pid=29776): stdout: | (launched: 2022-12-14_02:30:13.639147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:15.104496 run osmo-stp_10.42.42.5(pid=29776): stderr: | [0;m[38;5;43m20221214023013809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023013809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023013809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023013810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023013810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023013810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023013810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:15.232565 run osmo-stp_10.42.42.5(pid=29776): stdout: | (launched: 2022-12-14_02:30:13.639147) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:15.355079 run osmo-stp_10.42.42.5(pid=29776): stderr: | [0;m[38;5;43m20221214023013809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023013809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023013809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023013810 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023013810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023013810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023013810 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:15.500018 run patchelf(pid=29779): Terminating (SIGINT) 02:30:15.668337 run patchelf(pid=29779): Terminated: ok {rc=0} 02:30:15.789521 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29776): Process ended prematurely: osmo-stp_10.42.42.5(pid=29776) [trial-2398↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29776)] [trial-2398↪gprs:trx-b200↪iperf3.py:8] 02:30:15.798879 tst iperf3.py:8: Test FAILED (7.4 sec) 02:30:15.825662 run osmo-hlr_10.42.42.2(pid=29773): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29773)] 02:30:15.900198 run osmo-hlr_10.42.42.2(pid=29773): stdout: | (launched: 2022-12-14_02:30:12.712273) 02:30:15.952897 run osmo-hlr_10.42.42.2(pid=29773): stderr: | [0;m[1;31m20221214023012885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023012885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023012885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023012885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023012885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023012885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023012897 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023012906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023012906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023012906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:30:16.008438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29768): Terminating (SIGTERM) 02:30:16.052038 run iperf3-srv_10.42.42.10(pid=29769): Terminating (SIGTERM) 02:30:16.097249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29772): Terminating (SIGTERM) 02:30:16.142842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29775): Terminating (SIGTERM) 02:30:16.189822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29778): Terminating (SIGTERM) 02:30:16.236782 --- ParallelTerminationStrategy: PID 29768 died... 02:30:16.259114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29768): Terminated: ok {rc=0} 02:30:16.310161 --- ParallelTerminationStrategy: PID 29769 died... 02:30:16.331675 run iperf3-srv_10.42.42.10(pid=29769): Terminated {rc=256} 02:30:16.381045 --- ParallelTerminationStrategy: PID 29772 died... 02:30:16.403037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29772): Terminated: ok {rc=0} 02:30:16.451689 --- ParallelTerminationStrategy: PID 29775 died... 02:30:16.473602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29775): Terminated: ok {rc=0} 02:30:16.523203 --- ParallelTerminationStrategy: PID 29778 died... 02:30:16.545162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29778): Terminated: ok {rc=0} 02:30:16.637482 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 02:30:17.790959 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:17.802661 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 02:30:17.851606 tst iperf3m4.py: using LAC 37923 02:30:17.977374 tst iperf3m4.py: using RAC 183 02:30:18.100857 tst iperf3m4.py: using CellId 37923 02:30:18.225657 tst iperf3m4.py: using BVCI 37924 02:30:18.336893 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:18.347490 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:18.357742 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:18.367932 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:18.378085 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:18.388663 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:18.399586 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:18.410294 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:18.421572 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:18.542793 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:18.661525 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:18.782805 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:18.899644 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:30:19.100125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:19.401263 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29780): Launched 02:30:19.662464 run iperf3-srv_10.42.42.10(pid=29781): Launched 02:30:19.774897 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:30:19.974922 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:20.274224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29782): Launched 02:30:20.533530 run iperf3-srv_10.42.42.10(pid=29783): Launched 02:30:20.645683 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:30:20.845170 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:21.144201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29784): Launched 02:30:21.404339 run iperf3-srv_10.42.42.10(pid=29785): Launched 02:30:21.516432 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:30:21.716252 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:22.015365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29786): Launched 02:30:22.274485 run iperf3-srv_10.42.42.10(pid=29787): Launched 02:30:22.386353 tst iperf3m4.py:8: start network... 02:30:22.586415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:30:23.048244 run create_hlr_db(pid=29788): Launched 02:30:23.170597 bus /gobi_6: Setting Powered False 02:30:24.230805 run create_hlr_db(pid=29788): Terminated: ok {rc=0} 02:30:24.668710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29790): Launched 02:30:24.991218 run osmo-hlr_10.42.42.2(pid=29791): Launched 02:30:25.114094 run osmo-stp_10.42.42.5: Starting osmo-stp 02:30:25.671433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29793): Launched 02:30:25.991835 run osmo-stp_10.42.42.5(pid=29794): Launched 02:30:26.114466 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:30:26.666513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29796): Launched 02:30:26.790059 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:30:27.061346 run patchelf(pid=29797): Launched 02:30:27.240330 run osmo-stp_10.42.42.5(pid=29794): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29794)] 02:30:27.376567 run osmo-stp_10.42.42.5(pid=29794): stdout: | (launched: 2022-12-14_02:30:25.933870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:27.514598 run osmo-stp_10.42.42.5(pid=29794): stderr: | [0;m[38;5;43m20221214023026126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023026126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023026126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023026127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023026127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023026127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023026127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:27.652359 run osmo-stp_10.42.42.5(pid=29794): stdout: | (launched: 2022-12-14_02:30:25.933870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:27.784865 run osmo-stp_10.42.42.5(pid=29794): stderr: | [0;m[38;5;43m20221214023026126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023026126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023026126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023026127 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023026127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023026127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023026127 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:27.942117 run patchelf(pid=29797): Terminating (SIGINT) 02:30:28.123316 run patchelf(pid=29797): Terminated: ok {rc=0} 02:30:28.254539 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29794): Process ended prematurely: osmo-stp_10.42.42.5(pid=29794) [trial-2398↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29794)] [trial-2398↪gprs:trx-b200↪iperf3m4.py:8] 02:30:28.264686 tst iperf3m4.py:8: Test FAILED (10.5 sec) 02:30:28.293550 run osmo-hlr_10.42.42.2(pid=29791): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29791)] 02:30:28.344551 run osmo-hlr_10.42.42.2(pid=29791): stdout: | (launched: 2022-12-14_02:30:24.933237) 02:30:28.397158 run osmo-hlr_10.42.42.2(pid=29791): stderr: | [0;m[1;31m20221214023025132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023025132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023025132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023025132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023025132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023025132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023025144 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023025152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023025152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023025152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:30:28.449590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29780): Terminating (SIGTERM) 02:30:28.492011 run iperf3-srv_10.42.42.10(pid=29781): Terminating (SIGTERM) 02:30:28.534344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29782): Terminating (SIGTERM) 02:30:28.576731 run iperf3-srv_10.42.42.10(pid=29783): Terminating (SIGTERM) 02:30:28.619395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29784): Terminating (SIGTERM) 02:30:28.662344 run iperf3-srv_10.42.42.10(pid=29785): Terminating (SIGTERM) 02:30:28.704316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29786): Terminating (SIGTERM) 02:30:28.746406 run iperf3-srv_10.42.42.10(pid=29787): Terminating (SIGTERM) 02:30:28.788352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29790): Terminating (SIGTERM) 02:30:28.830277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29793): Terminating (SIGTERM) 02:30:28.872231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29796): Terminating (SIGTERM) 02:30:28.914647 --- ParallelTerminationStrategy: PID 29780 died... 02:30:28.934955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29780): Terminated: ok {rc=0} 02:30:28.981490 --- ParallelTerminationStrategy: PID 29781 died... 02:30:29.001370 run iperf3-srv_10.42.42.10(pid=29781): Terminated {rc=256} 02:30:29.047533 --- ParallelTerminationStrategy: PID 29782 died... 02:30:29.067337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29782): Terminated: ok {rc=0} 02:30:29.113788 --- ParallelTerminationStrategy: PID 29783 died... 02:30:29.133599 run iperf3-srv_10.42.42.10(pid=29783): Terminated {rc=256} 02:30:29.180415 --- ParallelTerminationStrategy: PID 29784 died... 02:30:29.200306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29784): Terminated: ok {rc=0} 02:30:29.246596 --- ParallelTerminationStrategy: PID 29785 died... 02:30:29.266400 run iperf3-srv_10.42.42.10(pid=29785): Terminated {rc=256} 02:30:29.312775 --- ParallelTerminationStrategy: PID 29786 died... 02:30:29.333184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29786): Terminated: ok {rc=0} 02:30:29.379695 --- ParallelTerminationStrategy: PID 29787 died... 02:30:29.399546 run iperf3-srv_10.42.42.10(pid=29787): Terminated {rc=256} 02:30:29.445771 --- ParallelTerminationStrategy: PID 29790 died... 02:30:29.465677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29790): Terminated: ok {rc=0} 02:30:29.511653 --- ParallelTerminationStrategy: PID 29793 died... 02:30:29.531629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29793): Terminated: ok {rc=0} 02:30:29.577746 --- ParallelTerminationStrategy: PID 29796 died... 02:30:29.597604 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29796): Terminated: ok {rc=0} 02:30:29.685286 bus /gobi_4: Setting Powered False 02:30:30.785185 bus /gobi_4: Setting Powered False 02:30:31.907098 bus /gobi_1: Setting Powered False 02:30:33.002537 bus /gobi_1: Setting Powered False 02:30:34.118692 bus /gobi_0: Setting Powered False 02:30:35.216440 bus /gobi_0: Setting Powered False 02:30:36.335994 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200 ping.py ---------------------------------------------- 02:30:37.438246 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:37.449281 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 02:30:37.500261 tst ping.py: using LAC 37924 02:30:37.620085 tst ping.py: using RAC 184 02:30:37.735520 tst ping.py: using CellId 37924 02:30:37.849607 tst ping.py: using BVCI 37925 02:30:37.956458 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:37.967128 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:37.977615 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:37.987837 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:37.998012 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:38.008724 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:38.019602 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:38.030481 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:38.145159 tst ping.py:19: start network... 02:30:38.341911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:30:38.794698 run create_hlr_db(pid=29798): Launched 02:30:38.914096 bus /gobi_6: Setting Powered False 02:30:39.972661 run create_hlr_db(pid=29798): Terminated: ok {rc=0} 02:30:40.404313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29800): Launched 02:30:40.719763 run osmo-hlr_10.42.42.2(pid=29801): Launched 02:30:40.840182 run osmo-stp_10.42.42.5: Starting osmo-stp 02:30:41.387726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29803): Launched 02:30:41.703302 run osmo-stp_10.42.42.5(pid=29804): Launched 02:30:41.824628 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:30:42.368187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29806): Launched 02:30:42.489487 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:30:42.755409 run patchelf(pid=29807): Launched 02:30:42.930600 run osmo-stp_10.42.42.5(pid=29804): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29804)] 02:30:43.064291 run osmo-stp_10.42.42.5(pid=29804): stdout: | (launched: 2022-12-14_02:30:41.646185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:43.199819 run osmo-stp_10.42.42.5(pid=29804): stderr: | [0;m[38;5;43m20221214023041835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023041835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023041835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023041835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023041838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023041838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023041838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:43.335205 run osmo-stp_10.42.42.5(pid=29804): stdout: | (launched: 2022-12-14_02:30:41.646185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:43.465073 run osmo-stp_10.42.42.5(pid=29804): stderr: | [0;m[38;5;43m20221214023041835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023041835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023041835 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023041835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023041838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023041838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023041838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:43.618941 run patchelf(pid=29807): Terminating (SIGINT) 02:30:43.797601 run patchelf(pid=29807): Terminated: ok {rc=0} 02:30:43.926501 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29804): Process ended prematurely: osmo-stp_10.42.42.5(pid=29804) [trial-2398↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29804)] [trial-2398↪gprs:trx-b200↪ping.py:22] 02:30:43.935838 tst ping.py:22: Test FAILED (6.5 sec) 02:30:43.963830 run osmo-hlr_10.42.42.2(pid=29801): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29801)] 02:30:44.014253 run osmo-hlr_10.42.42.2(pid=29801): stdout: | (launched: 2022-12-14_02:30:40.662462) 02:30:44.066228 run osmo-hlr_10.42.42.2(pid=29801): stderr: | [0;m[1;31m20221214023040860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023040860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023040860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023040860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023040860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023040860 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023040872 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023040880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023040880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023040880 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:30:44.118508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29800): Terminating (SIGTERM) 02:30:44.160581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29803): Terminating (SIGTERM) 02:30:44.203125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29806): Terminating (SIGTERM) 02:30:44.246027 --- ParallelTerminationStrategy: PID 29800 died... 02:30:44.266589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29800): Terminated: ok {rc=0} 02:30:44.313389 --- ParallelTerminationStrategy: PID 29803 died... 02:30:44.333641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29803): Terminated: ok {rc=0} 02:30:44.379901 --- ParallelTerminationStrategy: PID 29806 died... 02:30:44.399976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29806): Terminated: ok {rc=0} 02:30:44.488357 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 02:30:45.575192 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:45.586951 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 02:30:45.647584 tst ping_idle_ping.py: using LAC 37925 02:30:45.781571 tst ping_idle_ping.py: using RAC 185 02:30:45.912143 tst ping_idle_ping.py: using CellId 37925 02:30:46.041475 tst ping_idle_ping.py: using BVCI 37926 02:30:46.155429 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:46.167006 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:46.178446 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:46.189921 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:46.201978 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:46.214034 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:46.226241 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 02:30:46.238466 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 02:30:46.355562 tst ping_idle_ping.py:24: start network... 02:30:46.560796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:30:47.041202 run create_hlr_db(pid=29808): Launched 02:30:47.193951 bus /gobi_6: Setting Powered False 02:30:48.252560 run create_hlr_db(pid=29808): Terminated: ok {rc=0} 02:30:48.684265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29810): Launched 02:30:48.999533 run osmo-hlr_10.42.42.2(pid=29811): Launched 02:30:49.120172 run osmo-stp_10.42.42.5: Starting osmo-stp 02:30:49.666028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29813): Launched 02:30:49.983598 run osmo-stp_10.42.42.5(pid=29814): Launched 02:30:50.104486 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:30:50.650246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29816): Launched 02:30:50.771469 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:30:51.038222 run patchelf(pid=29817): Launched 02:30:51.214397 run osmo-stp_10.42.42.5(pid=29814): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29814)] 02:30:51.349143 run osmo-stp_10.42.42.5(pid=29814): stdout: | (launched: 2022-12-14_02:30:49.926122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:51.485046 run osmo-stp_10.42.42.5(pid=29814): stderr: | [0;m[38;5;43m20221214023050119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023050119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023050119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023050119 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023050120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023050120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023050120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:51.621407 run osmo-stp_10.42.42.5(pid=29814): stdout: | (launched: 2022-12-14_02:30:49.926122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:30:51.751696 run osmo-stp_10.42.42.5(pid=29814): stderr: | [0;m[38;5;43m20221214023050119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023050119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023050119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023050119 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023050120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023050120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023050120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:30:51.906796 run patchelf(pid=29817): Terminating (SIGINT) 02:30:52.087663 run patchelf(pid=29817): Terminated: ok {rc=0} 02:30:52.217214 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29814): Process ended prematurely: osmo-stp_10.42.42.5(pid=29814) [trial-2398↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29814)] [trial-2398↪gprs:trx-b200↪ping_idle_ping.py:27] 02:30:52.226649 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 02:30:52.254703 run osmo-hlr_10.42.42.2(pid=29811): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29811)] 02:30:52.304911 run osmo-hlr_10.42.42.2(pid=29811): stdout: | (launched: 2022-12-14_02:30:48.942606) 02:30:52.356430 run osmo-hlr_10.42.42.2(pid=29811): stderr: | [0;m[1;31m20221214023049139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023049139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023049139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023049139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023049139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023049139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023049150 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023049158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023049158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023049158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:30:52.408645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29810): Terminating (SIGTERM) 02:30:52.450573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29813): Terminating (SIGTERM) 02:30:52.492529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29816): Terminating (SIGTERM) 02:30:52.535704 --- ParallelTerminationStrategy: PID 29810 died... 02:30:52.556558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29810): Terminated: ok {rc=0} 02:30:52.603165 --- ParallelTerminationStrategy: PID 29813 died... 02:30:52.623025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29813): Terminated: ok {rc=0} 02:30:52.669361 --- ParallelTerminationStrategy: PID 29816 died... 02:30:52.689396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29816): Terminated: ok {rc=0} 02:30:52.777371 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 02:30:54.086161 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:30:54.091784 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:30:54.124737 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:30:54.162054 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:30:54.246765 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:30:54.278993 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:30:54.316122 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:30:54.908127 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:30:54.956325 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:54.967102 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:30:55.016307 tst cs_paging_gprs_active.py: using LAC 37926 02:30:55.141638 tst cs_paging_gprs_active.py: using RAC 186 02:30:55.258774 tst cs_paging_gprs_active.py: using CellId 37926 02:30:55.376699 tst cs_paging_gprs_active.py: using BVCI 37927 02:30:55.485327 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:55.495893 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:55.506344 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:55.516672 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:55.527019 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:55.538041 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:55.549501 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:55.559839 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:30:55.570420 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:30:55.690941 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:30:55.808381 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:30:56.010025 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:56.311456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29824): Launched 02:30:56.572379 run iperf3-srv_10.42.42.10(pid=29825): Launched 02:30:56.685188 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:30:56.885454 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:30:57.185200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29826): Launched 02:30:57.445691 run iperf3-srv_10.42.42.10(pid=29827): Launched 02:30:57.558498 tst cs_paging_gprs_active.py:38: start network... 02:30:57.758581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:30:58.221702 run create_hlr_db(pid=29828): Launched 02:30:58.343436 bus /gobi_6: Setting Powered False 02:30:59.403590 run create_hlr_db(pid=29828): Terminated: ok {rc=0} 02:30:59.841388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29830): Launched 02:31:00.164135 run osmo-hlr_10.42.42.2(pid=29831): Launched 02:31:00.288289 run osmo-stp_10.42.42.5: Starting osmo-stp 02:31:00.849700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29833): Launched 02:31:01.199341 run osmo-stp_10.42.42.5(pid=29834): Launched 02:31:01.422641 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:31:02.097986 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29836): Launched 02:31:02.232678 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:31:02.509179 run patchelf(pid=29837): Launched 02:31:02.689346 run osmo-stp_10.42.42.5(pid=29834): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29834)] 02:31:02.826447 run osmo-stp_10.42.42.5(pid=29834): stdout: | (launched: 2022-12-14_02:31:01.139597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:02.965332 run osmo-stp_10.42.42.5(pid=29834): stderr: | [0;m[38;5;43m20221214023101433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023101434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023101434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023101435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023101436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023101436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023101436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:03.103838 run osmo-stp_10.42.42.5(pid=29834): stdout: | (launched: 2022-12-14_02:31:01.139597) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:03.237776 run osmo-stp_10.42.42.5(pid=29834): stderr: | [0;m[38;5;43m20221214023101433 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023101434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023101434 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023101435 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023101436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023101436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023101436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:03.395587 run patchelf(pid=29837): Terminating (SIGINT) 02:31:03.578332 run patchelf(pid=29837): Terminated: ok {rc=0} 02:31:03.711063 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29834): Process ended prematurely: osmo-stp_10.42.42.5(pid=29834) [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29834)] [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:31:03.721249 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 02:31:03.749565 run osmo-hlr_10.42.42.2(pid=29831): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29831)] 02:31:03.801318 run osmo-hlr_10.42.42.2(pid=29831): stdout: | (launched: 2022-12-14_02:31:00.105924) 02:31:03.853864 run osmo-hlr_10.42.42.2(pid=29831): stderr: | [0;m[1;31m20221214023100304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023100304 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023100305 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023100305 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023100305 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023100305 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023100317 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023100325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023100325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023100325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:31:03.906698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29824): Terminating (SIGTERM) 02:31:03.949716 run iperf3-srv_10.42.42.10(pid=29825): Terminating (SIGTERM) 02:31:03.992621 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29826): Terminating (SIGTERM) 02:31:04.035590 run iperf3-srv_10.42.42.10(pid=29827): Terminating (SIGTERM) 02:31:04.078237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29830): Terminating (SIGTERM) 02:31:04.121340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29833): Terminating (SIGTERM) 02:31:04.164102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29836): Terminating (SIGTERM) 02:31:04.207330 --- ParallelTerminationStrategy: PID 29824 died... 02:31:04.228211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29824): Terminated: ok {rc=0} 02:31:04.275073 --- ParallelTerminationStrategy: PID 29825 died... 02:31:04.295254 run iperf3-srv_10.42.42.10(pid=29825): Terminated {rc=256} 02:31:04.341861 --- ParallelTerminationStrategy: PID 29826 died... 02:31:04.362077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29826): Terminated: ok {rc=0} 02:31:04.408674 --- ParallelTerminationStrategy: PID 29827 died... 02:31:04.428822 run iperf3-srv_10.42.42.10(pid=29827): Terminated {rc=256} 02:31:04.475394 --- ParallelTerminationStrategy: PID 29830 died... 02:31:04.495578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29830): Terminated: ok {rc=0} 02:31:04.542243 --- ParallelTerminationStrategy: PID 29833 died... 02:31:04.562542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29833): Terminated: ok {rc=0} 02:31:04.609229 --- ParallelTerminationStrategy: PID 29836 died... 02:31:04.629533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29836): Terminated: ok {rc=0} 02:31:04.717582 bus /gobi_0: Setting Powered False 02:31:05.815891 bus /gobi_0: Setting Powered False 02:31:06.928293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:31:08.075762 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:08.087647 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:31:08.141737 tst iperf3.py: using LAC 37927 02:31:08.270203 tst iperf3.py: using RAC 187 02:31:08.397736 tst iperf3.py: using CellId 37927 02:31:08.525644 tst iperf3.py: using BVCI 37928 02:31:08.642482 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:08.653725 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:08.664581 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:08.675551 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:08.686896 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:08.698129 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:08.709612 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:08.720620 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:08.731995 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:08.851376 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:31:09.068662 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:09.391383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29838): Launched 02:31:09.670466 run iperf3-srv_10.42.42.10(pid=29839): Launched 02:31:09.790829 tst iperf3.py:8: start network... 02:31:10.007225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:31:10.505049 run create_hlr_db(pid=29840): Launched 02:31:10.626867 bus /gobi_6: Setting Powered False 02:31:11.690407 run create_hlr_db(pid=29840): Terminated: ok {rc=0} 02:31:12.116923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29842): Launched 02:31:12.414788 run osmo-hlr_10.42.42.2(pid=29843): Launched 02:31:12.528766 run osmo-stp_10.42.42.5: Starting osmo-stp 02:31:13.043161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29845): Launched 02:31:13.339568 run osmo-stp_10.42.42.5(pid=29846): Launched 02:31:13.452876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:31:13.969043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29848): Launched 02:31:14.082724 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:31:14.334421 run patchelf(pid=29849): Launched 02:31:14.500303 run osmo-stp_10.42.42.5(pid=29846): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29846)] 02:31:14.626513 run osmo-stp_10.42.42.5(pid=29846): stdout: | (launched: 2022-12-14_02:31:13.285432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:14.753985 run osmo-stp_10.42.42.5(pid=29846): stderr: | [0;m[38;5;43m20221214023113453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023113453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023113453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023113454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023113456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023113456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023113456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:14.882210 run osmo-stp_10.42.42.5(pid=29846): stdout: | (launched: 2022-12-14_02:31:13.285432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:15.004282 run osmo-stp_10.42.42.5(pid=29846): stderr: | [0;m[38;5;43m20221214023113453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023113453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023113453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023113454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023113456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023113456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023113456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:15.149553 run patchelf(pid=29849): Terminating (SIGINT) 02:31:15.318079 run patchelf(pid=29849): Terminated: ok {rc=0} 02:31:15.439658 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29846): Process ended prematurely: osmo-stp_10.42.42.5(pid=29846) [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29846)] [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 02:31:15.449056 tst iperf3.py:8: Test FAILED (7.4 sec) 02:31:15.475705 run osmo-hlr_10.42.42.2(pid=29843): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29843)] 02:31:15.523299 run osmo-hlr_10.42.42.2(pid=29843): stdout: | (launched: 2022-12-14_02:31:12.360415) 02:31:15.572327 run osmo-hlr_10.42.42.2(pid=29843): stderr: | [0;m[1;31m20221214023112537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023112537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023112537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023112537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023112537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023112537 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023112549 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023112558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023112558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023112558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:31:15.621713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29838): Terminating (SIGTERM) 02:31:15.661223 run iperf3-srv_10.42.42.10(pid=29839): Terminating (SIGTERM) 02:31:15.700749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29842): Terminating (SIGTERM) 02:31:15.739961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29845): Terminating (SIGTERM) 02:31:15.779311 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29848): Terminating (SIGTERM) 02:31:15.818781 --- ParallelTerminationStrategy: PID 29838 died... 02:31:15.845791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29838): Terminated: ok {rc=0} 02:31:15.916852 --- ParallelTerminationStrategy: PID 29839 died... 02:31:15.937512 run iperf3-srv_10.42.42.10(pid=29839): Terminated {rc=256} 02:31:15.986240 --- ParallelTerminationStrategy: PID 29842 died... 02:31:16.007860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29842): Terminated: ok {rc=0} 02:31:16.056500 --- ParallelTerminationStrategy: PID 29845 died... 02:31:16.078410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29845): Terminated: ok {rc=0} 02:31:16.128862 --- ParallelTerminationStrategy: PID 29848 died... 02:31:16.150805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29848): Terminated: ok {rc=0} 02:31:16.243060 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:31:17.393061 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:17.405347 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:31:17.458469 tst iperf3m4.py: using LAC 37928 02:31:17.586920 tst iperf3m4.py: using RAC 188 02:31:17.704919 tst iperf3m4.py: using CellId 37928 02:31:17.834015 tst iperf3m4.py: using BVCI 37929 02:31:17.954075 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:17.965504 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:17.976454 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:17.987552 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:17.999099 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:18.010739 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:18.022400 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:18.033842 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:18.045324 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:18.163573 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:18.286564 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:18.402680 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:18.518699 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:31:18.718660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:19.017876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29850): Launched 02:31:19.277564 run iperf3-srv_10.42.42.10(pid=29851): Launched 02:31:19.389650 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:31:19.589572 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:19.888780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29852): Launched 02:31:20.149036 run iperf3-srv_10.42.42.10(pid=29853): Launched 02:31:20.260764 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:31:20.459689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:20.757886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29854): Launched 02:31:21.016329 run iperf3-srv_10.42.42.10(pid=29855): Launched 02:31:21.128259 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:31:21.327123 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:21.625421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29856): Launched 02:31:21.897444 run iperf3-srv_10.42.42.10(pid=29857): Launched 02:31:22.025642 tst iperf3m4.py:8: start network... 02:31:22.224853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:31:22.685333 run create_hlr_db(pid=29858): Launched 02:31:22.808683 bus /gobi_6: Setting Powered False 02:31:23.869312 run create_hlr_db(pid=29858): Terminated: ok {rc=0} 02:31:24.287605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29860): Launched 02:31:24.586210 run osmo-hlr_10.42.42.2(pid=29861): Launched 02:31:24.699187 run osmo-stp_10.42.42.5: Starting osmo-stp 02:31:25.231298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29863): Launched 02:31:25.529255 run osmo-stp_10.42.42.5(pid=29864): Launched 02:31:25.642907 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:31:26.158331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29866): Launched 02:31:26.272421 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:31:26.524766 run patchelf(pid=29867): Launched 02:31:26.690978 run osmo-stp_10.42.42.5(pid=29864): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29864)] 02:31:26.817487 run osmo-stp_10.42.42.5(pid=29864): stdout: | (launched: 2022-12-14_02:31:25.474575) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:26.945332 run osmo-stp_10.42.42.5(pid=29864): stderr: | [0;m[38;5;43m20221214023125643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023125643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023125643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023125643 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023125646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023125646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023125646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:27.073116 run osmo-stp_10.42.42.5(pid=29864): stdout: | (launched: 2022-12-14_02:31:25.474575) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:27.195860 run osmo-stp_10.42.42.5(pid=29864): stderr: | [0;m[38;5;43m20221214023125643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023125643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023125643 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023125643 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023125646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023125646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023125646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:27.341490 run patchelf(pid=29867): Terminating (SIGINT) 02:31:27.510433 run patchelf(pid=29867): Terminated: ok {rc=0} 02:31:27.632364 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29864): Process ended prematurely: osmo-stp_10.42.42.5(pid=29864) [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29864)] [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 02:31:27.641752 tst iperf3m4.py:8: Test FAILED (10.3 sec) 02:31:27.668655 run osmo-hlr_10.42.42.2(pid=29861): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29861)] 02:31:27.715855 run osmo-hlr_10.42.42.2(pid=29861): stdout: | (launched: 2022-12-14_02:31:24.531743) 02:31:27.764563 run osmo-hlr_10.42.42.2(pid=29861): stderr: | [0;m[1;31m20221214023124710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023124710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023124710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023124710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023124710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023124710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023124723 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023124731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023124731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023124731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:31:27.814445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29850): Terminating (SIGTERM) 02:31:27.854093 run iperf3-srv_10.42.42.10(pid=29851): Terminating (SIGTERM) 02:31:27.893413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29852): Terminating (SIGTERM) 02:31:27.933096 run iperf3-srv_10.42.42.10(pid=29853): Terminating (SIGTERM) 02:31:27.972475 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29854): Terminating (SIGTERM) 02:31:28.011997 run iperf3-srv_10.42.42.10(pid=29855): Terminating (SIGTERM) 02:31:28.051385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29856): Terminating (SIGTERM) 02:31:28.091069 run iperf3-srv_10.42.42.10(pid=29857): Terminating (SIGTERM) 02:31:28.130508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29860): Terminating (SIGTERM) 02:31:28.170086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29863): Terminating (SIGTERM) 02:31:28.209631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29866): Terminating (SIGTERM) 02:31:28.249527 --- ParallelTerminationStrategy: PID 29850 died... 02:31:28.268748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29850): Terminated: ok {rc=0} 02:31:28.312651 --- ParallelTerminationStrategy: PID 29851 died... 02:31:28.331113 run iperf3-srv_10.42.42.10(pid=29851): Terminated {rc=256} 02:31:28.374657 --- ParallelTerminationStrategy: PID 29852 died... 02:31:28.393321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29852): Terminated: ok {rc=0} 02:31:28.436874 --- ParallelTerminationStrategy: PID 29853 died... 02:31:28.455594 run iperf3-srv_10.42.42.10(pid=29853): Terminated {rc=256} 02:31:28.499111 --- ParallelTerminationStrategy: PID 29854 died... 02:31:28.517572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29854): Terminated: ok {rc=0} 02:31:28.561226 --- ParallelTerminationStrategy: PID 29855 died... 02:31:28.579761 run iperf3-srv_10.42.42.10(pid=29855): Terminated {rc=256} 02:31:28.623439 --- ParallelTerminationStrategy: PID 29856 died... 02:31:28.642091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29856): Terminated: ok {rc=0} 02:31:28.685666 --- ParallelTerminationStrategy: PID 29857 died... 02:31:28.704184 run iperf3-srv_10.42.42.10(pid=29857): Terminated {rc=256} 02:31:28.747977 --- ParallelTerminationStrategy: PID 29860 died... 02:31:28.766730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29860): Terminated: ok {rc=0} 02:31:28.810283 --- ParallelTerminationStrategy: PID 29863 died... 02:31:28.828922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29863): Terminated: ok {rc=0} 02:31:28.872417 --- ParallelTerminationStrategy: PID 29866 died... 02:31:28.891148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29866): Terminated: ok {rc=0} 02:31:28.973703 bus /gobi_4: Setting Powered False 02:31:30.069375 bus /gobi_4: Setting Powered False 02:31:31.185802 bus /gobi_1: Setting Powered False 02:31:32.285782 bus /gobi_1: Setting Powered False 02:31:33.402330 bus /gobi_0: Setting Powered False 02:31:34.500162 bus /gobi_0: Setting Powered False 02:31:35.615318 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 02:31:36.719566 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:36.731494 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:31:36.784179 tst ping.py: using LAC 37929 02:31:36.903925 tst ping.py: using RAC 189 02:31:37.020130 tst ping.py: using CellId 37929 02:31:37.145362 tst ping.py: using BVCI 37930 02:31:37.261210 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:37.272354 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:37.283367 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:37.294442 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:37.306208 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:37.317978 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:37.329982 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:37.341749 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:37.462044 tst ping.py:19: start network... 02:31:37.674041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:31:38.162498 run create_hlr_db(pid=29868): Launched 02:31:38.283371 bus /gobi_6: Setting Powered False 02:31:39.346162 run create_hlr_db(pid=29868): Terminated: ok {rc=0} 02:31:39.766739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29870): Launched 02:31:40.060891 run osmo-hlr_10.42.42.2(pid=29871): Launched 02:31:40.172042 run osmo-stp_10.42.42.5: Starting osmo-stp 02:31:40.696495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29873): Launched 02:31:40.989691 run osmo-stp_10.42.42.5(pid=29874): Launched 02:31:41.100891 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:31:41.609665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29876): Launched 02:31:41.721413 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:31:41.968639 run patchelf(pid=29877): Launched 02:31:42.132252 run osmo-stp_10.42.42.5(pid=29874): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29874)] 02:31:42.256293 run osmo-stp_10.42.42.5(pid=29874): stdout: | (launched: 2022-12-14_02:31:40.935989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:42.382252 run osmo-stp_10.42.42.5(pid=29874): stderr: | [0;m[38;5;43m20221214023141107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023141107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023141107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023141108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023141108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023141108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023141108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:42.507648 run osmo-stp_10.42.42.5(pid=29874): stdout: | (launched: 2022-12-14_02:31:40.935989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:42.628332 run osmo-stp_10.42.42.5(pid=29874): stderr: | [0;m[38;5;43m20221214023141107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023141107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023141107 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023141108 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023141108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023141108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023141108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:42.770697 run patchelf(pid=29877): Terminating (SIGINT) 02:31:42.936448 run patchelf(pid=29877): Terminated: ok {rc=0} 02:31:43.055866 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29874): Process ended prematurely: osmo-stp_10.42.42.5(pid=29874) [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29874)] [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 02:31:43.064715 tst ping.py:22: Test FAILED (6.3 sec) 02:31:43.091193 run osmo-hlr_10.42.42.2(pid=29871): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29871)] 02:31:43.138713 run osmo-hlr_10.42.42.2(pid=29871): stdout: | (launched: 2022-12-14_02:31:40.007639) 02:31:43.187534 run osmo-hlr_10.42.42.2(pid=29871): stderr: | [0;m[1;31m20221214023140183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023140183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023140183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023140183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023140183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023140183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023140195 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023140203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023140203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023140203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:31:43.236521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29870): Terminating (SIGTERM) 02:31:43.275885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29873): Terminating (SIGTERM) 02:31:43.315199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29876): Terminating (SIGTERM) 02:31:43.355148 --- ParallelTerminationStrategy: PID 29870 died... 02:31:43.374079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29870): Terminated: ok {rc=0} 02:31:43.417471 --- ParallelTerminationStrategy: PID 29873 died... 02:31:43.435688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29873): Terminated: ok {rc=0} 02:31:43.479186 --- ParallelTerminationStrategy: PID 29876 died... 02:31:43.497508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29876): Terminated: ok {rc=0} 02:31:43.581616 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:31:44.667584 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:44.678927 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:31:44.732549 tst ping_idle_ping.py: using LAC 37930 02:31:44.848606 tst ping_idle_ping.py: using RAC 190 02:31:44.962638 tst ping_idle_ping.py: using CellId 37930 02:31:45.075668 tst ping_idle_ping.py: using BVCI 37931 02:31:45.181494 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:45.192216 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:45.202850 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:45.213581 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:45.224019 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:45.235012 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:45.245721 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:31:45.256082 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:31:45.370572 tst ping_idle_ping.py:24: start network... 02:31:45.567138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:31:46.052299 run create_hlr_db(pid=29878): Launched 02:31:46.219266 bus /gobi_6: Setting Powered False 02:31:47.287235 run create_hlr_db(pid=29878): Terminated: ok {rc=0} 02:31:47.702551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29880): Launched 02:31:47.996162 run osmo-hlr_10.42.42.2(pid=29881): Launched 02:31:48.107705 run osmo-stp_10.42.42.5: Starting osmo-stp 02:31:48.632542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29883): Launched 02:31:48.926877 run osmo-stp_10.42.42.5(pid=29884): Launched 02:31:49.038725 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:31:49.546879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29886): Launched 02:31:49.659469 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:31:49.908773 run patchelf(pid=29887): Launched 02:31:50.073296 run osmo-stp_10.42.42.5(pid=29884): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29884)] 02:31:50.197830 run osmo-stp_10.42.42.5(pid=29884): stdout: | (launched: 2022-12-14_02:31:48.872840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:50.323547 run osmo-stp_10.42.42.5(pid=29884): stderr: | [0;m[38;5;43m20221214023149043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023149043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023149043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023149044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023149044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023149044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023149044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:50.449861 run osmo-stp_10.42.42.5(pid=29884): stdout: | (launched: 2022-12-14_02:31:48.872840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:31:50.570683 run osmo-stp_10.42.42.5(pid=29884): stderr: | [0;m[38;5;43m20221214023149043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023149043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023149043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023149044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023149044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023149044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023149044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:31:50.713955 run patchelf(pid=29887): Terminating (SIGINT) 02:31:50.882036 run patchelf(pid=29887): Terminated: ok {rc=0} 02:31:51.002701 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29884): Process ended prematurely: osmo-stp_10.42.42.5(pid=29884) [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29884)] [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 02:31:51.011471 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 02:31:51.037949 run osmo-hlr_10.42.42.2(pid=29881): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29881)] 02:31:51.085491 run osmo-hlr_10.42.42.2(pid=29881): stdout: | (launched: 2022-12-14_02:31:47.941719) 02:31:51.134341 run osmo-hlr_10.42.42.2(pid=29881): stderr: | [0;m[1;31m20221214023148117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023148117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023148117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023148117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023148117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023148117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023148130 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023148138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023148138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023148138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:31:51.183634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29880): Terminating (SIGTERM) 02:31:51.223006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29883): Terminating (SIGTERM) 02:31:51.262296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29886): Terminating (SIGTERM) 02:31:51.301983 --- ParallelTerminationStrategy: PID 29880 died... 02:31:51.320763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29880): Terminated: ok {rc=0} 02:31:51.364658 --- ParallelTerminationStrategy: PID 29883 died... 02:31:51.383200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29883): Terminated: ok {rc=0} 02:31:51.426548 --- ParallelTerminationStrategy: PID 29886 died... 02:31:51.445002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29886): Terminated: ok {rc=0} 02:31:51.527467 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:31:52.836603 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:31:52.843248 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:31:52.876415 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:31:52.916092 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:31:53.003824 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:31:53.037252 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:31:53.075886 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:31:53.670763 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:31:53.723556 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:53.734857 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:31:53.808682 tst cs_paging_gprs_active.py: using LAC 37931 02:31:53.927363 tst cs_paging_gprs_active.py: using RAC 191 02:31:54.046700 tst cs_paging_gprs_active.py: using CellId 37931 02:31:54.163174 tst cs_paging_gprs_active.py: using BVCI 37932 02:31:54.271982 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:54.282850 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:54.293611 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:54.303994 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:54.314403 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:54.324930 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:54.335496 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:54.345903 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:31:54.356436 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:31:54.471040 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:31:54.588508 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:31:54.806405 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:55.129312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29891): Launched 02:31:55.408840 run iperf3-srv_10.42.42.10(pid=29892): Launched 02:31:55.529771 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:31:55.746510 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:31:56.069035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29893): Launched 02:31:56.348855 run iperf3-srv_10.42.42.10(pid=29894): Launched 02:31:56.469897 tst cs_paging_gprs_active.py:38: start network... 02:31:56.687290 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:31:57.185293 run create_hlr_db(pid=29895): Launched 02:31:57.308664 bus /gobi_6: Setting Powered False 02:31:58.373053 run create_hlr_db(pid=29895): Terminated: ok {rc=0} 02:31:58.800435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29897): Launched 02:31:59.100315 run osmo-hlr_10.42.42.2(pid=29898): Launched 02:31:59.214640 run osmo-stp_10.42.42.5: Starting osmo-stp 02:31:59.732750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29900): Launched 02:32:00.032660 run osmo-stp_10.42.42.5(pid=29901): Launched 02:32:00.148414 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:32:00.665364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29903): Launched 02:32:00.779634 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:32:01.056724 run patchelf(pid=29904): Launched 02:32:01.240442 run osmo-stp_10.42.42.5(pid=29901): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29901)] 02:32:01.369251 run osmo-stp_10.42.42.5(pid=29901): stdout: | (launched: 2022-12-14_02:31:59.978133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:01.499598 run osmo-stp_10.42.42.5(pid=29901): stderr: | [0;m[38;5;43m20221214023200149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023200149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023200149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023200149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023200150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023200150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023200150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:01.630477 run osmo-stp_10.42.42.5(pid=29901): stdout: | (launched: 2022-12-14_02:31:59.978133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:01.755487 run osmo-stp_10.42.42.5(pid=29901): stderr: | [0;m[38;5;43m20221214023200149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023200149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023200149 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023200149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023200150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023200150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023200150 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:01.903557 run patchelf(pid=29904): Terminating (SIGINT) 02:32:02.076272 run patchelf(pid=29904): Terminated: ok {rc=0} 02:32:02.219934 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29901): Process ended prematurely: osmo-stp_10.42.42.5(pid=29901) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29901)] [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:32:02.230974 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 02:32:02.260262 run osmo-hlr_10.42.42.2(pid=29898): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29898)] 02:32:02.312615 run osmo-hlr_10.42.42.2(pid=29898): stdout: | (launched: 2022-12-14_02:31:59.045615) 02:32:02.365889 run osmo-hlr_10.42.42.2(pid=29898): stderr: | [0;m[1;31m20221214023159222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023159222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023159222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023159222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023159222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023159222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023159234 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023159243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023159243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023159243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:32:02.420935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29891): Terminating (SIGTERM) 02:32:02.463241 run iperf3-srv_10.42.42.10(pid=29892): Terminating (SIGTERM) 02:32:02.505991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29893): Terminating (SIGTERM) 02:32:02.548878 run iperf3-srv_10.42.42.10(pid=29894): Terminating (SIGTERM) 02:32:02.591839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29897): Terminating (SIGTERM) 02:32:02.634794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29900): Terminating (SIGTERM) 02:32:02.677884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29903): Terminating (SIGTERM) 02:32:02.720832 --- ParallelTerminationStrategy: PID 29891 died... 02:32:02.741836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29891): Terminated: ok {rc=0} 02:32:02.789082 --- ParallelTerminationStrategy: PID 29892 died... 02:32:02.809527 run iperf3-srv_10.42.42.10(pid=29892): Terminated {rc=256} 02:32:02.856260 --- ParallelTerminationStrategy: PID 29893 died... 02:32:02.876892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29893): Terminated: ok {rc=0} 02:32:02.923996 --- ParallelTerminationStrategy: PID 29894 died... 02:32:02.944813 run iperf3-srv_10.42.42.10(pid=29894): Terminated {rc=256} 02:32:02.991596 --- ParallelTerminationStrategy: PID 29897 died... 02:32:03.012057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29897): Terminated: ok {rc=0} 02:32:03.058840 --- ParallelTerminationStrategy: PID 29900 died... 02:32:03.079236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29900): Terminated: ok {rc=0} 02:32:03.126167 --- ParallelTerminationStrategy: PID 29903 died... 02:32:03.146713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29903): Terminated: ok {rc=0} 02:32:03.237051 bus /gobi_0: Setting Powered False 02:32:04.333635 bus /gobi_0: Setting Powered False 02:32:05.446925 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:32:06.596817 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:06.608793 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:32:06.681659 tst iperf3.py: using LAC 37932 02:32:06.808786 tst iperf3.py: using RAC 192 02:32:06.933963 tst iperf3.py: using CellId 37932 02:32:07.061179 tst iperf3.py: using BVCI 37933 02:32:07.177822 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:07.189134 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:07.200178 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:07.211813 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:07.223341 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:07.235189 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:07.246825 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:07.258520 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:07.270284 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:07.387205 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:32:07.587406 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:07.886715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29905): Launched 02:32:08.147205 run iperf3-srv_10.42.42.10(pid=29906): Launched 02:32:08.259172 tst iperf3.py:8: start network... 02:32:08.458317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:32:08.919664 run create_hlr_db(pid=29907): Launched 02:32:09.042690 bus /gobi_6: Setting Powered False 02:32:10.102655 run create_hlr_db(pid=29907): Terminated: ok {rc=0} 02:32:10.539644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29909): Launched 02:32:10.859572 run osmo-hlr_10.42.42.2(pid=29910): Launched 02:32:10.981833 run osmo-stp_10.42.42.5: Starting osmo-stp 02:32:11.532467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29912): Launched 02:32:11.852588 run osmo-stp_10.42.42.5(pid=29913): Launched 02:32:11.975218 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:32:12.529569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29915): Launched 02:32:12.652465 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:32:12.923367 run patchelf(pid=29916): Launched 02:32:13.102614 run osmo-stp_10.42.42.5(pid=29913): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29913)] 02:32:13.239190 run osmo-stp_10.42.42.5(pid=29913): stdout: | (launched: 2022-12-14_02:32:11.794654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:13.377507 run osmo-stp_10.42.42.5(pid=29913): stderr: | [0;m[38;5;43m20221214023211987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023211987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023211987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023211988 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023211990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023211990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023211990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:13.515511 run osmo-stp_10.42.42.5(pid=29913): stdout: | (launched: 2022-12-14_02:32:11.794654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:13.648410 run osmo-stp_10.42.42.5(pid=29913): stderr: | [0;m[38;5;43m20221214023211987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023211987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023211987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023211988 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023211990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023211990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023211990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:13.805839 run patchelf(pid=29916): Terminating (SIGINT) 02:32:13.987173 run patchelf(pid=29916): Terminated: ok {rc=0} 02:32:14.118203 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29913): Process ended prematurely: osmo-stp_10.42.42.5(pid=29913) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29913)] [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 02:32:14.128518 tst iperf3.py:8: Test FAILED (7.6 sec) 02:32:14.157380 run osmo-hlr_10.42.42.2(pid=29910): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29910)] 02:32:14.209286 run osmo-hlr_10.42.42.2(pid=29910): stdout: | (launched: 2022-12-14_02:32:10.801805) 02:32:14.262027 run osmo-hlr_10.42.42.2(pid=29910): stderr: | [0;m[1;31m20221214023211001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023211001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023211001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023211001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023211001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023211001 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023211012 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023211021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023211021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023211021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:32:14.315369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29905): Terminating (SIGTERM) 02:32:14.357763 run iperf3-srv_10.42.42.10(pid=29906): Terminating (SIGTERM) 02:32:14.400070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29909): Terminating (SIGTERM) 02:32:14.442902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29912): Terminating (SIGTERM) 02:32:14.485431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29915): Terminating (SIGTERM) 02:32:14.528259 --- ParallelTerminationStrategy: PID 29905 died... 02:32:14.548434 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29905): Terminated: ok {rc=0} 02:32:14.594958 --- ParallelTerminationStrategy: PID 29906 died... 02:32:14.614639 run iperf3-srv_10.42.42.10(pid=29906): Terminated {rc=256} 02:32:14.660782 --- ParallelTerminationStrategy: PID 29909 died... 02:32:14.681048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29909): Terminated: ok {rc=0} 02:32:14.727124 --- ParallelTerminationStrategy: PID 29912 died... 02:32:14.747058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29912): Terminated: ok {rc=0} 02:32:14.793237 --- ParallelTerminationStrategy: PID 29915 died... 02:32:14.812896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29915): Terminated: ok {rc=0} 02:32:14.901114 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:32:16.053732 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:16.066618 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:32:16.138099 tst iperf3m4.py: using LAC 37933 02:32:16.282997 tst iperf3m4.py: using RAC 193 02:32:16.409726 tst iperf3m4.py: using CellId 37933 02:32:16.536414 tst iperf3m4.py: using BVCI 37934 02:32:16.694541 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:16.708795 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:16.722055 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:16.736006 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:16.749953 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:16.764392 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:16.779178 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:16.793197 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:16.807827 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:16.936010 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:17.058288 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:17.200591 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:17.333605 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:32:17.552012 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:17.875310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29918): Launched 02:32:18.155896 run iperf3-srv_10.42.42.10(pid=29919): Launched 02:32:18.278125 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:32:18.496180 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:18.818403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29920): Launched 02:32:19.097883 run iperf3-srv_10.42.42.10(pid=29921): Launched 02:32:19.218998 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:32:19.435491 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:19.757083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29922): Launched 02:32:20.035897 run iperf3-srv_10.42.42.10(pid=29923): Launched 02:32:20.156657 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:32:20.374108 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:20.695599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29924): Launched 02:32:20.974480 run iperf3-srv_10.42.42.10(pid=29925): Launched 02:32:21.095083 tst iperf3m4.py:8: start network... 02:32:21.312584 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:32:21.810247 run create_hlr_db(pid=29926): Launched 02:32:21.932103 bus /gobi_6: Setting Powered False 02:32:22.996487 run create_hlr_db(pid=29926): Terminated: ok {rc=0} 02:32:23.443780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29928): Launched 02:32:23.765108 run osmo-hlr_10.42.42.2(pid=29929): Launched 02:32:23.888366 run osmo-stp_10.42.42.5: Starting osmo-stp 02:32:24.441617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29931): Launched 02:32:24.762082 run osmo-stp_10.42.42.5(pid=29932): Launched 02:32:24.884886 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:32:25.438997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29934): Launched 02:32:25.561600 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:32:25.832454 run patchelf(pid=29935): Launched 02:32:26.010699 run osmo-stp_10.42.42.5(pid=29932): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29932)] 02:32:26.146898 run osmo-stp_10.42.42.5(pid=29932): stdout: | (launched: 2022-12-14_02:32:24.704123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:26.285271 run osmo-stp_10.42.42.5(pid=29932): stderr: | [0;m[38;5;43m20221214023224894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023224894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023224894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023224894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023224895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023224895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023224895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:26.423034 run osmo-stp_10.42.42.5(pid=29932): stdout: | (launched: 2022-12-14_02:32:24.704123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:26.555355 run osmo-stp_10.42.42.5(pid=29932): stderr: | [0;m[38;5;43m20221214023224894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023224894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023224894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023224894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023224895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023224895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023224895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:26.711929 run patchelf(pid=29935): Terminating (SIGINT) 02:32:26.893622 run patchelf(pid=29935): Terminated: ok {rc=0} 02:32:27.024696 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29932): Process ended prematurely: osmo-stp_10.42.42.5(pid=29932) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29932)] [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:32:27.034814 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:32:27.063476 run osmo-hlr_10.42.42.2(pid=29929): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29929)] 02:32:27.114424 run osmo-hlr_10.42.42.2(pid=29929): stdout: | (launched: 2022-12-14_02:32:23.706759) 02:32:27.166521 run osmo-hlr_10.42.42.2(pid=29929): stderr: | [0;m[1;31m20221214023223903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023223903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023223903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023223903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023223903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023223903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023223963 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023223973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023223973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023223973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:32:27.219269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29918): Terminating (SIGTERM) 02:32:27.261531 run iperf3-srv_10.42.42.10(pid=29919): Terminating (SIGTERM) 02:32:27.303666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29920): Terminating (SIGTERM) 02:32:27.346436 run iperf3-srv_10.42.42.10(pid=29921): Terminating (SIGTERM) 02:32:27.388457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29922): Terminating (SIGTERM) 02:32:27.430933 run iperf3-srv_10.42.42.10(pid=29923): Terminating (SIGTERM) 02:32:27.473016 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29924): Terminating (SIGTERM) 02:32:27.515565 run iperf3-srv_10.42.42.10(pid=29925): Terminating (SIGTERM) 02:32:27.558008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29928): Terminating (SIGTERM) 02:32:27.600133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29931): Terminating (SIGTERM) 02:32:27.642502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29934): Terminating (SIGTERM) 02:32:27.684873 --- ParallelTerminationStrategy: PID 29918 died... 02:32:27.705329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29918): Terminated: ok {rc=0} 02:32:27.751987 --- ParallelTerminationStrategy: PID 29919 died... 02:32:27.771717 run iperf3-srv_10.42.42.10(pid=29919): Terminated {rc=256} 02:32:27.817908 --- ParallelTerminationStrategy: PID 29920 died... 02:32:27.837731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29920): Terminated: ok {rc=0} 02:32:27.883777 --- ParallelTerminationStrategy: PID 29921 died... 02:32:27.903662 run iperf3-srv_10.42.42.10(pid=29921): Terminated {rc=256} 02:32:27.949888 --- ParallelTerminationStrategy: PID 29922 died... 02:32:27.969875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29922): Terminated: ok {rc=0} 02:32:28.015965 --- ParallelTerminationStrategy: PID 29923 died... 02:32:28.035876 run iperf3-srv_10.42.42.10(pid=29923): Terminated {rc=256} 02:32:28.082108 --- ParallelTerminationStrategy: PID 29924 died... 02:32:28.101985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29924): Terminated: ok {rc=0} 02:32:28.148390 --- ParallelTerminationStrategy: PID 29925 died... 02:32:28.168138 run iperf3-srv_10.42.42.10(pid=29925): Terminated {rc=256} 02:32:28.214692 --- ParallelTerminationStrategy: PID 29928 died... 02:32:28.234577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29928): Terminated: ok {rc=0} 02:32:28.280900 --- ParallelTerminationStrategy: PID 29931 died... 02:32:28.301057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29931): Terminated: ok {rc=0} 02:32:28.347312 --- ParallelTerminationStrategy: PID 29934 died... 02:32:28.367288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29934): Terminated: ok {rc=0} 02:32:28.455171 bus /gobi_4: Setting Powered False 02:32:29.553215 bus /gobi_4: Setting Powered False 02:32:30.669434 bus /gobi_1: Setting Powered False 02:32:31.767742 bus /gobi_1: Setting Powered False 02:32:32.881075 bus /gobi_0: Setting Powered False 02:32:33.978975 bus /gobi_0: Setting Powered False 02:32:35.095712 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:32:36.198370 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:36.210444 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:32:36.282888 tst ping.py: using LAC 37934 02:32:36.410554 tst ping.py: using RAC 194 02:32:36.536049 tst ping.py: using CellId 37934 02:32:36.660864 tst ping.py: using BVCI 37935 02:32:36.775457 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:36.786871 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:36.797974 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:36.809103 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:36.820290 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:36.831645 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:36.843241 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:36.854691 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:36.972692 tst ping.py:19: start network... 02:32:37.185211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:32:37.673967 run create_hlr_db(pid=29936): Launched 02:32:37.793729 bus /gobi_6: Setting Powered False 02:32:38.855308 run create_hlr_db(pid=29936): Terminated: ok {rc=0} 02:32:39.277141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29938): Launched 02:32:39.570823 run osmo-hlr_10.42.42.2(pid=29939): Launched 02:32:39.683074 run osmo-stp_10.42.42.5: Starting osmo-stp 02:32:40.193628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29941): Launched 02:32:40.488240 run osmo-stp_10.42.42.5(pid=29942): Launched 02:32:40.600236 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:32:41.106973 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29944): Launched 02:32:41.219122 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:32:41.467270 run patchelf(pid=29945): Launched 02:32:41.631111 run osmo-stp_10.42.42.5(pid=29942): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29942)] 02:32:41.755646 run osmo-stp_10.42.42.5(pid=29942): stdout: | (launched: 2022-12-14_02:32:40.434437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:41.881817 run osmo-stp_10.42.42.5(pid=29942): stderr: | [0;m[38;5;43m20221214023240605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023240605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023240605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023240606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023240606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023240606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023240607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:42.007806 run osmo-stp_10.42.42.5(pid=29942): stdout: | (launched: 2022-12-14_02:32:40.434437) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:42.128622 run osmo-stp_10.42.42.5(pid=29942): stderr: | [0;m[38;5;43m20221214023240605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023240605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023240605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023240606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023240606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023240606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023240607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:42.271489 run patchelf(pid=29945): Terminating (SIGINT) 02:32:42.438976 run patchelf(pid=29945): Terminated: ok {rc=0} 02:32:42.559684 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29942): Process ended prematurely: osmo-stp_10.42.42.5(pid=29942) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29942)] [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 02:32:42.568384 tst ping.py:22: Test FAILED (6.4 sec) 02:32:42.595075 run osmo-hlr_10.42.42.2(pid=29939): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29939)] 02:32:42.642837 run osmo-hlr_10.42.42.2(pid=29939): stdout: | (launched: 2022-12-14_02:32:39.517213) 02:32:42.692044 run osmo-hlr_10.42.42.2(pid=29939): stderr: | [0;m[1;31m20221214023239691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023239691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023239691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023239691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023239691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023239691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023239704 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023239712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023239712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023239712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:32:42.742484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29938): Terminating (SIGTERM) 02:32:42.782404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29941): Terminating (SIGTERM) 02:32:42.822202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29944): Terminating (SIGTERM) 02:32:42.862268 --- ParallelTerminationStrategy: PID 29938 died... 02:32:42.881675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29938): Terminated: ok {rc=0} 02:32:42.926017 --- ParallelTerminationStrategy: PID 29941 died... 02:32:42.944891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29941): Terminated: ok {rc=0} 02:32:42.988848 --- ParallelTerminationStrategy: PID 29944 died... 02:32:43.007867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29944): Terminated: ok {rc=0} 02:32:43.091484 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:32:44.177284 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:44.189360 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:32:44.262047 tst ping_idle_ping.py: using LAC 37935 02:32:44.388318 tst ping_idle_ping.py: using RAC 195 02:32:44.514129 tst ping_idle_ping.py: using CellId 37935 02:32:44.638809 tst ping_idle_ping.py: using BVCI 37936 02:32:44.755892 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:44.767406 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:44.778653 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:44.789850 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:44.801299 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:44.812709 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:44.824417 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:32:44.835999 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:32:44.951837 tst ping_idle_ping.py:24: start network... 02:32:45.166014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:32:45.663972 run create_hlr_db(pid=29946): Launched 02:32:45.784038 bus /gobi_6: Setting Powered False 02:32:46.879308 run create_hlr_db(pid=29946): Terminated: ok {rc=0} 02:32:47.327310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29948): Launched 02:32:47.622251 run osmo-hlr_10.42.42.2(pid=29949): Launched 02:32:47.735531 run osmo-stp_10.42.42.5: Starting osmo-stp 02:32:48.241286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29951): Launched 02:32:48.535800 run osmo-stp_10.42.42.5(pid=29952): Launched 02:32:48.647680 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:32:49.154356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29954): Launched 02:32:49.266931 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:32:49.514723 run patchelf(pid=29955): Launched 02:32:49.678465 run osmo-stp_10.42.42.5(pid=29952): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29952)] 02:32:49.803533 run osmo-stp_10.42.42.5(pid=29952): stdout: | (launched: 2022-12-14_02:32:48.482285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:49.929665 run osmo-stp_10.42.42.5(pid=29952): stderr: | [0;m[38;5;43m20221214023248651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023248651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023248651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023248652 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023248652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023248652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023248652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:50.055649 run osmo-stp_10.42.42.5(pid=29952): stdout: | (launched: 2022-12-14_02:32:48.482285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:32:50.176632 run osmo-stp_10.42.42.5(pid=29952): stderr: | [0;m[38;5;43m20221214023248651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023248651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023248651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023248652 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023248652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023248652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023248652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:32:50.319879 run patchelf(pid=29955): Terminating (SIGINT) 02:32:50.487418 run patchelf(pid=29955): Terminated: ok {rc=0} 02:32:50.608216 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29952): Process ended prematurely: osmo-stp_10.42.42.5(pid=29952) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29952)] [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:32:50.617086 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:32:50.643443 run osmo-hlr_10.42.42.2(pid=29949): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29949)] 02:32:50.691235 run osmo-hlr_10.42.42.2(pid=29949): stdout: | (launched: 2022-12-14_02:32:47.568584) 02:32:50.740898 run osmo-hlr_10.42.42.2(pid=29949): stderr: | [0;m[1;31m20221214023247743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023247743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023247743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023247743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023247743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023247743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023247755 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023247766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023247766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023247766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:32:50.790413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29948): Terminating (SIGTERM) 02:32:50.830327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29951): Terminating (SIGTERM) 02:32:50.870010 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29954): Terminating (SIGTERM) 02:32:50.909783 --- ParallelTerminationStrategy: PID 29948 died... 02:32:50.928885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29948): Terminated: ok {rc=0} 02:32:50.972880 --- ParallelTerminationStrategy: PID 29951 died... 02:32:50.991959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29951): Terminated: ok {rc=0} 02:32:51.035989 --- ParallelTerminationStrategy: PID 29954 died... 02:32:51.054647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29954): Terminated: ok {rc=0} 02:32:51.139649 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:32:52.440644 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:32:52.446602 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:32:52.479188 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:32:52.516924 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:32:52.607890 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:32:52.640812 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:32:52.678229 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:32:53.264134 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:32:53.312218 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:53.323130 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:32:53.390878 tst cs_paging_gprs_active.py: using LAC 37936 02:32:53.507133 tst cs_paging_gprs_active.py: using RAC 196 02:32:53.624811 tst cs_paging_gprs_active.py: using CellId 37936 02:32:53.742560 tst cs_paging_gprs_active.py: using BVCI 37937 02:32:53.852457 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:53.863182 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:53.873768 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:53.884194 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:53.894542 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:53.905431 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:53.916085 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:53.926702 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:32:53.937469 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:32:54.057353 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:32:54.176045 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:32:54.395570 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:54.720160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29959): Launched 02:32:55.000479 run iperf3-srv_10.42.42.10(pid=29960): Launched 02:32:55.122450 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:32:55.341465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:32:55.664161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29961): Launched 02:32:55.944685 run iperf3-srv_10.42.42.10(pid=29962): Launched 02:32:56.066043 tst cs_paging_gprs_active.py:38: start network... 02:32:56.283945 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:32:56.784467 run create_hlr_db(pid=29963): Launched 02:32:56.908229 bus /gobi_6: Setting Powered False 02:32:57.971206 run create_hlr_db(pid=29963): Terminated: ok {rc=0} 02:32:58.400205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29965): Launched 02:32:58.723985 run osmo-hlr_10.42.42.2(pid=29966): Launched 02:32:58.847862 run osmo-stp_10.42.42.5: Starting osmo-stp 02:32:59.401298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29968): Launched 02:32:59.723576 run osmo-stp_10.42.42.5(pid=29969): Launched 02:32:59.847326 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:33:00.403640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29971): Launched 02:33:00.526926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:33:00.798330 run patchelf(pid=29972): Launched 02:33:00.983394 run osmo-stp_10.42.42.5(pid=29969): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29969)] 02:33:01.123284 run osmo-stp_10.42.42.5(pid=29969): stdout: | (launched: 2022-12-14_02:32:59.665285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:01.264214 run osmo-stp_10.42.42.5(pid=29969): stderr: | [0;m[38;5;43m20221214023259855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023259855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023259856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023259856 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023259857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023259857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023259857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:01.406040 run osmo-stp_10.42.42.5(pid=29969): stdout: | (launched: 2022-12-14_02:32:59.665285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:01.541455 run osmo-stp_10.42.42.5(pid=29969): stderr: | [0;m[38;5;43m20221214023259855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023259855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023259856 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023259856 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023259857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023259857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023259857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:01.701722 run patchelf(pid=29972): Terminating (SIGINT) 02:33:01.895713 run patchelf(pid=29972): Terminated: ok {rc=0} 02:33:02.030136 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29969): Process ended prematurely: osmo-stp_10.42.42.5(pid=29969) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29969)] [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:33:02.041380 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 02:33:02.070847 run osmo-hlr_10.42.42.2(pid=29966): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29966)] 02:33:02.125255 run osmo-hlr_10.42.42.2(pid=29966): stdout: | (launched: 2022-12-14_02:32:58.666047) 02:33:02.179346 run osmo-hlr_10.42.42.2(pid=29966): stderr: | [0;m[1;31m20221214023258863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023258863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023258863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023258863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023258863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023258863 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023258875 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023258883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023258883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023258883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:33:02.234300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29959): Terminating (SIGTERM) 02:33:02.276844 run iperf3-srv_10.42.42.10(pid=29960): Terminating (SIGTERM) 02:33:02.319686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29961): Terminating (SIGTERM) 02:33:02.361989 run iperf3-srv_10.42.42.10(pid=29962): Terminating (SIGTERM) 02:33:02.403893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29965): Terminating (SIGTERM) 02:33:02.446011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29968): Terminating (SIGTERM) 02:33:02.488135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29971): Terminating (SIGTERM) 02:33:02.530428 --- ParallelTerminationStrategy: PID 29959 died... 02:33:02.550739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29959): Terminated: ok {rc=0} 02:33:02.597189 --- ParallelTerminationStrategy: PID 29960 died... 02:33:02.616879 run iperf3-srv_10.42.42.10(pid=29960): Terminated {rc=256} 02:33:02.663044 --- ParallelTerminationStrategy: PID 29961 died... 02:33:02.682911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29961): Terminated: ok {rc=0} 02:33:02.728879 --- ParallelTerminationStrategy: PID 29962 died... 02:33:02.749049 run iperf3-srv_10.42.42.10(pid=29962): Terminated {rc=256} 02:33:02.794831 --- ParallelTerminationStrategy: PID 29965 died... 02:33:02.814582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29965): Terminated: ok {rc=0} 02:33:02.860724 --- ParallelTerminationStrategy: PID 29968 died... 02:33:02.880574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29968): Terminated: ok {rc=0} 02:33:02.926716 --- ParallelTerminationStrategy: PID 29971 died... 02:33:02.946466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29971): Terminated: ok {rc=0} 02:33:03.035260 bus /gobi_0: Setting Powered False 02:33:04.133485 bus /gobi_0: Setting Powered False 02:33:05.248250 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:33:06.400646 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:06.413094 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:33:06.487420 tst iperf3.py: using LAC 37937 02:33:06.613929 tst iperf3.py: using RAC 197 02:33:06.742344 tst iperf3.py: using CellId 37937 02:33:06.868266 tst iperf3.py: using BVCI 37938 02:33:06.987258 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:06.998708 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:07.009841 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:07.021135 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:07.032452 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:07.044003 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:07.055571 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:07.067126 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:07.078733 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:07.194249 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:33:07.394881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:07.694174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29974): Launched 02:33:07.954114 run iperf3-srv_10.42.42.10(pid=29975): Launched 02:33:08.066069 tst iperf3.py:8: start network... 02:33:08.265758 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:33:08.728100 run create_hlr_db(pid=29976): Launched 02:33:08.850572 bus /gobi_6: Setting Powered False 02:33:09.910446 run create_hlr_db(pid=29976): Terminated: ok {rc=0} 02:33:10.325840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29978): Launched 02:33:10.624132 run osmo-hlr_10.42.42.2(pid=29979): Launched 02:33:10.737737 run osmo-stp_10.42.42.5: Starting osmo-stp 02:33:11.266723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29981): Launched 02:33:11.564566 run osmo-stp_10.42.42.5(pid=29982): Launched 02:33:11.678141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:33:12.191806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29984): Launched 02:33:12.305870 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:33:12.558688 run patchelf(pid=29985): Launched 02:33:12.725766 run osmo-stp_10.42.42.5(pid=29982): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29982)] 02:33:12.851938 run osmo-stp_10.42.42.5(pid=29982): stdout: | (launched: 2022-12-14_02:33:11.509845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:12.979816 run osmo-stp_10.42.42.5(pid=29982): stderr: | [0;m[38;5;43m20221214023311681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023311681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023311681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023311682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023311682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023311682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023311683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:13.108054 run osmo-stp_10.42.42.5(pid=29982): stdout: | (launched: 2022-12-14_02:33:11.509845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:13.230829 run osmo-stp_10.42.42.5(pid=29982): stderr: | [0;m[38;5;43m20221214023311681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023311681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023311681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023311682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023311682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023311682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023311683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:13.376132 run patchelf(pid=29985): Terminating (SIGINT) 02:33:13.543944 run patchelf(pid=29985): Terminated: ok {rc=0} 02:33:13.664912 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29982): Process ended prematurely: osmo-stp_10.42.42.5(pid=29982) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29982)] [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 02:33:13.674582 tst iperf3.py:8: Test FAILED (7.3 sec) 02:33:13.701658 run osmo-hlr_10.42.42.2(pid=29979): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29979)] 02:33:13.749302 run osmo-hlr_10.42.42.2(pid=29979): stdout: | (launched: 2022-12-14_02:33:10.569231) 02:33:13.798610 run osmo-hlr_10.42.42.2(pid=29979): stderr: | [0;m[1;31m20221214023310747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023310747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023310747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023310747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023310747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023310747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023310761 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023310769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023310769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023310769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:33:13.848471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29974): Terminating (SIGTERM) 02:33:13.888279 run iperf3-srv_10.42.42.10(pid=29975): Terminating (SIGTERM) 02:33:13.928115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29978): Terminating (SIGTERM) 02:33:13.967983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29981): Terminating (SIGTERM) 02:33:14.008056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29984): Terminating (SIGTERM) 02:33:14.048142 --- ParallelTerminationStrategy: PID 29974 died... 02:33:14.066935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29974): Terminated: ok {rc=0} 02:33:14.110887 --- ParallelTerminationStrategy: PID 29975 died... 02:33:14.129268 run iperf3-srv_10.42.42.10(pid=29975): Terminated {rc=256} 02:33:14.172870 --- ParallelTerminationStrategy: PID 29978 died... 02:33:14.192000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29978): Terminated: ok {rc=0} 02:33:14.235766 --- ParallelTerminationStrategy: PID 29981 died... 02:33:14.254427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29981): Terminated: ok {rc=0} 02:33:14.298154 --- ParallelTerminationStrategy: PID 29984 died... 02:33:14.316746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29984): Terminated: ok {rc=0} 02:33:14.399616 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:33:15.547391 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:15.559318 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:33:15.631605 tst iperf3m4.py: using LAC 37938 02:33:15.759685 tst iperf3m4.py: using RAC 198 02:33:15.907712 tst iperf3m4.py: using CellId 37938 02:33:16.040189 tst iperf3m4.py: using BVCI 37939 02:33:16.154974 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:16.166624 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:16.177961 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:16.189196 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:16.200655 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:16.212159 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:16.223702 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:16.235569 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:16.248006 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:16.365140 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:16.487985 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:16.631799 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:16.772751 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:33:16.994932 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:17.322500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29986): Launched 02:33:17.602277 run iperf3-srv_10.42.42.10(pid=29987): Launched 02:33:17.723304 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:33:17.940776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:18.263772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29988): Launched 02:33:18.542797 run iperf3-srv_10.42.42.10(pid=29989): Launched 02:33:18.662953 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:33:18.880031 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:19.201723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29990): Launched 02:33:19.480575 run iperf3-srv_10.42.42.10(pid=29991): Launched 02:33:19.601195 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:33:19.818183 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:20.140079 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29992): Launched 02:33:20.419256 run iperf3-srv_10.42.42.10(pid=29993): Launched 02:33:20.539781 tst iperf3m4.py:8: start network... 02:33:20.756486 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:33:21.256725 run create_hlr_db(pid=29994): Launched 02:33:21.379163 bus /gobi_6: Setting Powered False 02:33:22.442344 run create_hlr_db(pid=29994): Terminated: ok {rc=0} 02:33:22.890127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29996): Launched 02:33:23.210604 run osmo-hlr_10.42.42.2(pid=29997): Launched 02:33:23.334382 run osmo-stp_10.42.42.5: Starting osmo-stp 02:33:23.889631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29999): Launched 02:33:24.209857 run osmo-stp_10.42.42.5(pid=30000): Launched 02:33:24.333188 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:33:24.886606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30002): Launched 02:33:25.009740 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:33:25.281285 run patchelf(pid=30003): Launched 02:33:25.459823 run osmo-stp_10.42.42.5(pid=30000): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30000)] 02:33:25.595779 run osmo-stp_10.42.42.5(pid=30000): stdout: | (launched: 2022-12-14_02:33:24.152035) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:25.733132 run osmo-stp_10.42.42.5(pid=30000): stderr: | [0;m[38;5;43m20221214023324342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023324342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023324343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023324343 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023324344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023324344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023324344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:25.870868 run osmo-stp_10.42.42.5(pid=30000): stdout: | (launched: 2022-12-14_02:33:24.152035) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:26.002859 run osmo-stp_10.42.42.5(pid=30000): stderr: | [0;m[38;5;43m20221214023324342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023324342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023324343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023324343 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023324344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023324344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023324344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:26.159265 run patchelf(pid=30003): Terminating (SIGINT) 02:33:26.340445 run patchelf(pid=30003): Terminated: ok {rc=0} 02:33:26.470845 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30000): Process ended prematurely: osmo-stp_10.42.42.5(pid=30000) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30000)] [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:33:26.480887 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:33:26.509452 run osmo-hlr_10.42.42.2(pid=29997): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29997)] 02:33:26.559773 run osmo-hlr_10.42.42.2(pid=29997): stdout: | (launched: 2022-12-14_02:33:23.152298) 02:33:26.611890 run osmo-hlr_10.42.42.2(pid=29997): stderr: | [0;m[1;31m20221214023323349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023323349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023323349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023323349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023323349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023323349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023323361 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023323369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023323370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023323370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:33:26.664232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29986): Terminating (SIGTERM) 02:33:26.706011 run iperf3-srv_10.42.42.10(pid=29987): Terminating (SIGTERM) 02:33:26.748584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29988): Terminating (SIGTERM) 02:33:26.790870 run iperf3-srv_10.42.42.10(pid=29989): Terminating (SIGTERM) 02:33:26.832684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29990): Terminating (SIGTERM) 02:33:26.874775 run iperf3-srv_10.42.42.10(pid=29991): Terminating (SIGTERM) 02:33:26.916588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29992): Terminating (SIGTERM) 02:33:26.958569 run iperf3-srv_10.42.42.10(pid=29993): Terminating (SIGTERM) 02:33:27.000405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29996): Terminating (SIGTERM) 02:33:27.043000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29999): Terminating (SIGTERM) 02:33:27.084914 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30002): Terminating (SIGTERM) 02:33:27.127143 --- ParallelTerminationStrategy: PID 29986 died... 02:33:27.147540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29986): Terminated: ok {rc=0} 02:33:27.194155 --- ParallelTerminationStrategy: PID 29987 died... 02:33:27.213926 run iperf3-srv_10.42.42.10(pid=29987): Terminated {rc=256} 02:33:27.260472 --- ParallelTerminationStrategy: PID 29988 died... 02:33:27.280143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29988): Terminated: ok {rc=0} 02:33:27.326491 --- ParallelTerminationStrategy: PID 29989 died... 02:33:27.346197 run iperf3-srv_10.42.42.10(pid=29989): Terminated {rc=256} 02:33:27.392320 --- ParallelTerminationStrategy: PID 29990 died... 02:33:27.412546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29990): Terminated: ok {rc=0} 02:33:27.458694 --- ParallelTerminationStrategy: PID 29991 died... 02:33:27.478448 run iperf3-srv_10.42.42.10(pid=29991): Terminated {rc=256} 02:33:27.524552 --- ParallelTerminationStrategy: PID 29992 died... 02:33:27.545080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29992): Terminated: ok {rc=0} 02:33:27.591268 --- ParallelTerminationStrategy: PID 29993 died... 02:33:27.611035 run iperf3-srv_10.42.42.10(pid=29993): Terminated {rc=256} 02:33:27.656930 --- ParallelTerminationStrategy: PID 29996 died... 02:33:27.676780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29996): Terminated: ok {rc=0} 02:33:27.722701 --- ParallelTerminationStrategy: PID 29999 died... 02:33:27.742375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29999): Terminated: ok {rc=0} 02:33:27.788414 --- ParallelTerminationStrategy: PID 30002 died... 02:33:27.808406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30002): Terminated: ok {rc=0} 02:33:27.896516 bus /gobi_4: Setting Powered False 02:33:28.996092 bus /gobi_4: Setting Powered False 02:33:30.111088 bus /gobi_1: Setting Powered False 02:33:31.217545 bus /gobi_1: Setting Powered False 02:33:32.353362 bus /gobi_0: Setting Powered False 02:33:33.450996 bus /gobi_0: Setting Powered False 02:33:34.566129 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:33:35.668566 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:35.680418 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:33:35.752735 tst ping.py: using LAC 37939 02:33:35.876646 tst ping.py: using RAC 199 02:33:36.001236 tst ping.py: using CellId 37939 02:33:36.125376 tst ping.py: using BVCI 37940 02:33:36.242273 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:36.253983 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:36.264913 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:36.276384 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:36.287700 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:36.299181 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:36.310734 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:36.322111 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:36.437394 tst ping.py:19: start network... 02:33:36.634280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:33:37.090706 run create_hlr_db(pid=30004): Launched 02:33:37.211622 bus /gobi_6: Setting Powered False 02:33:38.271725 run create_hlr_db(pid=30004): Terminated: ok {rc=0} 02:33:38.702388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30006): Launched 02:33:39.017978 run osmo-hlr_10.42.42.2(pid=30007): Launched 02:33:39.138386 run osmo-stp_10.42.42.5: Starting osmo-stp 02:33:39.688364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30009): Launched 02:33:40.002547 run osmo-stp_10.42.42.5(pid=30010): Launched 02:33:40.117901 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:33:40.624907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30012): Launched 02:33:40.737297 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:33:40.985143 run patchelf(pid=30013): Launched 02:33:41.148379 run osmo-stp_10.42.42.5(pid=30010): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30010)] 02:33:41.272158 run osmo-stp_10.42.42.5(pid=30010): stdout: | (launched: 2022-12-14_02:33:39.946109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:41.397816 run osmo-stp_10.42.42.5(pid=30010): stderr: | [0;m[38;5;43m20221214023340115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023340115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023340115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023340115 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023340118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023340118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023340118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:41.523338 run osmo-stp_10.42.42.5(pid=30010): stdout: | (launched: 2022-12-14_02:33:39.946109) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:41.643994 run osmo-stp_10.42.42.5(pid=30010): stderr: | [0;m[38;5;43m20221214023340115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023340115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023340115 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023340115 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023340118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023340118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023340118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:41.786648 run patchelf(pid=30013): Terminating (SIGINT) 02:33:41.953120 run patchelf(pid=30013): Terminated: ok {rc=0} 02:33:42.072634 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30010): Process ended prematurely: osmo-stp_10.42.42.5(pid=30010) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30010)] [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 02:33:42.081453 tst ping.py:22: Test FAILED (6.4 sec) 02:33:42.107891 run osmo-hlr_10.42.42.2(pid=30007): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30007)] 02:33:42.154948 run osmo-hlr_10.42.42.2(pid=30007): stdout: | (launched: 2022-12-14_02:33:38.960798) 02:33:42.204396 run osmo-hlr_10.42.42.2(pid=30007): stderr: | [0;m[1;31m20221214023339159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023339159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023339159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023339159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023339159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023339159 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023339173 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023339183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023339183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023339183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:33:42.253857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30006): Terminating (SIGTERM) 02:33:42.293511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30009): Terminating (SIGTERM) 02:33:42.332939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30012): Terminating (SIGTERM) 02:33:42.372739 --- ParallelTerminationStrategy: PID 30006 died... 02:33:42.391969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30006): Terminated: ok {rc=0} 02:33:42.435535 --- ParallelTerminationStrategy: PID 30009 died... 02:33:42.454067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30009): Terminated: ok {rc=0} 02:33:42.497367 --- ParallelTerminationStrategy: PID 30012 died... 02:33:42.515699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30012): Terminated: ok {rc=0} 02:33:42.600556 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:33:43.688114 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:43.699532 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:33:43.769703 tst ping_idle_ping.py: using LAC 37940 02:33:43.890363 tst ping_idle_ping.py: using RAC 200 02:33:44.007224 tst ping_idle_ping.py: using CellId 37940 02:33:44.122752 tst ping_idle_ping.py: using BVCI 37941 02:33:44.228524 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:44.239303 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:44.249792 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:44.260332 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:44.270784 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:44.281283 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:44.292233 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:33:44.302872 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:33:44.416882 tst ping_idle_ping.py:24: start network... 02:33:44.613333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:33:45.069795 run create_hlr_db(pid=30014): Launched 02:33:45.190272 bus /gobi_6: Setting Powered False 02:33:46.252330 run create_hlr_db(pid=30014): Terminated: ok {rc=0} 02:33:46.803127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30016): Launched 02:33:47.154141 run osmo-hlr_10.42.42.2(pid=30017): Launched 02:33:47.361921 run osmo-stp_10.42.42.5: Starting osmo-stp 02:33:47.907817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30019): Launched 02:33:48.223868 run osmo-stp_10.42.42.5(pid=30020): Launched 02:33:48.345973 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:33:48.891717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30022): Launched 02:33:49.013726 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:33:49.281089 run patchelf(pid=30023): Launched 02:33:49.457173 run osmo-stp_10.42.42.5(pid=30020): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30020)] 02:33:49.591094 run osmo-stp_10.42.42.5(pid=30020): stdout: | (launched: 2022-12-14_02:33:48.166703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:49.726839 run osmo-stp_10.42.42.5(pid=30020): stderr: | [0;m[38;5;43m20221214023348356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023348356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023348356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023348356 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023348357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023348357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023348357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:49.862366 run osmo-stp_10.42.42.5(pid=30020): stdout: | (launched: 2022-12-14_02:33:48.166703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:33:49.992652 run osmo-stp_10.42.42.5(pid=30020): stderr: | [0;m[38;5;43m20221214023348356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023348356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023348356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023348356 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023348357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023348357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023348357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:33:50.146856 run patchelf(pid=30023): Terminating (SIGINT) 02:33:50.326565 run patchelf(pid=30023): Terminated: ok {rc=0} 02:33:50.455488 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30020): Process ended prematurely: osmo-stp_10.42.42.5(pid=30020) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30020)] [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:33:50.464912 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 02:33:50.492818 run osmo-hlr_10.42.42.2(pid=30017): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30017)] 02:33:50.543023 run osmo-hlr_10.42.42.2(pid=30017): stdout: | (launched: 2022-12-14_02:33:47.092710) 02:33:50.594872 run osmo-hlr_10.42.42.2(pid=30017): stderr: | [0;m[1;31m20221214023347343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023347343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023347343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023347343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023347344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023347344 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023347355 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023347363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023347363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023347363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:33:50.647418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30016): Terminating (SIGTERM) 02:33:50.689050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30019): Terminating (SIGTERM) 02:33:50.730734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30022): Terminating (SIGTERM) 02:33:50.772767 --- ParallelTerminationStrategy: PID 30016 died... 02:33:50.793013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30016): Terminated: ok {rc=0} 02:33:50.839297 --- ParallelTerminationStrategy: PID 30019 died... 02:33:50.858948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30019): Terminated: ok {rc=0} 02:33:50.905227 --- ParallelTerminationStrategy: PID 30022 died... 02:33:50.924931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30022): Terminated: ok {rc=0} 02:33:51.013124 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 02:33:52.316363 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:33:52.322972 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 02:33:52.355368 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 02:33:52.393518 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 02:33:52.477182 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 02:33:52.509315 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 02:33:52.546690 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 02:33:53.150507 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 02:33:53.203377 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.214954 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:33:53.266455 tst cs_paging_gprs_active.py: using LAC 37941 02:33:53.393474 tst cs_paging_gprs_active.py: using RAC 201 02:33:53.510334 tst cs_paging_gprs_active.py: using CellId 37941 02:33:53.626461 tst cs_paging_gprs_active.py: using BVCI 37942 02:33:53.736616 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.748163 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.759033 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.769955 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.780700 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.791605 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.802818 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.813611 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:33:53.824656 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:33:53.945618 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:33:54.066364 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:33:54.285680 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:54.609417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30028): Launched 02:33:54.889699 run iperf3-srv_10.42.42.10(pid=30029): Launched 02:33:55.011096 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:33:55.229110 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:33:55.552858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30030): Launched 02:33:55.832917 run iperf3-srv_10.42.42.10(pid=30031): Launched 02:33:55.954324 tst cs_paging_gprs_active.py:38: start network... 02:33:56.172071 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:33:56.672607 run create_hlr_db(pid=30032): Launched 02:33:56.796530 bus /gobi_6: Setting Powered False 02:33:57.861186 run create_hlr_db(pid=30032): Terminated: ok {rc=0} 02:33:58.289674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30034): Launched 02:33:58.589185 run osmo-hlr_10.42.42.2(pid=30035): Launched 02:33:58.704053 run osmo-stp_10.42.42.5: Starting osmo-stp 02:33:59.219796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30037): Launched 02:33:59.518554 run osmo-stp_10.42.42.5(pid=30038): Launched 02:33:59.633287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:34:00.150090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30040): Launched 02:34:00.264546 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:34:00.517568 run patchelf(pid=30041): Launched 02:34:00.684547 run osmo-stp_10.42.42.5(pid=30038): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30038)] 02:34:00.811633 run osmo-stp_10.42.42.5(pid=30038): stdout: | (launched: 2022-12-14_02:33:59.463844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:00.947585 run osmo-stp_10.42.42.5(pid=30038): stderr: | [0;m[38;5;43m20221214023359634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023359635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023359635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023359635 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023359636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023359636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023359636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:01.078507 run osmo-stp_10.42.42.5(pid=30038): stdout: | (launched: 2022-12-14_02:33:59.463844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:01.203836 run osmo-stp_10.42.42.5(pid=30038): stderr: | [0;m[38;5;43m20221214023359634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023359635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023359635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023359635 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023359636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023359636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023359636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:01.352069 run patchelf(pid=30041): Terminating (SIGINT) 02:34:01.524889 run patchelf(pid=30041): Terminated: ok {rc=0} 02:34:01.649749 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30038): Process ended prematurely: osmo-stp_10.42.42.5(pid=30038) [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30038)] [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 02:34:01.660166 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 02:34:01.688445 run osmo-hlr_10.42.42.2(pid=30035): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30035)] 02:34:01.737156 run osmo-hlr_10.42.42.2(pid=30035): stdout: | (launched: 2022-12-14_02:33:58.534273) 02:34:01.787375 run osmo-hlr_10.42.42.2(pid=30035): stderr: | [0;m[1;31m20221214023358713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023358713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023358713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023358713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023358713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023358713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023358725 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023358734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023358734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023358734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:01.838154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30028): Terminating (SIGTERM) 02:34:01.879634 run iperf3-srv_10.42.42.10(pid=30029): Terminating (SIGTERM) 02:34:01.923253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30030): Terminating (SIGTERM) 02:34:01.964752 run iperf3-srv_10.42.42.10(pid=30031): Terminating (SIGTERM) 02:34:02.008392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30034): Terminating (SIGTERM) 02:34:02.049368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30037): Terminating (SIGTERM) 02:34:02.090302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30040): Terminating (SIGTERM) 02:34:02.132558 --- ParallelTerminationStrategy: PID 30028 died... 02:34:02.151739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30028): Terminated: ok {rc=0} 02:34:02.196133 --- ParallelTerminationStrategy: PID 30029 died... 02:34:02.215015 run iperf3-srv_10.42.42.10(pid=30029): Terminated {rc=256} 02:34:02.258952 --- ParallelTerminationStrategy: PID 30030 died... 02:34:02.277421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30030): Terminated: ok {rc=0} 02:34:02.320751 --- ParallelTerminationStrategy: PID 30031 died... 02:34:02.339089 run iperf3-srv_10.42.42.10(pid=30031): Terminated {rc=256} 02:34:02.382366 --- ParallelTerminationStrategy: PID 30034 died... 02:34:02.400648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30034): Terminated: ok {rc=0} 02:34:02.444321 --- ParallelTerminationStrategy: PID 30037 died... 02:34:02.462836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30037): Terminated: ok {rc=0} 02:34:02.506232 --- ParallelTerminationStrategy: PID 30040 died... 02:34:02.524711 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30040): Terminated: ok {rc=0} 02:34:02.609594 bus /gobi_0: Setting Powered False 02:34:03.708568 bus /gobi_0: Setting Powered False 02:34:04.824747 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 02:34:05.970757 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:05.982444 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:34:06.037471 tst iperf3.py: using LAC 37942 02:34:06.156663 tst iperf3.py: using RAC 202 02:34:06.275661 tst iperf3.py: using CellId 37942 02:34:06.395330 tst iperf3.py: using BVCI 37943 02:34:06.505714 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:06.516719 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:06.527640 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:06.538512 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:06.549342 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:06.560080 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:06.571170 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:06.582028 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:06.593007 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:06.707791 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:34:06.908462 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:34:07.209607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30042): Launched 02:34:07.470474 run iperf3-srv_10.42.42.10(pid=30043): Launched 02:34:07.582589 tst iperf3.py:8: start network... 02:34:07.782888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:34:08.248084 run create_hlr_db(pid=30044): Launched 02:34:08.370249 bus /gobi_6: Setting Powered False 02:34:09.433540 run create_hlr_db(pid=30044): Terminated: ok {rc=0} 02:34:09.880505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30046): Launched 02:34:10.201646 run osmo-hlr_10.42.42.2(pid=30047): Launched 02:34:10.324763 run osmo-stp_10.42.42.5: Starting osmo-stp 02:34:10.883651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30049): Launched 02:34:11.205706 run osmo-stp_10.42.42.5(pid=30050): Launched 02:34:11.329172 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:34:11.884237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30052): Launched 02:34:12.007324 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:34:12.278996 run patchelf(pid=30053): Launched 02:34:12.458478 run osmo-stp_10.42.42.5(pid=30050): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30050)] 02:34:12.594976 run osmo-stp_10.42.42.5(pid=30050): stdout: | (launched: 2022-12-14_02:34:11.147687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:12.733231 run osmo-stp_10.42.42.5(pid=30050): stderr: | [0;m[38;5;43m20221214023411339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023411339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023411339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023411339 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023411340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023411340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023411340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:12.871465 run osmo-stp_10.42.42.5(pid=30050): stdout: | (launched: 2022-12-14_02:34:11.147687) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:13.004130 run osmo-stp_10.42.42.5(pid=30050): stderr: | [0;m[38;5;43m20221214023411339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023411339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023411339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023411339 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023411340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023411340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023411340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:13.161514 run patchelf(pid=30053): Terminating (SIGINT) 02:34:13.344077 run patchelf(pid=30053): Terminated: ok {rc=0} 02:34:13.475668 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30050): Process ended prematurely: osmo-stp_10.42.42.5(pid=30050) [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30050)] [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 02:34:13.485851 tst iperf3.py:8: Test FAILED (7.6 sec) 02:34:13.514201 run osmo-hlr_10.42.42.2(pid=30047): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30047)] 02:34:13.564600 run osmo-hlr_10.42.42.2(pid=30047): stdout: | (launched: 2022-12-14_02:34:10.143896) 02:34:13.616754 run osmo-hlr_10.42.42.2(pid=30047): stderr: | [0;m[1;31m20221214023410343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023410343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023410343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023410343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023410343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023410343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023410355 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023410363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023410364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023410364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:13.668912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30042): Terminating (SIGTERM) 02:34:13.710636 run iperf3-srv_10.42.42.10(pid=30043): Terminating (SIGTERM) 02:34:13.753043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30046): Terminating (SIGTERM) 02:34:13.795245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30049): Terminating (SIGTERM) 02:34:13.837438 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30052): Terminating (SIGTERM) 02:34:13.879533 --- ParallelTerminationStrategy: PID 30042 died... 02:34:13.899804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30042): Terminated: ok {rc=0} 02:34:13.946589 --- ParallelTerminationStrategy: PID 30043 died... 02:34:13.966472 run iperf3-srv_10.42.42.10(pid=30043): Terminated {rc=256} 02:34:14.012678 --- ParallelTerminationStrategy: PID 30046 died... 02:34:14.032567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30046): Terminated: ok {rc=0} 02:34:14.078499 --- ParallelTerminationStrategy: PID 30049 died... 02:34:14.098579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30049): Terminated: ok {rc=0} 02:34:14.144820 --- ParallelTerminationStrategy: PID 30052 died... 02:34:14.165309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30052): Terminated: ok {rc=0} 02:34:14.253657 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 02:34:15.405451 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:15.417698 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:34:15.470873 tst iperf3m4.py: using LAC 37943 02:34:15.597189 tst iperf3m4.py: using RAC 203 02:34:15.723068 tst iperf3m4.py: using CellId 37943 02:34:15.863371 tst iperf3m4.py: using BVCI 37944 02:34:15.996086 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:16.009462 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:16.021614 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:16.033803 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:16.046966 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:16.058945 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:16.070674 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:16.082238 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:16.094116 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:16.217773 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:16.344564 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:16.469787 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:16.593595 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:34:16.816056 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:34:17.150110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30054): Launched 02:34:17.441753 run iperf3-srv_10.42.42.10(pid=30055): Launched 02:34:17.562265 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:34:17.779537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:34:18.101631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30056): Launched 02:34:18.381917 run iperf3-srv_10.42.42.10(pid=30057): Launched 02:34:18.502772 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:34:18.720215 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:34:19.043683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30058): Launched 02:34:19.324629 run iperf3-srv_10.42.42.10(pid=30059): Launched 02:34:19.445652 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:34:19.662853 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:34:19.985495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30060): Launched 02:34:20.264838 run iperf3-srv_10.42.42.10(pid=30061): Launched 02:34:20.386170 tst iperf3m4.py:8: start network... 02:34:20.603107 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:34:21.101618 run create_hlr_db(pid=30062): Launched 02:34:21.223764 bus /gobi_6: Setting Powered False 02:34:22.287142 run create_hlr_db(pid=30062): Terminated: ok {rc=0} 02:34:22.733635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30064): Launched 02:34:23.054053 run osmo-hlr_10.42.42.2(pid=30065): Launched 02:34:23.177202 run osmo-stp_10.42.42.5: Starting osmo-stp 02:34:23.738032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30067): Launched 02:34:24.057560 run osmo-stp_10.42.42.5(pid=30068): Launched 02:34:24.180589 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:34:24.735322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30070): Launched 02:34:24.859004 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:34:25.130007 run patchelf(pid=30071): Launched 02:34:25.309218 run osmo-stp_10.42.42.5(pid=30068): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30068)] 02:34:25.445323 run osmo-stp_10.42.42.5(pid=30068): stdout: | (launched: 2022-12-14_02:34:23.999678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:25.582769 run osmo-stp_10.42.42.5(pid=30068): stderr: | [0;m[38;5;43m20221214023424190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023424190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023424190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023424191 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023424193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023424193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023424193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:25.720146 run osmo-stp_10.42.42.5(pid=30068): stdout: | (launched: 2022-12-14_02:34:23.999678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:25.852401 run osmo-stp_10.42.42.5(pid=30068): stderr: | [0;m[38;5;43m20221214023424190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023424190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023424190 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023424191 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023424193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023424193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023424193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:26.008654 run patchelf(pid=30071): Terminating (SIGINT) 02:34:26.190601 run patchelf(pid=30071): Terminated: ok {rc=0} 02:34:26.322001 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30068): Process ended prematurely: osmo-stp_10.42.42.5(pid=30068) [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30068)] [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 02:34:26.332312 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:34:26.360881 run osmo-hlr_10.42.42.2(pid=30065): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30065)] 02:34:26.411749 run osmo-hlr_10.42.42.2(pid=30065): stdout: | (launched: 2022-12-14_02:34:22.995930) 02:34:26.463694 run osmo-hlr_10.42.42.2(pid=30065): stderr: | [0;m[1;31m20221214023423196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023423196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023423196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023423196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023423196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023423196 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023423207 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023423216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023423216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023423216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:26.516271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30054): Terminating (SIGTERM) 02:34:26.558396 run iperf3-srv_10.42.42.10(pid=30055): Terminating (SIGTERM) 02:34:26.600185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30056): Terminating (SIGTERM) 02:34:26.642668 run iperf3-srv_10.42.42.10(pid=30057): Terminating (SIGTERM) 02:34:26.684472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30058): Terminating (SIGTERM) 02:34:26.726834 run iperf3-srv_10.42.42.10(pid=30059): Terminating (SIGTERM) 02:34:26.768712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30060): Terminating (SIGTERM) 02:34:26.810600 run iperf3-srv_10.42.42.10(pid=30061): Terminating (SIGTERM) 02:34:26.852143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30064): Terminating (SIGTERM) 02:34:26.894153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30067): Terminating (SIGTERM) 02:34:26.935781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30070): Terminating (SIGTERM) 02:34:26.978321 --- ParallelTerminationStrategy: PID 30054 died... 02:34:26.998645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30054): Terminated: ok {rc=0} 02:34:27.045011 --- ParallelTerminationStrategy: PID 30055 died... 02:34:27.065068 run iperf3-srv_10.42.42.10(pid=30055): Terminated {rc=256} 02:34:27.111255 --- ParallelTerminationStrategy: PID 30056 died... 02:34:27.131060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30056): Terminated: ok {rc=0} 02:34:27.177108 --- ParallelTerminationStrategy: PID 30057 died... 02:34:27.196811 run iperf3-srv_10.42.42.10(pid=30057): Terminated {rc=256} 02:34:27.242997 --- ParallelTerminationStrategy: PID 30058 died... 02:34:27.262880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30058): Terminated: ok {rc=0} 02:34:27.309244 --- ParallelTerminationStrategy: PID 30059 died... 02:34:27.329493 run iperf3-srv_10.42.42.10(pid=30059): Terminated {rc=256} 02:34:27.375553 --- ParallelTerminationStrategy: PID 30060 died... 02:34:27.395335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30060): Terminated: ok {rc=0} 02:34:27.441521 --- ParallelTerminationStrategy: PID 30061 died... 02:34:27.461307 run iperf3-srv_10.42.42.10(pid=30061): Terminated {rc=256} 02:34:27.507056 --- ParallelTerminationStrategy: PID 30064 died... 02:34:27.526780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30064): Terminated: ok {rc=0} 02:34:27.572791 --- ParallelTerminationStrategy: PID 30067 died... 02:34:27.592866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30067): Terminated: ok {rc=0} 02:34:27.638717 --- ParallelTerminationStrategy: PID 30070 died... 02:34:27.658400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30070): Terminated: ok {rc=0} 02:34:27.746611 bus /gobi_4: Setting Powered False 02:34:28.846460 bus /gobi_4: Setting Powered False 02:34:29.963360 bus /gobi_1: Setting Powered False 02:34:31.061900 bus /gobi_1: Setting Powered False 02:34:32.178116 bus /gobi_0: Setting Powered False 02:34:33.274599 bus /gobi_0: Setting Powered False 02:34:34.390159 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 02:34:35.492722 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:35.504457 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:34:35.556543 tst ping.py: using LAC 37944 02:34:35.673840 tst ping.py: using RAC 204 02:34:35.790633 tst ping.py: using CellId 37944 02:34:35.907980 tst ping.py: using BVCI 37945 02:34:36.014010 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:36.025103 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:36.036005 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:36.046829 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:36.057642 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:36.068467 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:36.079478 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:36.090388 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:36.208749 tst ping.py:19: start network... 02:34:36.422385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:34:36.910934 run create_hlr_db(pid=30073): Launched 02:34:37.031491 bus /gobi_6: Setting Powered False 02:34:38.093845 run create_hlr_db(pid=30073): Terminated: ok {rc=0} 02:34:38.517021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30075): Launched 02:34:38.811138 run osmo-hlr_10.42.42.2(pid=30076): Launched 02:34:38.923374 run osmo-stp_10.42.42.5: Starting osmo-stp 02:34:39.436550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30078): Launched 02:34:39.730506 run osmo-stp_10.42.42.5(pid=30079): Launched 02:34:39.842792 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:34:40.350190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30081): Launched 02:34:40.462256 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:34:40.710710 run patchelf(pid=30082): Launched 02:34:40.873834 run osmo-stp_10.42.42.5(pid=30079): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30079)] 02:34:40.998311 run osmo-stp_10.42.42.5(pid=30079): stdout: | (launched: 2022-12-14_02:34:39.676570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:41.124016 run osmo-stp_10.42.42.5(pid=30079): stderr: | [0;m[38;5;43m20221214023439844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023439844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023439844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023439844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023439847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023439847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023439847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:41.249932 run osmo-stp_10.42.42.5(pid=30079): stdout: | (launched: 2022-12-14_02:34:39.676570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:41.371143 run osmo-stp_10.42.42.5(pid=30079): stderr: | [0;m[38;5;43m20221214023439844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023439844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023439844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023439844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023439847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023439847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023439847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:41.513941 run patchelf(pid=30082): Terminating (SIGINT) 02:34:41.680273 run patchelf(pid=30082): Terminated: ok {rc=0} 02:34:41.800641 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30079): Process ended prematurely: osmo-stp_10.42.42.5(pid=30079) [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30079)] [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 02:34:41.809603 tst ping.py:22: Test FAILED (6.3 sec) 02:34:41.836354 run osmo-hlr_10.42.42.2(pid=30076): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30076)] 02:34:41.883884 run osmo-hlr_10.42.42.2(pid=30076): stdout: | (launched: 2022-12-14_02:34:38.756751) 02:34:41.933306 run osmo-hlr_10.42.42.2(pid=30076): stderr: | [0;m[1;31m20221214023438930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023438930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023438930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023438930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023438930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023438930 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023438942 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023438951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023438951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023438951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:41.982993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30075): Terminating (SIGTERM) 02:34:42.022587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30078): Terminating (SIGTERM) 02:34:42.062202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30081): Terminating (SIGTERM) 02:34:42.102233 --- ParallelTerminationStrategy: PID 30075 died... 02:34:42.121305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30075): Terminated: ok {rc=0} 02:34:42.164899 --- ParallelTerminationStrategy: PID 30078 died... 02:34:42.183580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30078): Terminated: ok {rc=0} 02:34:42.227457 --- ParallelTerminationStrategy: PID 30081 died... 02:34:42.246092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30081): Terminated: ok {rc=0} 02:34:42.330059 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 02:34:43.416701 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:43.429248 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:34:43.487640 tst ping_idle_ping.py: using LAC 37945 02:34:43.603219 tst ping_idle_ping.py: using RAC 205 02:34:43.717939 tst ping_idle_ping.py: using CellId 37945 02:34:43.832435 tst ping_idle_ping.py: using BVCI 37946 02:34:43.939129 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:43.950343 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:43.961315 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:43.972190 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:43.982990 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:43.993901 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:44.004886 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:34:44.015785 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:34:44.133469 tst ping_idle_ping.py:24: start network... 02:34:44.348308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:34:44.841183 run create_hlr_db(pid=30083): Launched 02:34:44.962893 bus /gobi_6: Setting Powered False 02:34:46.037676 run create_hlr_db(pid=30083): Terminated: ok {rc=0} 02:34:46.511312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30085): Launched 02:34:46.859125 run osmo-hlr_10.42.42.2(pid=30086): Launched 02:34:47.100415 run osmo-stp_10.42.42.5: Starting osmo-stp 02:34:47.662319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30088): Launched 02:34:47.955108 run osmo-stp_10.42.42.5(pid=30089): Launched 02:34:48.066401 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:34:48.573379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30091): Launched 02:34:48.685851 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:34:48.934095 run patchelf(pid=30092): Launched 02:34:49.097540 run osmo-stp_10.42.42.5(pid=30089): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30089)] 02:34:49.221973 run osmo-stp_10.42.42.5(pid=30089): stdout: | (launched: 2022-12-14_02:34:47.901776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:49.347622 run osmo-stp_10.42.42.5(pid=30089): stderr: | [0;m[38;5;43m20221214023448069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023448069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023448069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023448069 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023448072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023448072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023448072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:49.473956 run osmo-stp_10.42.42.5(pid=30089): stdout: | (launched: 2022-12-14_02:34:47.901776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:49.594409 run osmo-stp_10.42.42.5(pid=30089): stderr: | [0;m[38;5;43m20221214023448069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023448069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023448069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023448069 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023448072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023448072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023448072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:49.737618 run patchelf(pid=30092): Terminating (SIGINT) 02:34:49.903516 run patchelf(pid=30092): Terminated: ok {rc=0} 02:34:50.023350 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30089): Process ended prematurely: osmo-stp_10.42.42.5(pid=30089) [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30089)] [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 02:34:50.032341 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 02:34:50.058976 run osmo-hlr_10.42.42.2(pid=30086): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30086)] 02:34:50.106798 run osmo-hlr_10.42.42.2(pid=30086): stdout: | (launched: 2022-12-14_02:34:46.786398) 02:34:50.156205 run osmo-hlr_10.42.42.2(pid=30086): stderr: | [0;m[1;31m20221214023446998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023446998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023446998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023446998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023446999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023446999 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023447013 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023447022 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023447023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023447024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:50.205908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30085): Terminating (SIGTERM) 02:34:50.245876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30088): Terminating (SIGTERM) 02:34:50.285673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30091): Terminating (SIGTERM) 02:34:50.325900 --- ParallelTerminationStrategy: PID 30085 died... 02:34:50.345243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30085): Terminated: ok {rc=0} 02:34:50.389277 --- ParallelTerminationStrategy: PID 30088 died... 02:34:50.407931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30088): Terminated: ok {rc=0} 02:34:50.451869 --- ParallelTerminationStrategy: PID 30091 died... 02:34:50.470468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30091): Terminated: ok {rc=0} 02:34:50.555867 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:34:51.863919 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:34:51.871024 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:34:51.903522 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:34:51.938419 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:34:51.990902 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:34:52.023636 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:34:52.057142 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:34:52.613038 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2398 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:34:52.617963 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:34:52.628904 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:34:52.696616 tst switch_tch_pdch.py: using LAC 37946 02:34:52.817713 tst switch_tch_pdch.py: using RAC 206 02:34:52.943589 tst switch_tch_pdch.py: using CellId 37946 02:34:53.063704 tst switch_tch_pdch.py: using BVCI 37947 02:34:53.171327 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:34:53.182446 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:34:53.193322 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:34:53.204045 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:34:53.214844 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:34:53.225583 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:34:53.236475 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:34:53.247313 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:34:53.366630 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:34:53.483504 tst switch_tch_pdch.py:51: start network... 02:34:53.679148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:34:54.132694 run create_hlr_db(pid=30096): Launched 02:34:54.252547 bus /gobi_6: Setting Powered False 02:34:55.311984 run create_hlr_db(pid=30096): Terminated: ok {rc=0} 02:34:55.743845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30098): Launched 02:34:56.059181 run osmo-hlr_10.42.42.2(pid=30099): Launched 02:34:56.179755 run osmo-stp_10.42.42.5: Starting osmo-stp 02:34:56.726067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30101): Launched 02:34:57.041857 run osmo-stp_10.42.42.5(pid=30102): Launched 02:34:57.162023 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:34:57.708821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30104): Launched 02:34:57.830094 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:34:58.097615 run patchelf(pid=30105): Launched 02:34:58.273695 run osmo-stp_10.42.42.5(pid=30102): ERR: Terminated: ERROR {rc=1} [trial-2398↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30102)] 02:34:58.409177 run osmo-stp_10.42.42.5(pid=30102): stdout: | (launched: 2022-12-14_02:34:56.984228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:58.545188 run osmo-stp_10.42.42.5(pid=30102): stderr: | [0;m[38;5;43m20221214023457178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023457178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023457179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023457179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023457179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023457179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023457180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:58.681401 run osmo-stp_10.42.42.5(pid=30102): stdout: | (launched: 2022-12-14_02:34:56.984228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:34:58.812188 run osmo-stp_10.42.42.5(pid=30102): stderr: | [0;m[38;5;43m20221214023457178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023457178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023457179 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023457179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023457179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023457179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023457180 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:34:58.967017 run patchelf(pid=30105): Terminating (SIGINT) 02:34:59.146412 run patchelf(pid=30105): Terminated: ok {rc=0} 02:34:59.275759 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30102): Process ended prematurely: osmo-stp_10.42.42.5(pid=30102) [trial-2398↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30102)] [trial-2398↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:34:59.285311 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 02:34:59.313662 run osmo-hlr_10.42.42.2(pid=30099): ERR: Terminated: ERROR {rc=237} [trial-2398↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30099)] 02:34:59.364119 run osmo-hlr_10.42.42.2(pid=30099): stdout: | (launched: 2022-12-14_02:34:56.001742) 02:34:59.416313 run osmo-hlr_10.42.42.2(pid=30099): stderr: | [0;m[1;31m20221214023456200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023456200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023456200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023456200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023456200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023456200 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023456213 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023456221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023456221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023456221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:34:59.468171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30098): Terminating (SIGTERM) 02:34:59.510263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30101): Terminating (SIGTERM) 02:34:59.553361 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30104): Terminating (SIGTERM) 02:34:59.595525 --- ParallelTerminationStrategy: PID 30098 died... 02:34:59.615824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30098): Terminated: ok {rc=0} 02:34:59.661742 --- ParallelTerminationStrategy: PID 30101 died... 02:34:59.681431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30101): Terminated: ok {rc=0} 02:34:59.727247 --- ParallelTerminationStrategy: PID 30104 died... 02:34:59.746933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30104): Terminated: ok {rc=0} 02:34:59.835200 bus /gobi_0: Setting Powered False 02:35:00.936172 bus /gobi_0: Setting Powered False 02:35:02.055583 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:35:03.307811 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:35:03.313553 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:35:03.345835 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:35:03.379845 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:35:03.432446 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:35:03.465768 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:35:03.500902 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:35:04.050807 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2398 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:35:04.057259 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:35:04.068459 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:35:04.140613 tst switch_tch_pdch.py: using LAC 37947 02:35:04.266424 tst switch_tch_pdch.py: using RAC 207 02:35:04.390926 tst switch_tch_pdch.py: using CellId 37947 02:35:04.517155 tst switch_tch_pdch.py: using BVCI 37948 02:35:04.632841 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:35:04.644102 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:35:04.655169 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:35:04.666307 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:35:04.677698 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:35:04.689074 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:35:04.700548 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:35:04.711979 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:35:04.832598 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:35:04.948665 tst switch_tch_pdch.py:51: start network... 02:35:05.144350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:35:05.574326 run create_hlr_db(pid=30113): Launched 02:35:05.695553 bus /gobi_6: Setting Powered False 02:35:06.754902 run create_hlr_db(pid=30113): Terminated: ok {rc=0} 02:35:07.139568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30115): Launched 02:35:07.432304 run osmo-hlr_10.42.42.2(pid=30116): Launched 02:35:07.545109 run osmo-stp_10.42.42.5: Starting osmo-stp 02:35:08.038711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30118): Launched 02:35:08.332117 run osmo-stp_10.42.42.5(pid=30119): Launched 02:35:08.443007 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:35:08.925464 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30121): Launched 02:35:09.037114 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:35:09.285609 run patchelf(pid=30122): Launched 02:35:09.448166 run osmo-stp_10.42.42.5(pid=30119): ERR: Terminated: ERROR {rc=1} [trial-2398↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30119)] 02:35:09.573881 run osmo-stp_10.42.42.5(pid=30119): stdout: | (launched: 2022-12-14_02:35:08.278209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:09.699656 run osmo-stp_10.42.42.5(pid=30119): stderr: | [0;m[38;5;43m20221214023508448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023508448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023508448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023508448 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023508449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023508449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023508449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:09.825350 run osmo-stp_10.42.42.5(pid=30119): stdout: | (launched: 2022-12-14_02:35:08.278209) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:09.945443 run osmo-stp_10.42.42.5(pid=30119): stderr: | [0;m[38;5;43m20221214023508448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023508448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023508448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023508448 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023508449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023508449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023508449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:10.088154 run patchelf(pid=30122): Terminating (SIGINT) 02:35:10.253973 run patchelf(pid=30122): Terminated: ok {rc=0} 02:35:10.373816 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30119): Process ended prematurely: osmo-stp_10.42.42.5(pid=30119) [trial-2398↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30119)] [trial-2398↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 02:35:10.382595 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 02:35:10.408795 run osmo-hlr_10.42.42.2(pid=30116): ERR: Terminated: ERROR {rc=237} [trial-2398↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30116)] 02:35:10.456150 run osmo-hlr_10.42.42.2(pid=30116): stdout: | (launched: 2022-12-14_02:35:07.378944) 02:35:10.505475 run osmo-hlr_10.42.42.2(pid=30116): stderr: | [0;m[1;31m20221214023507554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023507554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023507554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023507554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023507554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023507554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023507568 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023507578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023507578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023507578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:35:10.555111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30115): Terminating (SIGTERM) 02:35:10.594819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30118): Terminating (SIGTERM) 02:35:10.634326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30121): Terminating (SIGTERM) 02:35:10.674161 --- ParallelTerminationStrategy: PID 30115 died... 02:35:10.692923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30115): Terminated: ok {rc=0} 02:35:10.736752 --- ParallelTerminationStrategy: PID 30118 died... 02:35:10.755084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30118): Terminated: ok {rc=0} 02:35:10.798874 --- ParallelTerminationStrategy: PID 30121 died... 02:35:10.817346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30121): Terminated: ok {rc=0} 02:35:10.899866 bus /gobi_0: Setting Powered False 02:35:11.997453 bus /gobi_0: Setting Powered False 02:35:13.115228 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 02:35:14.364430 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:35:14.368402 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:35:14.401132 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 02:35:14.408000 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 02:35:14.458967 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:35:14.492565 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 02:35:14.499455 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 02:35:15.035777 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 02:35:15.040490 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 02:35:15.051245 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:35:15.098402 tst mo_mt_sms.py: using LAC 37948 02:35:15.215668 tst mo_mt_sms.py: using RAC 208 02:35:15.342922 tst mo_mt_sms.py: using CellId 37948 02:35:15.467715 tst mo_mt_sms.py: using BVCI 37949 02:35:15.582644 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:35:15.698895 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:35:15.815606 tst mo_mt_sms.py:9: start nitb and bts... 02:35:16.033682 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:35:16.695133 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30126): Launched 02:35:17.029657 run osmo-nitb_10.42.42.2(pid=30127): Launched 02:35:17.223574 run osmo-nitb_10.42.42.2(pid=30127): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30127)] 02:35:17.367472 run osmo-nitb_10.42.42.2(pid=30127): stdout: | (launched: 2022-12-14_02:35:16.960716) 02:35:17.512031 run osmo-nitb_10.42.42.2(pid=30127): stderr: | (launched: 2022-12-14_02:35:17.008473) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:35:17.656806 run osmo-nitb_10.42.42.2(pid=30127): stdout: | (launched: 2022-12-14_02:35:16.960716) 02:35:17.795470 run osmo-nitb_10.42.42.2(pid=30127): stderr: | (launched: 2022-12-14_02:35:17.008473) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30127): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30127) [trial-2398↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30127)] 02:35:18.166251 tst osmo-nitb_10.42.42.2(pid=30127): stdout: | (launched: 2022-12-14_02:35:16.960716) 02:35:18.294511 tst osmo-nitb_10.42.42.2(pid=30127): stderr: | (launched: 2022-12-14_02:35:17.008473) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:35:18.445914 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30127): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30127) [trial-2398↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30127)] [trial-2398↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 02:35:18.455134 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 02:35:18.462400 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30126): Terminating (SIGTERM) 02:35:18.673835 --- ParallelTerminationStrategy: PID 30126 died... 02:35:18.695827 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30126): Terminated: ok {rc=0} 02:35:18.784835 bus /sierra_3: Setting Powered False 02:35:19.884821 bus /sierra_3: Setting Powered False 02:35:21.002950 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 sms:trx-sysmocell5000 --------------------------------------------------------------------- 02:35:22.204446 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:35:22.208682 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:35:22.242725 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:35:22.270443 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 02:35:22.324001 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:35:22.358256 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:35:22.385425 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 02:35:22.928381 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 02:35:22.934098 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:22.945139 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:35:22.991899 tst mo_mt_sms.py: using LAC 37949 02:35:23.108910 tst mo_mt_sms.py: using RAC 209 02:35:23.224879 tst mo_mt_sms.py: using CellId 37949 02:35:23.339670 tst mo_mt_sms.py: using BVCI 37950 02:35:23.446646 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:23.457246 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:23.467713 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:23.478021 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:23.488269 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:23.498582 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:35:23.611591 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 02:35:23.730483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:35:24.220866 run create_hlr_db(pid=30132): Launched 02:35:24.342609 bus /sierra_2: Setting Powered False 02:35:25.405881 run create_hlr_db(pid=30132): Terminated: ok {rc=0} 02:35:25.828345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30134): Launched 02:35:26.121866 run osmo-hlr_10.42.42.2(pid=30135): Launched 02:35:26.233662 run osmo-stp_10.42.42.5: Starting osmo-stp 02:35:26.738600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30137): Launched 02:35:27.031265 run osmo-stp_10.42.42.5(pid=30138): Launched 02:35:27.142036 run osmo-msc_10.42.42.6: Starting osmo-msc 02:35:27.672921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30140): Launched 02:35:27.966379 run osmo-msc_10.42.42.6(pid=30141): Launched 02:35:28.129892 run osmo-stp_10.42.42.5(pid=30138): ERR: Terminated: ERROR {rc=1} [trial-2398↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30138)] 02:35:28.254192 run osmo-stp_10.42.42.5(pid=30138): stdout: | (launched: 2022-12-14_02:35:26.977736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:28.378618 run osmo-stp_10.42.42.5(pid=30138): stderr: | [0;m[38;5;43m20221214023527147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023527148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023527148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023527148 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023527149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023527149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023527149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:28.500719 run osmo-stp_10.42.42.5(pid=30138): stdout: | (launched: 2022-12-14_02:35:26.977736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:28.617299 run osmo-stp_10.42.42.5(pid=30138): stderr: | [0;m[38;5;43m20221214023527147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023527148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023527148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023527148 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023527149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023527149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023527149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:28.756411 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30138): Process ended prematurely: osmo-stp_10.42.42.5(pid=30138) [trial-2398↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30138)] [trial-2398↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 02:35:28.764563 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 02:35:28.790203 run osmo-hlr_10.42.42.2(pid=30135): ERR: Terminated: ERROR {rc=237} [trial-2398↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30135)] 02:35:28.837983 run osmo-hlr_10.42.42.2(pid=30135): stdout: | (launched: 2022-12-14_02:35:26.068637) 02:35:28.886985 run osmo-hlr_10.42.42.2(pid=30135): stderr: | [0;m[1;31m20221214023526242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023526242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023526242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023526242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023526242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023526242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023526255 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023526265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023526266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023526266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:35:28.955403 run osmo-msc_10.42.42.6(pid=30141): ERR: Terminated: ERROR {rc=2} [trial-2398↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30141)] 02:35:29.002571 run osmo-msc_10.42.42.6(pid=30141): stdout: | (launched: 2022-12-14_02:35:27.912679) 02:35:29.051276 run osmo-msc_10.42.42.6(pid=30141): stderr: | [0;m[38;5;43m20221214023528183 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023528183 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f267d684c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023528183 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023528183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023528183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023528184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023528187 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023528188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023528188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023528188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:35:29.100940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30134): Terminating (SIGTERM) 02:35:29.140233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30137): Terminating (SIGTERM) 02:35:29.179476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30140): Terminating (SIGTERM) 02:35:29.218975 --- ParallelTerminationStrategy: PID 30134 died... 02:35:29.237831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30134): Terminated: ok {rc=0} 02:35:29.281227 --- ParallelTerminationStrategy: PID 30137 died... 02:35:29.299587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30137): Terminated: ok {rc=0} 02:35:29.343626 --- ParallelTerminationStrategy: PID 30140 died... 02:35:29.361997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30140): Terminated: ok {rc=0} 02:35:29.444130 bus /sierra_3: Setting Powered False 02:35:30.541287 bus /sierra_3: Setting Powered False 02:35:31.659492 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 02:35:32.897795 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:35:32.902061 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:35:32.936046 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 02:35:32.943867 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 02:35:32.982424 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:35:33.018861 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 02:35:33.026266 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 02:35:33.542959 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2398 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 02:35:33.549198 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 02:35:33.561325 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:35:33.611618 tst assert_extension.py: using LAC 37950 02:35:33.727289 tst assert_extension.py: using RAC 210 02:35:33.842325 tst assert_extension.py: using CellId 37950 02:35:33.956026 tst assert_extension.py: using BVCI 37951 02:35:34.061589 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 02:35:34.179340 tst assert_extension.py:10: start nitb and bts... 02:35:34.392656 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:35:35.037297 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30146): Launched 02:35:35.353746 run osmo-nitb_10.42.42.2(pid=30147): Launched 02:35:35.529255 run osmo-nitb_10.42.42.2(pid=30147): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30147)] 02:35:35.671285 run osmo-nitb_10.42.42.2(pid=30147): stdout: | (launched: 2022-12-14_02:35:35.296063) 02:35:35.815582 run osmo-nitb_10.42.42.2(pid=30147): stderr: | (launched: 2022-12-14_02:35:35.343654) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:35:35.959119 run osmo-nitb_10.42.42.2(pid=30147): stdout: | (launched: 2022-12-14_02:35:35.296063) 02:35:36.097797 run osmo-nitb_10.42.42.2(pid=30147): stderr: | (launched: 2022-12-14_02:35:35.343654) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30147): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30147) [trial-2398↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30147)] 02:35:36.473203 tst osmo-nitb_10.42.42.2(pid=30147): stdout: | (launched: 2022-12-14_02:35:35.296063) 02:35:36.601076 tst osmo-nitb_10.42.42.2(pid=30147): stderr: | (launched: 2022-12-14_02:35:35.343654) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:35:36.751812 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=30147): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30147) [trial-2398↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30147)] [trial-2398↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 02:35:36.761084 tst assert_extension.py:12: Test FAILED (3.2 sec) 02:35:36.768337 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30146): Terminating (SIGTERM) 02:35:36.979687 --- ParallelTerminationStrategy: PID 30146 died... 02:35:37.001244 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30146): Terminated: ok {rc=0} 02:35:37.089863 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 02:35:38.269165 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:35:38.272863 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:35:38.305523 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:35:38.332831 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 02:35:38.366407 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:35:38.399754 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:35:38.426311 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 02:35:38.962626 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2398 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 02:35:38.968813 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:38.980782 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:35:39.030147 tst assert_extension.py: using LAC 37951 02:35:39.153485 tst assert_extension.py: using RAC 211 02:35:39.270095 tst assert_extension.py: using CellId 37951 02:35:39.385065 tst assert_extension.py: using BVCI 37952 02:35:39.490628 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:39.501238 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:39.511602 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:39.522057 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:39.532389 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:35:39.542793 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 02:35:39.662016 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:35:40.152860 run create_hlr_db(pid=30151): Launched 02:35:40.274667 bus /sierra_2: Setting Powered False 02:35:41.337934 run create_hlr_db(pid=30151): Terminated: ok {rc=0} 02:35:41.780124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30153): Launched 02:35:42.097514 run osmo-hlr_10.42.42.2(pid=30154): Launched 02:35:42.218406 run osmo-stp_10.42.42.5: Starting osmo-stp 02:35:42.854962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30156): Launched 02:35:43.165892 run osmo-stp_10.42.42.5(pid=30157): Launched 02:35:43.285677 run osmo-msc_10.42.42.6: Starting osmo-msc 02:35:43.848424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30159): Launched 02:35:44.141641 run osmo-msc_10.42.42.6(pid=30160): Launched 02:35:44.302654 run osmo-stp_10.42.42.5(pid=30157): ERR: Terminated: ERROR {rc=1} [trial-2398↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30157)] 02:35:44.425363 run osmo-stp_10.42.42.5(pid=30157): stdout: | (launched: 2022-12-14_02:35:43.109496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:44.548241 run osmo-stp_10.42.42.5(pid=30157): stderr: | [0;m[38;5;43m20221214023543299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023543299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023543299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023543300 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023543300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023543300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023543300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:44.669912 run osmo-stp_10.42.42.5(pid=30157): stdout: | (launched: 2022-12-14_02:35:43.109496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:44.785312 run osmo-stp_10.42.42.5(pid=30157): stderr: | [0;m[38;5;43m20221214023543299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023543299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023543299 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023543300 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023543300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023543300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023543300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:44.923255 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30157): Process ended prematurely: osmo-stp_10.42.42.5(pid=30157) [trial-2398↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30157)] [trial-2398↪ussd:trx-sysmocell5000↪assert_extension.py:17] 02:35:44.931487 tst assert_extension.py:17: Test FAILED (6.0 sec) 02:35:44.957127 run osmo-hlr_10.42.42.2(pid=30154): ERR: Terminated: ERROR {rc=237} [trial-2398↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30154)] 02:35:45.004717 run osmo-hlr_10.42.42.2(pid=30154): stdout: | (launched: 2022-12-14_02:35:42.040243) 02:35:45.053847 run osmo-hlr_10.42.42.2(pid=30154): stderr: | [0;m[1;31m20221214023542236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023542236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023542237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023542237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023542237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023542237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023542249 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023542258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023542258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023542258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:35:45.123588 run osmo-msc_10.42.42.6(pid=30160): ERR: Terminated: ERROR {rc=2} [trial-2398↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30160)] 02:35:45.170937 run osmo-msc_10.42.42.6(pid=30160): stdout: | (launched: 2022-12-14_02:35:44.089229) 02:35:45.220083 run osmo-msc_10.42.42.6(pid=30160): stderr: | [0;m[38;5;43m20221214023544359 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023544359 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc43a128c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023544359 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023544359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023544359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023544360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023544361 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023544362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023544362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023544362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:35:45.269764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30153): Terminating (SIGTERM) 02:35:45.309356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30156): Terminating (SIGTERM) 02:35:45.349035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30159): Terminating (SIGTERM) 02:35:45.388534 --- ParallelTerminationStrategy: PID 30153 died... 02:35:45.407499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30153): Terminated: ok {rc=0} 02:35:45.450783 --- ParallelTerminationStrategy: PID 30156 died... 02:35:45.469037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30156): Terminated: ok {rc=0} 02:35:45.512202 --- ParallelTerminationStrategy: PID 30159 died... 02:35:45.530532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30159): Terminated: ok {rc=0} 02:35:45.615083 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:35:46.834653 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:35:46.842517 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:35:46.880125 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:35:46.908843 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:35:46.964864 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:35:47.007842 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:35:47.040618 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:35:47.576514 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:35:47.630527 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:47.641512 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:35:47.712585 tst mo_mt_call.py: using LAC 37952 02:35:47.828451 tst mo_mt_call.py: using RAC 212 02:35:47.953356 tst mo_mt_call.py: using CellId 37952 02:35:48.075871 tst mo_mt_call.py: using BVCI 37953 02:35:48.191456 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:48.202947 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:48.214260 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:48.225693 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:48.237448 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:48.248915 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:35:48.368807 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:35:48.485751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:35:48.943474 run create_hlr_db(pid=30165): Launched 02:35:49.065544 bus /sierra_2: Setting Powered False 02:35:50.124773 run create_hlr_db(pid=30165): Terminated: ok {rc=0} 02:35:50.559255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30167): Launched 02:35:50.858570 run osmo-hlr_10.42.42.2(pid=30168): Launched 02:35:50.970883 run osmo-stp_10.42.42.5: Starting osmo-stp 02:35:51.477257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30170): Launched 02:35:51.771556 run osmo-stp_10.42.42.5(pid=30171): Launched 02:35:51.883765 run osmo-msc_10.42.42.6: Starting osmo-msc 02:35:52.425123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30174): Launched 02:35:52.721545 run osmo-msc_10.42.42.6(pid=30175): Launched 02:35:52.886261 run osmo-stp_10.42.42.5(pid=30171): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30171)] 02:35:53.013342 run osmo-stp_10.42.42.5(pid=30171): stdout: | (launched: 2022-12-14_02:35:51.717850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:53.139133 run osmo-stp_10.42.42.5(pid=30171): stderr: | [0;m[38;5;43m20221214023551887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023551888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023551888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023551888 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023551889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023551889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023551889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:53.262621 run osmo-stp_10.42.42.5(pid=30171): stdout: | (launched: 2022-12-14_02:35:51.717850) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:35:53.380521 run osmo-stp_10.42.42.5(pid=30171): stderr: | [0;m[38;5;43m20221214023551887 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023551888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023551888 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023551888 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023551889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023551889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023551889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:35:53.522230 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30171): Process ended prematurely: osmo-stp_10.42.42.5(pid=30171) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30171)] [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:35:53.531147 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 02:35:53.557301 run osmo-hlr_10.42.42.2(pid=30168): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30168)] 02:35:53.604844 run osmo-hlr_10.42.42.2(pid=30168): stdout: | (launched: 2022-12-14_02:35:50.805166) 02:35:53.654017 run osmo-hlr_10.42.42.2(pid=30168): stderr: | [0;m[1;31m20221214023550978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023550978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023550978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023550978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023550978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023550978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023550995 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023551004 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023551005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023551005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:35:53.722627 run osmo-msc_10.42.42.6(pid=30175): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30175)] 02:35:53.769884 run osmo-msc_10.42.42.6(pid=30175): stdout: | (launched: 2022-12-14_02:35:52.666714) 02:35:53.818828 run osmo-msc_10.42.42.6(pid=30175): stderr: | [0;m[38;5;43m20221214023552934 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023552934 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3b845edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023552934 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023552934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023552934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023552934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023552936 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023552936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023552937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023552937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:35:53.868215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30167): Terminating (SIGTERM) 02:35:53.908008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30170): Terminating (SIGTERM) 02:35:53.947840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30174): Terminating (SIGTERM) 02:35:53.987654 --- ParallelTerminationStrategy: PID 30167 died... 02:35:54.006639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30167): Terminated: ok {rc=0} 02:35:54.049925 --- ParallelTerminationStrategy: PID 30170 died... 02:35:54.068270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30170): Terminated: ok {rc=0} 02:35:54.111646 --- ParallelTerminationStrategy: PID 30174 died... 02:35:54.130178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30174): Terminated: ok {rc=0} 02:35:54.215349 bus /sierra_3: Setting Powered False 02:35:55.314269 bus /sierra_3: Setting Powered False 02:35:56.426302 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:35:57.573140 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:57.585355 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:35:57.656229 tst mo_mt_call_osmux.py: using LAC 37953 02:35:57.783047 tst mo_mt_call_osmux.py: using RAC 213 02:35:57.909240 tst mo_mt_call_osmux.py: using CellId 37953 02:35:58.035204 tst mo_mt_call_osmux.py: using BVCI 37954 02:35:58.152677 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:58.164163 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:58.175518 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:58.186860 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:58.198626 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:35:58.210277 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:35:58.327512 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:35:58.446482 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:35:58.939807 run create_hlr_db(pid=30177): Launched 02:35:59.060484 bus /sierra_2: Setting Powered False 02:36:00.123802 run create_hlr_db(pid=30177): Terminated: ok {rc=0} 02:36:00.547934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30179): Launched 02:36:00.845632 run osmo-hlr_10.42.42.2(pid=30180): Launched 02:36:01.018402 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:01.772170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30182): Launched 02:36:02.098938 run osmo-stp_10.42.42.5(pid=30183): Launched 02:36:02.449580 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:03.029260 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30185): Launched 02:36:03.348142 run osmo-msc_10.42.42.6(pid=30186): Launched 02:36:03.525913 run osmo-stp_10.42.42.5(pid=30183): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30183)] 02:36:03.660225 run osmo-stp_10.42.42.5(pid=30183): stdout: | (launched: 2022-12-14_02:36:02.031129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:03.795256 run osmo-stp_10.42.42.5(pid=30183): stderr: | [0;m[38;5;43m20221214023602228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023602228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023602228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023602230 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023602230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023602230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023602230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:03.929605 run osmo-stp_10.42.42.5(pid=30183): stdout: | (launched: 2022-12-14_02:36:02.031129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:04.057076 run osmo-stp_10.42.42.5(pid=30183): stderr: | [0;m[38;5;43m20221214023602228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023602228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023602228 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023602230 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023602230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023602230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023602230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:04.209673 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30183): Process ended prematurely: osmo-stp_10.42.42.5(pid=30183) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30183)] [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:36:04.219396 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 02:36:04.246788 run osmo-hlr_10.42.42.2(pid=30180): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30180)] 02:36:04.297561 run osmo-hlr_10.42.42.2(pid=30180): stdout: | (launched: 2022-12-14_02:36:00.791090) 02:36:04.350432 run osmo-hlr_10.42.42.2(pid=30180): stderr: | [0;m[1;31m20221214023601076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023601076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023601076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023601076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023601076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023601077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023601097 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023601114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023601114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023601114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:04.422920 run osmo-msc_10.42.42.6(pid=30186): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30186)] 02:36:04.472378 run osmo-msc_10.42.42.6(pid=30186): stdout: | (launched: 2022-12-14_02:36:03.290104) 02:36:04.524131 run osmo-msc_10.42.42.6(pid=30186): stderr: | [0;m[38;5;43m20221214023603610 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023603610 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5bda7cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023603610 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023603610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023603611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023603611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023603612 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023603613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023603613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023603613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:04.576427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30179): Terminating (SIGTERM) 02:36:04.618194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30182): Terminating (SIGTERM) 02:36:04.660350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30185): Terminating (SIGTERM) 02:36:04.702259 --- ParallelTerminationStrategy: PID 30179 died... 02:36:04.722644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30179): Terminated: ok {rc=0} 02:36:04.768926 --- ParallelTerminationStrategy: PID 30182 died... 02:36:04.789117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30182): Terminated: ok {rc=0} 02:36:04.834818 --- ParallelTerminationStrategy: PID 30185 died... 02:36:04.854622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30185): Terminated: ok {rc=0} 02:36:04.942357 bus /sierra_3: Setting Powered False 02:36:06.040662 bus /sierra_3: Setting Powered False 02:36:07.156926 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:36:08.410500 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:36:08.417536 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:36:08.451284 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:36:08.479626 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:36:08.531633 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:36:08.567986 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:36:08.595622 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:36:09.144465 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:36:09.196804 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:09.208482 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:36:09.280008 tst mo_mt_call.py: using LAC 37954 02:36:09.407307 tst mo_mt_call.py: using RAC 214 02:36:09.534300 tst mo_mt_call.py: using CellId 37954 02:36:09.660159 tst mo_mt_call.py: using BVCI 37955 02:36:09.777749 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:09.789357 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:09.800656 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:09.811963 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:09.824262 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:09.836410 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:36:09.954560 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:36:10.072183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:36:10.531279 run create_hlr_db(pid=30191): Launched 02:36:10.653172 bus /sierra_2: Setting Powered False 02:36:11.712912 run create_hlr_db(pid=30191): Terminated: ok {rc=0} 02:36:12.125948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30193): Launched 02:36:12.420682 run osmo-hlr_10.42.42.2(pid=30194): Launched 02:36:12.532718 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:13.042920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30196): Launched 02:36:13.338205 run osmo-stp_10.42.42.5(pid=30197): Launched 02:36:13.449787 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:13.989946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30199): Launched 02:36:14.287043 run osmo-msc_10.42.42.6(pid=30200): Launched 02:36:14.452922 run osmo-stp_10.42.42.5(pid=30197): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30197)] 02:36:14.578318 run osmo-stp_10.42.42.5(pid=30197): stdout: | (launched: 2022-12-14_02:36:13.283575) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:14.703734 run osmo-stp_10.42.42.5(pid=30197): stderr: | [0;m[38;5;43m20221214023613452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023613452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023613452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023613452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023613455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023613455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023613455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:14.827561 run osmo-stp_10.42.42.5(pid=30197): stdout: | (launched: 2022-12-14_02:36:13.283575) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:14.945908 run osmo-stp_10.42.42.5(pid=30197): stderr: | [0;m[38;5;43m20221214023613452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023613452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023613452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023613452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023613455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023613455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023613455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:15.088064 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30197): Process ended prematurely: osmo-stp_10.42.42.5(pid=30197) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30197)] [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:36:15.097019 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 02:36:15.123066 run osmo-hlr_10.42.42.2(pid=30194): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30194)] 02:36:15.170894 run osmo-hlr_10.42.42.2(pid=30194): stdout: | (launched: 2022-12-14_02:36:12.366928) 02:36:15.219743 run osmo-hlr_10.42.42.2(pid=30194): stderr: | [0;m[1;31m20221214023612542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023612542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023612542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023612542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023612542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023612542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023612555 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023612563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023612563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023612563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:15.287985 run osmo-msc_10.42.42.6(pid=30200): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30200)] 02:36:15.334974 run osmo-msc_10.42.42.6(pid=30200): stdout: | (launched: 2022-12-14_02:36:14.232649) 02:36:15.383764 run osmo-msc_10.42.42.6(pid=30200): stderr: | [0;m[38;5;43m20221214023614503 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023614503 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9a95855c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023614503 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023614503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023614504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023614504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023614506 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023614506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023614506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023614506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:15.433045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30193): Terminating (SIGTERM) 02:36:15.472299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30196): Terminating (SIGTERM) 02:36:15.511601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30199): Terminating (SIGTERM) 02:36:15.551057 --- ParallelTerminationStrategy: PID 30193 died... 02:36:15.569954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30193): Terminated: ok {rc=0} 02:36:15.613304 --- ParallelTerminationStrategy: PID 30196 died... 02:36:15.631520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30196): Terminated: ok {rc=0} 02:36:15.674726 --- ParallelTerminationStrategy: PID 30199 died... 02:36:15.693125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30199): Terminated: ok {rc=0} 02:36:15.777978 bus /sierra_3: Setting Powered False 02:36:16.877143 bus /sierra_3: Setting Powered False 02:36:17.996912 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:36:19.141502 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:19.153909 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:36:19.222301 tst mo_mt_call_osmux.py: using LAC 37955 02:36:19.340021 tst mo_mt_call_osmux.py: using RAC 215 02:36:19.458456 tst mo_mt_call_osmux.py: using CellId 37955 02:36:19.580524 tst mo_mt_call_osmux.py: using BVCI 37956 02:36:19.689988 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:19.701481 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:19.712210 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:19.722902 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:19.733843 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:36:19.744684 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:36:19.864604 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:36:19.980696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:36:20.440858 run create_hlr_db(pid=30202): Launched 02:36:20.562399 bus /sierra_2: Setting Powered False 02:36:21.621433 run create_hlr_db(pid=30202): Terminated: ok {rc=0} 02:36:22.054106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30204): Launched 02:36:22.373056 run osmo-hlr_10.42.42.2(pid=30205): Launched 02:36:22.494953 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:23.045130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30207): Launched 02:36:23.364109 run osmo-stp_10.42.42.5(pid=30208): Launched 02:36:23.486281 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:24.062615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30210): Launched 02:36:24.381939 run osmo-msc_10.42.42.6(pid=30211): Launched 02:36:24.559804 run osmo-stp_10.42.42.5(pid=30208): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30208)] 02:36:24.695417 run osmo-stp_10.42.42.5(pid=30208): stdout: | (launched: 2022-12-14_02:36:23.306315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:24.831313 run osmo-stp_10.42.42.5(pid=30208): stderr: | [0;m[38;5;43m20221214023623499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023623499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023623499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023623500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023623500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023623500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023623500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:24.966649 run osmo-stp_10.42.42.5(pid=30208): stdout: | (launched: 2022-12-14_02:36:23.306315) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:25.094284 run osmo-stp_10.42.42.5(pid=30208): stderr: | [0;m[38;5;43m20221214023623499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023623499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023623499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023623500 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023623500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023623500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023623500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:25.247105 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30208): Process ended prematurely: osmo-stp_10.42.42.5(pid=30208) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30208)] [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:36:25.256726 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:36:25.284132 run osmo-hlr_10.42.42.2(pid=30205): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30205)] 02:36:25.334929 run osmo-hlr_10.42.42.2(pid=30205): stdout: | (launched: 2022-12-14_02:36:22.315006) 02:36:25.386927 run osmo-hlr_10.42.42.2(pid=30205): stderr: | [0;m[1;31m20221214023622510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023622510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023622510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023622510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023622510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023622511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023622522 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023622530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023622530 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023622531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:25.458997 run osmo-msc_10.42.42.6(pid=30211): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30211)] 02:36:25.508442 run osmo-msc_10.42.42.6(pid=30211): stdout: | (launched: 2022-12-14_02:36:24.323916) 02:36:25.560254 run osmo-msc_10.42.42.6(pid=30211): stderr: | [0;m[38;5;43m20221214023624644 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023624644 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa13c353c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023624644 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023624644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023624644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023624645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023624646 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023624647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023624647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023624647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:25.611968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30204): Terminating (SIGTERM) 02:36:25.653644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30207): Terminating (SIGTERM) 02:36:25.695745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30210): Terminating (SIGTERM) 02:36:25.738057 --- ParallelTerminationStrategy: PID 30204 died... 02:36:25.758278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30204): Terminated: ok {rc=0} 02:36:25.804511 --- ParallelTerminationStrategy: PID 30207 died... 02:36:25.824374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30207): Terminated: ok {rc=0} 02:36:25.870335 --- ParallelTerminationStrategy: PID 30210 died... 02:36:25.890051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30210): Terminated: ok {rc=0} 02:36:25.977701 bus /sierra_3: Setting Powered False 02:36:27.075518 bus /sierra_3: Setting Powered False 02:36:28.190526 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:36:29.441964 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:36:29.450587 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:36:29.485272 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:36:29.512122 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:36:29.562014 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:36:29.596049 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:36:29.623320 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:36:30.177701 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:36:30.229864 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:30.241588 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:36:30.310634 tst mo_mt_call.py: using LAC 37956 02:36:30.434327 tst mo_mt_call.py: using RAC 216 02:36:30.558806 tst mo_mt_call.py: using CellId 37956 02:36:30.682825 tst mo_mt_call.py: using BVCI 37957 02:36:30.798632 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:30.810180 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:30.821453 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:30.835834 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:30.849779 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:30.862766 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:36:30.989436 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:36:31.124585 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:36:31.691533 run create_hlr_db(pid=30216): Launched 02:36:31.817130 bus /sierra_2: Setting Powered False 02:36:32.880512 run create_hlr_db(pid=30216): Terminated: ok {rc=0} 02:36:33.305981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30218): Launched 02:36:33.601613 run osmo-hlr_10.42.42.2(pid=30219): Launched 02:36:33.715290 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:34.224126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30221): Launched 02:36:34.520506 run osmo-stp_10.42.42.5(pid=30222): Launched 02:36:34.634223 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:35.171876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30224): Launched 02:36:35.468902 run osmo-msc_10.42.42.6(pid=30225): Launched 02:36:35.634791 run osmo-stp_10.42.42.5(pid=30222): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30222)] 02:36:35.762521 run osmo-stp_10.42.42.5(pid=30222): stdout: | (launched: 2022-12-14_02:36:34.466657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:35.887747 run osmo-stp_10.42.42.5(pid=30222): stderr: | [0;m[38;5;43m20221214023634638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023634638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023634638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023634638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023634639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023634639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023634639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:36.011433 run osmo-stp_10.42.42.5(pid=30222): stdout: | (launched: 2022-12-14_02:36:34.466657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:36.129748 run osmo-stp_10.42.42.5(pid=30222): stderr: | [0;m[38;5;43m20221214023634638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023634638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023634638 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023634638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023634639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023634639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023634639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:36.272231 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30222): Process ended prematurely: osmo-stp_10.42.42.5(pid=30222) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30222)] [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:36:36.281259 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:36:36.307305 run osmo-hlr_10.42.42.2(pid=30219): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30219)] 02:36:36.354547 run osmo-hlr_10.42.42.2(pid=30219): stdout: | (launched: 2022-12-14_02:36:33.547582) 02:36:36.403618 run osmo-hlr_10.42.42.2(pid=30219): stderr: | [0;m[1;31m20221214023633723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023633723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023633723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023633723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023633723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023633723 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023633752 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023633762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023633762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023633762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:36.472107 run osmo-msc_10.42.42.6(pid=30225): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30225)] 02:36:36.519224 run osmo-msc_10.42.42.6(pid=30225): stdout: | (launched: 2022-12-14_02:36:35.414824) 02:36:36.568801 run osmo-msc_10.42.42.6(pid=30225): stderr: | [0;m[38;5;43m20221214023635685 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023635685 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdad0ad0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023635685 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023635685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023635685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023635686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023635687 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023635688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023635688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023635688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:36.618521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30218): Terminating (SIGTERM) 02:36:36.657649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30221): Terminating (SIGTERM) 02:36:36.696833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30224): Terminating (SIGTERM) 02:36:36.736268 --- ParallelTerminationStrategy: PID 30218 died... 02:36:36.755142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30218): Terminated: ok {rc=0} 02:36:36.798652 --- ParallelTerminationStrategy: PID 30221 died... 02:36:36.816917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30221): Terminated: ok {rc=0} 02:36:36.860162 --- ParallelTerminationStrategy: PID 30224 died... 02:36:36.878568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30224): Terminated: ok {rc=0} 02:36:36.963220 bus /sierra_3: Setting Powered False 02:36:38.061146 bus /sierra_3: Setting Powered False 02:36:39.174147 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:36:40.319424 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:40.331040 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:36:40.400534 tst mo_mt_call_osmux.py: using LAC 37957 02:36:40.517106 tst mo_mt_call_osmux.py: using RAC 217 02:36:40.644723 tst mo_mt_call_osmux.py: using CellId 37957 02:36:40.770533 tst mo_mt_call_osmux.py: using BVCI 37958 02:36:40.886873 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:40.898647 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:40.910105 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:40.921650 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:40.933538 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:36:40.945781 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:36:41.061422 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:36:41.180379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:36:41.677555 run create_hlr_db(pid=30227): Launched 02:36:41.799194 bus /sierra_2: Setting Powered False 02:36:42.862107 run create_hlr_db(pid=30227): Terminated: ok {rc=0} 02:36:43.288457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30229): Launched 02:36:43.586084 run osmo-hlr_10.42.42.2(pid=30230): Launched 02:36:43.699551 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:44.209655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30232): Launched 02:36:44.505843 run osmo-stp_10.42.42.5(pid=30233): Launched 02:36:44.618086 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:45.156448 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30235): Launched 02:36:45.453459 run osmo-msc_10.42.42.6(pid=30236): Launched 02:36:45.619584 run osmo-stp_10.42.42.5(pid=30233): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30233)] 02:36:45.746898 run osmo-stp_10.42.42.5(pid=30233): stdout: | (launched: 2022-12-14_02:36:44.451710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:45.895924 run osmo-stp_10.42.42.5(pid=30233): stderr: | [0;m[38;5;43m20221214023644622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023644622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023644622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023644623 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023644625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023644625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023644625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:46.023216 run osmo-stp_10.42.42.5(pid=30233): stdout: | (launched: 2022-12-14_02:36:44.451710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:46.144218 run osmo-stp_10.42.42.5(pid=30233): stderr: | [0;m[38;5;43m20221214023644622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023644622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023644622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023644623 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023644625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023644625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023644625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:46.289515 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30233): Process ended prematurely: osmo-stp_10.42.42.5(pid=30233) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30233)] [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:36:46.299014 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:36:46.326854 run osmo-hlr_10.42.42.2(pid=30230): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30230)] 02:36:46.376554 run osmo-hlr_10.42.42.2(pid=30230): stdout: | (launched: 2022-12-14_02:36:43.531459) 02:36:46.428332 run osmo-hlr_10.42.42.2(pid=30230): stderr: | [0;m[1;31m20221214023643706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023643707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023643707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023643707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023643707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023643707 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023643719 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023643730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023643730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023643730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:46.499539 run osmo-msc_10.42.42.6(pid=30236): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30236)] 02:36:46.550094 run osmo-msc_10.42.42.6(pid=30236): stdout: | (launched: 2022-12-14_02:36:45.399305) 02:36:46.601939 run osmo-msc_10.42.42.6(pid=30236): stderr: | [0;m[38;5;43m20221214023645671 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023645671 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0f6da7dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023645671 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023645671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023645672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023645672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023645674 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023645674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023645674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023645674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:46.653218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30229): Terminating (SIGTERM) 02:36:46.694751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30232): Terminating (SIGTERM) 02:36:46.738358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30235): Terminating (SIGTERM) 02:36:46.779799 --- ParallelTerminationStrategy: PID 30229 died... 02:36:46.799356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30229): Terminated: ok {rc=0} 02:36:46.844507 --- ParallelTerminationStrategy: PID 30232 died... 02:36:46.864057 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30232): Terminated: ok {rc=0} 02:36:46.908279 --- ParallelTerminationStrategy: PID 30235 died... 02:36:46.927274 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30235): Terminated: ok {rc=0} 02:36:47.011262 bus /sierra_3: Setting Powered False 02:36:48.105774 bus /sierra_3: Setting Powered False 02:36:49.218313 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:36:50.468553 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:36:50.474988 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:36:50.507547 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:36:50.533916 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:36:50.586345 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:36:50.620591 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:36:50.647579 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:36:51.197576 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:36:51.245722 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:51.256677 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:36:51.326135 tst mo_mt_call.py: using LAC 37958 02:36:51.445786 tst mo_mt_call.py: using RAC 218 02:36:51.565390 tst mo_mt_call.py: using CellId 37958 02:36:51.681562 tst mo_mt_call.py: using BVCI 37959 02:36:51.801409 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:51.813157 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:51.824662 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:51.836189 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:51.848306 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:36:51.860192 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:36:51.976230 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:36:52.095525 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:36:52.591113 run create_hlr_db(pid=30241): Launched 02:36:52.712235 bus /sierra_2: Setting Powered False 02:36:53.775931 run create_hlr_db(pid=30241): Terminated: ok {rc=0} 02:36:54.199655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30243): Launched 02:36:54.496415 run osmo-hlr_10.42.42.2(pid=30244): Launched 02:36:54.609899 run osmo-stp_10.42.42.5: Starting osmo-stp 02:36:55.120769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30246): Launched 02:36:55.416568 run osmo-stp_10.42.42.5(pid=30247): Launched 02:36:55.529550 run osmo-msc_10.42.42.6: Starting osmo-msc 02:36:56.066887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30249): Launched 02:36:56.363220 run osmo-msc_10.42.42.6(pid=30250): Launched 02:36:56.530271 run osmo-stp_10.42.42.5(pid=30247): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30247)] 02:36:56.656265 run osmo-stp_10.42.42.5(pid=30247): stdout: | (launched: 2022-12-14_02:36:55.362333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:56.783780 run osmo-stp_10.42.42.5(pid=30247): stderr: | [0;m[38;5;43m20221214023655531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023655531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023655532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023655532 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023655535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023655535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023655535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:56.907734 run osmo-stp_10.42.42.5(pid=30247): stdout: | (launched: 2022-12-14_02:36:55.362333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:36:57.026132 run osmo-stp_10.42.42.5(pid=30247): stderr: | [0;m[38;5;43m20221214023655531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023655531 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023655532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023655532 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023655535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023655535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023655535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:36:57.167668 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30247): Process ended prematurely: osmo-stp_10.42.42.5(pid=30247) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30247)] [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:36:57.176469 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:36:57.202417 run osmo-hlr_10.42.42.2(pid=30244): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30244)] 02:36:57.249446 run osmo-hlr_10.42.42.2(pid=30244): stdout: | (launched: 2022-12-14_02:36:54.442253) 02:36:57.298385 run osmo-hlr_10.42.42.2(pid=30244): stderr: | [0;m[1;31m20221214023654618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023654618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023654619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023654619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023654619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023654619 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023654631 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023654639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023654639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023654639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:36:57.366585 run osmo-msc_10.42.42.6(pid=30250): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30250)] 02:36:57.413730 run osmo-msc_10.42.42.6(pid=30250): stdout: | (launched: 2022-12-14_02:36:56.309157) 02:36:57.462587 run osmo-msc_10.42.42.6(pid=30250): stderr: | [0;m[38;5;43m20221214023656578 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023656578 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc2920aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023656578 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023656578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023656578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023656579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023656582 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023656583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023656583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023656583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:36:57.511648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30243): Terminating (SIGTERM) 02:36:57.550853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30246): Terminating (SIGTERM) 02:36:57.590137 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30249): Terminating (SIGTERM) 02:36:57.629643 --- ParallelTerminationStrategy: PID 30243 died... 02:36:57.648328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30243): Terminated: ok {rc=0} 02:36:57.691261 --- ParallelTerminationStrategy: PID 30246 died... 02:36:57.709495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30246): Terminated: ok {rc=0} 02:36:57.752384 --- ParallelTerminationStrategy: PID 30249 died... 02:36:57.770586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30249): Terminated: ok {rc=0} 02:36:57.853122 bus /sierra_3: Setting Powered False 02:36:58.949431 bus /sierra_3: Setting Powered False 02:37:00.065050 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:37:01.207613 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:01.220350 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:37:01.292314 tst mo_mt_call_osmux.py: using LAC 37959 02:37:01.426546 tst mo_mt_call_osmux.py: using RAC 219 02:37:01.586077 tst mo_mt_call_osmux.py: using CellId 37959 02:37:01.717163 tst mo_mt_call_osmux.py: using BVCI 37960 02:37:01.879368 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:01.895949 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:01.912729 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:01.930618 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:01.949923 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:37:01.967176 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:37:02.114817 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:37:02.246021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:02.744846 run create_hlr_db(pid=30252): Launched 02:37:02.867435 bus /sierra_2: Setting Powered False 02:37:03.930280 run create_hlr_db(pid=30252): Terminated: ok {rc=0} 02:37:04.356614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30254): Launched 02:37:04.654633 run osmo-hlr_10.42.42.2(pid=30255): Launched 02:37:04.768259 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:05.298130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30257): Launched 02:37:05.595149 run osmo-stp_10.42.42.5(pid=30258): Launched 02:37:05.709374 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:06.246220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30260): Launched 02:37:06.543880 run osmo-msc_10.42.42.6(pid=30261): Launched 02:37:06.711116 run osmo-stp_10.42.42.5(pid=30258): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30258)] 02:37:06.836544 run osmo-stp_10.42.42.5(pid=30258): stdout: | (launched: 2022-12-14_02:37:05.540938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:06.962506 run osmo-stp_10.42.42.5(pid=30258): stderr: | [0;m[38;5;43m20221214023705710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023705710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023705710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023705710 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023705711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023705711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023705711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:07.086748 run osmo-stp_10.42.42.5(pid=30258): stdout: | (launched: 2022-12-14_02:37:05.540938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:07.205709 run osmo-stp_10.42.42.5(pid=30258): stderr: | [0;m[38;5;43m20221214023705710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023705710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023705710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023705710 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023705711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023705711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023705711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:07.347645 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30258): Process ended prematurely: osmo-stp_10.42.42.5(pid=30258) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30258)] [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:37:07.356621 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:37:07.382736 run osmo-hlr_10.42.42.2(pid=30255): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30255)] 02:37:07.430186 run osmo-hlr_10.42.42.2(pid=30255): stdout: | (launched: 2022-12-14_02:37:04.600344) 02:37:07.479423 run osmo-hlr_10.42.42.2(pid=30255): stderr: | [0;m[1;31m20221214023704777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023704778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023704778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023704778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023704778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023704778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023704792 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023704799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023704800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023704800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:37:07.547553 run osmo-msc_10.42.42.6(pid=30261): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30261)] 02:37:07.594657 run osmo-msc_10.42.42.6(pid=30261): stdout: | (launched: 2022-12-14_02:37:06.489570) 02:37:07.643549 run osmo-msc_10.42.42.6(pid=30261): stderr: | [0;m[38;5;43m20221214023706758 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023706758 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6641f97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023706759 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023706759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023706759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023706759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023706761 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023706761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023706762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023706762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:37:07.692875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30254): Terminating (SIGTERM) 02:37:07.732072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30257): Terminating (SIGTERM) 02:37:07.771293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30260): Terminating (SIGTERM) 02:37:07.810885 --- ParallelTerminationStrategy: PID 30254 died... 02:37:07.830015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30254): Terminated: ok {rc=0} 02:37:07.873467 --- ParallelTerminationStrategy: PID 30257 died... 02:37:07.892063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30257): Terminated: ok {rc=0} 02:37:07.935354 --- ParallelTerminationStrategy: PID 30260 died... 02:37:07.953730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30260): Terminated: ok {rc=0} 02:37:08.037176 bus /sierra_3: Setting Powered False 02:37:09.134257 bus /sierra_3: Setting Powered False 02:37:10.252654 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:37:11.499613 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:37:11.505816 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:37:11.538408 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:37:11.564245 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:37:11.614466 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:37:11.647640 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:37:11.673487 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:37:12.227651 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:37:12.274765 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:12.285858 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:37:12.352599 tst mo_mt_call.py: using LAC 37960 02:37:12.470722 tst mo_mt_call.py: using RAC 220 02:37:12.588414 tst mo_mt_call.py: using CellId 37960 02:37:12.703000 tst mo_mt_call.py: using BVCI 37961 02:37:12.811706 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:12.822751 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:12.833623 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:12.844483 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:12.855431 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:12.866306 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:37:12.987247 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:37:13.102882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:13.563139 run create_hlr_db(pid=30266): Launched 02:37:13.691133 bus /sierra_2: Setting Powered False 02:37:14.754247 run create_hlr_db(pid=30266): Terminated: ok {rc=0} 02:37:15.199177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30268): Launched 02:37:15.519117 run osmo-hlr_10.42.42.2(pid=30269): Launched 02:37:15.641903 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:16.211107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30271): Launched 02:37:16.554958 run osmo-stp_10.42.42.5(pid=30272): Launched 02:37:16.792336 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:17.482458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30274): Launched 02:37:17.802019 run osmo-msc_10.42.42.6(pid=30275): Launched 02:37:17.980340 run osmo-stp_10.42.42.5(pid=30272): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30272)] 02:37:18.115651 run osmo-stp_10.42.42.5(pid=30272): stdout: | (launched: 2022-12-14_02:37:16.481974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:18.251622 run osmo-stp_10.42.42.5(pid=30272): stderr: | [0;m[38;5;43m20221214023716781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023716781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023716781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023716782 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023716782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023716782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023716782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:18.387512 run osmo-stp_10.42.42.5(pid=30272): stdout: | (launched: 2022-12-14_02:37:16.481974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:18.515626 run osmo-stp_10.42.42.5(pid=30272): stderr: | [0;m[38;5;43m20221214023716781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023716781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023716781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023716782 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023716782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023716782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023716782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:18.668887 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30272): Process ended prematurely: osmo-stp_10.42.42.5(pid=30272) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30272)] [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:37:18.678569 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 02:37:18.706105 run osmo-hlr_10.42.42.2(pid=30269): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30269)] 02:37:18.756704 run osmo-hlr_10.42.42.2(pid=30269): stdout: | (launched: 2022-12-14_02:37:15.461717) 02:37:18.808562 run osmo-hlr_10.42.42.2(pid=30269): stderr: | [0;m[1;31m20221214023715659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023715659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023715659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023715659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023715659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023715660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023715672 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023715680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023715680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023715680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:37:18.880773 run osmo-msc_10.42.42.6(pid=30275): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30275)] 02:37:18.930515 run osmo-msc_10.42.42.6(pid=30275): stdout: | (launched: 2022-12-14_02:37:17.744374) 02:37:18.982661 run osmo-msc_10.42.42.6(pid=30275): stderr: | [0;m[38;5;43m20221214023718062 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023718063 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f76119e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023718063 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023718063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023718063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023718063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023718065 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023718065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023718065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023718065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:37:19.034858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30268): Terminating (SIGTERM) 02:37:19.076202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30271): Terminating (SIGTERM) 02:37:19.118185 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30274): Terminating (SIGTERM) 02:37:19.160351 --- ParallelTerminationStrategy: PID 30268 died... 02:37:19.180700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30268): Terminated: ok {rc=0} 02:37:19.226924 --- ParallelTerminationStrategy: PID 30271 died... 02:37:19.246682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30271): Terminated: ok {rc=0} 02:37:19.292806 --- ParallelTerminationStrategy: PID 30274 died... 02:37:19.313292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30274): Terminated: ok {rc=0} 02:37:19.401504 bus /sierra_3: Setting Powered False 02:37:20.499843 bus /sierra_3: Setting Powered False 02:37:21.615211 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:37:22.763992 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:22.776250 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:37:22.849158 tst mo_mt_call_osmux.py: using LAC 37961 02:37:22.975140 tst mo_mt_call_osmux.py: using RAC 221 02:37:23.102413 tst mo_mt_call_osmux.py: using CellId 37961 02:37:23.227628 tst mo_mt_call_osmux.py: using BVCI 37962 02:37:23.344134 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:23.355782 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:23.367484 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:23.379090 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:23.390952 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:37:23.402639 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:37:23.518954 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:37:23.633556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:24.094892 run create_hlr_db(pid=30277): Launched 02:37:24.217421 bus /sierra_2: Setting Powered False 02:37:25.276899 run create_hlr_db(pid=30277): Terminated: ok {rc=0} 02:37:25.692407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30279): Launched 02:37:25.989655 run osmo-hlr_10.42.42.2(pid=30280): Launched 02:37:26.102262 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:26.612468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30282): Launched 02:37:26.910743 run osmo-stp_10.42.42.5(pid=30283): Launched 02:37:27.024635 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:27.563735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30285): Launched 02:37:27.861083 run osmo-msc_10.42.42.6(pid=30286): Launched 02:37:28.027856 run osmo-stp_10.42.42.5(pid=30283): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30283)] 02:37:28.154914 run osmo-stp_10.42.42.5(pid=30283): stdout: | (launched: 2022-12-14_02:37:26.856700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:28.281389 run osmo-stp_10.42.42.5(pid=30283): stderr: | [0;m[38;5;43m20221214023727025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023727026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023727026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023727026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023727027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023727027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023727027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:28.406012 run osmo-stp_10.42.42.5(pid=30283): stdout: | (launched: 2022-12-14_02:37:26.856700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:28.525207 run osmo-stp_10.42.42.5(pid=30283): stderr: | [0;m[38;5;43m20221214023727025 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023727026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023727026 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023727026 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023727027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023727027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023727027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:28.668205 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30283): Process ended prematurely: osmo-stp_10.42.42.5(pid=30283) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30283)] [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:37:28.677589 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:37:28.703734 run osmo-hlr_10.42.42.2(pid=30280): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30280)] 02:37:28.751018 run osmo-hlr_10.42.42.2(pid=30280): stdout: | (launched: 2022-12-14_02:37:25.935436) 02:37:28.800356 run osmo-hlr_10.42.42.2(pid=30280): stderr: | [0;m[1;31m20221214023726111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023726111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023726111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023726111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023726111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023726111 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023726123 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023726133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023726133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023726133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:37:28.869042 run osmo-msc_10.42.42.6(pid=30286): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30286)] 02:37:28.915964 run osmo-msc_10.42.42.6(pid=30286): stdout: | (launched: 2022-12-14_02:37:27.806925) 02:37:28.965202 run osmo-msc_10.42.42.6(pid=30286): stderr: | [0;m[38;5;43m20221214023728077 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023728077 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1755904c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023728077 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023728077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023728077 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023728078 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023728079 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023728080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023728080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023728080 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:37:29.014729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30279): Terminating (SIGTERM) 02:37:29.054114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30282): Terminating (SIGTERM) 02:37:29.093580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30285): Terminating (SIGTERM) 02:37:29.133346 --- ParallelTerminationStrategy: PID 30279 died... 02:37:29.152315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30279): Terminated: ok {rc=0} 02:37:29.196432 --- ParallelTerminationStrategy: PID 30282 died... 02:37:29.215202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30282): Terminated: ok {rc=0} 02:37:29.258662 --- ParallelTerminationStrategy: PID 30285 died... 02:37:29.277208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30285): Terminated: ok {rc=0} 02:37:29.360061 bus /sierra_3: Setting Powered False 02:37:30.455820 bus /sierra_3: Setting Powered False 02:37:31.573964 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:37:32.829982 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:37:32.836879 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:37:32.870567 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:37:32.899046 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:37:32.948655 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:37:32.983279 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:37:33.010413 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:37:33.564173 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:37:33.616347 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:33.628159 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:37:33.698368 tst mo_mt_call.py: using LAC 37962 02:37:33.824156 tst mo_mt_call.py: using RAC 222 02:37:33.949700 tst mo_mt_call.py: using CellId 37962 02:37:34.075079 tst mo_mt_call.py: using BVCI 37963 02:37:34.191329 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:34.203187 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:34.214769 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:34.226473 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:34.238638 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:34.250656 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:37:34.366435 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:37:34.487334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:34.982305 run create_hlr_db(pid=30291): Launched 02:37:35.104321 bus /sierra_2: Setting Powered False 02:37:36.167952 run create_hlr_db(pid=30291): Terminated: ok {rc=0} 02:37:36.593610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30293): Launched 02:37:36.890467 run osmo-hlr_10.42.42.2(pid=30294): Launched 02:37:37.003830 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:37.513447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30296): Launched 02:37:37.809198 run osmo-stp_10.42.42.5(pid=30297): Launched 02:37:37.922727 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:38.460643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30299): Launched 02:37:38.757560 run osmo-msc_10.42.42.6(pid=30300): Launched 02:37:38.923533 run osmo-stp_10.42.42.5(pid=30297): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30297)] 02:37:39.049829 run osmo-stp_10.42.42.5(pid=30297): stdout: | (launched: 2022-12-14_02:37:37.755381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:39.175996 run osmo-stp_10.42.42.5(pid=30297): stderr: | [0;m[38;5;43m20221214023737923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023737923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023737923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023737924 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023737924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023737924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023737924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:39.300007 run osmo-stp_10.42.42.5(pid=30297): stdout: | (launched: 2022-12-14_02:37:37.755381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:39.418600 run osmo-stp_10.42.42.5(pid=30297): stderr: | [0;m[38;5;43m20221214023737923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023737923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023737923 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023737924 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023737924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023737924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023737924 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:39.560274 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30297): Process ended prematurely: osmo-stp_10.42.42.5(pid=30297) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30297)] [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:37:39.569423 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:37:39.595341 run osmo-hlr_10.42.42.2(pid=30294): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30294)] 02:37:39.642850 run osmo-hlr_10.42.42.2(pid=30294): stdout: | (launched: 2022-12-14_02:37:36.836868) 02:37:39.692056 run osmo-hlr_10.42.42.2(pid=30294): stderr: | [0;m[1;31m20221214023737013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023737013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023737013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023737013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023737013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023737013 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023737025 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023737034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023737034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023737034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:37:39.760612 run osmo-msc_10.42.42.6(pid=30300): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30300)] 02:37:39.807675 run osmo-msc_10.42.42.6(pid=30300): stdout: | (launched: 2022-12-14_02:37:38.703192) 02:37:39.856816 run osmo-msc_10.42.42.6(pid=30300): stderr: | [0;m[38;5;43m20221214023738972 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023738973 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff0eac80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023738973 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023738973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023738973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023738974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023738977 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023738977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023738978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023738978 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:37:39.906136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30293): Terminating (SIGTERM) 02:37:39.945416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30296): Terminating (SIGTERM) 02:37:39.990646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30299): Terminating (SIGTERM) 02:37:40.033239 --- ParallelTerminationStrategy: PID 30293 died... 02:37:40.053804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30293): Terminated: ok {rc=0} 02:37:40.100298 --- ParallelTerminationStrategy: PID 30296 died... 02:37:40.120315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30296): Terminated: ok {rc=0} 02:37:40.166633 --- ParallelTerminationStrategy: PID 30299 died... 02:37:40.186665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30299): Terminated: ok {rc=0} 02:37:40.275452 bus /sierra_3: Setting Powered False 02:37:41.372600 bus /sierra_3: Setting Powered False 02:37:42.488626 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:37:43.629990 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:43.641872 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:37:43.710673 tst mo_mt_call_osmux.py: using LAC 37963 02:37:43.826606 tst mo_mt_call_osmux.py: using RAC 223 02:37:43.943678 tst mo_mt_call_osmux.py: using CellId 37963 02:37:44.059261 tst mo_mt_call_osmux.py: using BVCI 37964 02:37:44.166543 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:44.177818 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:44.188841 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:44.199829 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:44.210994 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:37:44.221890 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:37:44.343497 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:37:44.461190 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:44.922424 run create_hlr_db(pid=30302): Launched 02:37:45.043538 bus /sierra_2: Setting Powered False 02:37:46.123433 run create_hlr_db(pid=30302): Terminated: ok {rc=0} 02:37:46.618097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30304): Launched 02:37:46.962148 run osmo-hlr_10.42.42.2(pid=30305): Launched 02:37:47.121676 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:47.669245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30307): Launched 02:37:47.965513 run osmo-stp_10.42.42.5(pid=30308): Launched 02:37:48.078415 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:48.615167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30310): Launched 02:37:48.912411 run osmo-msc_10.42.42.6(pid=30311): Launched 02:37:49.078974 run osmo-stp_10.42.42.5(pid=30308): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30308)] 02:37:49.204883 run osmo-stp_10.42.42.5(pid=30308): stdout: | (launched: 2022-12-14_02:37:47.911257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:49.331762 run osmo-stp_10.42.42.5(pid=30308): stderr: | [0;m[38;5;43m20221214023748079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023748079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023748080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023748080 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023748081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023748081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023748081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:49.456453 run osmo-stp_10.42.42.5(pid=30308): stdout: | (launched: 2022-12-14_02:37:47.911257) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:37:49.575342 run osmo-stp_10.42.42.5(pid=30308): stderr: | [0;m[38;5;43m20221214023748079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023748079 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023748080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023748080 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023748081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023748081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023748081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:37:49.717924 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30308): Process ended prematurely: osmo-stp_10.42.42.5(pid=30308) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30308)] [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:37:49.726875 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 02:37:49.753024 run osmo-hlr_10.42.42.2(pid=30305): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30305)] 02:37:49.800612 run osmo-hlr_10.42.42.2(pid=30305): stdout: | (launched: 2022-12-14_02:37:46.895339) 02:37:49.850096 run osmo-hlr_10.42.42.2(pid=30305): stderr: | [0;m[1;31m20221214023747230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023747230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023747230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023747230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023747230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023747230 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023747243 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023747253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023747253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023747253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:37:49.918859 run osmo-msc_10.42.42.6(pid=30311): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30311)] 02:37:49.966285 run osmo-msc_10.42.42.6(pid=30311): stdout: | (launched: 2022-12-14_02:37:48.858245) 02:37:50.014884 run osmo-msc_10.42.42.6(pid=30311): stderr: | [0;m[38;5;43m20221214023749126 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023749126 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd1015cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023749126 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023749127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023749127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023749127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023749129 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023749129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023749129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023749129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:37:50.064288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30304): Terminating (SIGTERM) 02:37:50.103743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30307): Terminating (SIGTERM) 02:37:50.143270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30310): Terminating (SIGTERM) 02:37:50.183350 --- ParallelTerminationStrategy: PID 30304 died... 02:37:50.202506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30304): Terminated: ok {rc=0} 02:37:50.246252 --- ParallelTerminationStrategy: PID 30307 died... 02:37:50.264934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30307): Terminated: ok {rc=0} 02:37:50.308573 --- ParallelTerminationStrategy: PID 30310 died... 02:37:50.327252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30310): Terminated: ok {rc=0} 02:37:50.412020 bus /sierra_3: Setting Powered False 02:37:51.509777 bus /sierra_3: Setting Powered False 02:37:52.619606 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:37:53.868827 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:37:53.874535 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:37:53.907107 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:37:53.933669 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:37:53.984918 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:37:54.019095 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:37:54.046302 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:37:54.593374 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:37:54.641205 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:54.652187 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:37:54.721290 tst mo_mt_call.py: using LAC 37964 02:37:54.837650 tst mo_mt_call.py: using RAC 224 02:37:54.958637 tst mo_mt_call.py: using CellId 37964 02:37:55.075767 tst mo_mt_call.py: using BVCI 37965 02:37:55.183361 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:55.194244 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:55.204867 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:55.215656 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:55.226456 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:37:55.237092 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:37:55.352398 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:37:55.473446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:37:55.968814 run create_hlr_db(pid=30316): Launched 02:37:56.091167 bus /sierra_2: Setting Powered False 02:37:57.154598 run create_hlr_db(pid=30316): Terminated: ok {rc=0} 02:37:57.580660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30318): Launched 02:37:57.878564 run osmo-hlr_10.42.42.2(pid=30319): Launched 02:37:57.991801 run osmo-stp_10.42.42.5: Starting osmo-stp 02:37:58.525401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30321): Launched 02:37:58.822885 run osmo-stp_10.42.42.5(pid=30322): Launched 02:37:58.937231 run osmo-msc_10.42.42.6: Starting osmo-msc 02:37:59.475907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30324): Launched 02:37:59.773217 run osmo-msc_10.42.42.6(pid=30325): Launched 02:37:59.940804 run osmo-stp_10.42.42.5(pid=30322): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30322)] 02:38:00.067526 run osmo-stp_10.42.42.5(pid=30322): stdout: | (launched: 2022-12-14_02:37:58.768328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:00.194128 run osmo-stp_10.42.42.5(pid=30322): stderr: | [0;m[38;5;43m20221214023758938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023758938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023758938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023758939 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023758939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023758939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023758939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:00.318648 run osmo-stp_10.42.42.5(pid=30322): stdout: | (launched: 2022-12-14_02:37:58.768328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:00.437890 run osmo-stp_10.42.42.5(pid=30322): stderr: | [0;m[38;5;43m20221214023758938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023758938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023758938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023758939 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023758939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023758939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023758939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:00.580405 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30322): Process ended prematurely: osmo-stp_10.42.42.5(pid=30322) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30322)] [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:38:00.589519 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:38:00.615781 run osmo-hlr_10.42.42.2(pid=30319): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30319)] 02:38:00.663650 run osmo-hlr_10.42.42.2(pid=30319): stdout: | (launched: 2022-12-14_02:37:57.824307) 02:38:00.713236 run osmo-hlr_10.42.42.2(pid=30319): stderr: | [0;m[1;31m20221214023757998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023757998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023757998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023757998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023757998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023757998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023758010 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023758019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023758019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023758019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:38:00.782202 run osmo-msc_10.42.42.6(pid=30325): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30325)] 02:38:00.829775 run osmo-msc_10.42.42.6(pid=30325): stdout: | (launched: 2022-12-14_02:37:59.718984) 02:38:00.888290 run osmo-msc_10.42.42.6(pid=30325): stderr: | [0;m[38;5;43m20221214023759988 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023759988 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7febed66fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023759988 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023759988 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023759989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023759989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023759992 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023759993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023759993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023759993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:38:00.948493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30318): Terminating (SIGTERM) 02:38:00.988790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30321): Terminating (SIGTERM) 02:38:01.034076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30324): Terminating (SIGTERM) 02:38:01.076624 --- ParallelTerminationStrategy: PID 30318 died... 02:38:01.095973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30318): Terminated: ok {rc=0} 02:38:01.140782 --- ParallelTerminationStrategy: PID 30321 died... 02:38:01.160122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30321): Terminated: ok {rc=0} 02:38:01.204880 --- ParallelTerminationStrategy: PID 30324 died... 02:38:01.224242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30324): Terminated: ok {rc=0} 02:38:01.308743 bus /sierra_3: Setting Powered False 02:38:02.404033 bus /sierra_3: Setting Powered False 02:38:03.517829 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:38:04.663446 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:04.674997 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:38:04.745247 tst mo_mt_call_osmux.py: using LAC 37965 02:38:04.863675 tst mo_mt_call_osmux.py: using RAC 225 02:38:04.988240 tst mo_mt_call_osmux.py: using CellId 37965 02:38:05.105651 tst mo_mt_call_osmux.py: using BVCI 37966 02:38:05.213770 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:05.224564 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:05.235309 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:05.246000 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:05.256781 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:38:05.267602 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:38:05.386881 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:38:05.505865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:38:05.965105 run create_hlr_db(pid=30327): Launched 02:38:06.086856 bus /sierra_2: Setting Powered False 02:38:07.146226 run create_hlr_db(pid=30327): Terminated: ok {rc=0} 02:38:07.559197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30329): Launched 02:38:07.855851 run osmo-hlr_10.42.42.2(pid=30330): Launched 02:38:07.968649 run osmo-stp_10.42.42.5: Starting osmo-stp 02:38:08.478518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30332): Launched 02:38:08.775386 run osmo-stp_10.42.42.5(pid=30333): Launched 02:38:08.888410 run osmo-msc_10.42.42.6: Starting osmo-msc 02:38:09.426201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30335): Launched 02:38:09.723046 run osmo-msc_10.42.42.6(pid=30336): Launched 02:38:09.888726 run osmo-stp_10.42.42.5(pid=30333): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30333)] 02:38:10.014241 run osmo-stp_10.42.42.5(pid=30333): stdout: | (launched: 2022-12-14_02:38:08.720915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:10.139817 run osmo-stp_10.42.42.5(pid=30333): stderr: | [0;m[38;5;43m20221214023808890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023808890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023808890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023808890 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023808893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023808893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023808893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:10.264464 run osmo-stp_10.42.42.5(pid=30333): stdout: | (launched: 2022-12-14_02:38:08.720915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:10.383045 run osmo-stp_10.42.42.5(pid=30333): stderr: | [0;m[38;5;43m20221214023808890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023808890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023808890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023808890 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023808893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023808893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023808893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:10.525223 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30333): Process ended prematurely: osmo-stp_10.42.42.5(pid=30333) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30333)] [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:38:10.534238 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 02:38:10.560353 run osmo-hlr_10.42.42.2(pid=30330): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30330)] 02:38:10.608177 run osmo-hlr_10.42.42.2(pid=30330): stdout: | (launched: 2022-12-14_02:38:07.801805) 02:38:10.657648 run osmo-hlr_10.42.42.2(pid=30330): stderr: | [0;m[1;31m20221214023807977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023807977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023807977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023807977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023807977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023807977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023807989 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023807998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023807998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023807998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:38:10.726081 run osmo-msc_10.42.42.6(pid=30336): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30336)] 02:38:10.773659 run osmo-msc_10.42.42.6(pid=30336): stdout: | (launched: 2022-12-14_02:38:09.669135) 02:38:10.822796 run osmo-msc_10.42.42.6(pid=30336): stderr: | [0;m[38;5;43m20221214023809940 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023809940 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd0a71e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023809940 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023809940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023809941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023809941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023809943 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023809943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023809943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023809943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:38:10.871924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30329): Terminating (SIGTERM) 02:38:10.911264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30332): Terminating (SIGTERM) 02:38:10.950729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30335): Terminating (SIGTERM) 02:38:10.990666 --- ParallelTerminationStrategy: PID 30329 died... 02:38:11.009913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30329): Terminated: ok {rc=0} 02:38:11.054047 --- ParallelTerminationStrategy: PID 30332 died... 02:38:11.072668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30332): Terminated: ok {rc=0} 02:38:11.116316 --- ParallelTerminationStrategy: PID 30335 died... 02:38:11.134986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30335): Terminated: ok {rc=0} 02:38:11.220056 bus /sierra_3: Setting Powered False 02:38:12.319586 bus /sierra_3: Setting Powered False 02:38:13.433694 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 02:38:14.680591 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:38:14.684939 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:38:14.717585 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 02:38:14.744068 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 02:38:14.826622 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:38:14.859549 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 02:38:14.885657 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 02:38:15.467291 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2398 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 02:38:15.472544 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:15.483307 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:38:15.532266 tst emergency_mo_mt_call.py: using LAC 37966 02:38:15.646967 tst emergency_mo_mt_call.py: using RAC 226 02:38:15.761582 tst emergency_mo_mt_call.py: using CellId 37966 02:38:15.876538 tst emergency_mo_mt_call.py: using BVCI 37967 02:38:15.993525 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:16.004693 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:16.015747 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:16.026739 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:16.038028 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:16.049354 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:16.163315 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:16.290052 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:38:16.758804 run create_hlr_db(pid=30341): Launched 02:38:16.886914 bus /sierra_2: Setting Powered False 02:38:17.945942 run create_hlr_db(pid=30341): Terminated: ok {rc=0} 02:38:18.373410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30343): Launched 02:38:18.687168 run osmo-hlr_10.42.42.2(pid=30344): Launched 02:38:18.806792 run osmo-stp_10.42.42.5: Starting osmo-stp 02:38:19.344345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30346): Launched 02:38:19.636556 run osmo-stp_10.42.42.5(pid=30347): Launched 02:38:19.758403 tst emergency_mo_mt_call.py: using MSISDN 8461 02:38:19.908392 run osmo-msc_10.42.42.6: Starting osmo-msc 02:38:20.433745 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30349): Launched 02:38:20.724554 run osmo-msc_10.42.42.6(pid=30350): Launched 02:38:20.887311 run osmo-stp_10.42.42.5(pid=30347): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30347)] 02:38:21.010417 run osmo-stp_10.42.42.5(pid=30347): stdout: | (launched: 2022-12-14_02:38:19.583699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:21.135152 run osmo-stp_10.42.42.5(pid=30347): stderr: | [0;m[38;5;43m20221214023819752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023819752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023819752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023819753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023819753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023819753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023819753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:21.256756 run osmo-stp_10.42.42.5(pid=30347): stdout: | (launched: 2022-12-14_02:38:19.583699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:21.372685 run osmo-stp_10.42.42.5(pid=30347): stderr: | [0;m[38;5;43m20221214023819752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023819752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023819752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023819753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023819753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023819753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023819753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:21.511711 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30347): Process ended prematurely: osmo-stp_10.42.42.5(pid=30347) [trial-2398↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30347)] [trial-2398↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 02:38:21.520105 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 02:38:21.545761 run osmo-hlr_10.42.42.2(pid=30344): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30344)] 02:38:21.593596 run osmo-hlr_10.42.42.2(pid=30344): stdout: | (launched: 2022-12-14_02:38:18.630339) 02:38:21.642318 run osmo-hlr_10.42.42.2(pid=30344): stderr: | [0;m[1;31m20221214023818827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023818827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023818827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023818827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023818827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023818827 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023818840 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023818848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023818848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023818848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:38:21.710498 run osmo-msc_10.42.42.6(pid=30350): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30350)] 02:38:21.757528 run osmo-msc_10.42.42.6(pid=30350): stdout: | (launched: 2022-12-14_02:38:20.671474) 02:38:21.806223 run osmo-msc_10.42.42.6(pid=30350): stderr: | [0;m[38;5;43m20221214023820943 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023820944 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8cca1bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023820944 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023820944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023820944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023820944 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023820946 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023820946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023820947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023820947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:38:21.855263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30343): Terminating (SIGTERM) 02:38:21.894605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30346): Terminating (SIGTERM) 02:38:21.933862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30349): Terminating (SIGTERM) 02:38:21.973779 --- ParallelTerminationStrategy: PID 30343 died... 02:38:21.992132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30343): Terminated: ok {rc=0} 02:38:22.035503 --- ParallelTerminationStrategy: PID 30346 died... 02:38:22.054055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30346): Terminated: ok {rc=0} 02:38:22.097573 --- ParallelTerminationStrategy: PID 30349 died... 02:38:22.115989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30349): Terminated: ok {rc=0} 02:38:22.201698 bus /sierra_3: Setting Powered False 02:38:23.301417 bus /sierra_3: Setting Powered False 02:38:24.416594 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 02:38:25.502837 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:25.514587 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:38:25.567236 tst emergency_preemptive_call.py: using LAC 37967 02:38:25.690760 tst emergency_preemptive_call.py: using RAC 227 02:38:25.813377 tst emergency_preemptive_call.py: using CellId 37967 02:38:25.948326 tst emergency_preemptive_call.py: using BVCI 37968 02:38:26.063773 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:26.074963 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:26.085926 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:26.096796 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:26.108137 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 02:38:26.119376 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:26.234137 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:26.353463 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:26.467985 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:26.584813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:38:27.072610 run create_hlr_db(pid=30352): Launched 02:38:27.192152 bus /sierra_2: Setting Powered False 02:38:28.254158 run create_hlr_db(pid=30352): Terminated: ok {rc=0} 02:38:28.674060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30354): Launched 02:38:28.966091 run osmo-hlr_10.42.42.2(pid=30355): Launched 02:38:29.076894 run osmo-stp_10.42.42.5: Starting osmo-stp 02:38:29.596497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30357): Launched 02:38:29.887646 run osmo-stp_10.42.42.5(pid=30358): Launched 02:38:30.007531 tst emergency_preemptive_call.py: using MSISDN 8462 02:38:30.156509 run osmo-msc_10.42.42.6: Starting osmo-msc 02:38:30.680193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30360): Launched 02:38:30.986142 run osmo-msc_10.42.42.6(pid=30361): Launched 02:38:31.400877 run osmo-stp_10.42.42.5(pid=30358): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30358)] 02:38:31.688581 run osmo-stp_10.42.42.5(pid=30358): stdout: | (launched: 2022-12-14_02:38:29.834517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:31.816800 run osmo-stp_10.42.42.5(pid=30358): stderr: | [0;m[38;5;43m20221214023830004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023830004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023830004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023830005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023830005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023830005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023830005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:31.942878 run osmo-stp_10.42.42.5(pid=30358): stdout: | (launched: 2022-12-14_02:38:29.834517) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:32.064141 run osmo-stp_10.42.42.5(pid=30358): stderr: | [0;m[38;5;43m20221214023830004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023830004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023830004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023830005 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023830005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023830005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023830005 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:32.206837 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30358): Process ended prematurely: osmo-stp_10.42.42.5(pid=30358) [trial-2398↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30358)] [trial-2398↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 02:38:32.215706 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 02:38:32.242283 run osmo-hlr_10.42.42.2(pid=30355): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30355)] 02:38:32.291187 run osmo-hlr_10.42.42.2(pid=30355): stdout: | (launched: 2022-12-14_02:38:28.912640) 02:38:32.341684 run osmo-hlr_10.42.42.2(pid=30355): stderr: | [0;m[1;31m20221214023829085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023829085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023829085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023829085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023829085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023829085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023829098 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023829106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023829106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023829106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:38:32.412103 run osmo-msc_10.42.42.6(pid=30361): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30361)] 02:38:32.460676 run osmo-msc_10.42.42.6(pid=30361): stdout: | (launched: 2022-12-14_02:38:30.921338) 02:38:32.510667 run osmo-msc_10.42.42.6(pid=30361): stderr: | [0;m[38;5;43m20221214023831376 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214023831378 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe983b76c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214023831379 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214023831379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214023831382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214023831383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214023831388 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214023831388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214023831388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214023831388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:38:32.560264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30354): Terminating (SIGTERM) 02:38:32.600164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30357): Terminating (SIGTERM) 02:38:32.640238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30360): Terminating (SIGTERM) 02:38:32.680284 --- ParallelTerminationStrategy: PID 30354 died... 02:38:32.699607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30354): Terminated: ok {rc=0} 02:38:32.743405 --- ParallelTerminationStrategy: PID 30357 died... 02:38:32.762092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30357): Terminated: ok {rc=0} 02:38:32.805646 --- ParallelTerminationStrategy: PID 30360 died... 02:38:32.824300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30360): Terminated: ok {rc=0} 02:38:32.907634 bus /sierra_9: Setting Powered False 02:38:34.005408 bus /sierra_9: Setting Powered False 02:38:35.123376 bus /sierra_8: Setting Powered False 02:38:36.221066 bus /sierra_8: Setting Powered False 02:38:37.335583 bus /sierra_3: Setting Powered False 02:38:38.432804 bus /sierra_3: Setting Powered False 02:38:39.547877 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 02:38:40.824566 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:38:40.828918 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 02:38:40.861547 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 02:38:40.899149 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 02:38:40.984016 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 02:38:41.018099 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 02:38:41.056920 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 02:38:41.644336 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 02:38:41.693233 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:41.703917 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:38:41.750309 tst cs_paging_gprs_active.py: using LAC 37968 02:38:41.868146 tst cs_paging_gprs_active.py: using RAC 228 02:38:41.986610 tst cs_paging_gprs_active.py: using CellId 37968 02:38:42.104168 tst cs_paging_gprs_active.py: using BVCI 37969 02:38:42.212046 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:42.222654 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:42.232910 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:42.243336 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:42.253568 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:42.264365 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:42.275679 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:42.286137 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:42.296584 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:42.416867 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:42.535390 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:38:42.736152 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:38:43.035609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30367): Launched 02:38:43.296752 run iperf3-srv_10.42.42.10(pid=30368): Launched 02:38:43.408832 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:38:43.608722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:38:43.907568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30369): Launched 02:38:44.166544 run iperf3-srv_10.42.42.10(pid=30370): Launched 02:38:44.278419 tst cs_paging_gprs_active.py:38: start network... 02:38:44.477791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:38:44.940223 run create_hlr_db(pid=30371): Launched 02:38:45.063373 bus /sierra_2: Setting Powered False 02:38:46.126312 run create_hlr_db(pid=30371): Terminated: ok {rc=0} 02:38:46.590205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30373): Launched 02:38:46.934970 run osmo-hlr_10.42.42.2(pid=30374): Launched 02:38:47.124691 run osmo-stp_10.42.42.5: Starting osmo-stp 02:38:47.646086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30376): Launched 02:38:47.944311 run osmo-stp_10.42.42.5(pid=30377): Launched 02:38:48.057953 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:38:48.573372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30379): Launched 02:38:48.687796 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:38:48.939856 run patchelf(pid=30380): Launched 02:38:49.105794 run osmo-stp_10.42.42.5(pid=30377): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30377)] 02:38:49.231993 run osmo-stp_10.42.42.5(pid=30377): stdout: | (launched: 2022-12-14_02:38:47.889122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:49.360044 run osmo-stp_10.42.42.5(pid=30377): stderr: | [0;m[38;5;43m20221214023848060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023848060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023848061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023848061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023848062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023848062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023848062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:49.488535 run osmo-stp_10.42.42.5(pid=30377): stdout: | (launched: 2022-12-14_02:38:47.889122) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:38:49.610870 run osmo-stp_10.42.42.5(pid=30377): stderr: | [0;m[38;5;43m20221214023848060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023848060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023848061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023848061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023848062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023848062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023848062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:38:49.755653 run patchelf(pid=30380): Terminating (SIGINT) 02:38:49.923964 run patchelf(pid=30380): Terminated: ok {rc=0} 02:38:50.045384 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30377): Process ended prematurely: osmo-stp_10.42.42.5(pid=30377) [trial-2398↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30377)] [trial-2398↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 02:38:50.054819 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 02:38:50.081789 run osmo-hlr_10.42.42.2(pid=30374): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30374)] 02:38:50.129079 run osmo-hlr_10.42.42.2(pid=30374): stdout: | (launched: 2022-12-14_02:38:46.870200) 02:38:50.178005 run osmo-hlr_10.42.42.2(pid=30374): stderr: | [0;m[1;31m20221214023847146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023847146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023847146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023847146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023847146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023847146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023847166 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023847179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023847179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023847179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:38:50.227347 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30367): Terminating (SIGTERM) 02:38:50.266824 run iperf3-srv_10.42.42.10(pid=30368): Terminating (SIGTERM) 02:38:50.306238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30369): Terminating (SIGTERM) 02:38:50.345706 run iperf3-srv_10.42.42.10(pid=30370): Terminating (SIGTERM) 02:38:50.384848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30373): Terminating (SIGTERM) 02:38:50.424226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30376): Terminating (SIGTERM) 02:38:50.463455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30379): Terminating (SIGTERM) 02:38:50.502909 --- ParallelTerminationStrategy: PID 30367 died... 02:38:50.521822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30367): Terminated: ok {rc=0} 02:38:50.565347 --- ParallelTerminationStrategy: PID 30368 died... 02:38:50.583538 run iperf3-srv_10.42.42.10(pid=30368): Terminated {rc=256} 02:38:50.626820 --- ParallelTerminationStrategy: PID 30369 died... 02:38:50.645236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30369): Terminated: ok {rc=0} 02:38:50.688444 --- ParallelTerminationStrategy: PID 30370 died... 02:38:50.706721 run iperf3-srv_10.42.42.10(pid=30370): Terminated {rc=256} 02:38:50.749776 --- ParallelTerminationStrategy: PID 30373 died... 02:38:50.768135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30373): Terminated: ok {rc=0} 02:38:50.811525 --- ParallelTerminationStrategy: PID 30376 died... 02:38:50.830016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30376): Terminated: ok {rc=0} 02:38:50.873568 --- ParallelTerminationStrategy: PID 30379 died... 02:38:50.892125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30379): Terminated: ok {rc=0} 02:38:50.975194 bus /gobi_0: Setting Powered False 02:38:52.069957 bus /gobi_0: Setting Powered False 02:38:53.185441 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 02:38:54.330933 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:54.342138 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:38:54.393071 tst iperf3.py: using LAC 37969 02:38:54.514247 tst iperf3.py: using RAC 229 02:38:54.629789 tst iperf3.py: using CellId 37969 02:38:54.748660 tst iperf3.py: using BVCI 37970 02:38:54.858701 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:54.869354 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:54.879667 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:54.890003 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:54.900220 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:54.910600 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:54.921500 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:54.932103 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:38:54.942979 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:38:55.057157 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:38:55.256503 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:38:55.555238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30381): Launched 02:38:55.814297 run iperf3-srv_10.42.42.10(pid=30382): Launched 02:38:55.925904 tst iperf3.py:8: start network... 02:38:56.125248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:38:56.587119 run create_hlr_db(pid=30383): Launched 02:38:56.709798 bus /gobi_6: Setting Powered False 02:38:57.770349 run create_hlr_db(pid=30383): Terminated: ok {rc=0} 02:38:58.208171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30385): Launched 02:38:58.529233 run osmo-hlr_10.42.42.2(pid=30386): Launched 02:38:58.652290 run osmo-stp_10.42.42.5: Starting osmo-stp 02:38:59.204067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30388): Launched 02:38:59.527024 run osmo-stp_10.42.42.5(pid=30389): Launched 02:38:59.652197 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:39:00.208851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30391): Launched 02:39:00.331835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:39:00.604197 run patchelf(pid=30392): Launched 02:39:00.783335 run osmo-stp_10.42.42.5(pid=30389): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30389)] 02:39:00.934211 run osmo-stp_10.42.42.5(pid=30389): stdout: | (launched: 2022-12-14_02:38:59.468378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:01.075383 run osmo-stp_10.42.42.5(pid=30389): stderr: | [0;m[38;5;43m20221214023859662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023859662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023859662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023859663 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023859663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023859663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023859663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:01.216814 run osmo-stp_10.42.42.5(pid=30389): stdout: | (launched: 2022-12-14_02:38:59.468378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:01.357791 run osmo-stp_10.42.42.5(pid=30389): stderr: | [0;m[38;5;43m20221214023859662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023859662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023859662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023859663 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023859663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023859663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023859663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:01.542792 run patchelf(pid=30392): Terminating (SIGINT) 02:39:01.758330 run patchelf(pid=30392): Terminated: ok {rc=0} 02:39:01.893765 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30389): Process ended prematurely: osmo-stp_10.42.42.5(pid=30389) [trial-2398↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30389)] [trial-2398↪gprs:trx-sysmocell5000↪iperf3.py:8] 02:39:01.904901 tst iperf3.py:8: Test FAILED (7.6 sec) 02:39:01.934827 run osmo-hlr_10.42.42.2(pid=30386): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30386)] 02:39:01.989242 run osmo-hlr_10.42.42.2(pid=30386): stdout: | (launched: 2022-12-14_02:38:58.471450) 02:39:02.043858 run osmo-hlr_10.42.42.2(pid=30386): stderr: | [0;m[1;31m20221214023858667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023858667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023858667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023858667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023858667 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023858668 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023858681 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023858689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023858689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023858689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:39:02.099354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30381): Terminating (SIGTERM) 02:39:02.155280 run iperf3-srv_10.42.42.10(pid=30382): Terminating (SIGTERM) 02:39:02.211116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30385): Terminating (SIGTERM) 02:39:02.255513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30388): Terminating (SIGTERM) 02:39:02.317358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30391): Terminating (SIGTERM) 02:39:02.372073 --- ParallelTerminationStrategy: PID 30381 died... 02:39:02.397218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30381): Terminated: ok {rc=0} 02:39:02.450562 --- ParallelTerminationStrategy: PID 30382 died... 02:39:02.472319 run iperf3-srv_10.42.42.10(pid=30382): Terminated {rc=256} 02:39:02.520816 --- ParallelTerminationStrategy: PID 30385 died... 02:39:02.542400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30385): Terminated: ok {rc=0} 02:39:02.601139 --- ParallelTerminationStrategy: PID 30388 died... 02:39:02.624401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30388): Terminated: ok {rc=0} 02:39:02.681304 --- ParallelTerminationStrategy: PID 30391 died... 02:39:02.703720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30391): Terminated: ok {rc=0} 02:39:02.818277 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 02:39:03.980339 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:03.992519 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:39:04.042581 tst iperf3m4.py: using LAC 37970 02:39:04.162824 tst iperf3m4.py: using RAC 230 02:39:04.281268 tst iperf3m4.py: using CellId 37970 02:39:04.401545 tst iperf3m4.py: using BVCI 37971 02:39:04.512098 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:04.523982 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:04.535531 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:04.548089 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:04.560343 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:04.572353 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:04.584559 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:04.596708 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:04.608914 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:04.731733 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:04.854396 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:04.975902 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:05.095235 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:39:05.301330 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:05.616452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30663): Launched 02:39:05.910494 run iperf3-srv_10.42.42.10(pid=30664): Launched 02:39:06.035395 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:39:06.240217 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:06.553576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30667): Launched 02:39:06.842967 run iperf3-srv_10.42.42.10(pid=30668): Launched 02:39:06.977416 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:39:07.196747 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:07.528253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30669): Launched 02:39:07.837653 run iperf3-srv_10.42.42.10(pid=30670): Launched 02:39:07.969191 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:39:08.193466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:08.525949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30671): Launched 02:39:08.824585 run iperf3-srv_10.42.42.10(pid=30672): Launched 02:39:08.964835 tst iperf3m4.py:8: start network... 02:39:09.192735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:39:09.711764 run create_hlr_db(pid=30673): Launched 02:39:09.874072 bus /gobi_6: Setting Powered False 02:39:10.938755 run create_hlr_db(pid=30673): Terminated: ok {rc=0} 02:39:11.409026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30675): Launched 02:39:11.759274 run osmo-hlr_10.42.42.2(pid=30676): Launched 02:39:12.015946 run osmo-stp_10.42.42.5: Starting osmo-stp 02:39:12.697333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30678): Launched 02:39:13.049583 run osmo-stp_10.42.42.5(pid=30679): Launched 02:39:13.300038 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:39:13.963498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30681): Launched 02:39:14.102777 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:39:14.387704 run patchelf(pid=30682): Launched 02:39:14.587762 run osmo-stp_10.42.42.5(pid=30679): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30679)] 02:39:14.730355 run osmo-stp_10.42.42.5(pid=30679): stdout: | (launched: 2022-12-14_02:39:12.986667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:14.875599 run osmo-stp_10.42.42.5(pid=30679): stderr: | [0;m[38;5;43m20221214023913290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023913290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023913290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023913291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023913291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023913291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023913291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:15.021527 run osmo-stp_10.42.42.5(pid=30679): stdout: | (launched: 2022-12-14_02:39:12.986667) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:15.161246 run osmo-stp_10.42.42.5(pid=30679): stderr: | [0;m[38;5;43m20221214023913290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023913290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023913290 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023913291 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023913291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023913291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023913291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:15.326386 run patchelf(pid=30682): Terminating (SIGINT) 02:39:15.518876 run patchelf(pid=30682): Terminated: ok {rc=0} 02:39:15.658473 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30679): Process ended prematurely: osmo-stp_10.42.42.5(pid=30679) [trial-2398↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30679)] [trial-2398↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 02:39:15.669950 tst iperf3m4.py:8: Test FAILED (11.7 sec) 02:39:15.700255 run osmo-hlr_10.42.42.2(pid=30676): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30676)] 02:39:15.756677 run osmo-hlr_10.42.42.2(pid=30676): stdout: | (launched: 2022-12-14_02:39:11.697895) 02:39:15.812135 run osmo-hlr_10.42.42.2(pid=30676): stderr: | [0;m[1;31m20221214023912010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023912010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023912010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023912010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023912010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023912010 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023912030 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023912042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023912042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023912042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:39:15.889566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30663): Terminating (SIGTERM) 02:39:15.934311 run iperf3-srv_10.42.42.10(pid=30664): Terminating (SIGTERM) 02:39:15.986032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30667): Terminating (SIGTERM) 02:39:16.031371 run iperf3-srv_10.42.42.10(pid=30668): Terminating (SIGTERM) 02:39:16.078745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30669): Terminating (SIGTERM) 02:39:16.124633 run iperf3-srv_10.42.42.10(pid=30670): Terminating (SIGTERM) 02:39:16.173453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30671): Terminating (SIGTERM) 02:39:16.218680 run iperf3-srv_10.42.42.10(pid=30672): Terminating (SIGTERM) 02:39:16.268355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30675): Terminating (SIGTERM) 02:39:16.316078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30678): Terminating (SIGTERM) 02:39:16.373392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30681): Terminating (SIGTERM) 02:39:16.428822 --- ParallelTerminationStrategy: PID 30663 died... 02:39:16.452896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30663): Terminated: ok {rc=0} 02:39:16.513124 --- ParallelTerminationStrategy: PID 30664 died... 02:39:16.538069 run iperf3-srv_10.42.42.10(pid=30664): Terminated {rc=256} 02:39:16.597290 --- ParallelTerminationStrategy: PID 30667 died... 02:39:16.622755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30667): Terminated: ok {rc=0} 02:39:16.680432 --- ParallelTerminationStrategy: PID 30668 died... 02:39:16.704556 run iperf3-srv_10.42.42.10(pid=30668): Terminated {rc=256} 02:39:16.764605 --- ParallelTerminationStrategy: PID 30669 died... 02:39:16.788162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30669): Terminated: ok {rc=0} 02:39:16.846587 --- ParallelTerminationStrategy: PID 30670 died... 02:39:16.870947 run iperf3-srv_10.42.42.10(pid=30670): Terminated {rc=256} 02:39:16.929457 --- ParallelTerminationStrategy: PID 30671 died... 02:39:16.956066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30671): Terminated: ok {rc=0} 02:39:17.014712 --- ParallelTerminationStrategy: PID 30672 died... 02:39:17.037637 run iperf3-srv_10.42.42.10(pid=30672): Terminated {rc=256} 02:39:17.094157 --- ParallelTerminationStrategy: PID 30675 died... 02:39:17.117982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30675): Terminated: ok {rc=0} 02:39:17.178586 --- ParallelTerminationStrategy: PID 30678 died... 02:39:17.203553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30678): Terminated: ok {rc=0} 02:39:17.262038 --- ParallelTerminationStrategy: PID 30681 died... 02:39:17.286356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30681): Terminated: ok {rc=0} 02:39:17.399639 bus /gobi_4: Setting Powered False 02:39:18.518711 bus /gobi_4: Setting Powered False 02:39:19.652349 bus /gobi_1: Setting Powered False 02:39:20.752556 bus /gobi_1: Setting Powered False 02:39:21.870953 bus /gobi_0: Setting Powered False 02:39:22.977479 bus /gobi_0: Setting Powered False 02:39:24.097380 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 02:39:25.201560 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:25.213154 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:39:25.262038 tst ping.py: using LAC 37971 02:39:25.379884 tst ping.py: using RAC 231 02:39:25.499768 tst ping.py: using CellId 37971 02:39:25.619553 tst ping.py: using BVCI 37972 02:39:25.738678 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:25.750100 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:25.761537 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:25.772698 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:25.784156 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:25.795382 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:25.806889 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:25.818351 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:25.933997 tst ping.py:19: start network... 02:39:26.134495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:39:26.594935 run create_hlr_db(pid=30684): Launched 02:39:26.717633 bus /gobi_6: Setting Powered False 02:39:27.777647 run create_hlr_db(pid=30684): Terminated: ok {rc=0} 02:39:28.214925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30686): Launched 02:39:28.537681 run osmo-hlr_10.42.42.2(pid=30687): Launched 02:39:28.661872 run osmo-stp_10.42.42.5: Starting osmo-stp 02:39:29.218681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30689): Launched 02:39:29.541174 run osmo-stp_10.42.42.5(pid=30690): Launched 02:39:29.666269 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:39:30.225478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30692): Launched 02:39:30.349822 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:39:30.621928 run patchelf(pid=30693): Launched 02:39:30.802390 run osmo-stp_10.42.42.5(pid=30690): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30690)] 02:39:30.973665 run osmo-stp_10.42.42.5(pid=30690): stdout: | (launched: 2022-12-14_02:39:29.482832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:31.105017 run osmo-stp_10.42.42.5(pid=30690): stderr: | [0;m[38;5;43m20221214023929676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023929676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023929676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023929677 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023929677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023929677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023929677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:31.237804 run osmo-stp_10.42.42.5(pid=30690): stdout: | (launched: 2022-12-14_02:39:29.482832) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:31.365758 run osmo-stp_10.42.42.5(pid=30690): stderr: | [0;m[38;5;43m20221214023929676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023929676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023929676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023929677 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023929677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023929677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023929677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:31.515253 run patchelf(pid=30693): Terminating (SIGINT) 02:39:31.691809 run patchelf(pid=30693): Terminated: ok {rc=0} 02:39:31.819320 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30690): Process ended prematurely: osmo-stp_10.42.42.5(pid=30690) [trial-2398↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30690)] [trial-2398↪gprs:trx-sysmocell5000↪ping.py:22] 02:39:31.829527 tst ping.py:22: Test FAILED (6.6 sec) 02:39:31.857713 run osmo-hlr_10.42.42.2(pid=30687): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30687)] 02:39:31.907425 run osmo-hlr_10.42.42.2(pid=30687): stdout: | (launched: 2022-12-14_02:39:28.479399) 02:39:31.960057 run osmo-hlr_10.42.42.2(pid=30687): stderr: | [0;m[1;31m20221214023928678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023928678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023928678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023928678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023928678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023928678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023928690 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023928700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023928701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023928701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:39:32.012121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30686): Terminating (SIGTERM) 02:39:32.054754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30689): Terminating (SIGTERM) 02:39:32.097997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30692): Terminating (SIGTERM) 02:39:32.142907 --- ParallelTerminationStrategy: PID 30686 died... 02:39:32.162598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30686): Terminated: ok {rc=0} 02:39:32.207016 --- ParallelTerminationStrategy: PID 30689 died... 02:39:32.225988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30689): Terminated: ok {rc=0} 02:39:32.270224 --- ParallelTerminationStrategy: PID 30692 died... 02:39:32.289117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30692): Terminated: ok {rc=0} 02:39:32.375700 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 02:39:33.463636 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:33.475286 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 02:39:33.528397 tst ping_idle_ping.py: using LAC 37972 02:39:33.645726 tst ping_idle_ping.py: using RAC 232 02:39:33.762614 tst ping_idle_ping.py: using CellId 37972 02:39:33.878679 tst ping_idle_ping.py: using BVCI 37973 02:39:33.988448 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:33.999336 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:34.009996 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:34.020498 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:34.030924 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:34.041495 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:34.052643 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 02:39:34.063681 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 02:39:34.181587 tst ping_idle_ping.py:24: start network... 02:39:34.382122 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:39:34.848093 run create_hlr_db(pid=30694): Launched 02:39:34.971045 bus /gobi_6: Setting Powered False 02:39:36.031088 run create_hlr_db(pid=30694): Terminated: ok {rc=0} 02:39:36.471869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30696): Launched 02:39:36.793905 run osmo-hlr_10.42.42.2(pid=30697): Launched 02:39:36.918029 run osmo-stp_10.42.42.5: Starting osmo-stp 02:39:37.472148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30699): Launched 02:39:37.793940 run osmo-stp_10.42.42.5(pid=30700): Launched 02:39:37.918424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:39:38.475527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30702): Launched 02:39:38.592501 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:39:38.846420 run patchelf(pid=30703): Launched 02:39:39.012783 run osmo-stp_10.42.42.5(pid=30700): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30700)] 02:39:39.139181 run osmo-stp_10.42.42.5(pid=30700): stdout: | (launched: 2022-12-14_02:39:37.735486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:39.267517 run osmo-stp_10.42.42.5(pid=30700): stderr: | [0;m[38;5;43m20221214023937925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023937925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023937925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023937926 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023937928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023937928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023937928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:39.395819 run osmo-stp_10.42.42.5(pid=30700): stdout: | (launched: 2022-12-14_02:39:37.735486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:39.518623 run osmo-stp_10.42.42.5(pid=30700): stderr: | [0;m[38;5;43m20221214023937925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023937925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023937925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023937926 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023937928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023937928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023937928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:39.663642 run patchelf(pid=30703): Terminating (SIGINT) 02:39:39.833459 run patchelf(pid=30703): Terminated: ok {rc=0} 02:39:39.955786 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30700): Process ended prematurely: osmo-stp_10.42.42.5(pid=30700) [trial-2398↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30700)] [trial-2398↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 02:39:39.965387 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 02:39:39.992177 run osmo-hlr_10.42.42.2(pid=30697): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30697)] 02:39:40.039819 run osmo-hlr_10.42.42.2(pid=30697): stdout: | (launched: 2022-12-14_02:39:36.735557) 02:39:40.089132 run osmo-hlr_10.42.42.2(pid=30697): stderr: | [0;m[1;31m20221214023936933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023936933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023936933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023936933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023936933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023936933 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023936945 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023936954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023936954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023936954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:39:40.139032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30696): Terminating (SIGTERM) 02:39:40.178936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30699): Terminating (SIGTERM) 02:39:40.218629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30702): Terminating (SIGTERM) 02:39:40.258924 --- ParallelTerminationStrategy: PID 30696 died... 02:39:40.278252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30696): Terminated: ok {rc=0} 02:39:40.322436 --- ParallelTerminationStrategy: PID 30699 died... 02:39:40.341491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30699): Terminated: ok {rc=0} 02:39:40.385595 --- ParallelTerminationStrategy: PID 30702 died... 02:39:40.404240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30702): Terminated: ok {rc=0} 02:39:40.491454 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 02:39:41.805859 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:39:41.811835 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:39:41.846356 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:39:41.886354 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:39:41.974478 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:39:42.008457 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:39:42.047519 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:39:42.644491 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:39:42.696698 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:42.707748 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:39:42.757845 tst cs_paging_gprs_active.py: using LAC 37973 02:39:42.888059 tst cs_paging_gprs_active.py: using RAC 233 02:39:43.015765 tst cs_paging_gprs_active.py: using CellId 37973 02:39:43.145714 tst cs_paging_gprs_active.py: using BVCI 37974 02:39:43.265044 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:43.276388 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:43.287576 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:43.298781 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:43.310197 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:43.321703 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:43.333366 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:43.345074 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:43.356640 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:39:43.475378 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:39:43.597154 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:39:43.818575 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:44.147810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30707): Launched 02:39:44.432266 run iperf3-srv_10.42.42.10(pid=30708): Launched 02:39:44.555368 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:39:44.776275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:45.105498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30709): Launched 02:39:45.389228 run iperf3-srv_10.42.42.10(pid=30710): Launched 02:39:45.513889 tst cs_paging_gprs_active.py:38: start network... 02:39:45.734490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:39:46.259853 run create_hlr_db(pid=30711): Launched 02:39:46.388325 bus /gobi_6: Setting Powered False 02:39:47.449676 run create_hlr_db(pid=30711): Terminated: ok {rc=0} 02:39:47.910002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30713): Launched 02:39:48.236822 run osmo-hlr_10.42.42.2(pid=30714): Launched 02:39:48.363323 run osmo-stp_10.42.42.5: Starting osmo-stp 02:39:48.926998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30716): Launched 02:39:49.254673 run osmo-stp_10.42.42.5(pid=30717): Launched 02:39:49.381128 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:39:49.948894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30719): Launched 02:39:50.074630 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:39:50.352397 run patchelf(pid=30720): Launched 02:39:50.535422 run osmo-stp_10.42.42.5(pid=30717): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30717)] 02:39:50.674852 run osmo-stp_10.42.42.5(pid=30717): stdout: | (launched: 2022-12-14_02:39:49.195509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:50.815459 run osmo-stp_10.42.42.5(pid=30717): stderr: | [0;m[38;5;43m20221214023949388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023949388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023949388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023949389 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023949391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023949391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023949391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:50.956037 run osmo-stp_10.42.42.5(pid=30717): stdout: | (launched: 2022-12-14_02:39:49.195509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:39:51.091110 run osmo-stp_10.42.42.5(pid=30717): stderr: | [0;m[38;5;43m20221214023949388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214023949388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214023949388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214023949389 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214023949391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214023949391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214023949391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:39:51.250937 run patchelf(pid=30720): Terminating (SIGINT) 02:39:51.436211 run patchelf(pid=30720): Terminated: ok {rc=0} 02:39:51.570391 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30717): Process ended prematurely: osmo-stp_10.42.42.5(pid=30717) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30717)] [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:39:51.580741 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 02:39:51.609434 run osmo-hlr_10.42.42.2(pid=30714): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30714)] 02:39:51.660397 run osmo-hlr_10.42.42.2(pid=30714): stdout: | (launched: 2022-12-14_02:39:48.177570) 02:39:51.713276 run osmo-hlr_10.42.42.2(pid=30714): stderr: | [0;m[1;31m20221214023948378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214023948378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214023948378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214023948378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214023948379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214023948379 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214023948390 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214023948398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214023948399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214023948399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:39:51.765851 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30707): Terminating (SIGTERM) 02:39:51.808306 run iperf3-srv_10.42.42.10(pid=30708): Terminating (SIGTERM) 02:39:51.850915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30709): Terminating (SIGTERM) 02:39:51.893331 run iperf3-srv_10.42.42.10(pid=30710): Terminating (SIGTERM) 02:39:51.935362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30713): Terminating (SIGTERM) 02:39:51.977774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30716): Terminating (SIGTERM) 02:39:52.019929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30719): Terminating (SIGTERM) 02:39:52.062249 --- ParallelTerminationStrategy: PID 30707 died... 02:39:52.082714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30707): Terminated: ok {rc=0} 02:39:52.129265 --- ParallelTerminationStrategy: PID 30708 died... 02:39:52.149095 run iperf3-srv_10.42.42.10(pid=30708): Terminated {rc=256} 02:39:52.195310 --- ParallelTerminationStrategy: PID 30709 died... 02:39:52.215123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30709): Terminated: ok {rc=0} 02:39:52.261440 --- ParallelTerminationStrategy: PID 30710 died... 02:39:52.281297 run iperf3-srv_10.42.42.10(pid=30710): Terminated {rc=256} 02:39:52.327342 --- ParallelTerminationStrategy: PID 30713 died... 02:39:52.347278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30713): Terminated: ok {rc=0} 02:39:52.393406 --- ParallelTerminationStrategy: PID 30716 died... 02:39:52.413227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30716): Terminated: ok {rc=0} 02:39:52.459715 --- ParallelTerminationStrategy: PID 30719 died... 02:39:52.479521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30719): Terminated: ok {rc=0} 02:39:52.567779 bus /gobi_0: Setting Powered False 02:39:53.666807 bus /gobi_0: Setting Powered False 02:39:54.786906 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:39:55.932867 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:55.944623 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:39:56.001568 tst iperf3.py: using LAC 37974 02:39:56.129045 tst iperf3.py: using RAC 234 02:39:56.261176 tst iperf3.py: using CellId 37974 02:39:56.386862 tst iperf3.py: using BVCI 37975 02:39:56.505960 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:56.517453 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:56.528556 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:56.539799 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:56.551281 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:56.562814 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:56.574451 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:56.585898 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:39:56.597507 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:39:56.714630 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:39:56.934545 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:39:57.260210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30721): Launched 02:39:57.543982 run iperf3-srv_10.42.42.10(pid=30722): Launched 02:39:57.665864 tst iperf3.py:8: start network... 02:39:57.885287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:39:58.390253 run create_hlr_db(pid=30723): Launched 02:39:58.516853 bus /gobi_6: Setting Powered False 02:39:59.580903 run create_hlr_db(pid=30723): Terminated: ok {rc=0} 02:40:00.015521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30725): Launched 02:40:00.319284 run osmo-hlr_10.42.42.2(pid=30726): Launched 02:40:00.436075 run osmo-stp_10.42.42.5: Starting osmo-stp 02:40:01.037174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30728): Launched 02:40:01.423563 run osmo-stp_10.42.42.5(pid=30732): Launched 02:40:01.592415 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:40:02.252196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30734): Launched 02:40:02.392158 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:40:02.670610 run patchelf(pid=30735): Launched 02:40:02.853962 run osmo-stp_10.42.42.5(pid=30732): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30732)] 02:40:02.992628 run osmo-stp_10.42.42.5(pid=30732): stdout: | (launched: 2022-12-14_02:40:01.364075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:03.132592 run osmo-stp_10.42.42.5(pid=30732): stderr: | [0;m[38;5;43m20221214024001743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024001743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024001744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024001744 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024001744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024001744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024001744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:03.272654 run osmo-stp_10.42.42.5(pid=30732): stdout: | (launched: 2022-12-14_02:40:01.364075) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:03.407296 run osmo-stp_10.42.42.5(pid=30732): stderr: | [0;m[38;5;43m20221214024001743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024001743 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024001744 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024001744 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024001744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024001744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024001744 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:03.567508 run patchelf(pid=30735): Terminating (SIGINT) 02:40:03.751610 run patchelf(pid=30735): Terminated: ok {rc=0} 02:40:03.884653 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30732): Process ended prematurely: osmo-stp_10.42.42.5(pid=30732) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30732)] [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 02:40:03.895058 tst iperf3.py:8: Test FAILED (8.0 sec) 02:40:03.923664 run osmo-hlr_10.42.42.2(pid=30726): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30726)] 02:40:03.974483 run osmo-hlr_10.42.42.2(pid=30726): stdout: | (launched: 2022-12-14_02:40:00.263403) 02:40:04.027121 run osmo-hlr_10.42.42.2(pid=30726): stderr: | [0;m[1;31m20221214024000443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024000443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024000443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024000443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024000443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024000443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024000455 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024000464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024000464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024000464 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:40:04.080126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30721): Terminating (SIGTERM) 02:40:04.122138 run iperf3-srv_10.42.42.10(pid=30722): Terminating (SIGTERM) 02:40:04.165083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30725): Terminating (SIGTERM) 02:40:04.207522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30728): Terminating (SIGTERM) 02:40:04.250393 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30734): Terminating (SIGTERM) 02:40:04.292908 --- ParallelTerminationStrategy: PID 30721 died... 02:40:04.313425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30721): Terminated: ok {rc=0} 02:40:04.360349 --- ParallelTerminationStrategy: PID 30722 died... 02:40:04.380227 run iperf3-srv_10.42.42.10(pid=30722): Terminated {rc=256} 02:40:04.426570 --- ParallelTerminationStrategy: PID 30725 died... 02:40:04.446544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30725): Terminated: ok {rc=0} 02:40:04.493397 --- ParallelTerminationStrategy: PID 30728 died... 02:40:04.513492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30728): Terminated: ok {rc=0} 02:40:04.559911 --- ParallelTerminationStrategy: PID 30734 died... 02:40:04.579966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30734): Terminated: ok {rc=0} 02:40:04.668794 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:40:05.812037 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:05.823779 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:40:05.873743 tst iperf3m4.py: using LAC 37975 02:40:05.994519 tst iperf3m4.py: using RAC 235 02:40:06.116533 tst iperf3m4.py: using CellId 37975 02:40:06.236825 tst iperf3m4.py: using BVCI 37976 02:40:06.347430 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:06.358456 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:06.369179 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:06.379942 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:06.390588 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:06.401335 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:06.412161 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:06.422897 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:06.433703 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:40:06.550849 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:40:06.674849 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:40:06.793940 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:40:06.915612 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:40:07.136823 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:07.464864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30736): Launched 02:40:07.750018 run iperf3-srv_10.42.42.10(pid=30737): Launched 02:40:07.873987 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:40:08.094924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:08.423525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30738): Launched 02:40:08.707641 run iperf3-srv_10.42.42.10(pid=30739): Launched 02:40:08.830018 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:40:09.050366 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:09.377907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30740): Launched 02:40:09.662340 run iperf3-srv_10.42.42.10(pid=30741): Launched 02:40:09.786139 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:40:10.007026 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:10.335234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30742): Launched 02:40:10.619793 run iperf3-srv_10.42.42.10(pid=30743): Launched 02:40:10.742194 tst iperf3m4.py:8: start network... 02:40:10.962726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:40:11.469183 run create_hlr_db(pid=30744): Launched 02:40:11.595058 bus /gobi_6: Setting Powered False 02:40:12.658932 run create_hlr_db(pid=30744): Terminated: ok {rc=0} 02:40:13.093160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30746): Launched 02:40:13.397699 run osmo-hlr_10.42.42.2(pid=30747): Launched 02:40:13.514218 run osmo-stp_10.42.42.5: Starting osmo-stp 02:40:14.055854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30749): Launched 02:40:14.361165 run osmo-stp_10.42.42.5(pid=30750): Launched 02:40:14.476845 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:40:15.002742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30752): Launched 02:40:15.119418 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:40:15.376779 run patchelf(pid=30753): Launched 02:40:15.545712 run osmo-stp_10.42.42.5(pid=30750): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30750)] 02:40:15.674195 run osmo-stp_10.42.42.5(pid=30750): stdout: | (launched: 2022-12-14_02:40:14.304809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:15.804267 run osmo-stp_10.42.42.5(pid=30750): stderr: | [0;m[38;5;43m20221214024014478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024014478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024014478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024014478 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024014481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024014481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024014481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:15.974729 run osmo-stp_10.42.42.5(pid=30750): stdout: | (launched: 2022-12-14_02:40:14.304809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:16.112726 run osmo-stp_10.42.42.5(pid=30750): stderr: | [0;m[38;5;43m20221214024014478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024014478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024014478 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024014478 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024014481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024014481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024014481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:16.277166 run patchelf(pid=30753): Terminating (SIGINT) 02:40:16.468077 run patchelf(pid=30753): Terminated: ok {rc=0} 02:40:16.606881 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30750): Process ended prematurely: osmo-stp_10.42.42.5(pid=30750) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30750)] [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 02:40:16.618319 tst iperf3m4.py:8: Test FAILED (10.8 sec) 02:40:16.648550 run osmo-hlr_10.42.42.2(pid=30747): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30747)] 02:40:16.703534 run osmo-hlr_10.42.42.2(pid=30747): stdout: | (launched: 2022-12-14_02:40:13.342038) 02:40:16.760208 run osmo-hlr_10.42.42.2(pid=30747): stderr: | [0;m[1;31m20221214024013519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024013519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024013519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024013519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024013519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024013519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024013532 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024013543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024013543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024013543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:40:16.816198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30736): Terminating (SIGTERM) 02:40:16.859918 run iperf3-srv_10.42.42.10(pid=30737): Terminating (SIGTERM) 02:40:16.904313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30738): Terminating (SIGTERM) 02:40:16.950230 run iperf3-srv_10.42.42.10(pid=30739): Terminating (SIGTERM) 02:40:16.997577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30740): Terminating (SIGTERM) 02:40:17.041958 run iperf3-srv_10.42.42.10(pid=30741): Terminating (SIGTERM) 02:40:17.086103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30742): Terminating (SIGTERM) 02:40:17.130801 run iperf3-srv_10.42.42.10(pid=30743): Terminating (SIGTERM) 02:40:17.175646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30746): Terminating (SIGTERM) 02:40:17.220346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30749): Terminating (SIGTERM) 02:40:17.262943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30752): Terminating (SIGTERM) 02:40:17.305717 --- ParallelTerminationStrategy: PID 30736 died... 02:40:17.326585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30736): Terminated: ok {rc=0} 02:40:17.373799 --- ParallelTerminationStrategy: PID 30737 died... 02:40:17.394177 run iperf3-srv_10.42.42.10(pid=30737): Terminated {rc=256} 02:40:17.440844 --- ParallelTerminationStrategy: PID 30738 died... 02:40:17.461619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30738): Terminated: ok {rc=0} 02:40:17.508600 --- ParallelTerminationStrategy: PID 30739 died... 02:40:17.528992 run iperf3-srv_10.42.42.10(pid=30739): Terminated {rc=256} 02:40:17.575619 --- ParallelTerminationStrategy: PID 30740 died... 02:40:17.596052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30740): Terminated: ok {rc=0} 02:40:17.642883 --- ParallelTerminationStrategy: PID 30741 died... 02:40:17.663263 run iperf3-srv_10.42.42.10(pid=30741): Terminated {rc=256} 02:40:17.710040 --- ParallelTerminationStrategy: PID 30742 died... 02:40:17.730805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30742): Terminated: ok {rc=0} 02:40:17.777681 --- ParallelTerminationStrategy: PID 30743 died... 02:40:17.798056 run iperf3-srv_10.42.42.10(pid=30743): Terminated {rc=256} 02:40:17.844592 --- ParallelTerminationStrategy: PID 30746 died... 02:40:17.865071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30746): Terminated: ok {rc=0} 02:40:17.912039 --- ParallelTerminationStrategy: PID 30749 died... 02:40:17.932492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30749): Terminated: ok {rc=0} 02:40:17.979861 --- ParallelTerminationStrategy: PID 30752 died... 02:40:18.000623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30752): Terminated: ok {rc=0} 02:40:18.090768 bus /gobi_4: Setting Powered False 02:40:19.189557 bus /gobi_4: Setting Powered False 02:40:20.306322 bus /gobi_1: Setting Powered False 02:40:21.405352 bus /gobi_1: Setting Powered False 02:40:22.522348 bus /gobi_0: Setting Powered False 02:40:23.620173 bus /gobi_0: Setting Powered False 02:40:24.738843 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 02:40:25.841726 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:25.853320 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:40:25.903861 tst ping.py: using LAC 37976 02:40:26.030552 tst ping.py: using RAC 236 02:40:26.157482 tst ping.py: using CellId 37976 02:40:26.275431 tst ping.py: using BVCI 37977 02:40:26.384527 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:26.395489 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:26.406404 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:26.417219 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:26.427699 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:26.438324 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:26.449141 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:26.459826 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:40:26.576135 tst ping.py:19: start network... 02:40:26.776274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:40:27.238384 run create_hlr_db(pid=30754): Launched 02:40:27.361711 bus /gobi_6: Setting Powered False 02:40:28.421553 run create_hlr_db(pid=30754): Terminated: ok {rc=0} 02:40:28.859226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Launched 02:40:29.180614 run osmo-hlr_10.42.42.2(pid=30757): Launched 02:40:29.304479 run osmo-stp_10.42.42.5: Starting osmo-stp 02:40:29.864773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Launched 02:40:30.185388 run osmo-stp_10.42.42.5(pid=30761): Launched 02:40:30.309328 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:40:30.869676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30763): Launched 02:40:31.005445 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:40:31.283738 run patchelf(pid=30764): Launched 02:40:31.478777 run osmo-stp_10.42.42.5(pid=30761): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30761)] 02:40:31.618612 run osmo-stp_10.42.42.5(pid=30761): stdout: | (launched: 2022-12-14_02:40:30.126894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:31.759412 run osmo-stp_10.42.42.5(pid=30761): stderr: | [0;m[38;5;43m20221214024030318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024030318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024030319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024030319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024030320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024030320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024030320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:31.902455 run osmo-stp_10.42.42.5(pid=30761): stdout: | (launched: 2022-12-14_02:40:30.126894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:32.037857 run osmo-stp_10.42.42.5(pid=30761): stderr: | [0;m[38;5;43m20221214024030318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024030318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024030319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024030319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024030320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024030320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024030320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:32.197914 run patchelf(pid=30764): Terminating (SIGINT) 02:40:32.380244 run patchelf(pid=30764): Terminated: ok {rc=0} 02:40:32.511960 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30761): Process ended prematurely: osmo-stp_10.42.42.5(pid=30761) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30761)] [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 02:40:32.521518 tst ping.py:22: Test FAILED (6.7 sec) 02:40:32.549497 run osmo-hlr_10.42.42.2(pid=30757): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30757)] 02:40:32.602273 run osmo-hlr_10.42.42.2(pid=30757): stdout: | (launched: 2022-12-14_02:40:29.122035) 02:40:32.654515 run osmo-hlr_10.42.42.2(pid=30757): stderr: | [0;m[1;31m20221214024029319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024029319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024029319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024029319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024029319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024029319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024029332 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024029340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024029340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024029340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:40:32.708613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Terminating (SIGTERM) 02:40:32.750822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Terminating (SIGTERM) 02:40:32.793857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30763): Terminating (SIGTERM) 02:40:32.837128 --- ParallelTerminationStrategy: PID 30756 died... 02:40:32.858123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Terminated: ok {rc=0} 02:40:32.905359 --- ParallelTerminationStrategy: PID 30759 died... 02:40:32.925820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Terminated: ok {rc=0} 02:40:32.972697 --- ParallelTerminationStrategy: PID 30763 died... 02:40:32.993258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30763): Terminated: ok {rc=0} 02:40:33.083566 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:40:34.170799 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:34.183034 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:40:34.236878 tst ping_idle_ping.py: using LAC 37977 02:40:34.365467 tst ping_idle_ping.py: using RAC 237 02:40:34.493869 tst ping_idle_ping.py: using CellId 37977 02:40:34.622488 tst ping_idle_ping.py: using BVCI 37978 02:40:34.741734 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:34.753633 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:34.764794 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:34.776051 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:34.787968 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:34.799936 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:34.812241 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:40:34.824358 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:40:34.942889 tst ping_idle_ping.py:24: start network... 02:40:35.143815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:40:35.610855 run create_hlr_db(pid=30765): Launched 02:40:35.734465 bus /gobi_6: Setting Powered False 02:40:36.794696 run create_hlr_db(pid=30765): Terminated: ok {rc=0} 02:40:37.235608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30767): Launched 02:40:37.559933 run osmo-hlr_10.42.42.2(pid=30768): Launched 02:40:37.683655 run osmo-stp_10.42.42.5: Starting osmo-stp 02:40:38.239509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30770): Launched 02:40:38.562118 run osmo-stp_10.42.42.5(pid=30771): Launched 02:40:38.687909 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:40:39.246274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30773): Launched 02:40:39.371349 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:40:39.644810 run patchelf(pid=30774): Launched 02:40:39.825242 run osmo-stp_10.42.42.5(pid=30771): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30771)] 02:40:39.961587 run osmo-stp_10.42.42.5(pid=30771): stdout: | (launched: 2022-12-14_02:40:38.503201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:40.099621 run osmo-stp_10.42.42.5(pid=30771): stderr: | [0;m[38;5;43m20221214024038697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024038697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024038697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024038697 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024038698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024038698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024038698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:40.238634 run osmo-stp_10.42.42.5(pid=30771): stdout: | (launched: 2022-12-14_02:40:38.503201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:40.371379 run osmo-stp_10.42.42.5(pid=30771): stderr: | [0;m[38;5;43m20221214024038697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024038697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024038697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024038697 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024038698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024038698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024038698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:40.529154 run patchelf(pid=30774): Terminating (SIGINT) 02:40:40.711203 run patchelf(pid=30774): Terminated: ok {rc=0} 02:40:40.842422 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30771): Process ended prematurely: osmo-stp_10.42.42.5(pid=30771) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30771)] [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 02:40:40.852076 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 02:40:40.880397 run osmo-hlr_10.42.42.2(pid=30768): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30768)] 02:40:40.931153 run osmo-hlr_10.42.42.2(pid=30768): stdout: | (launched: 2022-12-14_02:40:37.500911) 02:40:40.983266 run osmo-hlr_10.42.42.2(pid=30768): stderr: | [0;m[1;31m20221214024037698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024037698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024037698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024037698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024037698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024037698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024037713 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024037721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024037721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024037721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:40:41.035747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30767): Terminating (SIGTERM) 02:40:41.077699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30770): Terminating (SIGTERM) 02:40:41.120305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30773): Terminating (SIGTERM) 02:40:41.163338 --- ParallelTerminationStrategy: PID 30767 died... 02:40:41.183848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30767): Terminated: ok {rc=0} 02:40:41.230979 --- ParallelTerminationStrategy: PID 30770 died... 02:40:41.250954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30770): Terminated: ok {rc=0} 02:40:41.297494 --- ParallelTerminationStrategy: PID 30773 died... 02:40:41.317505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30773): Terminated: ok {rc=0} 02:40:41.406661 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:40:42.730233 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:40:42.736118 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:40:42.769144 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:40:42.807336 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:40:42.892737 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:40:42.925582 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:40:42.963032 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:40:43.559155 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:40:43.607933 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:43.618868 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:40:43.691622 tst cs_paging_gprs_active.py: using LAC 37978 02:40:43.815162 tst cs_paging_gprs_active.py: using RAC 238 02:40:43.935130 tst cs_paging_gprs_active.py: using CellId 37978 02:40:44.054444 tst cs_paging_gprs_active.py: using BVCI 37979 02:40:44.166586 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:44.177603 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:44.188317 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:44.199073 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:44.210212 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:44.221065 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:44.231960 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:44.242811 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:44.253800 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:40:44.371523 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:40:44.492802 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:40:44.714189 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:45.042404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30782): Launched 02:40:45.326779 run iperf3-srv_10.42.42.10(pid=30783): Launched 02:40:45.451226 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:40:45.672830 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:46.006607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30784): Launched 02:40:46.304704 run iperf3-srv_10.42.42.10(pid=30785): Launched 02:40:46.442867 tst cs_paging_gprs_active.py:38: start network... 02:40:46.669027 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:40:47.187917 run create_hlr_db(pid=30786): Launched 02:40:47.314171 bus /gobi_6: Setting Powered False 02:40:48.378672 run create_hlr_db(pid=30786): Terminated: ok {rc=0} 02:40:48.815489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30788): Launched 02:40:49.122077 run osmo-hlr_10.42.42.2(pid=30789): Launched 02:40:49.238352 run osmo-stp_10.42.42.5: Starting osmo-stp 02:40:49.762582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30791): Launched 02:40:50.067203 run osmo-stp_10.42.42.5(pid=30792): Launched 02:40:50.183140 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:40:50.710526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30794): Launched 02:40:50.827262 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:40:51.085413 run patchelf(pid=30795): Launched 02:40:51.254874 run osmo-stp_10.42.42.5(pid=30792): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30792)] 02:40:51.383496 run osmo-stp_10.42.42.5(pid=30792): stdout: | (launched: 2022-12-14_02:40:50.011054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:51.513645 run osmo-stp_10.42.42.5(pid=30792): stderr: | [0;m[38;5;43m20221214024050184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024050185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024050185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024050185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024050186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024050186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024050186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:51.644286 run osmo-stp_10.42.42.5(pid=30792): stdout: | (launched: 2022-12-14_02:40:50.011054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:40:51.768816 run osmo-stp_10.42.42.5(pid=30792): stderr: | [0;m[38;5;43m20221214024050184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024050185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024050185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024050185 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024050186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024050186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024050186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:40:51.917163 run patchelf(pid=30795): Terminating (SIGINT) 02:40:52.088792 run patchelf(pid=30795): Terminated: ok {rc=0} 02:40:52.212609 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30792): Process ended prematurely: osmo-stp_10.42.42.5(pid=30792) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30792)] [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:40:52.222257 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:40:52.249305 run osmo-hlr_10.42.42.2(pid=30789): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30789)] 02:40:52.298568 run osmo-hlr_10.42.42.2(pid=30789): stdout: | (launched: 2022-12-14_02:40:49.065707) 02:40:52.347694 run osmo-hlr_10.42.42.2(pid=30789): stderr: | [0;m[1;31m20221214024049242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024049242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024049242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024049242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024049242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024049242 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024049254 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024049263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024049263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024049263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:40:52.397310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30782): Terminating (SIGTERM) 02:40:52.436770 run iperf3-srv_10.42.42.10(pid=30783): Terminating (SIGTERM) 02:40:52.476770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30784): Terminating (SIGTERM) 02:40:52.516173 run iperf3-srv_10.42.42.10(pid=30785): Terminating (SIGTERM) 02:40:52.555469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30788): Terminating (SIGTERM) 02:40:52.594851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30791): Terminating (SIGTERM) 02:40:52.634332 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30794): Terminating (SIGTERM) 02:40:52.673974 --- ParallelTerminationStrategy: PID 30782 died... 02:40:52.692854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30782): Terminated: ok {rc=0} 02:40:52.736642 --- ParallelTerminationStrategy: PID 30783 died... 02:40:52.755210 run iperf3-srv_10.42.42.10(pid=30783): Terminated {rc=256} 02:40:52.798837 --- ParallelTerminationStrategy: PID 30784 died... 02:40:52.817356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30784): Terminated: ok {rc=0} 02:40:52.860721 --- ParallelTerminationStrategy: PID 30785 died... 02:40:52.879116 run iperf3-srv_10.42.42.10(pid=30785): Terminated {rc=256} 02:40:52.922296 --- ParallelTerminationStrategy: PID 30788 died... 02:40:52.940745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30788): Terminated: ok {rc=0} 02:40:52.984133 --- ParallelTerminationStrategy: PID 30791 died... 02:40:53.002676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30791): Terminated: ok {rc=0} 02:40:53.046167 --- ParallelTerminationStrategy: PID 30794 died... 02:40:53.064670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30794): Terminated: ok {rc=0} 02:40:53.150378 bus /gobi_0: Setting Powered False 02:40:54.251230 bus /gobi_0: Setting Powered False 02:40:55.368055 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:40:56.519326 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:56.531733 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:40:56.611009 tst iperf3.py: using LAC 37979 02:40:56.738720 tst iperf3.py: using RAC 239 02:40:56.865353 tst iperf3.py: using CellId 37979 02:40:56.992436 tst iperf3.py: using BVCI 37980 02:40:57.112076 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:57.123553 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:57.134804 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:57.146099 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:57.158112 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:57.170131 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:57.182295 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:57.194298 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:40:57.206565 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:40:57.326467 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:40:57.532380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:40:57.836837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30799): Launched 02:40:58.100611 run iperf3-srv_10.42.42.10(pid=30800): Launched 02:40:58.214503 tst iperf3.py:8: start network... 02:40:58.418221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:40:58.889369 run create_hlr_db(pid=30801): Launched 02:40:59.018373 bus /gobi_6: Setting Powered False 02:41:00.082554 run create_hlr_db(pid=30801): Terminated: ok {rc=0} 02:41:00.537631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30803): Launched 02:41:00.869800 run osmo-hlr_10.42.42.2(pid=30804): Launched 02:41:01.059138 run osmo-stp_10.42.42.5: Starting osmo-stp 02:41:01.652536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30806): Launched 02:41:01.994570 run osmo-stp_10.42.42.5(pid=30807): Launched 02:41:02.248124 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:41:02.885654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30809): Launched 02:41:03.013121 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:41:03.290616 run patchelf(pid=30810): Launched 02:41:03.475132 run osmo-stp_10.42.42.5(pid=30807): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30807)] 02:41:03.615461 run osmo-stp_10.42.42.5(pid=30807): stdout: | (launched: 2022-12-14_02:41:01.932449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:03.756247 run osmo-stp_10.42.42.5(pid=30807): stderr: | [0;m[38;5;43m20221214024102370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024102370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024102370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024102371 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024102371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024102371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024102371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:03.897465 run osmo-stp_10.42.42.5(pid=30807): stdout: | (launched: 2022-12-14_02:41:01.932449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:04.032698 run osmo-stp_10.42.42.5(pid=30807): stderr: | [0;m[38;5;43m20221214024102370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024102370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024102370 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024102371 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024102371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024102371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024102371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:04.192673 run patchelf(pid=30810): Terminating (SIGINT) 02:41:04.378604 run patchelf(pid=30810): Terminated: ok {rc=0} 02:41:04.512897 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30807): Process ended prematurely: osmo-stp_10.42.42.5(pid=30807) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30807)] [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 02:41:04.523482 tst iperf3.py:8: Test FAILED (8.0 sec) 02:41:04.552350 run osmo-hlr_10.42.42.2(pid=30804): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30804)] 02:41:04.604328 run osmo-hlr_10.42.42.2(pid=30804): stdout: | (launched: 2022-12-14_02:41:00.807314) 02:41:04.657438 run osmo-hlr_10.42.42.2(pid=30804): stderr: | [0;m[1;31m20221214024101179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024101180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024101180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024101180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024101180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024101180 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024101210 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024101230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024101230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024101230 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:41:04.710846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30799): Terminating (SIGTERM) 02:41:04.753354 run iperf3-srv_10.42.42.10(pid=30800): Terminating (SIGTERM) 02:41:04.795720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30803): Terminating (SIGTERM) 02:41:04.838640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30806): Terminating (SIGTERM) 02:41:04.881388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30809): Terminating (SIGTERM) 02:41:04.924025 --- ParallelTerminationStrategy: PID 30799 died... 02:41:04.944826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30799): Terminated: ok {rc=0} 02:41:04.992525 --- ParallelTerminationStrategy: PID 30800 died... 02:41:05.012707 run iperf3-srv_10.42.42.10(pid=30800): Terminated {rc=256} 02:41:05.059465 --- ParallelTerminationStrategy: PID 30803 died... 02:41:05.079581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30803): Terminated: ok {rc=0} 02:41:05.126380 --- ParallelTerminationStrategy: PID 30806 died... 02:41:05.146520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30806): Terminated: ok {rc=0} 02:41:05.193231 --- ParallelTerminationStrategy: PID 30809 died... 02:41:05.213421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30809): Terminated: ok {rc=0} 02:41:05.302681 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:41:06.454368 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:06.466864 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:41:06.540649 tst iperf3m4.py: using LAC 37980 02:41:06.670462 tst iperf3m4.py: using RAC 240 02:41:06.792214 tst iperf3m4.py: using CellId 37980 02:41:06.914405 tst iperf3m4.py: using BVCI 37981 02:41:07.027693 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:07.039015 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:07.050101 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:07.061060 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:07.072493 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:07.084085 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:07.095905 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:07.107182 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:07.118925 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:41:07.243251 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:41:07.367163 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:41:07.489472 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:41:07.608620 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:41:07.815374 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:08.122887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30811): Launched 02:41:08.389495 run iperf3-srv_10.42.42.10(pid=30812): Launched 02:41:08.505907 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:41:08.710782 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:09.017171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30813): Launched 02:41:09.282686 run iperf3-srv_10.42.42.10(pid=30814): Launched 02:41:09.396814 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:41:09.600710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:09.906369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30815): Launched 02:41:10.173587 run iperf3-srv_10.42.42.10(pid=30816): Launched 02:41:10.287513 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:41:10.491887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:10.797224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30817): Launched 02:41:11.061645 run iperf3-srv_10.42.42.10(pid=30818): Launched 02:41:11.175316 tst iperf3m4.py:8: start network... 02:41:11.378769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:41:11.850061 run create_hlr_db(pid=30819): Launched 02:41:11.976184 bus /gobi_6: Setting Powered False 02:41:13.037099 run create_hlr_db(pid=30819): Terminated: ok {rc=0} 02:41:13.483697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30821): Launched 02:41:13.811966 run osmo-hlr_10.42.42.2(pid=30822): Launched 02:41:13.937546 run osmo-stp_10.42.42.5: Starting osmo-stp 02:41:14.506661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30824): Launched 02:41:14.834293 run osmo-stp_10.42.42.5(pid=30825): Launched 02:41:14.960639 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:41:15.527175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30827): Launched 02:41:15.652567 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:41:15.949641 run patchelf(pid=30828): Launched 02:41:16.145721 run osmo-stp_10.42.42.5(pid=30825): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30825)] 02:41:16.286452 run osmo-stp_10.42.42.5(pid=30825): stdout: | (launched: 2022-12-14_02:41:14.774844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:16.429057 run osmo-stp_10.42.42.5(pid=30825): stderr: | [0;m[38;5;43m20221214024114969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024114969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024114969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024114970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024114970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024114970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024114970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:16.572028 run osmo-stp_10.42.42.5(pid=30825): stdout: | (launched: 2022-12-14_02:41:14.774844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:16.709079 run osmo-stp_10.42.42.5(pid=30825): stderr: | [0;m[38;5;43m20221214024114969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024114969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024114969 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024114970 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024114970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024114970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024114970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:16.871144 run patchelf(pid=30828): Terminating (SIGINT) 02:41:17.058587 run patchelf(pid=30828): Terminated: ok {rc=0} 02:41:17.193795 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30825): Process ended prematurely: osmo-stp_10.42.42.5(pid=30825) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30825)] [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:41:17.204139 tst iperf3m4.py:8: Test FAILED (10.8 sec) 02:41:17.233204 run osmo-hlr_10.42.42.2(pid=30822): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30822)] 02:41:17.284579 run osmo-hlr_10.42.42.2(pid=30822): stdout: | (launched: 2022-12-14_02:41:13.752473) 02:41:17.337424 run osmo-hlr_10.42.42.2(pid=30822): stderr: | [0;m[1;31m20221214024113949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024113949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024113949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024113949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024113949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024113949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024113963 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024113973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024113973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024113973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:41:17.390637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30811): Terminating (SIGTERM) 02:41:17.432878 run iperf3-srv_10.42.42.10(pid=30812): Terminating (SIGTERM) 02:41:17.475488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30813): Terminating (SIGTERM) 02:41:17.518399 run iperf3-srv_10.42.42.10(pid=30814): Terminating (SIGTERM) 02:41:17.561026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30815): Terminating (SIGTERM) 02:41:17.603561 run iperf3-srv_10.42.42.10(pid=30816): Terminating (SIGTERM) 02:41:17.645892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30817): Terminating (SIGTERM) 02:41:17.688313 run iperf3-srv_10.42.42.10(pid=30818): Terminating (SIGTERM) 02:41:17.731255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30821): Terminating (SIGTERM) 02:41:17.773801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30824): Terminating (SIGTERM) 02:41:17.816225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30827): Terminating (SIGTERM) 02:41:17.859292 --- ParallelTerminationStrategy: PID 30811 died... 02:41:17.881338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30811): Terminated: ok {rc=0} 02:41:17.928139 --- ParallelTerminationStrategy: PID 30812 died... 02:41:17.948148 run iperf3-srv_10.42.42.10(pid=30812): Terminated {rc=256} 02:41:17.994308 --- ParallelTerminationStrategy: PID 30813 died... 02:41:18.014167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30813): Terminated: ok {rc=0} 02:41:18.060675 --- ParallelTerminationStrategy: PID 30814 died... 02:41:18.080540 run iperf3-srv_10.42.42.10(pid=30814): Terminated {rc=256} 02:41:18.126628 --- ParallelTerminationStrategy: PID 30815 died... 02:41:18.146524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30815): Terminated: ok {rc=0} 02:41:18.192942 --- ParallelTerminationStrategy: PID 30816 died... 02:41:18.212865 run iperf3-srv_10.42.42.10(pid=30816): Terminated {rc=256} 02:41:18.259118 --- ParallelTerminationStrategy: PID 30817 died... 02:41:18.279094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30817): Terminated: ok {rc=0} 02:41:18.325836 --- ParallelTerminationStrategy: PID 30818 died... 02:41:18.345850 run iperf3-srv_10.42.42.10(pid=30818): Terminated {rc=256} 02:41:18.391886 --- ParallelTerminationStrategy: PID 30821 died... 02:41:18.411743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30821): Terminated: ok {rc=0} 02:41:18.457982 --- ParallelTerminationStrategy: PID 30824 died... 02:41:18.477860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30824): Terminated: ok {rc=0} 02:41:18.524778 --- ParallelTerminationStrategy: PID 30827 died... 02:41:18.545341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30827): Terminated: ok {rc=0} 02:41:18.634047 bus /gobi_4: Setting Powered False 02:41:19.733109 bus /gobi_4: Setting Powered False 02:41:20.848665 bus /gobi_1: Setting Powered False 02:41:21.947433 bus /gobi_1: Setting Powered False 02:41:23.064172 bus /gobi_0: Setting Powered False 02:41:24.162655 bus /gobi_0: Setting Powered False 02:41:25.279796 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:41:26.382309 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:26.394525 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:41:26.466659 tst ping.py: using LAC 37981 02:41:26.595122 tst ping.py: using RAC 241 02:41:26.722680 tst ping.py: using CellId 37981 02:41:26.851680 tst ping.py: using BVCI 37982 02:41:26.962321 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:26.973537 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:26.984529 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:26.995654 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:27.007133 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:27.018708 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:27.030644 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:27.042406 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:41:27.162770 tst ping.py:19: start network... 02:41:27.378450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:41:27.874443 run create_hlr_db(pid=30829): Launched 02:41:27.997437 bus /gobi_6: Setting Powered False 02:41:29.061098 run create_hlr_db(pid=30829): Terminated: ok {rc=0} 02:41:29.488822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30831): Launched 02:41:29.789111 run osmo-hlr_10.42.42.2(pid=30832): Launched 02:41:29.903211 run osmo-stp_10.42.42.5: Starting osmo-stp 02:41:30.439838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30834): Launched 02:41:30.739094 run osmo-stp_10.42.42.5(pid=30835): Launched 02:41:30.922651 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:41:31.511407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30837): Launched 02:41:31.657201 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:41:31.937462 run patchelf(pid=30838): Launched 02:41:32.135134 run osmo-stp_10.42.42.5(pid=30835): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30835)] 02:41:32.274665 run osmo-stp_10.42.42.5(pid=30835): stdout: | (launched: 2022-12-14_02:41:30.684290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:32.412132 run osmo-stp_10.42.42.5(pid=30835): stderr: | [0;m[38;5;43m20221214024130854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024130855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024130855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024130855 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024130856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024130856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024130856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:32.549199 run osmo-stp_10.42.42.5(pid=30835): stdout: | (launched: 2022-12-14_02:41:30.684290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:32.680872 run osmo-stp_10.42.42.5(pid=30835): stderr: | [0;m[38;5;43m20221214024130854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024130855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024130855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024130855 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024130856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024130856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024130856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:32.835718 run patchelf(pid=30838): Terminating (SIGINT) 02:41:33.015564 run patchelf(pid=30838): Terminated: ok {rc=0} 02:41:33.145600 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30835): Process ended prematurely: osmo-stp_10.42.42.5(pid=30835) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30835)] [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 02:41:33.155489 tst ping.py:22: Test FAILED (6.8 sec) 02:41:33.183710 run osmo-hlr_10.42.42.2(pid=30832): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30832)] 02:41:33.235137 run osmo-hlr_10.42.42.2(pid=30832): stdout: | (launched: 2022-12-14_02:41:29.734199) 02:41:33.288314 run osmo-hlr_10.42.42.2(pid=30832): stderr: | [0;m[1;31m20221214024129910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024129910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024129910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024129910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024129911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024129911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024129923 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024129934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024129934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024129934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:41:33.341369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30831): Terminating (SIGTERM) 02:41:33.383234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30834): Terminating (SIGTERM) 02:41:33.425933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30837): Terminating (SIGTERM) 02:41:33.468419 --- ParallelTerminationStrategy: PID 30831 died... 02:41:33.489169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30831): Terminated: ok {rc=0} 02:41:33.536020 --- ParallelTerminationStrategy: PID 30834 died... 02:41:33.556598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30834): Terminated: ok {rc=0} 02:41:33.603453 --- ParallelTerminationStrategy: PID 30837 died... 02:41:33.623615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30837): Terminated: ok {rc=0} 02:41:33.712256 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:41:34.799376 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:34.811651 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:41:34.885372 tst ping_idle_ping.py: using LAC 37982 02:41:35.012161 tst ping_idle_ping.py: using RAC 242 02:41:35.137235 tst ping_idle_ping.py: using CellId 37982 02:41:35.262038 tst ping_idle_ping.py: using BVCI 37983 02:41:35.378828 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:35.390451 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:35.401927 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:35.413334 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:35.425049 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:35.436917 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:35.448743 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:41:35.460613 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:41:35.580006 tst ping_idle_ping.py:24: start network... 02:41:35.795232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:41:36.298329 run create_hlr_db(pid=30839): Launched 02:41:36.420333 bus /gobi_6: Setting Powered False 02:41:37.484156 run create_hlr_db(pid=30839): Terminated: ok {rc=0} 02:41:37.913143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30841): Launched 02:41:38.213261 run osmo-hlr_10.42.42.2(pid=30842): Launched 02:41:38.327780 run osmo-stp_10.42.42.5: Starting osmo-stp 02:41:38.842792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30844): Launched 02:41:39.139520 run osmo-stp_10.42.42.5(pid=30845): Launched 02:41:39.253730 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:41:39.767240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30847): Launched 02:41:39.881122 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:41:40.133053 run patchelf(pid=30848): Launched 02:41:40.300207 run osmo-stp_10.42.42.5(pid=30845): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30845)] 02:41:40.426253 run osmo-stp_10.42.42.5(pid=30845): stdout: | (launched: 2022-12-14_02:41:39.084528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:40.553423 run osmo-stp_10.42.42.5(pid=30845): stderr: | [0;m[38;5;43m20221214024139257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024139257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024139257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024139257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024139258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024139258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024139258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:40.682099 run osmo-stp_10.42.42.5(pid=30845): stdout: | (launched: 2022-12-14_02:41:39.084528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:40.803974 run osmo-stp_10.42.42.5(pid=30845): stderr: | [0;m[38;5;43m20221214024139257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024139257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024139257 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024139257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024139258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024139258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024139258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:40.948544 run patchelf(pid=30848): Terminating (SIGINT) 02:41:41.116066 run patchelf(pid=30848): Terminated: ok {rc=0} 02:41:41.237226 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30845): Process ended prematurely: osmo-stp_10.42.42.5(pid=30845) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30845)] [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:41:41.246148 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:41:41.272564 run osmo-hlr_10.42.42.2(pid=30842): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30842)] 02:41:41.319928 run osmo-hlr_10.42.42.2(pid=30842): stdout: | (launched: 2022-12-14_02:41:38.158005) 02:41:41.369007 run osmo-hlr_10.42.42.2(pid=30842): stderr: | [0;m[1;31m20221214024138334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024138334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024138334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024138334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024138334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024138334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024138354 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024138363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024138363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024138363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:41:41.418599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30841): Terminating (SIGTERM) 02:41:41.458431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30844): Terminating (SIGTERM) 02:41:41.498252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30847): Terminating (SIGTERM) 02:41:41.538223 --- ParallelTerminationStrategy: PID 30841 died... 02:41:41.556808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30841): Terminated: ok {rc=0} 02:41:41.600578 --- ParallelTerminationStrategy: PID 30844 died... 02:41:41.619044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30844): Terminated: ok {rc=0} 02:41:41.662749 --- ParallelTerminationStrategy: PID 30847 died... 02:41:41.681841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30847): Terminated: ok {rc=0} 02:41:41.764662 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:41:43.074755 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:41:43.081519 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:41:43.115374 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:41:43.156141 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:41:43.245182 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:41:43.278839 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:41:43.318221 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:41:43.915597 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:41:43.969069 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:43.980356 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:41:44.053408 tst cs_paging_gprs_active.py: using LAC 37983 02:41:44.183240 tst cs_paging_gprs_active.py: using RAC 243 02:41:44.311500 tst cs_paging_gprs_active.py: using CellId 37983 02:41:44.438901 tst cs_paging_gprs_active.py: using BVCI 37984 02:41:44.560373 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:44.571708 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:44.582983 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:44.594122 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:44.606241 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:44.618122 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:44.630171 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:44.642170 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:44.654415 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:41:44.775747 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:41:44.899188 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:41:45.120082 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:45.446276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30852): Launched 02:41:45.730931 run iperf3-srv_10.42.42.10(pid=30853): Launched 02:41:45.853877 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:41:46.082266 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:46.428397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30854): Launched 02:41:46.735412 run iperf3-srv_10.42.42.10(pid=30855): Launched 02:41:46.903784 tst cs_paging_gprs_active.py:38: start network... 02:41:47.150407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:41:47.631023 run create_hlr_db(pid=30856): Launched 02:41:47.757121 bus /gobi_6: Setting Powered False 02:41:48.817808 run create_hlr_db(pid=30856): Terminated: ok {rc=0} 02:41:49.258834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30858): Launched 02:41:49.566364 run osmo-hlr_10.42.42.2(pid=30859): Launched 02:41:49.681170 run osmo-stp_10.42.42.5: Starting osmo-stp 02:41:50.203299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30861): Launched 02:41:50.506110 run osmo-stp_10.42.42.5(pid=30862): Launched 02:41:50.621148 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:41:51.143461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30864): Launched 02:41:51.259021 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:41:51.513624 run patchelf(pid=30865): Launched 02:41:51.681119 run osmo-stp_10.42.42.5(pid=30862): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30862)] 02:41:51.808214 run osmo-stp_10.42.42.5(pid=30862): stdout: | (launched: 2022-12-14_02:41:50.450741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:51.936821 run osmo-stp_10.42.42.5(pid=30862): stderr: | [0;m[38;5;43m20221214024150621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024150622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024150622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024150622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024150624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024150625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024150625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:52.065734 run osmo-stp_10.42.42.5(pid=30862): stdout: | (launched: 2022-12-14_02:41:50.450741) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:41:52.189248 run osmo-stp_10.42.42.5(pid=30862): stderr: | [0;m[38;5;43m20221214024150621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024150622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024150622 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024150622 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024150624 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024150625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024150625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:41:52.335548 run patchelf(pid=30865): Terminating (SIGINT) 02:41:52.505416 run patchelf(pid=30865): Terminated: ok {rc=0} 02:41:52.627932 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30862): Process ended prematurely: osmo-stp_10.42.42.5(pid=30862) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30862)] [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:41:52.637546 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:41:52.664393 run osmo-hlr_10.42.42.2(pid=30859): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30859)] 02:41:52.711666 run osmo-hlr_10.42.42.2(pid=30859): stdout: | (launched: 2022-12-14_02:41:49.510886) 02:41:52.761398 run osmo-hlr_10.42.42.2(pid=30859): stderr: | [0;m[1;31m20221214024149688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024149688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024149688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024149689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024149689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024149689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024149701 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024149710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024149710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024149710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:41:52.810942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30852): Terminating (SIGTERM) 02:41:52.850501 run iperf3-srv_10.42.42.10(pid=30853): Terminating (SIGTERM) 02:41:52.889835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30854): Terminating (SIGTERM) 02:41:52.929267 run iperf3-srv_10.42.42.10(pid=30855): Terminating (SIGTERM) 02:41:52.968405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30858): Terminating (SIGTERM) 02:41:53.007836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30861): Terminating (SIGTERM) 02:41:53.047335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30864): Terminating (SIGTERM) 02:41:53.086786 --- ParallelTerminationStrategy: PID 30852 died... 02:41:53.105692 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30852): Terminated: ok {rc=0} 02:41:53.149079 --- ParallelTerminationStrategy: PID 30853 died... 02:41:53.167406 run iperf3-srv_10.42.42.10(pid=30853): Terminated {rc=256} 02:41:53.210625 --- ParallelTerminationStrategy: PID 30854 died... 02:41:53.229044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30854): Terminated: ok {rc=0} 02:41:53.272183 --- ParallelTerminationStrategy: PID 30855 died... 02:41:53.290464 run iperf3-srv_10.42.42.10(pid=30855): Terminated {rc=256} 02:41:53.333526 --- ParallelTerminationStrategy: PID 30858 died... 02:41:53.351853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30858): Terminated: ok {rc=0} 02:41:53.395259 --- ParallelTerminationStrategy: PID 30861 died... 02:41:53.413773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30861): Terminated: ok {rc=0} 02:41:53.457018 --- ParallelTerminationStrategy: PID 30864 died... 02:41:53.475351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30864): Terminated: ok {rc=0} 02:41:53.559621 bus /gobi_0: Setting Powered False 02:41:54.656893 bus /gobi_0: Setting Powered False 02:41:55.770751 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:41:56.916000 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:56.927450 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:41:57.000144 tst iperf3.py: using LAC 37984 02:41:57.119999 tst iperf3.py: using RAC 244 02:41:57.245116 tst iperf3.py: using CellId 37984 02:41:57.365841 tst iperf3.py: using BVCI 37985 02:41:57.486721 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:57.498325 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:57.510167 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:57.521643 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:57.534058 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:57.545732 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:57.557692 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:57.569426 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:41:57.581087 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:41:57.696641 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:41:57.900523 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:41:58.204322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30866): Launched 02:41:58.469388 run iperf3-srv_10.42.42.10(pid=30867): Launched 02:41:58.583251 tst iperf3.py:8: start network... 02:41:58.785838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:41:59.257435 run create_hlr_db(pid=30868): Launched 02:41:59.382655 bus /gobi_6: Setting Powered False 02:42:00.443236 run create_hlr_db(pid=30868): Terminated: ok {rc=0} 02:42:00.922373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30871): Launched 02:42:01.373892 run osmo-hlr_10.42.42.2(pid=30873): Launched 02:42:01.683108 run osmo-stp_10.42.42.5: Starting osmo-stp 02:42:02.314431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30875): Launched 02:42:02.643702 run osmo-stp_10.42.42.5(pid=30876): Launched 02:42:02.762492 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:42:03.282302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30878): Launched 02:42:03.396444 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:42:03.649553 run patchelf(pid=30879): Launched 02:42:03.815929 run osmo-stp_10.42.42.5(pid=30876): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30876)] 02:42:03.942586 run osmo-stp_10.42.42.5(pid=30876): stdout: | (launched: 2022-12-14_02:42:02.588107) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:04.072605 run osmo-stp_10.42.42.5(pid=30876): stderr: | [0;m[38;5;43m20221214024202764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024202764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024202764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024202765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024202765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024202765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024202766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:04.200909 run osmo-stp_10.42.42.5(pid=30876): stdout: | (launched: 2022-12-14_02:42:02.588107) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:04.323884 run osmo-stp_10.42.42.5(pid=30876): stderr: | [0;m[38;5;43m20221214024202764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024202764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024202764 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024202765 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024202765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024202765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024202766 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:04.469589 run patchelf(pid=30879): Terminating (SIGINT) 02:42:04.639134 run patchelf(pid=30879): Terminated: ok {rc=0} 02:42:04.760890 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30876): Process ended prematurely: osmo-stp_10.42.42.5(pid=30876) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30876)] [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 02:42:04.770444 tst iperf3.py:8: Test FAILED (7.9 sec) 02:42:04.797538 run osmo-hlr_10.42.42.2(pid=30873): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30873)] 02:42:04.845389 run osmo-hlr_10.42.42.2(pid=30873): stdout: | (launched: 2022-12-14_02:42:01.294044) 02:42:04.894886 run osmo-hlr_10.42.42.2(pid=30873): stderr: | [0;m[1;31m20221214024201540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024201540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024201540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024201540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024201540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024201540 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024201556 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024201570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024201570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024201570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:42:04.944282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30866): Terminating (SIGTERM) 02:42:04.983834 run iperf3-srv_10.42.42.10(pid=30867): Terminating (SIGTERM) 02:42:05.023233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30871): Terminating (SIGTERM) 02:42:05.062854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30875): Terminating (SIGTERM) 02:42:05.102293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30878): Terminating (SIGTERM) 02:42:05.142224 --- ParallelTerminationStrategy: PID 30866 died... 02:42:05.161173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30866): Terminated: ok {rc=0} 02:42:05.204776 --- ParallelTerminationStrategy: PID 30867 died... 02:42:05.223063 run iperf3-srv_10.42.42.10(pid=30867): Terminated {rc=256} 02:42:05.266253 --- ParallelTerminationStrategy: PID 30871 died... 02:42:05.284580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30871): Terminated: ok {rc=0} 02:42:05.328049 --- ParallelTerminationStrategy: PID 30875 died... 02:42:05.346526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30875): Terminated: ok {rc=0} 02:42:05.389977 --- ParallelTerminationStrategy: PID 30878 died... 02:42:05.408441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30878): Terminated: ok {rc=0} 02:42:05.491759 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:42:06.641265 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:06.653488 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:42:06.726012 tst iperf3m4.py: using LAC 37985 02:42:06.851962 tst iperf3m4.py: using RAC 245 02:42:06.977792 tst iperf3m4.py: using CellId 37985 02:42:07.106182 tst iperf3m4.py: using BVCI 37986 02:42:07.223587 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:07.235019 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:07.246217 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:07.257525 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:07.268899 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:07.280339 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:07.291942 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:07.303315 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:07.314984 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:42:07.436038 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:42:07.556307 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:42:07.678123 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:42:07.794564 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:42:07.995992 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:42:08.297487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30880): Launched 02:42:08.559472 run iperf3-srv_10.42.42.10(pid=30881): Launched 02:42:08.671719 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:42:08.871931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:42:09.173568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30882): Launched 02:42:09.433884 run iperf3-srv_10.42.42.10(pid=30883): Launched 02:42:09.546098 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:42:09.746280 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:42:10.046327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30884): Launched 02:42:10.306793 run iperf3-srv_10.42.42.10(pid=30885): Launched 02:42:10.418727 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:42:10.618284 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:42:10.918793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30886): Launched 02:42:11.179865 run iperf3-srv_10.42.42.10(pid=30887): Launched 02:42:11.291938 tst iperf3m4.py:8: start network... 02:42:11.491504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:42:11.955680 run create_hlr_db(pid=30888): Launched 02:42:12.078394 bus /gobi_6: Setting Powered False 02:42:13.138455 run create_hlr_db(pid=30888): Terminated: ok {rc=0} 02:42:13.555475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30890): Launched 02:42:13.853897 run osmo-hlr_10.42.42.2(pid=30891): Launched 02:42:13.967617 run osmo-stp_10.42.42.5: Starting osmo-stp 02:42:14.498562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30893): Launched 02:42:14.797642 run osmo-stp_10.42.42.5(pid=30894): Launched 02:42:14.911382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:42:15.428030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30896): Launched 02:42:15.541686 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:42:15.794142 run patchelf(pid=30897): Launched 02:42:15.974074 run osmo-stp_10.42.42.5(pid=30894): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30894)] 02:42:16.129403 run osmo-stp_10.42.42.5(pid=30894): stdout: | (launched: 2022-12-14_02:42:14.742513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:16.273216 run osmo-stp_10.42.42.5(pid=30894): stderr: | [0;m[38;5;43m20221214024214912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024214912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024214912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024214913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024214913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024214913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024214914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:16.417203 run osmo-stp_10.42.42.5(pid=30894): stdout: | (launched: 2022-12-14_02:42:14.742513) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:16.555440 run osmo-stp_10.42.42.5(pid=30894): stderr: | [0;m[38;5;43m20221214024214912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024214912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024214912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024214913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024214913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024214913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024214914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:16.721361 run patchelf(pid=30897): Terminating (SIGINT) 02:42:16.909237 run patchelf(pid=30897): Terminated: ok {rc=0} 02:42:17.045873 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30894): Process ended prematurely: osmo-stp_10.42.42.5(pid=30894) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30894)] [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:42:17.057244 tst iperf3m4.py:8: Test FAILED (10.5 sec) 02:42:17.087379 run osmo-hlr_10.42.42.2(pid=30891): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30891)] 02:42:17.142222 run osmo-hlr_10.42.42.2(pid=30891): stdout: | (launched: 2022-12-14_02:42:13.799073) 02:42:17.195070 run osmo-hlr_10.42.42.2(pid=30891): stderr: | [0;m[1;31m20221214024213974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024213974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024213974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024213974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024213974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024213974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024213986 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024213994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024213995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024213995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:42:17.247856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30880): Terminating (SIGTERM) 02:42:17.290185 run iperf3-srv_10.42.42.10(pid=30881): Terminating (SIGTERM) 02:42:17.332620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30882): Terminating (SIGTERM) 02:42:17.375273 run iperf3-srv_10.42.42.10(pid=30883): Terminating (SIGTERM) 02:42:17.417462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30884): Terminating (SIGTERM) 02:42:17.459743 run iperf3-srv_10.42.42.10(pid=30885): Terminating (SIGTERM) 02:42:17.501983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30886): Terminating (SIGTERM) 02:42:17.544494 run iperf3-srv_10.42.42.10(pid=30887): Terminating (SIGTERM) 02:42:17.587030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30890): Terminating (SIGTERM) 02:42:17.629644 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30893): Terminating (SIGTERM) 02:42:17.672052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30896): Terminating (SIGTERM) 02:42:17.714668 --- ParallelTerminationStrategy: PID 30880 died... 02:42:17.734752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30880): Terminated: ok {rc=0} 02:42:17.781985 --- ParallelTerminationStrategy: PID 30881 died... 02:42:17.801925 run iperf3-srv_10.42.42.10(pid=30881): Terminated {rc=256} 02:42:17.848480 --- ParallelTerminationStrategy: PID 30882 died... 02:42:17.868458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30882): Terminated: ok {rc=0} 02:42:17.915066 --- ParallelTerminationStrategy: PID 30883 died... 02:42:17.934966 run iperf3-srv_10.42.42.10(pid=30883): Terminated {rc=256} 02:42:17.981524 --- ParallelTerminationStrategy: PID 30884 died... 02:42:18.001655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30884): Terminated: ok {rc=0} 02:42:18.048303 --- ParallelTerminationStrategy: PID 30885 died... 02:42:18.068218 run iperf3-srv_10.42.42.10(pid=30885): Terminated {rc=256} 02:42:18.114697 --- ParallelTerminationStrategy: PID 30886 died... 02:42:18.134817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30886): Terminated: ok {rc=0} 02:42:18.181353 --- ParallelTerminationStrategy: PID 30887 died... 02:42:18.201452 run iperf3-srv_10.42.42.10(pid=30887): Terminated {rc=256} 02:42:18.247939 --- ParallelTerminationStrategy: PID 30890 died... 02:42:18.268108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30890): Terminated: ok {rc=0} 02:42:18.314756 --- ParallelTerminationStrategy: PID 30893 died... 02:42:18.334737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30893): Terminated: ok {rc=0} 02:42:18.381440 --- ParallelTerminationStrategy: PID 30896 died... 02:42:18.401584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30896): Terminated: ok {rc=0} 02:42:18.490908 bus /gobi_4: Setting Powered False 02:42:19.590144 bus /gobi_4: Setting Powered False 02:42:20.706470 bus /gobi_1: Setting Powered False 02:42:21.805560 bus /gobi_1: Setting Powered False 02:42:22.921595 bus /gobi_0: Setting Powered False 02:42:24.019318 bus /gobi_0: Setting Powered False 02:42:25.136014 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:42:26.238200 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:26.250605 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:42:26.323155 tst ping.py: using LAC 37986 02:42:26.449972 tst ping.py: using RAC 246 02:42:26.568083 tst ping.py: using CellId 37986 02:42:26.683870 tst ping.py: using BVCI 37987 02:42:26.792456 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:26.803541 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:26.814443 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:26.825148 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:26.835774 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:26.846554 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:26.857361 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:26.868025 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:42:26.982487 tst ping.py:19: start network... 02:42:27.179394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:42:27.634961 run create_hlr_db(pid=30898): Launched 02:42:27.755054 bus /gobi_6: Setting Powered False 02:42:28.814306 run create_hlr_db(pid=30898): Terminated: ok {rc=0} 02:42:29.247232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30900): Launched 02:42:29.566306 run osmo-hlr_10.42.42.2(pid=30901): Launched 02:42:29.688509 run osmo-stp_10.42.42.5: Starting osmo-stp 02:42:30.245974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30903): Launched 02:42:30.563128 run osmo-stp_10.42.42.5(pid=30904): Launched 02:42:30.684289 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:42:31.247753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30906): Launched 02:42:31.382716 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:42:31.662657 run patchelf(pid=30907): Launched 02:42:31.843122 run osmo-stp_10.42.42.5(pid=30904): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30904)] 02:42:31.982118 run osmo-stp_10.42.42.5(pid=30904): stdout: | (launched: 2022-12-14_02:42:30.504669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:32.121111 run osmo-stp_10.42.42.5(pid=30904): stderr: | [0;m[38;5;43m20221214024230696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024230696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024230696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024230697 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024230697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024230697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024230697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:32.259773 run osmo-stp_10.42.42.5(pid=30904): stdout: | (launched: 2022-12-14_02:42:30.504669) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:32.390320 run osmo-stp_10.42.42.5(pid=30904): stderr: | [0;m[38;5;43m20221214024230696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024230696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024230696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024230697 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024230697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024230697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024230697 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:32.545312 run patchelf(pid=30907): Terminating (SIGINT) 02:42:32.724628 run patchelf(pid=30907): Terminated: ok {rc=0} 02:42:32.854602 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30904): Process ended prematurely: osmo-stp_10.42.42.5(pid=30904) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30904)] [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 02:42:32.864170 tst ping.py:22: Test FAILED (6.6 sec) 02:42:32.892373 run osmo-hlr_10.42.42.2(pid=30901): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30901)] 02:42:32.943491 run osmo-hlr_10.42.42.2(pid=30901): stdout: | (launched: 2022-12-14_02:42:29.507064) 02:42:32.996089 run osmo-hlr_10.42.42.2(pid=30901): stderr: | [0;m[1;31m20221214024229705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024229705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024229705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024229705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024229705 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024229706 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024229718 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024229726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024229726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024229726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:42:33.049175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30900): Terminating (SIGTERM) 02:42:33.091737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30903): Terminating (SIGTERM) 02:42:33.134577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30906): Terminating (SIGTERM) 02:42:33.177437 --- ParallelTerminationStrategy: PID 30900 died... 02:42:33.198050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30900): Terminated: ok {rc=0} 02:42:33.244880 --- ParallelTerminationStrategy: PID 30903 died... 02:42:33.265063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30903): Terminated: ok {rc=0} 02:42:33.311672 --- ParallelTerminationStrategy: PID 30906 died... 02:42:33.331774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30906): Terminated: ok {rc=0} 02:42:33.420772 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:42:34.508311 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:34.520441 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:42:34.593705 tst ping_idle_ping.py: using LAC 37987 02:42:34.709772 tst ping_idle_ping.py: using RAC 247 02:42:34.824671 tst ping_idle_ping.py: using CellId 37987 02:42:34.939691 tst ping_idle_ping.py: using BVCI 37988 02:42:35.047013 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:35.058081 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:35.068936 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:35.079842 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:35.090962 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:35.102118 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:35.113132 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:42:35.123986 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:42:35.244503 tst ping_idle_ping.py:24: start network... 02:42:35.459612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:42:35.956280 run create_hlr_db(pid=30908): Launched 02:42:36.078817 bus /gobi_6: Setting Powered False 02:42:37.142014 run create_hlr_db(pid=30908): Terminated: ok {rc=0} 02:42:37.568509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30910): Launched 02:42:37.865661 run osmo-hlr_10.42.42.2(pid=30911): Launched 02:42:37.978443 run osmo-stp_10.42.42.5: Starting osmo-stp 02:42:38.506839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30913): Launched 02:42:38.802251 run osmo-stp_10.42.42.5(pid=30914): Launched 02:42:38.915011 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:42:39.426394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30916): Launched 02:42:39.539708 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:42:39.790898 run patchelf(pid=30917): Launched 02:42:39.955611 run osmo-stp_10.42.42.5(pid=30914): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30914)] 02:42:40.081548 run osmo-stp_10.42.42.5(pid=30914): stdout: | (launched: 2022-12-14_02:42:38.748050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:40.208494 run osmo-stp_10.42.42.5(pid=30914): stderr: | [0;m[38;5;43m20221214024238918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024238918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024238918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024238918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024238919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024238919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024238919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:40.335166 run osmo-stp_10.42.42.5(pid=30914): stdout: | (launched: 2022-12-14_02:42:38.748050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:40.456393 run osmo-stp_10.42.42.5(pid=30914): stderr: | [0;m[38;5;43m20221214024238918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024238918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024238918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024238918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024238919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024238919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024238919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:40.600486 run patchelf(pid=30917): Terminating (SIGINT) 02:42:40.767217 run patchelf(pid=30917): Terminated: ok {rc=0} 02:42:40.887988 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30914): Process ended prematurely: osmo-stp_10.42.42.5(pid=30914) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30914)] [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:42:40.897003 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:42:40.923323 run osmo-hlr_10.42.42.2(pid=30911): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30911)] 02:42:40.970879 run osmo-hlr_10.42.42.2(pid=30911): stdout: | (launched: 2022-12-14_02:42:37.811170) 02:42:41.019898 run osmo-hlr_10.42.42.2(pid=30911): stderr: | [0;m[1;31m20221214024237987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024237987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024237987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024237987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024237987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024237987 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024237999 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024238010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024238010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024238010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:42:41.069137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30910): Terminating (SIGTERM) 02:42:41.108499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30913): Terminating (SIGTERM) 02:42:41.148546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30916): Terminating (SIGTERM) 02:42:41.188506 --- ParallelTerminationStrategy: PID 30910 died... 02:42:41.207484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30910): Terminated: ok {rc=0} 02:42:41.251150 --- ParallelTerminationStrategy: PID 30913 died... 02:42:41.269615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30913): Terminated: ok {rc=0} 02:42:41.312848 --- ParallelTerminationStrategy: PID 30916 died... 02:42:41.331884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30916): Terminated: ok {rc=0} 02:42:41.414517 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:42:42.726635 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:42:42.735888 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:42:42.772382 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:42:42.807264 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:42:42.859383 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:42:42.893551 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:42:42.929131 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:42:43.490636 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2398 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:42:43.496006 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:42:43.507591 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:42:43.579961 tst switch_tch_pdch.py: using LAC 37988 02:42:43.702324 tst switch_tch_pdch.py: using RAC 248 02:42:43.826287 tst switch_tch_pdch.py: using CellId 37988 02:42:43.950507 tst switch_tch_pdch.py: using BVCI 37989 02:42:44.066083 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:42:44.077817 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:42:44.089209 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:42:44.100556 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:42:44.112872 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:42:44.125229 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:42:44.137632 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:42:44.149930 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:42:44.269337 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:42:44.388651 tst switch_tch_pdch.py:51: start network... 02:42:44.603286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:42:45.093257 run create_hlr_db(pid=30921): Launched 02:42:45.214036 bus /gobi_6: Setting Powered False 02:42:46.298896 run create_hlr_db(pid=30921): Terminated: ok {rc=0} 02:42:46.800892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30923): Launched 02:42:47.225830 run osmo-hlr_10.42.42.2(pid=30924): Launched 02:42:47.376831 run osmo-stp_10.42.42.5: Starting osmo-stp 02:42:47.922259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30926): Launched 02:42:48.238237 run osmo-stp_10.42.42.5(pid=30927): Launched 02:42:48.358935 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:42:48.903726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30929): Launched 02:42:49.025184 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:42:49.291937 run patchelf(pid=30930): Launched 02:42:49.467441 run osmo-stp_10.42.42.5(pid=30927): ERR: Terminated: ERROR {rc=1} [trial-2398↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30927)] 02:42:49.601794 run osmo-stp_10.42.42.5(pid=30927): stdout: | (launched: 2022-12-14_02:42:48.180770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:49.737081 run osmo-stp_10.42.42.5(pid=30927): stderr: | [0;m[38;5;43m20221214024248371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024248371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024248372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024248372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024248373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024248373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024248373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:49.873134 run osmo-stp_10.42.42.5(pid=30927): stdout: | (launched: 2022-12-14_02:42:48.180770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:42:50.002884 run osmo-stp_10.42.42.5(pid=30927): stderr: | [0;m[38;5;43m20221214024248371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024248371 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024248372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024248372 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024248373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024248373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024248373 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:42:50.156712 run patchelf(pid=30930): Terminating (SIGINT) 02:42:50.335192 run patchelf(pid=30930): Terminated: ok {rc=0} 02:42:50.464261 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30927): Process ended prematurely: osmo-stp_10.42.42.5(pid=30927) [trial-2398↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30927)] [trial-2398↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:42:50.473960 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 02:42:50.501635 run osmo-hlr_10.42.42.2(pid=30924): ERR: Terminated: ERROR {rc=237} [trial-2398↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30924)] 02:42:50.552396 run osmo-hlr_10.42.42.2(pid=30924): stdout: | (launched: 2022-12-14_02:42:47.152743) 02:42:50.604686 run osmo-hlr_10.42.42.2(pid=30924): stderr: | [0;m[1;31m20221214024247390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024247390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024247390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024247390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024247390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024247390 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024247448 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024247456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024247456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024247456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:42:50.657220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30923): Terminating (SIGTERM) 02:42:50.698759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30926): Terminating (SIGTERM) 02:42:50.741186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30929): Terminating (SIGTERM) 02:42:50.783677 --- ParallelTerminationStrategy: PID 30923 died... 02:42:50.803817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30923): Terminated: ok {rc=0} 02:42:50.850032 --- ParallelTerminationStrategy: PID 30926 died... 02:42:50.869879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30926): Terminated: ok {rc=0} 02:42:50.915723 --- ParallelTerminationStrategy: PID 30929 died... 02:42:50.935396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30929): Terminated: ok {rc=0} 02:42:51.023181 bus /gobi_0: Setting Powered False 02:42:52.121699 bus /gobi_0: Setting Powered False 02:42:53.238016 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:42:54.494462 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:42:54.500610 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:42:54.535124 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:42:54.570960 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:42:54.625570 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:42:54.660228 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:42:54.695104 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:42:55.251499 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2398 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:42:55.257198 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:42:55.268728 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:42:55.340677 tst switch_tch_pdch.py: using LAC 37989 02:42:55.466227 tst switch_tch_pdch.py: using RAC 249 02:42:55.593320 tst switch_tch_pdch.py: using CellId 37989 02:42:55.717097 tst switch_tch_pdch.py: using BVCI 37990 02:42:55.833894 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:42:55.845423 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:42:55.856758 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:42:55.868119 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:42:55.879826 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:42:55.891562 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:42:55.903384 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:42:55.915011 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:42:56.030275 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:42:56.149893 tst switch_tch_pdch.py:51: start network... 02:42:56.362668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:42:56.824725 run create_hlr_db(pid=30934): Launched 02:42:56.944769 bus /gobi_6: Setting Powered False 02:42:58.007673 run create_hlr_db(pid=30934): Terminated: ok {rc=0} 02:42:58.421864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30936): Launched 02:42:58.738514 run osmo-hlr_10.42.42.2(pid=30937): Launched 02:42:58.859307 run osmo-stp_10.42.42.5: Starting osmo-stp 02:42:59.378132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30939): Launched 02:42:59.692929 run osmo-stp_10.42.42.5(pid=30940): Launched 02:42:59.813465 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:43:00.330752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30942): Launched 02:43:00.452323 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:43:00.720628 run patchelf(pid=30943): Launched 02:43:00.898081 run osmo-stp_10.42.42.5(pid=30940): ERR: Terminated: ERROR {rc=1} [trial-2398↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30940)] 02:43:01.035043 run osmo-stp_10.42.42.5(pid=30940): stdout: | (launched: 2022-12-14_02:42:59.635590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:01.172675 run osmo-stp_10.42.42.5(pid=30940): stderr: | [0;m[38;5;43m20221214024259826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024259826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024259827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024259827 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024259827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024259828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024259828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:01.310687 run osmo-stp_10.42.42.5(pid=30940): stdout: | (launched: 2022-12-14_02:42:59.635590) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:01.443116 run osmo-stp_10.42.42.5(pid=30940): stderr: | [0;m[38;5;43m20221214024259826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024259826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024259827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024259827 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024259827 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024259828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024259828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:01.599980 run patchelf(pid=30943): Terminating (SIGINT) 02:43:01.781982 run patchelf(pid=30943): Terminated: ok {rc=0} 02:43:01.914170 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30940): Process ended prematurely: osmo-stp_10.42.42.5(pid=30940) [trial-2398↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30940)] [trial-2398↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 02:43:01.924390 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 02:43:01.953154 run osmo-hlr_10.42.42.2(pid=30937): ERR: Terminated: ERROR {rc=237} [trial-2398↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30937)] 02:43:02.004710 run osmo-hlr_10.42.42.2(pid=30937): stdout: | (launched: 2022-12-14_02:42:58.680769) 02:43:02.058110 run osmo-hlr_10.42.42.2(pid=30937): stderr: | [0;m[1;31m20221214024258879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024258879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024258879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024258879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024258879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024258879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024258892 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024258900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024258900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024258900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:43:02.111506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30936): Terminating (SIGTERM) 02:43:02.153930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30939): Terminating (SIGTERM) 02:43:02.196746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30942): Terminating (SIGTERM) 02:43:02.240170 --- ParallelTerminationStrategy: PID 30936 died... 02:43:02.260496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30936): Terminated: ok {rc=0} 02:43:02.306900 --- ParallelTerminationStrategy: PID 30939 died... 02:43:02.326825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30939): Terminated: ok {rc=0} 02:43:02.373084 --- ParallelTerminationStrategy: PID 30942 died... 02:43:02.392731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30942): Terminated: ok {rc=0} 02:43:02.481308 bus /gobi_0: Setting Powered False 02:43:03.580498 bus /gobi_0: Setting Powered False 02:43:04.696046 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_sms:trx-umtrx --------------------------------------------------------------------- 02:43:05.950532 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:43:05.955180 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:43:05.987879 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 02:43:05.994991 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 02:43:06.044631 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:43:06.076518 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 02:43:06.083212 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 02:43:06.625022 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 02:43:06.630059 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 02:43:06.641050 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 02:43:06.690015 tst mo_mt_sms.py: using LAC 37990 02:43:06.810643 tst mo_mt_sms.py: using RAC 250 02:43:06.926476 tst mo_mt_sms.py: using CellId 37990 02:43:07.042920 tst mo_mt_sms.py: using BVCI 37991 02:43:07.149812 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 02:43:07.268091 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 02:43:07.385364 tst mo_mt_sms.py:9: start nitb and bts... 02:43:07.601954 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:43:08.248134 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30947): Launched 02:43:08.567550 run osmo-nitb_10.42.42.2(pid=30948): Launched 02:43:08.744177 run osmo-nitb_10.42.42.2(pid=30948): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30948)] 02:43:08.886912 run osmo-nitb_10.42.42.2(pid=30948): stdout: | (launched: 2022-12-14_02:43:08.508506) 02:43:09.031091 run osmo-nitb_10.42.42.2(pid=30948): stderr: | (launched: 2022-12-14_02:43:08.556480) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:43:09.175088 run osmo-nitb_10.42.42.2(pid=30948): stdout: | (launched: 2022-12-14_02:43:08.508506) 02:43:09.314098 run osmo-nitb_10.42.42.2(pid=30948): stderr: | (launched: 2022-12-14_02:43:08.556480) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30948): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30948) [trial-2398↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30948)] 02:43:09.687865 tst osmo-nitb_10.42.42.2(pid=30948): stdout: | (launched: 2022-12-14_02:43:08.508506) 02:43:09.816606 tst osmo-nitb_10.42.42.2(pid=30948): stderr: | (launched: 2022-12-14_02:43:08.556480) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:43:09.968131 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30948): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30948) [trial-2398↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30948)] [trial-2398↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 02:43:09.977412 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 02:43:09.984358 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30947): Terminating (SIGTERM) 02:43:10.196150 --- ParallelTerminationStrategy: PID 30947 died... 02:43:10.217945 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30947): Terminated: ok {rc=0} 02:43:10.307115 bus /sierra_3: Setting Powered False 02:43:11.405733 bus /sierra_3: Setting Powered False 02:43:12.522208 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 sms:trx-umtrx --------------------------------------------------------------------- 02:43:13.716404 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:43:13.720358 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:43:13.751756 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:43:13.778504 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 02:43:13.830086 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:43:13.863358 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:43:13.891537 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 02:43:14.432818 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 02:43:14.438436 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:14.449347 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 02:43:14.495410 tst mo_mt_sms.py: using LAC 37991 02:43:14.612238 tst mo_mt_sms.py: using RAC 251 02:43:14.729502 tst mo_mt_sms.py: using CellId 37991 02:43:14.849329 tst mo_mt_sms.py: using BVCI 37992 02:43:14.957330 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:14.967754 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:14.978048 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:14.988230 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:14.998578 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:15.009578 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 02:43:15.128142 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 02:43:15.243851 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:43:15.703447 run create_hlr_db(pid=30952): Launched 02:43:15.824449 bus /sierra_2: Setting Powered False 02:43:16.897204 run create_hlr_db(pid=30952): Terminated: ok {rc=0} 02:43:17.390837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30954): Launched 02:43:17.687005 run osmo-hlr_10.42.42.2(pid=30955): Launched 02:43:17.798308 run osmo-stp_10.42.42.5: Starting osmo-stp 02:43:18.320128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30957): Launched 02:43:18.615220 run osmo-stp_10.42.42.5(pid=30958): Launched 02:43:18.727246 run osmo-msc_10.42.42.6: Starting osmo-msc 02:43:19.261016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30960): Launched 02:43:19.557018 run osmo-msc_10.42.42.6(pid=30961): Launched 02:43:19.722310 run osmo-stp_10.42.42.5(pid=30958): ERR: Terminated: ERROR {rc=1} [trial-2398↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30958)] 02:43:19.847785 run osmo-stp_10.42.42.5(pid=30958): stdout: | (launched: 2022-12-14_02:43:18.560804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:19.972717 run osmo-stp_10.42.42.5(pid=30958): stderr: | [0;m[38;5;43m20221214024318731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024318731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024318732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024318732 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024318733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024318733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024318733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:20.095329 run osmo-stp_10.42.42.5(pid=30958): stdout: | (launched: 2022-12-14_02:43:18.560804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:20.212398 run osmo-stp_10.42.42.5(pid=30958): stderr: | [0;m[38;5;43m20221214024318731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024318731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024318732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024318732 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024318733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024318733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024318733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:20.352519 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30958): Process ended prematurely: osmo-stp_10.42.42.5(pid=30958) [trial-2398↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30958)] [trial-2398↪sms:trx-umtrx↪mo_mt_sms.py:16] 02:43:20.360789 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 02:43:20.387067 run osmo-hlr_10.42.42.2(pid=30955): ERR: Terminated: ERROR {rc=237} [trial-2398↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30955)] 02:43:20.434578 run osmo-hlr_10.42.42.2(pid=30955): stdout: | (launched: 2022-12-14_02:43:17.632623) 02:43:20.484006 run osmo-hlr_10.42.42.2(pid=30955): stderr: | [0;m[1;31m20221214024317807 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024317808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024317808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024317808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024317808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024317808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024317821 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024317829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024317829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024317829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:43:20.553106 run osmo-msc_10.42.42.6(pid=30961): ERR: Terminated: ERROR {rc=2} [trial-2398↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30961)] 02:43:20.601319 run osmo-msc_10.42.42.6(pid=30961): stdout: | (launched: 2022-12-14_02:43:19.502786) 02:43:20.650621 run osmo-msc_10.42.42.6(pid=30961): stderr: | [0;m[38;5;43m20221214024319774 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024319774 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbd09b69c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024319774 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024319774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024319774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024319774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024319776 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024319776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024319777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024319777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:43:20.700153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30954): Terminating (SIGTERM) 02:43:20.739896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30957): Terminating (SIGTERM) 02:43:20.780285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30960): Terminating (SIGTERM) 02:43:20.820374 --- ParallelTerminationStrategy: PID 30954 died... 02:43:20.839589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30954): Terminated: ok {rc=0} 02:43:20.883250 --- ParallelTerminationStrategy: PID 30957 died... 02:43:20.901820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30957): Terminated: ok {rc=0} 02:43:20.945378 --- ParallelTerminationStrategy: PID 30960 died... 02:43:20.963954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30960): Terminated: ok {rc=0} 02:43:21.050361 bus /sierra_3: Setting Powered False 02:43:22.149742 bus /sierra_3: Setting Powered False 02:43:23.264909 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 02:43:24.492497 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:43:24.497576 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:43:24.530920 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 02:43:24.539338 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 02:43:24.578324 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:43:24.611773 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 02:43:24.618723 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 02:43:25.135806 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2398 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 02:43:25.141801 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 02:43:25.152384 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 02:43:25.198335 tst assert_extension.py: using LAC 37992 02:43:25.315811 tst assert_extension.py: using RAC 252 02:43:25.431916 tst assert_extension.py: using CellId 37992 02:43:25.549449 tst assert_extension.py: using BVCI 37993 02:43:25.655925 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 02:43:25.774278 tst assert_extension.py:10: start nitb and bts... 02:43:25.987572 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:43:26.634768 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30966): Launched 02:43:26.951626 run osmo-nitb_10.42.42.2(pid=30967): Launched 02:43:27.127578 run osmo-nitb_10.42.42.2(pid=30967): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30967)] 02:43:27.270184 run osmo-nitb_10.42.42.2(pid=30967): stdout: | (launched: 2022-12-14_02:43:26.894204) 02:43:27.414822 run osmo-nitb_10.42.42.2(pid=30967): stderr: | (launched: 2022-12-14_02:43:26.941265) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:43:27.559496 run osmo-nitb_10.42.42.2(pid=30967): stdout: | (launched: 2022-12-14_02:43:26.894204) 02:43:27.698239 run osmo-nitb_10.42.42.2(pid=30967): stderr: | (launched: 2022-12-14_02:43:26.941265) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30967): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30967) [trial-2398↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30967)] 02:43:28.071603 tst osmo-nitb_10.42.42.2(pid=30967): stdout: | (launched: 2022-12-14_02:43:26.894204) 02:43:28.200463 tst osmo-nitb_10.42.42.2(pid=30967): stderr: | (launched: 2022-12-14_02:43:26.941265) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:43:28.352183 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=30967): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30967) [trial-2398↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30967)] [trial-2398↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 02:43:28.361420 tst assert_extension.py:12: Test FAILED (3.2 sec) 02:43:28.368411 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30966): Terminating (SIGTERM) 02:43:28.579854 --- ParallelTerminationStrategy: PID 30966 died... 02:43:28.601788 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30966): Terminated: ok {rc=0} 02:43:28.690057 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 ussd:trx-umtrx --------------------------------------------------------------------- 02:43:29.864850 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:43:29.868730 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:43:29.900397 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:43:29.927490 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 02:43:29.962669 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:43:29.994826 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:43:30.021476 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 02:43:30.547075 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2398 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 02:43:30.552057 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:30.562529 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 02:43:30.608921 tst assert_extension.py: using LAC 37993 02:43:30.724492 tst assert_extension.py: using RAC 253 02:43:30.844350 tst assert_extension.py: using CellId 37993 02:43:31.003995 tst assert_extension.py: using BVCI 37994 02:43:31.121834 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:31.133609 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:31.144937 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:31.156476 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:31.169453 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:43:31.181575 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 02:43:31.308008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:43:31.781694 run create_hlr_db(pid=30971): Launched 02:43:31.939311 bus /sierra_2: Setting Powered False 02:43:32.998176 run create_hlr_db(pid=30971): Terminated: ok {rc=0} 02:43:33.412614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30973): Launched 02:43:33.709339 run osmo-hlr_10.42.42.2(pid=30974): Launched 02:43:33.820313 run osmo-stp_10.42.42.5: Starting osmo-stp 02:43:34.350236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30976): Launched 02:43:34.643977 run osmo-stp_10.42.42.5(pid=30977): Launched 02:43:34.756740 run osmo-msc_10.42.42.6: Starting osmo-msc 02:43:35.288442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30979): Launched 02:43:35.582003 run osmo-msc_10.42.42.6(pid=30980): Launched 02:43:35.746569 run osmo-stp_10.42.42.5(pid=30977): ERR: Terminated: ERROR {rc=1} [trial-2398↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30977)] 02:43:35.871381 run osmo-stp_10.42.42.5(pid=30977): stdout: | (launched: 2022-12-14_02:43:34.589829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:35.995883 run osmo-stp_10.42.42.5(pid=30977): stderr: | [0;m[38;5;43m20221214024334760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024334760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024334760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024334760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024334761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024334761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024334761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:36.118467 run osmo-stp_10.42.42.5(pid=30977): stdout: | (launched: 2022-12-14_02:43:34.589829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:36.235044 run osmo-stp_10.42.42.5(pid=30977): stderr: | [0;m[38;5;43m20221214024334760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024334760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024334760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024334760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024334761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024334761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024334761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:36.374636 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30977): Process ended prematurely: osmo-stp_10.42.42.5(pid=30977) [trial-2398↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30977)] [trial-2398↪ussd:trx-umtrx↪assert_extension.py:17] 02:43:36.382811 tst assert_extension.py:17: Test FAILED (5.8 sec) 02:43:36.408767 run osmo-hlr_10.42.42.2(pid=30974): ERR: Terminated: ERROR {rc=237} [trial-2398↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30974)] 02:43:36.456849 run osmo-hlr_10.42.42.2(pid=30974): stdout: | (launched: 2022-12-14_02:43:33.654730) 02:43:36.506416 run osmo-hlr_10.42.42.2(pid=30974): stderr: | [0;m[1;31m20221214024333832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024333832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024333832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024333832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024333832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024333832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024333845 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024333854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024333854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024333854 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:43:36.575443 run osmo-msc_10.42.42.6(pid=30980): ERR: Terminated: ERROR {rc=2} [trial-2398↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30980)] 02:43:36.623201 run osmo-msc_10.42.42.6(pid=30980): stdout: | (launched: 2022-12-14_02:43:35.527546) 02:43:36.672380 run osmo-msc_10.42.42.6(pid=30980): stderr: | [0;m[38;5;43m20221214024335796 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024335796 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f599d3c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024335796 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024335796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024335797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024335797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024335799 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024335799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024335799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024335799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:43:36.722325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30973): Terminating (SIGTERM) 02:43:36.762348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30976): Terminating (SIGTERM) 02:43:36.802273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30979): Terminating (SIGTERM) 02:43:36.842535 --- ParallelTerminationStrategy: PID 30973 died... 02:43:36.861825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30973): Terminated: ok {rc=0} 02:43:36.905774 --- ParallelTerminationStrategy: PID 30976 died... 02:43:36.924294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30976): Terminated: ok {rc=0} 02:43:36.968089 --- ParallelTerminationStrategy: PID 30979 died... 02:43:36.986645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30979): Terminated: ok {rc=0} 02:43:37.069827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:43:38.280189 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:43:38.287227 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:43:38.319837 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:43:38.348293 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:43:38.402049 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:43:38.435513 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:43:38.462928 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:43:39.012231 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:43:39.065569 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:39.077109 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:43:39.146616 tst mo_mt_call.py: using LAC 37994 02:43:39.274349 tst mo_mt_call.py: using RAC 254 02:43:39.402444 tst mo_mt_call.py: using CellId 37994 02:43:39.530200 tst mo_mt_call.py: using BVCI 37995 02:43:39.648922 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:39.660334 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:39.671787 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:39.683289 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:39.695136 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:39.706697 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:43:39.822249 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:43:39.940319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:43:40.441916 run create_hlr_db(pid=30985): Launched 02:43:40.565583 bus /sierra_2: Setting Powered False 02:43:41.629790 run create_hlr_db(pid=30985): Terminated: ok {rc=0} 02:43:42.060200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30987): Launched 02:43:42.362571 run osmo-hlr_10.42.42.2(pid=30988): Launched 02:43:42.477814 run osmo-stp_10.42.42.5: Starting osmo-stp 02:43:42.998973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30990): Launched 02:43:43.298178 run osmo-stp_10.42.42.5(pid=30991): Launched 02:43:43.412665 run osmo-msc_10.42.42.6: Starting osmo-msc 02:43:43.957587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30993): Launched 02:43:44.257449 run osmo-msc_10.42.42.6(pid=30994): Launched 02:43:44.425819 run osmo-stp_10.42.42.5(pid=30991): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30991)] 02:43:44.561568 run osmo-stp_10.42.42.5(pid=30991): stdout: | (launched: 2022-12-14_02:43:43.243451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:44.700818 run osmo-stp_10.42.42.5(pid=30991): stderr: | [0;m[38;5;43m20221214024343413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024343413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024343414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024343414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024343414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024343415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024343415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:44.825973 run osmo-stp_10.42.42.5(pid=30991): stdout: | (launched: 2022-12-14_02:43:43.243451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:44.945362 run osmo-stp_10.42.42.5(pid=30991): stderr: | [0;m[38;5;43m20221214024343413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024343413 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024343414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024343414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024343414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024343415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024343415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:45.088336 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30991): Process ended prematurely: osmo-stp_10.42.42.5(pid=30991) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30991)] [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:43:45.097699 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:43:45.124104 run osmo-hlr_10.42.42.2(pid=30988): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30988)] 02:43:45.171749 run osmo-hlr_10.42.42.2(pid=30988): stdout: | (launched: 2022-12-14_02:43:42.307517) 02:43:45.221158 run osmo-hlr_10.42.42.2(pid=30988): stderr: | [0;m[1;31m20221214024342484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024342484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024342484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024342484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024342484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024342484 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024342497 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024342505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024342506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024342506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:43:45.290074 run osmo-msc_10.42.42.6(pid=30994): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30994)] 02:43:45.337803 run osmo-msc_10.42.42.6(pid=30994): stdout: | (launched: 2022-12-14_02:43:44.202196) 02:43:45.387357 run osmo-msc_10.42.42.6(pid=30994): stderr: | [0;m[38;5;43m20221214024344473 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024344473 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f064aa5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024344474 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024344474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024344474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024344474 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024344476 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024344476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024344476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024344476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:43:45.437067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30987): Terminating (SIGTERM) 02:43:45.476754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30990): Terminating (SIGTERM) 02:43:45.516693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30993): Terminating (SIGTERM) 02:43:45.556606 --- ParallelTerminationStrategy: PID 30987 died... 02:43:45.575796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30987): Terminated: ok {rc=0} 02:43:45.620637 --- ParallelTerminationStrategy: PID 30990 died... 02:43:45.639411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30990): Terminated: ok {rc=0} 02:43:45.683978 --- ParallelTerminationStrategy: PID 30993 died... 02:43:45.702578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30993): Terminated: ok {rc=0} 02:43:45.784478 bus /sierra_3: Setting Powered False 02:43:46.880172 bus /sierra_3: Setting Powered False 02:43:47.997150 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:43:49.146040 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:49.158100 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:43:49.228901 tst mo_mt_call_osmux.py: using LAC 37995 02:43:49.355302 tst mo_mt_call_osmux.py: using RAC 255 02:43:49.482323 tst mo_mt_call_osmux.py: using CellId 37995 02:43:49.611191 tst mo_mt_call_osmux.py: using BVCI 37996 02:43:49.729510 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:49.740844 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:49.752037 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:49.763254 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:49.774946 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:43:49.786495 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:43:49.903155 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:43:50.024640 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:43:50.490315 run create_hlr_db(pid=30996): Launched 02:43:50.613804 bus /sierra_2: Setting Powered False 02:43:51.674086 run create_hlr_db(pid=30996): Terminated: ok {rc=0} 02:43:52.094861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30998): Launched 02:43:52.393852 run osmo-hlr_10.42.42.2(pid=30999): Launched 02:43:52.506715 run osmo-stp_10.42.42.5: Starting osmo-stp 02:43:53.026234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31001): Launched 02:43:53.326159 run osmo-stp_10.42.42.5(pid=31002): Launched 02:43:53.439515 run osmo-msc_10.42.42.6: Starting osmo-msc 02:43:53.982862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31004): Launched 02:43:54.282069 run osmo-msc_10.42.42.6(pid=31005): Launched 02:43:54.450250 run osmo-stp_10.42.42.5(pid=31002): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31002)] 02:43:54.577491 run osmo-stp_10.42.42.5(pid=31002): stdout: | (launched: 2022-12-14_02:43:53.271120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:54.704455 run osmo-stp_10.42.42.5(pid=31002): stderr: | [0;m[38;5;43m20221214024353442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024353442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024353442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024353442 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024353443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024353443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024353443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:54.829923 run osmo-stp_10.42.42.5(pid=31002): stdout: | (launched: 2022-12-14_02:43:53.271120) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:43:54.949418 run osmo-stp_10.42.42.5(pid=31002): stderr: | [0;m[38;5;43m20221214024353442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024353442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024353442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024353442 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024353443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024353443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024353443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:43:55.092692 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31002): Process ended prematurely: osmo-stp_10.42.42.5(pid=31002) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31002)] [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:43:55.101837 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:43:55.128124 run osmo-hlr_10.42.42.2(pid=30999): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30999)] 02:43:55.175756 run osmo-hlr_10.42.42.2(pid=30999): stdout: | (launched: 2022-12-14_02:43:52.339201) 02:43:55.224708 run osmo-hlr_10.42.42.2(pid=30999): stderr: | [0;m[1;31m20221214024352516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024352516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024352516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024352516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024352516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024352516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024352529 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024352539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024352539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024352539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:43:55.293379 run osmo-msc_10.42.42.6(pid=31005): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31005)] 02:43:55.340485 run osmo-msc_10.42.42.6(pid=31005): stdout: | (launched: 2022-12-14_02:43:54.227174) 02:43:55.389576 run osmo-msc_10.42.42.6(pid=31005): stderr: | [0;m[38;5;43m20221214024354497 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024354497 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3ce8fd5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024354497 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024354497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024354497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024354497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024354499 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024354500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024354500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024354500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:43:55.438787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30998): Terminating (SIGTERM) 02:43:55.478260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31001): Terminating (SIGTERM) 02:43:55.517891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31004): Terminating (SIGTERM) 02:43:55.557876 --- ParallelTerminationStrategy: PID 30998 died... 02:43:55.576881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30998): Terminated: ok {rc=0} 02:43:55.620905 --- ParallelTerminationStrategy: PID 31001 died... 02:43:55.639707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31001): Terminated: ok {rc=0} 02:43:55.683292 --- ParallelTerminationStrategy: PID 31004 died... 02:43:55.701940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31004): Terminated: ok {rc=0} 02:43:55.785126 bus /sierra_3: Setting Powered False 02:43:56.881197 bus /sierra_3: Setting Powered False 02:43:57.992460 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:43:59.241438 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:43:59.248458 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:43:59.281327 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:43:59.309280 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:43:59.360854 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:43:59.393569 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:43:59.420849 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:43:59.972541 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:44:00.025219 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:00.037138 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:44:00.106848 tst mo_mt_call.py: using LAC 37996 02:44:00.234770 tst mo_mt_call.py: using RAC 1 02:44:00.361079 tst mo_mt_call.py: using CellId 37996 02:44:00.488611 tst mo_mt_call.py: using BVCI 37997 02:44:00.608107 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:00.619910 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:00.631267 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:00.642693 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:00.654815 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:00.666861 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:44:00.783890 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:44:00.905986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:01.405100 run create_hlr_db(pid=31010): Launched 02:44:01.568887 bus /sierra_2: Setting Powered False 02:44:02.633197 run create_hlr_db(pid=31010): Terminated: ok {rc=0} 02:44:03.071587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31012): Launched 02:44:03.371921 run osmo-hlr_10.42.42.2(pid=31013): Launched 02:44:03.485521 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:04.003800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31015): Launched 02:44:04.303335 run osmo-stp_10.42.42.5(pid=31016): Launched 02:44:04.417277 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:04.958942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31018): Launched 02:44:05.258580 run osmo-msc_10.42.42.6(pid=31019): Launched 02:44:05.426083 run osmo-stp_10.42.42.5(pid=31016): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31016)] 02:44:05.552530 run osmo-stp_10.42.42.5(pid=31016): stdout: | (launched: 2022-12-14_02:44:04.248653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:05.679531 run osmo-stp_10.42.42.5(pid=31016): stderr: | [0;m[38;5;43m20221214024404418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024404419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024404419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024404419 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024404422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024404422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024404422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:05.805246 run osmo-stp_10.42.42.5(pid=31016): stdout: | (launched: 2022-12-14_02:44:04.248653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:05.925473 run osmo-stp_10.42.42.5(pid=31016): stderr: | [0;m[38;5;43m20221214024404418 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024404419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024404419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024404419 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024404422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024404422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024404422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:06.068594 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31016): Process ended prematurely: osmo-stp_10.42.42.5(pid=31016) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31016)] [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:44:06.077736 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:44:06.104369 run osmo-hlr_10.42.42.2(pid=31013): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31013)] 02:44:06.152725 run osmo-hlr_10.42.42.2(pid=31013): stdout: | (launched: 2022-12-14_02:44:03.316831) 02:44:06.203111 run osmo-hlr_10.42.42.2(pid=31013): stderr: | [0;m[1;31m20221214024403492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024403492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024403492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024403492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024403492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024403492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024403505 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024403514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024403514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024403514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:44:06.272872 run osmo-msc_10.42.42.6(pid=31019): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31019)] 02:44:06.320637 run osmo-msc_10.42.42.6(pid=31019): stdout: | (launched: 2022-12-14_02:44:05.203449) 02:44:06.370379 run osmo-msc_10.42.42.6(pid=31019): stderr: | [0;m[38;5;43m20221214024405475 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024405475 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fefaff7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024405475 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024405475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024405475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024405476 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024405477 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024405478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024405478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024405478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:44:06.420280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31012): Terminating (SIGTERM) 02:44:06.460274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31015): Terminating (SIGTERM) 02:44:06.500170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31018): Terminating (SIGTERM) 02:44:06.540407 --- ParallelTerminationStrategy: PID 31012 died... 02:44:06.559805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31012): Terminated: ok {rc=0} 02:44:06.604152 --- ParallelTerminationStrategy: PID 31015 died... 02:44:06.623353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31015): Terminated: ok {rc=0} 02:44:06.667905 --- ParallelTerminationStrategy: PID 31018 died... 02:44:06.687010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31018): Terminated: ok {rc=0} 02:44:06.773757 bus /sierra_3: Setting Powered False 02:44:07.873592 bus /sierra_3: Setting Powered False 02:44:08.989187 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:44:10.134998 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:10.146925 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:44:10.215239 tst mo_mt_call_osmux.py: using LAC 37997 02:44:10.332712 tst mo_mt_call_osmux.py: using RAC 2 02:44:10.450567 tst mo_mt_call_osmux.py: using CellId 37997 02:44:10.569601 tst mo_mt_call_osmux.py: using BVCI 37998 02:44:10.678409 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:10.689642 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:10.700408 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:10.711334 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:10.722208 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:44:10.733213 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:44:10.852585 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:44:10.973106 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:11.437217 run create_hlr_db(pid=31021): Launched 02:44:11.560430 bus /sierra_2: Setting Powered False 02:44:12.620867 run create_hlr_db(pid=31021): Terminated: ok {rc=0} 02:44:13.039191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31023): Launched 02:44:13.339174 run osmo-hlr_10.42.42.2(pid=31024): Launched 02:44:13.453281 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:13.970598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31026): Launched 02:44:14.271232 run osmo-stp_10.42.42.5(pid=31027): Launched 02:44:14.386094 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:14.929428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31029): Launched 02:44:15.229962 run osmo-msc_10.42.42.6(pid=31030): Launched 02:44:15.397478 run osmo-stp_10.42.42.5(pid=31027): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31027)] 02:44:15.523934 run osmo-stp_10.42.42.5(pid=31027): stdout: | (launched: 2022-12-14_02:44:14.215632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:15.650637 run osmo-stp_10.42.42.5(pid=31027): stderr: | [0;m[38;5;43m20221214024414385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024414385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024414386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024414386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024414386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024414387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024414387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:15.775810 run osmo-stp_10.42.42.5(pid=31027): stdout: | (launched: 2022-12-14_02:44:14.215632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:15.928788 run osmo-stp_10.42.42.5(pid=31027): stderr: | [0;m[38;5;43m20221214024414385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024414385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024414386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024414386 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024414386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024414387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024414387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:16.080038 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31027): Process ended prematurely: osmo-stp_10.42.42.5(pid=31027) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31027)] [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:44:16.090139 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:44:16.117560 run osmo-hlr_10.42.42.2(pid=31024): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31024)] 02:44:16.166993 run osmo-hlr_10.42.42.2(pid=31024): stdout: | (launched: 2022-12-14_02:44:13.284395) 02:44:16.217280 run osmo-hlr_10.42.42.2(pid=31024): stderr: | [0;m[1;31m20221214024413459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024413459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024413459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024413459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024413459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024413459 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024413471 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024413479 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024413480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024413480 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:44:16.287777 run osmo-msc_10.42.42.6(pid=31030): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31030)] 02:44:16.337078 run osmo-msc_10.42.42.6(pid=31030): stdout: | (launched: 2022-12-14_02:44:15.174787) 02:44:16.387555 run osmo-msc_10.42.42.6(pid=31030): stderr: | [0;m[38;5;43m20221214024415447 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024415447 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb3bc168c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024415447 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024415447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024415447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024415447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024415449 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024415450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024415450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024415450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:44:16.438522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31023): Terminating (SIGTERM) 02:44:16.486299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31026): Terminating (SIGTERM) 02:44:16.539296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31029): Terminating (SIGTERM) 02:44:16.582058 --- ParallelTerminationStrategy: PID 31023 died... 02:44:16.601973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31023): Terminated: ok {rc=0} 02:44:16.646523 --- ParallelTerminationStrategy: PID 31026 died... 02:44:16.666372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31026): Terminated: ok {rc=0} 02:44:16.711471 --- ParallelTerminationStrategy: PID 31029 died... 02:44:16.730874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31029): Terminated: ok {rc=0} 02:44:16.824201 bus /sierra_3: Setting Powered False 02:44:17.930194 bus /sierra_3: Setting Powered False 02:44:19.044329 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:44:20.289254 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:44:20.295707 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:44:20.327325 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:44:20.353977 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:44:20.404942 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:44:20.437904 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:44:20.465677 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:44:21.013037 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:44:21.061450 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:21.072569 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:44:21.139721 tst mo_mt_call.py: using LAC 37998 02:44:21.260152 tst mo_mt_call.py: using RAC 3 02:44:21.377745 tst mo_mt_call.py: using CellId 37998 02:44:21.494163 tst mo_mt_call.py: using BVCI 37999 02:44:21.604505 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:21.615467 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:21.626211 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:21.636939 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:21.647770 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:21.658506 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:44:21.778731 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:44:21.897583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:22.372329 run create_hlr_db(pid=31035): Launched 02:44:22.495401 bus /sierra_2: Setting Powered False 02:44:23.555027 run create_hlr_db(pid=31035): Terminated: ok {rc=0} 02:44:23.974005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31037): Launched 02:44:24.273653 run osmo-hlr_10.42.42.2(pid=31038): Launched 02:44:24.387597 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:24.919371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31041): Launched 02:44:25.220119 run osmo-stp_10.42.42.5(pid=31042): Launched 02:44:25.334427 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:25.878981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31044): Launched 02:44:26.180233 run osmo-msc_10.42.42.6(pid=31045): Launched 02:44:26.349168 run osmo-stp_10.42.42.5(pid=31042): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31042)] 02:44:26.476804 run osmo-stp_10.42.42.5(pid=31042): stdout: | (launched: 2022-12-14_02:44:25.165061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:26.604722 run osmo-stp_10.42.42.5(pid=31042): stderr: | [0;m[38;5;43m20221214024425335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024425335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024425335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024425335 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024425338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024425338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024425338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:26.730533 run osmo-stp_10.42.42.5(pid=31042): stdout: | (launched: 2022-12-14_02:44:25.165061) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:26.850493 run osmo-stp_10.42.42.5(pid=31042): stderr: | [0;m[38;5;43m20221214024425335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024425335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024425335 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024425335 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024425338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024425338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024425338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:26.993651 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31042): Process ended prematurely: osmo-stp_10.42.42.5(pid=31042) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31042)] [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:44:27.002694 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:44:27.029124 run osmo-hlr_10.42.42.2(pid=31038): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31038)] 02:44:27.076754 run osmo-hlr_10.42.42.2(pid=31038): stdout: | (launched: 2022-12-14_02:44:24.218955) 02:44:27.125995 run osmo-hlr_10.42.42.2(pid=31038): stderr: | [0;m[1;31m20221214024424394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024424394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024424394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024424394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024424394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024424394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024424406 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024424414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024424415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024424415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:44:27.194764 run osmo-msc_10.42.42.6(pid=31045): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31045)] 02:44:27.242354 run osmo-msc_10.42.42.6(pid=31045): stdout: | (launched: 2022-12-14_02:44:26.125054) 02:44:27.291716 run osmo-msc_10.42.42.6(pid=31045): stderr: | [0;m[38;5;43m20221214024426397 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024426398 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa728eecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024426398 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024426398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024426398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024426398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024426400 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024426400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024426400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024426400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:44:27.342229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31037): Terminating (SIGTERM) 02:44:27.382056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31041): Terminating (SIGTERM) 02:44:27.421754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31044): Terminating (SIGTERM) 02:44:27.461758 --- ParallelTerminationStrategy: PID 31037 died... 02:44:27.481252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31037): Terminated: ok {rc=0} 02:44:27.525251 --- ParallelTerminationStrategy: PID 31041 died... 02:44:27.543999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31041): Terminated: ok {rc=0} 02:44:27.587908 --- ParallelTerminationStrategy: PID 31044 died... 02:44:27.606647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31044): Terminated: ok {rc=0} 02:44:27.690014 bus /sierra_3: Setting Powered False 02:44:28.788130 bus /sierra_3: Setting Powered False 02:44:29.905620 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:44:31.057100 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:31.070225 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:44:31.144439 tst mo_mt_call_osmux.py: using LAC 37999 02:44:31.273429 tst mo_mt_call_osmux.py: using RAC 4 02:44:31.398566 tst mo_mt_call_osmux.py: using CellId 37999 02:44:31.551167 tst mo_mt_call_osmux.py: using BVCI 38000 02:44:31.675064 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:31.687170 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:31.699164 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:31.711568 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:31.725513 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:44:31.738778 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:44:31.862167 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:44:31.984907 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:32.477489 run create_hlr_db(pid=31047): Launched 02:44:32.602267 bus /sierra_2: Setting Powered False 02:44:33.666278 run create_hlr_db(pid=31047): Terminated: ok {rc=0} 02:44:34.116130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31049): Launched 02:44:34.439095 run osmo-hlr_10.42.42.2(pid=31050): Launched 02:44:34.562292 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:35.121420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31052): Launched 02:44:35.444374 run osmo-stp_10.42.42.5(pid=31053): Launched 02:44:35.567779 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:36.152619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31055): Launched 02:44:36.474234 run osmo-msc_10.42.42.6(pid=31056): Launched 02:44:36.654637 run osmo-stp_10.42.42.5(pid=31053): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31053)] 02:44:36.791059 run osmo-stp_10.42.42.5(pid=31053): stdout: | (launched: 2022-12-14_02:44:35.385788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:36.928132 run osmo-stp_10.42.42.5(pid=31053): stderr: | [0;m[38;5;43m20221214024435578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024435578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024435578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024435579 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024435579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024435579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024435579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:37.064299 run osmo-stp_10.42.42.5(pid=31053): stdout: | (launched: 2022-12-14_02:44:35.385788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:37.193486 run osmo-stp_10.42.42.5(pid=31053): stderr: | [0;m[38;5;43m20221214024435578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024435578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024435578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024435579 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024435579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024435579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024435579 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:37.347873 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31053): Process ended prematurely: osmo-stp_10.42.42.5(pid=31053) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31053)] [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:44:37.357604 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:44:37.385336 run osmo-hlr_10.42.42.2(pid=31050): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31050)] 02:44:37.436027 run osmo-hlr_10.42.42.2(pid=31050): stdout: | (launched: 2022-12-14_02:44:34.380384) 02:44:37.488473 run osmo-hlr_10.42.42.2(pid=31050): stderr: | [0;m[1;31m20221214024434579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024434579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024434580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024434580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024434580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024434580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024434591 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024434600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024434600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024434600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:44:37.560899 run osmo-msc_10.42.42.6(pid=31056): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31056)] 02:44:37.611099 run osmo-msc_10.42.42.6(pid=31056): stdout: | (launched: 2022-12-14_02:44:36.415762) 02:44:37.663713 run osmo-msc_10.42.42.6(pid=31056): stderr: | [0;m[38;5;43m20221214024436739 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024436739 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f62876edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024436739 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024436739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024436740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024436740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024436741 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024436742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024436742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024436742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:44:37.716120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31049): Terminating (SIGTERM) 02:44:37.757712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31052): Terminating (SIGTERM) 02:44:37.799647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31055): Terminating (SIGTERM) 02:44:37.841828 --- ParallelTerminationStrategy: PID 31049 died... 02:44:37.862087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31049): Terminated: ok {rc=0} 02:44:37.908462 --- ParallelTerminationStrategy: PID 31052 died... 02:44:37.928235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31052): Terminated: ok {rc=0} 02:44:37.974235 --- ParallelTerminationStrategy: PID 31055 died... 02:44:37.993980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31055): Terminated: ok {rc=0} 02:44:38.081537 bus /sierra_3: Setting Powered False 02:44:39.179967 bus /sierra_3: Setting Powered False 02:44:40.294902 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:44:41.543553 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:44:41.551172 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:44:41.582917 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:44:41.609222 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:44:41.660760 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:44:41.693666 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:44:41.720741 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:44:42.268236 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:44:42.316151 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:42.327079 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:44:42.397273 tst mo_mt_call.py: using LAC 38000 02:44:42.519204 tst mo_mt_call.py: using RAC 5 02:44:42.649705 tst mo_mt_call.py: using CellId 38000 02:44:42.769505 tst mo_mt_call.py: using BVCI 38001 02:44:42.880429 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:42.891390 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:42.902225 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:42.912857 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:42.923696 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:42.934418 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:44:43.053998 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:44:43.176049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:43.677509 run create_hlr_db(pid=31061): Launched 02:44:43.801574 bus /sierra_2: Setting Powered False 02:44:44.865280 run create_hlr_db(pid=31061): Terminated: ok {rc=0} 02:44:45.294377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31063): Launched 02:44:45.594349 run osmo-hlr_10.42.42.2(pid=31064): Launched 02:44:45.709638 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:46.261569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31066): Launched 02:44:46.583278 run osmo-stp_10.42.42.5(pid=31067): Launched 02:44:46.818558 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:47.462292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31069): Launched 02:44:47.761984 run osmo-msc_10.42.42.6(pid=31070): Launched 02:44:47.929200 run osmo-stp_10.42.42.5(pid=31067): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31067)] 02:44:48.056017 run osmo-stp_10.42.42.5(pid=31067): stdout: | (launched: 2022-12-14_02:44:46.524243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:48.183811 run osmo-stp_10.42.42.5(pid=31067): stderr: | [0;m[38;5;43m20221214024446851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024446851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024446851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024446852 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024446852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024446852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024446852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:48.308848 run osmo-stp_10.42.42.5(pid=31067): stdout: | (launched: 2022-12-14_02:44:46.524243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:48.428276 run osmo-stp_10.42.42.5(pid=31067): stderr: | [0;m[38;5;43m20221214024446851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024446851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024446851 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024446852 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024446852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024446852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024446852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:48.571429 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31067): Process ended prematurely: osmo-stp_10.42.42.5(pid=31067) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31067)] [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:44:48.580238 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 02:44:48.606431 run osmo-hlr_10.42.42.2(pid=31064): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31064)] 02:44:48.654047 run osmo-hlr_10.42.42.2(pid=31064): stdout: | (launched: 2022-12-14_02:44:45.539120) 02:44:48.703177 run osmo-hlr_10.42.42.2(pid=31064): stderr: | [0;m[1;31m20221214024445713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024445713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024445713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024445713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024445713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024445713 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024445726 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024445734 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024445735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024445735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:44:48.771648 run osmo-msc_10.42.42.6(pid=31070): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31070)] 02:44:48.818993 run osmo-msc_10.42.42.6(pid=31070): stdout: | (launched: 2022-12-14_02:44:47.707202) 02:44:48.868603 run osmo-msc_10.42.42.6(pid=31070): stderr: | [0;m[38;5;43m20221214024447981 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024447981 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5eab132c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024447981 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024447981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024447982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024447982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024447983 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024447984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024447984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024447984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:44:48.917979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31063): Terminating (SIGTERM) 02:44:48.957279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31066): Terminating (SIGTERM) 02:44:48.996637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31069): Terminating (SIGTERM) 02:44:49.036119 --- ParallelTerminationStrategy: PID 31063 died... 02:44:49.055215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31063): Terminated: ok {rc=0} 02:44:49.099178 --- ParallelTerminationStrategy: PID 31066 died... 02:44:49.117570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31066): Terminated: ok {rc=0} 02:44:49.160749 --- ParallelTerminationStrategy: PID 31069 died... 02:44:49.179164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31069): Terminated: ok {rc=0} 02:44:49.263927 bus /sierra_3: Setting Powered False 02:44:50.362139 bus /sierra_3: Setting Powered False 02:44:51.476756 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:44:52.622100 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:52.633690 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:44:52.705372 tst mo_mt_call_osmux.py: using LAC 38001 02:44:52.824523 tst mo_mt_call_osmux.py: using RAC 6 02:44:52.943190 tst mo_mt_call_osmux.py: using CellId 38001 02:44:53.070610 tst mo_mt_call_osmux.py: using BVCI 38002 02:44:53.188673 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:53.200181 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:53.211484 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:53.222827 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:53.234568 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:44:53.246104 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:44:53.361709 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:44:53.483733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:44:53.984888 run create_hlr_db(pid=31072): Launched 02:44:54.108166 bus /sierra_2: Setting Powered False 02:44:55.172106 run create_hlr_db(pid=31072): Terminated: ok {rc=0} 02:44:55.605708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31074): Launched 02:44:55.928393 run osmo-hlr_10.42.42.2(pid=31075): Launched 02:44:56.051317 run osmo-stp_10.42.42.5: Starting osmo-stp 02:44:56.612427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31077): Launched 02:44:56.934711 run osmo-stp_10.42.42.5(pid=31078): Launched 02:44:57.058055 run osmo-msc_10.42.42.6: Starting osmo-msc 02:44:57.642562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31080): Launched 02:44:57.964700 run osmo-msc_10.42.42.6(pid=31081): Launched 02:44:58.146651 run osmo-stp_10.42.42.5(pid=31078): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31078)] 02:44:58.283559 run osmo-stp_10.42.42.5(pid=31078): stdout: | (launched: 2022-12-14_02:44:56.876178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:58.421142 run osmo-stp_10.42.42.5(pid=31078): stderr: | [0;m[38;5;43m20221214024457070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024457070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024457071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024457071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024457071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024457071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024457072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:58.557480 run osmo-stp_10.42.42.5(pid=31078): stdout: | (launched: 2022-12-14_02:44:56.876178) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:44:58.686444 run osmo-stp_10.42.42.5(pid=31078): stderr: | [0;m[38;5;43m20221214024457070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024457070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024457071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024457071 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024457071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024457071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024457072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:44:58.840325 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31078): Process ended prematurely: osmo-stp_10.42.42.5(pid=31078) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31078)] [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:44:58.849970 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:44:58.877674 run osmo-hlr_10.42.42.2(pid=31075): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31075)] 02:44:58.927960 run osmo-hlr_10.42.42.2(pid=31075): stdout: | (launched: 2022-12-14_02:44:55.869771) 02:44:58.979612 run osmo-hlr_10.42.42.2(pid=31075): stderr: | [0;m[1;31m20221214024456069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024456069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024456069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024456069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024456069 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024456070 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024456082 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024456090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024456090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024456090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:44:59.051993 run osmo-msc_10.42.42.6(pid=31081): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31081)] 02:44:59.101593 run osmo-msc_10.42.42.6(pid=31081): stdout: | (launched: 2022-12-14_02:44:57.906101) 02:44:59.153149 run osmo-msc_10.42.42.6(pid=31081): stderr: | [0;m[38;5;43m20221214024458228 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024458229 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0a499d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024458229 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024458229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024458229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024458229 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024458231 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024458231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024458231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024458231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:44:59.205355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31074): Terminating (SIGTERM) 02:44:59.246942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31077): Terminating (SIGTERM) 02:44:59.289145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31080): Terminating (SIGTERM) 02:44:59.331198 --- ParallelTerminationStrategy: PID 31074 died... 02:44:59.351473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31074): Terminated: ok {rc=0} 02:44:59.397529 --- ParallelTerminationStrategy: PID 31077 died... 02:44:59.417144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31077): Terminated: ok {rc=0} 02:44:59.463102 --- ParallelTerminationStrategy: PID 31080 died... 02:44:59.482967 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31080): Terminated: ok {rc=0} 02:44:59.570065 bus /sierra_3: Setting Powered False 02:45:00.667231 bus /sierra_3: Setting Powered False 02:45:01.782442 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:45:03.034093 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:45:03.041832 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:45:03.073450 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:45:03.099655 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:45:03.151630 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:45:03.184806 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:45:03.211893 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:45:03.758517 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:45:03.807918 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:03.819086 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:45:03.887372 tst mo_mt_call.py: using LAC 38002 02:45:04.016437 tst mo_mt_call.py: using RAC 7 02:45:04.143197 tst mo_mt_call.py: using CellId 38002 02:45:04.273362 tst mo_mt_call.py: using BVCI 38003 02:45:04.392334 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:04.403808 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:04.415013 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:04.426292 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:04.438012 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:04.449640 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:45:04.565381 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:45:04.680386 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:45:05.144754 run create_hlr_db(pid=31090): Launched 02:45:05.268706 bus /sierra_2: Setting Powered False 02:45:06.330162 run create_hlr_db(pid=31090): Terminated: ok {rc=0} 02:45:06.772652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31092): Launched 02:45:07.095248 run osmo-hlr_10.42.42.2(pid=31093): Launched 02:45:07.218093 run osmo-stp_10.42.42.5: Starting osmo-stp 02:45:07.774452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31095): Launched 02:45:08.097496 run osmo-stp_10.42.42.5(pid=31096): Launched 02:45:08.221135 run osmo-msc_10.42.42.6: Starting osmo-msc 02:45:08.805543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31098): Launched 02:45:09.128032 run osmo-msc_10.42.42.6(pid=31099): Launched 02:45:09.308517 run osmo-stp_10.42.42.5(pid=31096): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31096)] 02:45:09.445985 run osmo-stp_10.42.42.5(pid=31096): stdout: | (launched: 2022-12-14_02:45:08.038859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:09.583518 run osmo-stp_10.42.42.5(pid=31096): stderr: | [0;m[38;5;43m20221214024508231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024508231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024508231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024508231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024508232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024508232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024508232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:09.720785 run osmo-stp_10.42.42.5(pid=31096): stdout: | (launched: 2022-12-14_02:45:08.038859) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:09.850762 run osmo-stp_10.42.42.5(pid=31096): stderr: | [0;m[38;5;43m20221214024508231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024508231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024508231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024508231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024508232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024508232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024508232 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:10.005549 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31096): Process ended prematurely: osmo-stp_10.42.42.5(pid=31096) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31096)] [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:45:10.015262 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:45:10.043092 run osmo-hlr_10.42.42.2(pid=31093): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31093)] 02:45:10.094058 run osmo-hlr_10.42.42.2(pid=31093): stdout: | (launched: 2022-12-14_02:45:07.036717) 02:45:10.146599 run osmo-hlr_10.42.42.2(pid=31093): stderr: | [0;m[1;31m20221214024507237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024507237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024507237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024507237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024507237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024507237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024507268 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024507277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024507277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024507277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:10.219267 run osmo-msc_10.42.42.6(pid=31099): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31099)] 02:45:10.269944 run osmo-msc_10.42.42.6(pid=31099): stdout: | (launched: 2022-12-14_02:45:09.069268) 02:45:10.322308 run osmo-msc_10.42.42.6(pid=31099): stderr: | [0;m[38;5;43m20221214024509389 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024509390 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f95e8637c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024509390 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024509390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024509390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024509390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024509392 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024509392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024509392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024509392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:10.374861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31092): Terminating (SIGTERM) 02:45:10.416852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31095): Terminating (SIGTERM) 02:45:10.459525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31098): Terminating (SIGTERM) 02:45:10.501862 --- ParallelTerminationStrategy: PID 31092 died... 02:45:10.522348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31092): Terminated: ok {rc=0} 02:45:10.568942 --- ParallelTerminationStrategy: PID 31095 died... 02:45:10.588928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31095): Terminated: ok {rc=0} 02:45:10.635520 --- ParallelTerminationStrategy: PID 31098 died... 02:45:10.655496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31098): Terminated: ok {rc=0} 02:45:10.743017 bus /sierra_3: Setting Powered False 02:45:11.843402 bus /sierra_3: Setting Powered False 02:45:12.961747 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:45:14.107119 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:14.118762 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:45:14.187888 tst mo_mt_call_osmux.py: using LAC 38003 02:45:14.305331 tst mo_mt_call_osmux.py: using RAC 8 02:45:14.424512 tst mo_mt_call_osmux.py: using CellId 38003 02:45:14.543070 tst mo_mt_call_osmux.py: using BVCI 38004 02:45:14.654087 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:14.665113 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:14.675827 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:14.686560 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:14.697544 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:45:14.708198 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:45:14.828494 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:45:14.946678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:45:15.412604 run create_hlr_db(pid=31101): Launched 02:45:15.535492 bus /sierra_2: Setting Powered False 02:45:16.596084 run create_hlr_db(pid=31101): Terminated: ok {rc=0} 02:45:17.026702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31103): Launched 02:45:17.343967 run osmo-hlr_10.42.42.2(pid=31104): Launched 02:45:17.458358 run osmo-stp_10.42.42.5: Starting osmo-stp 02:45:17.974534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31106): Launched 02:45:18.273444 run osmo-stp_10.42.42.5(pid=31107): Launched 02:45:18.387464 run osmo-msc_10.42.42.6: Starting osmo-msc 02:45:18.930777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31109): Launched 02:45:19.230938 run osmo-msc_10.42.42.6(pid=31110): Launched 02:45:19.398920 run osmo-stp_10.42.42.5(pid=31107): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31107)] 02:45:19.526420 run osmo-stp_10.42.42.5(pid=31107): stdout: | (launched: 2022-12-14_02:45:18.218552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:19.653749 run osmo-stp_10.42.42.5(pid=31107): stderr: | [0;m[38;5;43m20221214024518390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024518390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024518391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024518391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024518392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024518392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024518392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:19.778885 run osmo-stp_10.42.42.5(pid=31107): stdout: | (launched: 2022-12-14_02:45:18.218552) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:19.899272 run osmo-stp_10.42.42.5(pid=31107): stderr: | [0;m[38;5;43m20221214024518390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024518390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024518391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024518391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024518392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024518392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024518392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:20.042058 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31107): Process ended prematurely: osmo-stp_10.42.42.5(pid=31107) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31107)] [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:45:20.050911 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:45:20.077048 run osmo-hlr_10.42.42.2(pid=31104): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31104)] 02:45:20.124322 run osmo-hlr_10.42.42.2(pid=31104): stdout: | (launched: 2022-12-14_02:45:17.288723) 02:45:20.173443 run osmo-hlr_10.42.42.2(pid=31104): stderr: | [0;m[1;31m20221214024517463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024517463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024517463 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024517464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024517464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024517464 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024517476 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024517485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024517485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024517485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:20.241925 run osmo-msc_10.42.42.6(pid=31110): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31110)] 02:45:20.289164 run osmo-msc_10.42.42.6(pid=31110): stdout: | (launched: 2022-12-14_02:45:19.175575) 02:45:20.337766 run osmo-msc_10.42.42.6(pid=31110): stderr: | [0;m[38;5;43m20221214024519445 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024519446 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb31a8b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024519446 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024519446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024519446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024519446 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024519448 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024519448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024519449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024519449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:20.386680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31103): Terminating (SIGTERM) 02:45:20.426510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31106): Terminating (SIGTERM) 02:45:20.465893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31109): Terminating (SIGTERM) 02:45:20.505691 --- ParallelTerminationStrategy: PID 31103 died... 02:45:20.524668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31103): Terminated: ok {rc=0} 02:45:20.568119 --- ParallelTerminationStrategy: PID 31106 died... 02:45:20.586617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31106): Terminated: ok {rc=0} 02:45:20.629878 --- ParallelTerminationStrategy: PID 31109 died... 02:45:20.648237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31109): Terminated: ok {rc=0} 02:45:20.733820 bus /sierra_3: Setting Powered False 02:45:21.832752 bus /sierra_3: Setting Powered False 02:45:22.947228 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:45:24.197089 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:45:24.203397 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:45:24.234695 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:45:24.260509 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:45:24.309774 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:45:24.341495 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:45:24.367959 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:45:24.918731 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:45:24.966730 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:24.978111 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:45:25.044598 tst mo_mt_call.py: using LAC 38004 02:45:25.160887 tst mo_mt_call.py: using RAC 9 02:45:25.277328 tst mo_mt_call.py: using CellId 38004 02:45:25.396113 tst mo_mt_call.py: using BVCI 38005 02:45:25.504203 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:25.515203 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:25.526101 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:25.536818 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:25.547764 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:25.558597 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:45:25.677743 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:45:25.794414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:45:26.259222 run create_hlr_db(pid=31115): Launched 02:45:26.382444 bus /sierra_2: Setting Powered False 02:45:27.443017 run create_hlr_db(pid=31115): Terminated: ok {rc=0} 02:45:27.882309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31117): Launched 02:45:28.205839 run osmo-hlr_10.42.42.2(pid=31118): Launched 02:45:28.329461 run osmo-stp_10.42.42.5: Starting osmo-stp 02:45:28.890277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31120): Launched 02:45:29.213651 run osmo-stp_10.42.42.5(pid=31121): Launched 02:45:29.337068 run osmo-msc_10.42.42.6: Starting osmo-msc 02:45:29.920450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31123): Launched 02:45:30.243042 run osmo-msc_10.42.42.6(pid=31124): Launched 02:45:30.423561 run osmo-stp_10.42.42.5(pid=31121): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31121)] 02:45:30.560671 run osmo-stp_10.42.42.5(pid=31121): stdout: | (launched: 2022-12-14_02:45:29.154919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:30.699068 run osmo-stp_10.42.42.5(pid=31121): stderr: | [0;m[38;5;43m20221214024529347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024529347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024529347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024529348 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024529348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024529348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024529348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:30.845892 run osmo-stp_10.42.42.5(pid=31121): stdout: | (launched: 2022-12-14_02:45:29.154919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:30.991217 run osmo-stp_10.42.42.5(pid=31121): stderr: | [0;m[38;5;43m20221214024529347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024529347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024529347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024529348 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024529348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024529348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024529348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:31.164763 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31121): Process ended prematurely: osmo-stp_10.42.42.5(pid=31121) [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31121)] [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:45:31.175469 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:45:31.204231 run osmo-hlr_10.42.42.2(pid=31118): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31118)] 02:45:31.258751 run osmo-hlr_10.42.42.2(pid=31118): stdout: | (launched: 2022-12-14_02:45:28.147354) 02:45:31.313080 run osmo-hlr_10.42.42.2(pid=31118): stderr: | [0;m[1;31m20221214024528345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024528345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024528345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024528345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024528345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024528345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024528357 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024528365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024528366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024528366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:31.388284 run osmo-msc_10.42.42.6(pid=31124): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31124)] 02:45:31.440101 run osmo-msc_10.42.42.6(pid=31124): stdout: | (launched: 2022-12-14_02:45:30.184236) 02:45:31.494153 run osmo-msc_10.42.42.6(pid=31124): stderr: | [0;m[38;5;43m20221214024530504 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024530504 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3a879e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024530504 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024530504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024530504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024530504 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024530506 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024530507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024530507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024530507 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:31.548743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31117): Terminating (SIGTERM) 02:45:31.591420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31120): Terminating (SIGTERM) 02:45:31.636111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31123): Terminating (SIGTERM) 02:45:31.681742 --- ParallelTerminationStrategy: PID 31117 died... 02:45:31.703525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31117): Terminated: ok {rc=0} 02:45:31.751944 --- ParallelTerminationStrategy: PID 31120 died... 02:45:31.773205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31120): Terminated: ok {rc=0} 02:45:31.819396 --- ParallelTerminationStrategy: PID 31123 died... 02:45:31.838995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31123): Terminated: ok {rc=0} 02:45:31.925527 bus /sierra_3: Setting Powered False 02:45:33.021661 bus /sierra_3: Setting Powered False 02:45:34.136374 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:45:35.281845 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:35.293659 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:45:35.362730 tst mo_mt_call_osmux.py: using LAC 38005 02:45:35.481443 tst mo_mt_call_osmux.py: using RAC 10 02:45:35.598651 tst mo_mt_call_osmux.py: using CellId 38005 02:45:35.727385 tst mo_mt_call_osmux.py: using BVCI 38006 02:45:35.844218 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:35.855887 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:35.867316 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:35.878776 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:35.890664 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:45:35.902433 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:45:36.022879 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:45:36.139564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:45:36.604912 run create_hlr_db(pid=31126): Launched 02:45:36.729245 bus /sierra_2: Setting Powered False 02:45:37.789676 run create_hlr_db(pid=31126): Terminated: ok {rc=0} 02:45:38.228581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31128): Launched 02:45:38.551198 run osmo-hlr_10.42.42.2(pid=31129): Launched 02:45:38.676275 run osmo-stp_10.42.42.5: Starting osmo-stp 02:45:39.234016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31131): Launched 02:45:39.557873 run osmo-stp_10.42.42.5(pid=31132): Launched 02:45:39.682468 run osmo-msc_10.42.42.6: Starting osmo-msc 02:45:40.267171 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31134): Launched 02:45:40.591807 run osmo-msc_10.42.42.6(pid=31135): Launched 02:45:40.775341 run osmo-stp_10.42.42.5(pid=31132): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31132)] 02:45:40.913481 run osmo-stp_10.42.42.5(pid=31132): stdout: | (launched: 2022-12-14_02:45:39.498985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:41.051370 run osmo-stp_10.42.42.5(pid=31132): stderr: | [0;m[38;5;43m20221214024539693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024539693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024539693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024539694 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024539694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024539694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024539694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:41.187808 run osmo-stp_10.42.42.5(pid=31132): stdout: | (launched: 2022-12-14_02:45:39.498985) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:41.317138 run osmo-stp_10.42.42.5(pid=31132): stderr: | [0;m[38;5;43m20221214024539693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024539693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024539693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024539694 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024539694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024539694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024539694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:41.471906 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31132): Process ended prematurely: osmo-stp_10.42.42.5(pid=31132) [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31132)] [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:45:41.481592 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:45:41.509071 run osmo-hlr_10.42.42.2(pid=31129): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31129)] 02:45:41.559575 run osmo-hlr_10.42.42.2(pid=31129): stdout: | (launched: 2022-12-14_02:45:38.492646) 02:45:41.611882 run osmo-hlr_10.42.42.2(pid=31129): stderr: | [0;m[1;31m20221214024538691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024538691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024538691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024538691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024538691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024538691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024538703 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024538711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024538711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024538711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:41.684790 run osmo-msc_10.42.42.6(pid=31135): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31135)] 02:45:41.734402 run osmo-msc_10.42.42.6(pid=31135): stdout: | (launched: 2022-12-14_02:45:40.532663) 02:45:41.786380 run osmo-msc_10.42.42.6(pid=31135): stderr: | [0;m[38;5;43m20221214024540851 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024540851 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe836e67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024540851 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024540852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024540852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024540852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024540855 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024540856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024540856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024540856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:41.838463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31128): Terminating (SIGTERM) 02:45:41.880182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31131): Terminating (SIGTERM) 02:45:41.922303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31134): Terminating (SIGTERM) 02:45:41.964643 --- ParallelTerminationStrategy: PID 31128 died... 02:45:41.985170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31128): Terminated: ok {rc=0} 02:45:42.031329 --- ParallelTerminationStrategy: PID 31131 died... 02:45:42.050992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31131): Terminated: ok {rc=0} 02:45:42.097115 --- ParallelTerminationStrategy: PID 31134 died... 02:45:42.116747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31134): Terminated: ok {rc=0} 02:45:42.204510 bus /sierra_3: Setting Powered False 02:45:43.301838 bus /sierra_3: Setting Powered False 02:45:44.417236 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:45:45.664339 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:45:45.669850 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:45:45.701524 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:45:45.727457 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:45:45.777515 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:45:45.809677 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:45:45.836038 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:45:46.436178 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:45:46.494539 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:46.506132 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:45:46.574517 tst mo_mt_call.py: using LAC 38006 02:45:46.743763 tst mo_mt_call.py: using RAC 11 02:45:46.866139 tst mo_mt_call.py: using CellId 38006 02:45:46.992661 tst mo_mt_call.py: using BVCI 38007 02:45:47.113788 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:47.126073 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:47.138231 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:47.150443 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:47.163657 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:47.176850 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:45:47.302101 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:45:47.419617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:45:47.884342 run create_hlr_db(pid=31142): Launched 02:45:48.007855 bus /sierra_2: Setting Powered False 02:45:49.069206 run create_hlr_db(pid=31142): Terminated: ok {rc=0} 02:45:49.488900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31144): Launched 02:45:49.789390 run osmo-hlr_10.42.42.2(pid=31145): Launched 02:45:49.903506 run osmo-stp_10.42.42.5: Starting osmo-stp 02:45:50.418672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31147): Launched 02:45:50.718394 run osmo-stp_10.42.42.5(pid=31148): Launched 02:45:50.832281 run osmo-msc_10.42.42.6: Starting osmo-msc 02:45:51.375451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31150): Launched 02:45:51.675605 run osmo-msc_10.42.42.6(pid=31151): Launched 02:45:51.843139 run osmo-stp_10.42.42.5(pid=31148): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31148)] 02:45:51.974021 run osmo-stp_10.42.42.5(pid=31148): stdout: | (launched: 2022-12-14_02:45:50.663401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:52.101302 run osmo-stp_10.42.42.5(pid=31148): stderr: | [0;m[38;5;43m20221214024550834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024550834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024550834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024550835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024550837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024550837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024550837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:52.226529 run osmo-stp_10.42.42.5(pid=31148): stdout: | (launched: 2022-12-14_02:45:50.663401) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:45:52.346609 run osmo-stp_10.42.42.5(pid=31148): stderr: | [0;m[38;5;43m20221214024550834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024550834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024550834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024550835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024550837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024550837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024550837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:45:52.489992 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31148): Process ended prematurely: osmo-stp_10.42.42.5(pid=31148) [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31148)] [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:45:52.499052 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:45:52.525558 run osmo-hlr_10.42.42.2(pid=31145): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31145)] 02:45:52.574365 run osmo-hlr_10.42.42.2(pid=31145): stdout: | (launched: 2022-12-14_02:45:49.734414) 02:45:52.623958 run osmo-hlr_10.42.42.2(pid=31145): stderr: | [0;m[1;31m20221214024549911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024549911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024549911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024549912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024549912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024549912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024549927 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024549936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024549937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024549937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:45:52.693837 run osmo-msc_10.42.42.6(pid=31151): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31151)] 02:45:52.741560 run osmo-msc_10.42.42.6(pid=31151): stdout: | (launched: 2022-12-14_02:45:51.620173) 02:45:52.790858 run osmo-msc_10.42.42.6(pid=31151): stderr: | [0;m[38;5;43m20221214024551894 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024551894 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6c6f8f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024551894 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024551894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024551895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024551895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024551896 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024551897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024551897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024551897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:45:52.840783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31144): Terminating (SIGTERM) 02:45:52.880657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31147): Terminating (SIGTERM) 02:45:52.920210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31150): Terminating (SIGTERM) 02:45:52.960127 --- ParallelTerminationStrategy: PID 31144 died... 02:45:52.979529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31144): Terminated: ok {rc=0} 02:45:53.023486 --- ParallelTerminationStrategy: PID 31147 died... 02:45:53.042249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31147): Terminated: ok {rc=0} 02:45:53.085967 --- ParallelTerminationStrategy: PID 31150 died... 02:45:53.104655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31150): Terminated: ok {rc=0} 02:45:53.188426 bus /sierra_3: Setting Powered False 02:45:54.286615 bus /sierra_3: Setting Powered False 02:45:55.401675 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:45:56.543910 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:56.555508 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:45:56.632519 tst mo_mt_call_osmux.py: using LAC 38007 02:45:56.753248 tst mo_mt_call_osmux.py: using RAC 12 02:45:56.870417 tst mo_mt_call_osmux.py: using CellId 38007 02:45:56.989017 tst mo_mt_call_osmux.py: using BVCI 38008 02:45:57.097517 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:57.108317 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:57.119016 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:57.129715 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:57.140410 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:45:57.151155 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:45:57.265442 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:45:57.386158 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:45:57.889154 run create_hlr_db(pid=31153): Launched 02:45:58.012851 bus /sierra_2: Setting Powered False 02:45:59.076686 run create_hlr_db(pid=31153): Terminated: ok {rc=0} 02:45:59.507824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31155): Launched 02:45:59.807753 run osmo-hlr_10.42.42.2(pid=31156): Launched 02:45:59.922283 run osmo-stp_10.42.42.5: Starting osmo-stp 02:46:00.440051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31158): Launched 02:46:00.741610 run osmo-stp_10.42.42.5(pid=31159): Launched 02:46:00.922163 run osmo-msc_10.42.42.6: Starting osmo-msc 02:46:01.573605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31161): Launched 02:46:01.921407 run osmo-msc_10.42.42.6(pid=31162): Launched 02:46:02.192799 run osmo-stp_10.42.42.5(pid=31159): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31159)] 02:46:02.334055 run osmo-stp_10.42.42.5(pid=31159): stdout: | (launched: 2022-12-14_02:46:00.685606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:02.474412 run osmo-stp_10.42.42.5(pid=31159): stderr: | [0;m[38;5;43m20221214024600859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024600859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024600860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024600860 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024600863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024600863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024600863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:02.611618 run osmo-stp_10.42.42.5(pid=31159): stdout: | (launched: 2022-12-14_02:46:00.685606) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:02.741749 run osmo-stp_10.42.42.5(pid=31159): stderr: | [0;m[38;5;43m20221214024600859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024600859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024600860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024600860 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024600863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024600863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024600863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:02.897024 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31159): Process ended prematurely: osmo-stp_10.42.42.5(pid=31159) [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31159)] [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:46:02.906622 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 02:46:02.934455 run osmo-hlr_10.42.42.2(pid=31156): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31156)] 02:46:02.985705 run osmo-hlr_10.42.42.2(pid=31156): stdout: | (launched: 2022-12-14_02:45:59.752727) 02:46:03.038198 run osmo-hlr_10.42.42.2(pid=31156): stderr: | [0;m[1;31m20221214024559929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024559929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024559929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024559929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024559929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024559929 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024559942 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024559950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024559950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024559950 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:46:03.111176 run osmo-msc_10.42.42.6(pid=31162): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31162)] 02:46:03.162220 run osmo-msc_10.42.42.6(pid=31162): stdout: | (launched: 2022-12-14_02:46:01.856767) 02:46:03.215162 run osmo-msc_10.42.42.6(pid=31162): stderr: | [0;m[38;5;43m20221214024602311 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024602312 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efdba429c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024602312 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024602312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024602312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024602312 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024602314 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024602314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024602314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024602314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:46:03.267876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31155): Terminating (SIGTERM) 02:46:03.309908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31158): Terminating (SIGTERM) 02:46:03.352061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31161): Terminating (SIGTERM) 02:46:03.394586 --- ParallelTerminationStrategy: PID 31155 died... 02:46:03.415089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31155): Terminated: ok {rc=0} 02:46:03.461542 --- ParallelTerminationStrategy: PID 31158 died... 02:46:03.481259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31158): Terminated: ok {rc=0} 02:46:03.527994 --- ParallelTerminationStrategy: PID 31161 died... 02:46:03.548016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31161): Terminated: ok {rc=0} 02:46:03.636874 bus /sierra_3: Setting Powered False 02:46:04.736307 bus /sierra_3: Setting Powered False 02:46:05.853606 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 02:46:07.098528 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:46:07.104711 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 02:46:07.136213 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 02:46:07.162306 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 02:46:07.212081 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 02:46:07.244096 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 02:46:07.270354 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 02:46:07.822519 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 02:46:07.870891 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:07.882144 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:46:07.932541 tst mo_mt_call.py: using LAC 38008 02:46:08.050836 tst mo_mt_call.py: using RAC 13 02:46:08.170892 tst mo_mt_call.py: using CellId 38008 02:46:08.288303 tst mo_mt_call.py: using BVCI 38009 02:46:08.398519 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:08.409722 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:08.420662 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:08.431620 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:08.442684 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:08.453662 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:46:08.574650 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:46:08.692073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:46:09.159038 run create_hlr_db(pid=31167): Launched 02:46:09.281096 bus /sierra_2: Setting Powered False 02:46:10.341444 run create_hlr_db(pid=31167): Terminated: ok {rc=0} 02:46:10.781998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31169): Launched 02:46:11.104194 run osmo-hlr_10.42.42.2(pid=31170): Launched 02:46:11.227068 run osmo-stp_10.42.42.5: Starting osmo-stp 02:46:11.781356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31172): Launched 02:46:12.105101 run osmo-stp_10.42.42.5(pid=31173): Launched 02:46:12.228685 run osmo-msc_10.42.42.6: Starting osmo-msc 02:46:12.815374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31175): Launched 02:46:13.138383 run osmo-msc_10.42.42.6(pid=31176): Launched 02:46:13.319517 run osmo-stp_10.42.42.5(pid=31173): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31173)] 02:46:13.457595 run osmo-stp_10.42.42.5(pid=31173): stdout: | (launched: 2022-12-14_02:46:12.046376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:13.595206 run osmo-stp_10.42.42.5(pid=31173): stderr: | [0;m[38;5;43m20221214024612238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024612238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024612238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024612238 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024612239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024612239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024612239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:13.732824 run osmo-stp_10.42.42.5(pid=31173): stdout: | (launched: 2022-12-14_02:46:12.046376) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:13.862818 run osmo-stp_10.42.42.5(pid=31173): stderr: | [0;m[38;5;43m20221214024612238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024612238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024612238 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024612238 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024612239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024612239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024612239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:14.017787 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31173): Process ended prematurely: osmo-stp_10.42.42.5(pid=31173) [trial-2398↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31173)] [trial-2398↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 02:46:14.027468 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:46:14.055143 run osmo-hlr_10.42.42.2(pid=31170): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31170)] 02:46:14.105876 run osmo-hlr_10.42.42.2(pid=31170): stdout: | (launched: 2022-12-14_02:46:11.045731) 02:46:14.158441 run osmo-hlr_10.42.42.2(pid=31170): stderr: | [0;m[1;31m20221214024611245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024611245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024611245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024611245 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024611246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024611246 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024611258 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024611266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024611266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024611266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:46:14.231202 run osmo-msc_10.42.42.6(pid=31176): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31176)] 02:46:14.281447 run osmo-msc_10.42.42.6(pid=31176): stdout: | (launched: 2022-12-14_02:46:13.079674) 02:46:14.333578 run osmo-msc_10.42.42.6(pid=31176): stderr: | [0;m[38;5;43m20221214024613398 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024613399 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fca8e4a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024613399 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024613399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024613399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024613399 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024613403 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024613403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024613403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024613403 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:46:14.385837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31169): Terminating (SIGTERM) 02:46:14.427393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31172): Terminating (SIGTERM) 02:46:14.470128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31175): Terminating (SIGTERM) 02:46:14.512526 --- ParallelTerminationStrategy: PID 31169 died... 02:46:14.532865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31169): Terminated: ok {rc=0} 02:46:14.579277 --- ParallelTerminationStrategy: PID 31172 died... 02:46:14.598908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31172): Terminated: ok {rc=0} 02:46:14.645663 --- ParallelTerminationStrategy: PID 31175 died... 02:46:14.665432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31175): Terminated: ok {rc=0} 02:46:14.755520 bus /sierra_3: Setting Powered False 02:46:15.855110 bus /sierra_3: Setting Powered False 02:46:16.980237 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 02:46:18.144734 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:18.157151 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:46:18.210224 tst mo_mt_call_osmux.py: using LAC 38009 02:46:18.337732 tst mo_mt_call_osmux.py: using RAC 14 02:46:18.464330 tst mo_mt_call_osmux.py: using CellId 38009 02:46:18.589983 tst mo_mt_call_osmux.py: using BVCI 38010 02:46:18.709617 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:18.721288 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:18.732765 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:18.744271 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:18.756165 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 02:46:18.767893 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:46:18.886369 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 02:46:19.007372 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:46:19.508659 run create_hlr_db(pid=31178): Launched 02:46:19.631170 bus /sierra_2: Setting Powered False 02:46:20.694760 run create_hlr_db(pid=31178): Terminated: ok {rc=0} 02:46:21.143696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31180): Launched 02:46:21.467060 run osmo-hlr_10.42.42.2(pid=31181): Launched 02:46:21.591329 run osmo-stp_10.42.42.5: Starting osmo-stp 02:46:22.149563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31183): Launched 02:46:22.473490 run osmo-stp_10.42.42.5(pid=31184): Launched 02:46:22.597811 run osmo-msc_10.42.42.6: Starting osmo-msc 02:46:23.184478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31186): Launched 02:46:23.508205 run osmo-msc_10.42.42.6(pid=31187): Launched 02:46:23.689887 run osmo-stp_10.42.42.5(pid=31184): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31184)] 02:46:23.827484 run osmo-stp_10.42.42.5(pid=31184): stdout: | (launched: 2022-12-14_02:46:22.414570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:23.966072 run osmo-stp_10.42.42.5(pid=31184): stderr: | [0;m[38;5;43m20221214024622608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024622609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024622609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024622609 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024622610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024622610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024622610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:24.102778 run osmo-stp_10.42.42.5(pid=31184): stdout: | (launched: 2022-12-14_02:46:22.414570) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:24.232467 run osmo-stp_10.42.42.5(pid=31184): stderr: | [0;m[38;5;43m20221214024622608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024622609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024622609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024622609 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024622610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024622610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024622610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:24.387990 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31184): Process ended prematurely: osmo-stp_10.42.42.5(pid=31184) [trial-2398↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31184)] [trial-2398↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 02:46:24.397790 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:46:24.425397 run osmo-hlr_10.42.42.2(pid=31181): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31181)] 02:46:24.475719 run osmo-hlr_10.42.42.2(pid=31181): stdout: | (launched: 2022-12-14_02:46:21.408225) 02:46:24.527765 run osmo-hlr_10.42.42.2(pid=31181): stderr: | [0;m[1;31m20221214024621607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024621607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024621607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024621607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024621607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024621607 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024621619 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024621627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024621627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024621627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:46:24.599913 run osmo-msc_10.42.42.6(pid=31187): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31187)] 02:46:24.650027 run osmo-msc_10.42.42.6(pid=31187): stdout: | (launched: 2022-12-14_02:46:23.449351) 02:46:24.702335 run osmo-msc_10.42.42.6(pid=31187): stderr: | [0;m[38;5;43m20221214024623771 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024623771 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc5bc7dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024623771 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024623771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024623772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024623773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024623774 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024623775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024623775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024623775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:46:24.754611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31180): Terminating (SIGTERM) 02:46:24.796132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31183): Terminating (SIGTERM) 02:46:24.838501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31186): Terminating (SIGTERM) 02:46:24.880590 --- ParallelTerminationStrategy: PID 31180 died... 02:46:24.900830 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31180): Terminated: ok {rc=0} 02:46:24.947059 --- ParallelTerminationStrategy: PID 31183 died... 02:46:24.966856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31183): Terminated: ok {rc=0} 02:46:25.012870 --- ParallelTerminationStrategy: PID 31186 died... 02:46:25.033245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31186): Terminated: ok {rc=0} 02:46:25.121198 bus /sierra_3: Setting Powered False 02:46:26.218652 bus /sierra_3: Setting Powered False 02:46:27.332812 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 emergency:trx-umtrx --------------------------------------------------------------------- 02:46:28.589948 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:46:28.595395 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:46:28.627349 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 02:46:28.653638 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 02:46:28.736142 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:46:28.770015 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 02:46:28.797423 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 02:46:29.376214 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2398 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 02:46:29.382549 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:29.394309 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 02:46:29.443335 tst emergency_mo_mt_call.py: using LAC 38010 02:46:29.565865 tst emergency_mo_mt_call.py: using RAC 15 02:46:29.689365 tst emergency_mo_mt_call.py: using CellId 38010 02:46:29.811625 tst emergency_mo_mt_call.py: using BVCI 38011 02:46:29.927061 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:29.938213 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:29.949156 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:29.959931 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:29.971097 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:29.982242 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:46:30.097903 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:46:30.219223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:46:30.714379 run create_hlr_db(pid=31192): Launched 02:46:30.839561 bus /sierra_2: Setting Powered False 02:46:31.898738 run create_hlr_db(pid=31192): Terminated: ok {rc=0} 02:46:32.341739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31194): Launched 02:46:32.637434 run osmo-hlr_10.42.42.2(pid=31195): Launched 02:46:32.751909 run osmo-stp_10.42.42.5: Starting osmo-stp 02:46:33.261715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31197): Launched 02:46:33.557816 run osmo-stp_10.42.42.5(pid=31198): Launched 02:46:33.681162 tst emergency_mo_mt_call.py: using MSISDN 8463 02:46:33.834554 run osmo-msc_10.42.42.6: Starting osmo-msc 02:46:34.367953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31200): Launched 02:46:34.665079 run osmo-msc_10.42.42.6(pid=31201): Launched 02:46:34.832194 run osmo-stp_10.42.42.5(pid=31198): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31198)] 02:46:34.958159 run osmo-stp_10.42.42.5(pid=31198): stdout: | (launched: 2022-12-14_02:46:33.503330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:35.084877 run osmo-stp_10.42.42.5(pid=31198): stderr: | [0;m[38;5;43m20221214024633675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024633675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024633676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024633676 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024633677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024633677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024633677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:35.208563 run osmo-stp_10.42.42.5(pid=31198): stdout: | (launched: 2022-12-14_02:46:33.503330) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:35.326970 run osmo-stp_10.42.42.5(pid=31198): stderr: | [0;m[38;5;43m20221214024633675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024633675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024633676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024633676 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024633677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024633677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024633677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:35.467959 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=31198): Process ended prematurely: osmo-stp_10.42.42.5(pid=31198) [trial-2398↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31198)] [trial-2398↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 02:46:35.476285 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 02:46:35.502142 run osmo-hlr_10.42.42.2(pid=31195): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31195)] 02:46:35.549815 run osmo-hlr_10.42.42.2(pid=31195): stdout: | (launched: 2022-12-14_02:46:32.582948) 02:46:35.599373 run osmo-hlr_10.42.42.2(pid=31195): stderr: | [0;m[1;31m20221214024632760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024632760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024632760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024632760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024632760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024632760 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024632773 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024632782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024632782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024632782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:46:35.668404 run osmo-msc_10.42.42.6(pid=31201): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31201)] 02:46:35.715662 run osmo-msc_10.42.42.6(pid=31201): stdout: | (launched: 2022-12-14_02:46:34.610252) 02:46:35.764661 run osmo-msc_10.42.42.6(pid=31201): stderr: | [0;m[38;5;43m20221214024634881 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024634881 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f11a8839c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024634881 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024634881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024634881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024634881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024634883 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024634884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024634884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024634884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:46:35.813988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31194): Terminating (SIGTERM) 02:46:35.853474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31197): Terminating (SIGTERM) 02:46:35.892883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31200): Terminating (SIGTERM) 02:46:35.932627 --- ParallelTerminationStrategy: PID 31194 died... 02:46:35.951636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31194): Terminated: ok {rc=0} 02:46:35.994969 --- ParallelTerminationStrategy: PID 31197 died... 02:46:36.013474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31197): Terminated: ok {rc=0} 02:46:36.056784 --- ParallelTerminationStrategy: PID 31200 died... 02:46:36.075153 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31200): Terminated: ok {rc=0} 02:46:36.159754 bus /sierra_3: Setting Powered False 02:46:37.259779 bus /sierra_3: Setting Powered False 02:46:38.373748 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 02:46:39.460319 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:39.472325 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 02:46:39.523293 tst emergency_preemptive_call.py: using LAC 38011 02:46:39.648928 tst emergency_preemptive_call.py: using RAC 16 02:46:39.774334 tst emergency_preemptive_call.py: using CellId 38011 02:46:39.901104 tst emergency_preemptive_call.py: using BVCI 38012 02:46:40.016873 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:40.028073 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:40.038998 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:40.050047 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:40.061393 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 02:46:40.072642 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:46:40.191972 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:46:40.309100 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:46:40.428010 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 02:46:40.541819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:46:41.001990 run create_hlr_db(pid=31203): Launched 02:46:41.124608 bus /sierra_2: Setting Powered False 02:46:42.184746 run create_hlr_db(pid=31203): Terminated: ok {rc=0} 02:46:42.621339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31205): Launched 02:46:42.940641 run osmo-hlr_10.42.42.2(pid=31206): Launched 02:46:43.062724 run osmo-stp_10.42.42.5: Starting osmo-stp 02:46:43.611691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31208): Launched 02:46:43.932173 run osmo-stp_10.42.42.5(pid=31209): Launched 02:46:44.064596 tst emergency_preemptive_call.py: using MSISDN 8464 02:46:44.225828 run osmo-msc_10.42.42.6: Starting osmo-msc 02:46:44.797623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31211): Launched 02:46:45.115471 run osmo-msc_10.42.42.6(pid=31212): Launched 02:46:45.292599 run osmo-stp_10.42.42.5(pid=31209): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31209)] 02:46:45.427891 run osmo-stp_10.42.42.5(pid=31209): stdout: | (launched: 2022-12-14_02:46:43.874067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:45.563625 run osmo-stp_10.42.42.5(pid=31209): stderr: | [0;m[38;5;43m20221214024644066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024644066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024644067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024644067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024644067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024644068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024644068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:45.699224 run osmo-stp_10.42.42.5(pid=31209): stdout: | (launched: 2022-12-14_02:46:43.874067) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:46:45.826349 run osmo-stp_10.42.42.5(pid=31209): stderr: | [0;m[38;5;43m20221214024644066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024644066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024644067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024644067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024644067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024644068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024644068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:46:45.998455 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=31209): Process ended prematurely: osmo-stp_10.42.42.5(pid=31209) [trial-2398↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31209)] [trial-2398↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 02:46:46.008485 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 02:46:46.036992 run osmo-hlr_10.42.42.2(pid=31206): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31206)] 02:46:46.113428 run osmo-hlr_10.42.42.2(pid=31206): stdout: | (launched: 2022-12-14_02:46:42.882537) 02:46:46.166080 run osmo-hlr_10.42.42.2(pid=31206): stderr: | [0;m[1;31m20221214024643079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024643079 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024643080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024643080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024643080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024643080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024643091 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024643099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024643100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024643100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:46:46.239583 run osmo-msc_10.42.42.6(pid=31212): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31212)] 02:46:46.290282 run osmo-msc_10.42.42.6(pid=31212): stdout: | (launched: 2022-12-14_02:46:45.057249) 02:46:46.343323 run osmo-msc_10.42.42.6(pid=31212): stderr: | [0;m[38;5;43m20221214024645378 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214024645378 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7601a79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214024645378 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214024645378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214024645378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214024645379 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214024645382 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214024645383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214024645383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214024645383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:46:46.396529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31205): Terminating (SIGTERM) 02:46:46.438910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31208): Terminating (SIGTERM) 02:46:46.482125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31211): Terminating (SIGTERM) 02:46:46.526621 --- ParallelTerminationStrategy: PID 31205 died... 02:46:46.547297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31205): Terminated: ok {rc=0} 02:46:46.594698 --- ParallelTerminationStrategy: PID 31208 died... 02:46:46.615233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31208): Terminated: ok {rc=0} 02:46:46.662917 --- ParallelTerminationStrategy: PID 31211 died... 02:46:46.682823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31211): Terminated: ok {rc=0} 02:46:46.781398 bus /sierra_9: Setting Powered False 02:46:47.882788 bus /sierra_9: Setting Powered False 02:46:48.997523 bus /sierra_8: Setting Powered False 02:46:50.095212 bus /sierra_8: Setting Powered False 02:46:51.209963 bus /sierra_3: Setting Powered False 02:46:52.306917 bus /sierra_3: Setting Powered False 02:46:53.422848 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-umtrx --------------------------------------------------------------------- 02:46:54.698184 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:46:54.703299 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 02:46:54.735180 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 02:46:54.772846 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 02:46:54.858119 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 02:46:54.889864 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 02:46:54.927877 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 02:46:55.515148 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 02:46:55.564476 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:55.574990 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 02:46:55.622140 tst cs_paging_gprs_active.py: using LAC 38012 02:46:55.741440 tst cs_paging_gprs_active.py: using RAC 17 02:46:55.860497 tst cs_paging_gprs_active.py: using CellId 38012 02:46:55.979730 tst cs_paging_gprs_active.py: using BVCI 38013 02:46:56.090287 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:56.100743 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:56.111134 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:56.121465 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:56.131626 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:56.142223 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:56.152939 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:56.163155 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:46:56.174923 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:46:56.297808 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:46:56.418140 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:46:56.638418 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:46:56.964533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31217): Launched 02:46:57.247169 run iperf3-srv_10.42.42.10(pid=31218): Launched 02:46:57.369616 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:46:57.589648 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:46:57.916606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31219): Launched 02:46:58.198869 run iperf3-srv_10.42.42.10(pid=31220): Launched 02:46:58.320533 tst cs_paging_gprs_active.py:38: start network... 02:46:58.539927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:46:59.043312 run create_hlr_db(pid=31221): Launched 02:46:59.167565 bus /sierra_2: Setting Powered False 02:47:00.228809 run create_hlr_db(pid=31221): Terminated: ok {rc=0} 02:47:00.679779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31223): Launched 02:47:01.026400 run osmo-hlr_10.42.42.2(pid=31224): Launched 02:47:01.438886 run osmo-stp_10.42.42.5: Starting osmo-stp 02:47:02.065268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31226): Launched 02:47:02.382073 run osmo-stp_10.42.42.5(pid=31227): Launched 02:47:02.497967 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:47:03.017985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31229): Launched 02:47:03.132791 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:47:03.387495 run patchelf(pid=31230): Launched 02:47:03.554666 run osmo-stp_10.42.42.5(pid=31227): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31227)] 02:47:03.682085 run osmo-stp_10.42.42.5(pid=31227): stdout: | (launched: 2022-12-14_02:47:02.326813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:03.811186 run osmo-stp_10.42.42.5(pid=31227): stderr: | [0;m[38;5;43m20221214024702495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024702496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024702496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024702496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024702497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024702497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024702497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:03.940298 run osmo-stp_10.42.42.5(pid=31227): stdout: | (launched: 2022-12-14_02:47:02.326813) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:04.063828 run osmo-stp_10.42.42.5(pid=31227): stderr: | [0;m[38;5;43m20221214024702495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024702496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024702496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024702496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024702497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024702497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024702497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:04.210283 run patchelf(pid=31230): Terminating (SIGINT) 02:47:04.380849 run patchelf(pid=31230): Terminated: ok {rc=0} 02:47:04.503743 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31227): Process ended prematurely: osmo-stp_10.42.42.5(pid=31227) [trial-2398↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31227)] [trial-2398↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 02:47:04.513218 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 02:47:04.540166 run osmo-hlr_10.42.42.2(pid=31224): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31224)] 02:47:04.587120 run osmo-hlr_10.42.42.2(pid=31224): stdout: | (launched: 2022-12-14_02:47:00.959588) 02:47:04.635895 run osmo-hlr_10.42.42.2(pid=31224): stderr: | [0;m[1;31m20221214024701296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024701296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024701296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024701296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024701296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024701296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024701318 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024701340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024701340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024701340 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:47:04.684898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31217): Terminating (SIGTERM) 02:47:04.723993 run iperf3-srv_10.42.42.10(pid=31218): Terminating (SIGTERM) 02:47:04.762976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31219): Terminating (SIGTERM) 02:47:04.802102 run iperf3-srv_10.42.42.10(pid=31220): Terminating (SIGTERM) 02:47:04.841040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31223): Terminating (SIGTERM) 02:47:04.880063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31226): Terminating (SIGTERM) 02:47:04.919264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31229): Terminating (SIGTERM) 02:47:04.959121 --- ParallelTerminationStrategy: PID 31217 died... 02:47:04.978271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31217): Terminated: ok {rc=0} 02:47:05.021805 --- ParallelTerminationStrategy: PID 31218 died... 02:47:05.040216 run iperf3-srv_10.42.42.10(pid=31218): Terminated {rc=256} 02:47:05.083488 --- ParallelTerminationStrategy: PID 31219 died... 02:47:05.101953 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31219): Terminated: ok {rc=0} 02:47:05.145159 --- ParallelTerminationStrategy: PID 31220 died... 02:47:05.163852 run iperf3-srv_10.42.42.10(pid=31220): Terminated {rc=256} 02:47:05.207191 --- ParallelTerminationStrategy: PID 31223 died... 02:47:05.225971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31223): Terminated: ok {rc=0} 02:47:05.269915 --- ParallelTerminationStrategy: PID 31226 died... 02:47:05.288556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31226): Terminated: ok {rc=0} 02:47:05.331910 --- ParallelTerminationStrategy: PID 31229 died... 02:47:05.350370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31229): Terminated: ok {rc=0} 02:47:05.435239 bus /gobi_0: Setting Powered False 02:47:06.535270 bus /gobi_0: Setting Powered False 02:47:07.647996 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx iperf3.py ---------------------------------------------- 02:47:08.790307 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:08.801488 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 02:47:08.851540 tst iperf3.py: using LAC 38013 02:47:08.981213 tst iperf3.py: using RAC 18 02:47:09.111272 tst iperf3.py: using CellId 38013 02:47:09.241440 tst iperf3.py: using BVCI 38014 02:47:09.361998 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:09.373247 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:09.384453 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:09.395450 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:09.406670 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:09.417963 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:09.429395 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:09.440542 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:09.451914 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:09.568806 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:47:09.773096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:10.075973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31231): Launched 02:47:10.339570 run iperf3-srv_10.42.42.10(pid=31232): Launched 02:47:10.452789 tst iperf3.py:8: start network... 02:47:10.654560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:47:11.120655 run create_hlr_db(pid=31233): Launched 02:47:11.244822 bus /gobi_6: Setting Powered False 02:47:12.305644 run create_hlr_db(pid=31233): Terminated: ok {rc=0} 02:47:12.747695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31235): Launched 02:47:13.073880 run osmo-hlr_10.42.42.2(pid=31236): Launched 02:47:13.198306 run osmo-stp_10.42.42.5: Starting osmo-stp 02:47:13.757524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31238): Launched 02:47:14.081206 run osmo-stp_10.42.42.5(pid=31239): Launched 02:47:14.204831 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:47:14.763938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31241): Launched 02:47:14.887328 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:47:15.161412 run patchelf(pid=31242): Launched 02:47:15.342159 run osmo-stp_10.42.42.5(pid=31239): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31239)] 02:47:15.479623 run osmo-stp_10.42.42.5(pid=31239): stdout: | (launched: 2022-12-14_02:47:14.022266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:15.618924 run osmo-stp_10.42.42.5(pid=31239): stderr: | [0;m[38;5;43m20221214024714215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024714215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024714216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024714216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024714216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024714217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024714217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:15.759032 run osmo-stp_10.42.42.5(pid=31239): stdout: | (launched: 2022-12-14_02:47:14.022266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:15.903476 run osmo-stp_10.42.42.5(pid=31239): stderr: | [0;m[38;5;43m20221214024714215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024714215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024714216 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024714216 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024714216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024714217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024714217 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:16.079568 run patchelf(pid=31242): Terminating (SIGINT) 02:47:16.268053 run patchelf(pid=31242): Terminated: ok {rc=0} 02:47:16.404134 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31239): Process ended prematurely: osmo-stp_10.42.42.5(pid=31239) [trial-2398↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31239)] [trial-2398↪gprs:trx-umtrx↪iperf3.py:8] 02:47:16.415342 tst iperf3.py:8: Test FAILED (7.7 sec) 02:47:16.444791 run osmo-hlr_10.42.42.2(pid=31236): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31236)] 02:47:16.499636 run osmo-hlr_10.42.42.2(pid=31236): stdout: | (launched: 2022-12-14_02:47:13.014888) 02:47:16.553450 run osmo-hlr_10.42.42.2(pid=31236): stderr: | [0;m[1;31m20221214024713214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024713214 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024713215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024713215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024713215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024713215 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024713227 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024713235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024713235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024713235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:47:16.607082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31231): Terminating (SIGTERM) 02:47:16.651780 run iperf3-srv_10.42.42.10(pid=31232): Terminating (SIGTERM) 02:47:16.698995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31235): Terminating (SIGTERM) 02:47:16.743287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31238): Terminating (SIGTERM) 02:47:16.787503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31241): Terminating (SIGTERM) 02:47:16.831908 --- ParallelTerminationStrategy: PID 31231 died... 02:47:16.853733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31231): Terminated: ok {rc=0} 02:47:16.902031 --- ParallelTerminationStrategy: PID 31232 died... 02:47:16.923262 run iperf3-srv_10.42.42.10(pid=31232): Terminated {rc=256} 02:47:16.971171 --- ParallelTerminationStrategy: PID 31235 died... 02:47:16.992651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31235): Terminated: ok {rc=0} 02:47:17.040719 --- ParallelTerminationStrategy: PID 31238 died... 02:47:17.062143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31238): Terminated: ok {rc=0} 02:47:17.113093 --- ParallelTerminationStrategy: PID 31241 died... 02:47:17.132244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31241): Terminated: ok {rc=0} 02:47:17.216607 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 02:47:18.365644 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:18.377515 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 02:47:18.426276 tst iperf3m4.py: using LAC 38014 02:47:18.554362 tst iperf3m4.py: using RAC 19 02:47:18.682983 tst iperf3m4.py: using CellId 38014 02:47:18.812740 tst iperf3m4.py: using BVCI 38015 02:47:18.933566 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:18.944521 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:18.955402 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:18.966244 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:18.977776 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:18.989366 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:19.001004 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:19.012576 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:19.024412 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:19.146460 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:19.268286 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:19.389561 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:19.510588 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:47:19.730908 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:20.055647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31243): Launched 02:47:20.338070 run iperf3-srv_10.42.42.10(pid=31244): Launched 02:47:20.459740 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:47:20.679096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:21.005061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31245): Launched 02:47:21.287031 run iperf3-srv_10.42.42.10(pid=31246): Launched 02:47:21.409445 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:47:21.628575 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:21.954915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31247): Launched 02:47:22.237154 run iperf3-srv_10.42.42.10(pid=31248): Launched 02:47:22.359236 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:47:22.578588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:22.905270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31249): Launched 02:47:23.187610 run iperf3-srv_10.42.42.10(pid=31250): Launched 02:47:23.309516 tst iperf3m4.py:8: start network... 02:47:23.528604 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:47:24.035273 run create_hlr_db(pid=31251): Launched 02:47:24.159612 bus /gobi_6: Setting Powered False 02:47:25.224045 run create_hlr_db(pid=31251): Terminated: ok {rc=0} 02:47:25.675189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31253): Launched 02:47:26.000146 run osmo-hlr_10.42.42.2(pid=31254): Launched 02:47:26.125184 run osmo-stp_10.42.42.5: Starting osmo-stp 02:47:26.683586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31256): Launched 02:47:27.008590 run osmo-stp_10.42.42.5(pid=31257): Launched 02:47:27.133007 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:47:27.695083 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31259): Launched 02:47:27.819302 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:47:28.093357 run patchelf(pid=31260): Launched 02:47:28.273801 run osmo-stp_10.42.42.5(pid=31257): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31257)] 02:47:28.411277 run osmo-stp_10.42.42.5(pid=31257): stdout: | (launched: 2022-12-14_02:47:26.949388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:28.550375 run osmo-stp_10.42.42.5(pid=31257): stderr: | [0;m[38;5;43m20221214024727139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024727140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024727140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024727140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024727142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024727143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024727143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:28.689960 run osmo-stp_10.42.42.5(pid=31257): stdout: | (launched: 2022-12-14_02:47:26.949388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:28.823444 run osmo-stp_10.42.42.5(pid=31257): stderr: | [0;m[38;5;43m20221214024727139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024727140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024727140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024727140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024727142 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024727143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024727143 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:28.981794 run patchelf(pid=31260): Terminating (SIGINT) 02:47:29.164236 run patchelf(pid=31260): Terminated: ok {rc=0} 02:47:29.295786 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31257): Process ended prematurely: osmo-stp_10.42.42.5(pid=31257) [trial-2398↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31257)] [trial-2398↪gprs:trx-umtrx↪iperf3m4.py:8] 02:47:29.306058 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:47:29.334605 run osmo-hlr_10.42.42.2(pid=31254): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31254)] 02:47:29.385167 run osmo-hlr_10.42.42.2(pid=31254): stdout: | (launched: 2022-12-14_02:47:25.940648) 02:47:29.437362 run osmo-hlr_10.42.42.2(pid=31254): stderr: | [0;m[1;31m20221214024726137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024726137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024726137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024726137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024726137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024726137 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024726150 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024726158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024726158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024726158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:47:29.489741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31243): Terminating (SIGTERM) 02:47:29.531348 run iperf3-srv_10.42.42.10(pid=31244): Terminating (SIGTERM) 02:47:29.573088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31245): Terminating (SIGTERM) 02:47:29.614938 run iperf3-srv_10.42.42.10(pid=31246): Terminating (SIGTERM) 02:47:29.656783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31247): Terminating (SIGTERM) 02:47:29.698995 run iperf3-srv_10.42.42.10(pid=31248): Terminating (SIGTERM) 02:47:29.740752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31249): Terminating (SIGTERM) 02:47:29.782615 run iperf3-srv_10.42.42.10(pid=31250): Terminating (SIGTERM) 02:47:29.824342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31253): Terminating (SIGTERM) 02:47:29.866196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31256): Terminating (SIGTERM) 02:47:29.908032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31259): Terminating (SIGTERM) 02:47:29.950728 --- ParallelTerminationStrategy: PID 31243 died... 02:47:29.971560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31243): Terminated: ok {rc=0} 02:47:30.017715 --- ParallelTerminationStrategy: PID 31244 died... 02:47:30.037436 run iperf3-srv_10.42.42.10(pid=31244): Terminated {rc=256} 02:47:30.082949 --- ParallelTerminationStrategy: PID 31245 died... 02:47:30.103031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31245): Terminated: ok {rc=0} 02:47:30.148802 --- ParallelTerminationStrategy: PID 31246 died... 02:47:30.168842 run iperf3-srv_10.42.42.10(pid=31246): Terminated {rc=256} 02:47:30.214559 --- ParallelTerminationStrategy: PID 31247 died... 02:47:30.234198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31247): Terminated: ok {rc=0} 02:47:30.279849 --- ParallelTerminationStrategy: PID 31248 died... 02:47:30.299488 run iperf3-srv_10.42.42.10(pid=31248): Terminated {rc=256} 02:47:30.345244 --- ParallelTerminationStrategy: PID 31249 died... 02:47:30.364725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31249): Terminated: ok {rc=0} 02:47:30.410454 --- ParallelTerminationStrategy: PID 31250 died... 02:47:30.430094 run iperf3-srv_10.42.42.10(pid=31250): Terminated {rc=256} 02:47:30.475898 --- ParallelTerminationStrategy: PID 31253 died... 02:47:30.495623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31253): Terminated: ok {rc=0} 02:47:30.541392 --- ParallelTerminationStrategy: PID 31256 died... 02:47:30.561234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31256): Terminated: ok {rc=0} 02:47:30.607082 --- ParallelTerminationStrategy: PID 31259 died... 02:47:30.626774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31259): Terminated: ok {rc=0} 02:47:30.713984 bus /gobi_4: Setting Powered False 02:47:31.813849 bus /gobi_4: Setting Powered False 02:47:32.930567 bus /gobi_1: Setting Powered False 02:47:34.028154 bus /gobi_1: Setting Powered False 02:47:35.143421 bus /gobi_0: Setting Powered False 02:47:36.237947 bus /gobi_0: Setting Powered False 02:47:37.352613 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx ping.py ---------------------------------------------- 02:47:38.454978 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:38.466116 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 02:47:38.514094 tst ping.py: using LAC 38015 02:47:38.639247 tst ping.py: using RAC 20 02:47:38.766290 tst ping.py: using CellId 38015 02:47:38.890757 tst ping.py: using BVCI 38016 02:47:39.007909 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:39.018920 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:39.029782 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:39.040496 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:39.051528 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:39.062642 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:39.073885 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:39.084893 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:39.200696 tst ping.py:19: start network... 02:47:39.398571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:47:39.856586 run create_hlr_db(pid=31261): Launched 02:47:39.979565 bus /gobi_6: Setting Powered False 02:47:41.039343 run create_hlr_db(pid=31261): Terminated: ok {rc=0} 02:47:41.472459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31263): Launched 02:47:41.791644 run osmo-hlr_10.42.42.2(pid=31264): Launched 02:47:41.913269 run osmo-stp_10.42.42.5: Starting osmo-stp 02:47:42.463987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31266): Launched 02:47:42.783211 run osmo-stp_10.42.42.5(pid=31267): Launched 02:47:42.905324 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:47:43.456153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31269): Launched 02:47:43.578951 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:47:43.849063 run patchelf(pid=31270): Launched 02:47:44.026488 run osmo-stp_10.42.42.5(pid=31267): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31267)] 02:47:44.161392 run osmo-stp_10.42.42.5(pid=31267): stdout: | (launched: 2022-12-14_02:47:42.725009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:44.297491 run osmo-stp_10.42.42.5(pid=31267): stderr: | [0;m[38;5;43m20221214024742916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024742916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024742916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024742917 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024742917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024742917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024742917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:44.434036 run osmo-stp_10.42.42.5(pid=31267): stdout: | (launched: 2022-12-14_02:47:42.725009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:44.565096 run osmo-stp_10.42.42.5(pid=31267): stderr: | [0;m[38;5;43m20221214024742916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024742916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024742916 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024742917 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024742917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024742917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024742917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:44.720770 run patchelf(pid=31270): Terminating (SIGINT) 02:47:44.901068 run patchelf(pid=31270): Terminated: ok {rc=0} 02:47:45.031339 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31267): Process ended prematurely: osmo-stp_10.42.42.5(pid=31267) [trial-2398↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31267)] [trial-2398↪gprs:trx-umtrx↪ping.py:22] 02:47:45.040880 tst ping.py:22: Test FAILED (6.6 sec) 02:47:45.069065 run osmo-hlr_10.42.42.2(pid=31264): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31264)] 02:47:45.119269 run osmo-hlr_10.42.42.2(pid=31264): stdout: | (launched: 2022-12-14_02:47:41.733847) 02:47:45.171039 run osmo-hlr_10.42.42.2(pid=31264): stderr: | [0;m[1;31m20221214024741931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024741931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024741931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024741931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024741931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024741931 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024741944 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024741952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024741952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024741952 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:47:45.222793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31263): Terminating (SIGTERM) 02:47:45.264307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31266): Terminating (SIGTERM) 02:47:45.306431 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31269): Terminating (SIGTERM) 02:47:45.348373 --- ParallelTerminationStrategy: PID 31263 died... 02:47:45.368591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31263): Terminated: ok {rc=0} 02:47:45.414720 --- ParallelTerminationStrategy: PID 31266 died... 02:47:45.434731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31266): Terminated: ok {rc=0} 02:47:45.480771 --- ParallelTerminationStrategy: PID 31269 died... 02:47:45.500555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31269): Terminated: ok {rc=0} 02:47:45.589105 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 02:47:46.672319 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:46.684575 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 02:47:46.738480 tst ping_idle_ping.py: using LAC 38016 02:47:46.862119 tst ping_idle_ping.py: using RAC 21 02:47:46.983850 tst ping_idle_ping.py: using CellId 38016 02:47:47.113396 tst ping_idle_ping.py: using BVCI 38017 02:47:47.223004 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:47.234037 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:47.244343 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:47.254643 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:47.265016 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:47.275254 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:47.285671 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 02:47:47.295999 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 02:47:47.410664 tst ping_idle_ping.py:24: start network... 02:47:47.611356 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:47:48.074125 run create_hlr_db(pid=31271): Launched 02:47:48.195595 bus /gobi_6: Setting Powered False 02:47:49.254982 run create_hlr_db(pid=31271): Terminated: ok {rc=0} 02:47:49.691833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31273): Launched 02:47:50.012424 run osmo-hlr_10.42.42.2(pid=31274): Launched 02:47:50.134956 run osmo-stp_10.42.42.5: Starting osmo-stp 02:47:50.688334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31276): Launched 02:47:51.009203 run osmo-stp_10.42.42.5(pid=31277): Launched 02:47:51.132227 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:47:51.687156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31279): Launched 02:47:51.810933 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:47:52.081637 run patchelf(pid=31280): Launched 02:47:52.260453 run osmo-stp_10.42.42.5(pid=31277): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31277)] 02:47:52.396036 run osmo-stp_10.42.42.5(pid=31277): stdout: | (launched: 2022-12-14_02:47:50.950686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:52.533188 run osmo-stp_10.42.42.5(pid=31277): stderr: | [0;m[38;5;43m20221214024751143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024751144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024751144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024751144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024751145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024751145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024751145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:52.670334 run osmo-stp_10.42.42.5(pid=31277): stdout: | (launched: 2022-12-14_02:47:50.950686) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:47:52.803005 run osmo-stp_10.42.42.5(pid=31277): stderr: | [0;m[38;5;43m20221214024751143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024751144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024751144 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024751144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024751145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024751145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024751145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:47:52.959056 run patchelf(pid=31280): Terminating (SIGINT) 02:47:53.139698 run patchelf(pid=31280): Terminated: ok {rc=0} 02:47:53.270221 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31277): Process ended prematurely: osmo-stp_10.42.42.5(pid=31277) [trial-2398↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31277)] [trial-2398↪gprs:trx-umtrx↪ping_idle_ping.py:27] 02:47:53.279817 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 02:47:53.307951 run osmo-hlr_10.42.42.2(pid=31274): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31274)] 02:47:53.358796 run osmo-hlr_10.42.42.2(pid=31274): stdout: | (launched: 2022-12-14_02:47:49.954300) 02:47:53.411288 run osmo-hlr_10.42.42.2(pid=31274): stderr: | [0;m[1;31m20221214024750150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024750150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024750150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024750150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024750150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024750150 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024750162 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024750170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024750170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024750170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:47:53.464041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31273): Terminating (SIGTERM) 02:47:53.506001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31276): Terminating (SIGTERM) 02:47:53.548272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31279): Terminating (SIGTERM) 02:47:53.590980 --- ParallelTerminationStrategy: PID 31273 died... 02:47:53.611566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31273): Terminated: ok {rc=0} 02:47:53.658426 --- ParallelTerminationStrategy: PID 31276 died... 02:47:53.678390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31276): Terminated: ok {rc=0} 02:47:53.725151 --- ParallelTerminationStrategy: PID 31279 died... 02:47:53.745352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31279): Terminated: ok {rc=0} 02:47:53.834141 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 02:47:55.136411 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:47:55.142488 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:47:55.175155 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:47:55.215989 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:47:55.304714 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:47:55.337546 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:47:55.377286 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:47:55.970458 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:47:56.024096 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:56.035264 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:47:56.085680 tst cs_paging_gprs_active.py: using LAC 38017 02:47:56.207658 tst cs_paging_gprs_active.py: using RAC 22 02:47:56.326419 tst cs_paging_gprs_active.py: using CellId 38017 02:47:56.447742 tst cs_paging_gprs_active.py: using BVCI 38018 02:47:56.559663 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:56.570543 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:56.581169 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:56.591678 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:56.602097 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:56.612474 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:56.623644 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:56.634097 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:47:56.644753 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:47:56.766735 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:47:56.886930 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:47:57.106735 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:57.433405 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31286): Launched 02:47:57.718132 run iperf3-srv_10.42.42.10(pid=31287): Launched 02:47:57.840841 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:47:58.060857 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:47:58.388038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31288): Launched 02:47:58.672056 run iperf3-srv_10.42.42.10(pid=31289): Launched 02:47:58.795454 tst cs_paging_gprs_active.py:38: start network... 02:47:59.015134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:47:59.521151 run create_hlr_db(pid=31290): Launched 02:47:59.646303 bus /gobi_6: Setting Powered False 02:48:00.711248 run create_hlr_db(pid=31290): Terminated: ok {rc=0} 02:48:01.177481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31292): Launched 02:48:01.520108 run osmo-hlr_10.42.42.2(pid=31293): Launched 02:48:01.725843 run osmo-stp_10.42.42.5: Starting osmo-stp 02:48:02.509823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31295): Launched 02:48:02.812813 run osmo-stp_10.42.42.5(pid=31296): Launched 02:48:02.929158 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:48:03.450878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31298): Launched 02:48:03.565869 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:48:03.822312 run patchelf(pid=31299): Launched 02:48:03.989942 run osmo-stp_10.42.42.5(pid=31296): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31296)] 02:48:04.117233 run osmo-stp_10.42.42.5(pid=31296): stdout: | (launched: 2022-12-14_02:48:02.756708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:04.246195 run osmo-stp_10.42.42.5(pid=31296): stderr: | [0;m[38;5;43m20221214024802927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024802927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024802927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024802928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024802928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024802928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024802928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:04.375172 run osmo-stp_10.42.42.5(pid=31296): stdout: | (launched: 2022-12-14_02:48:02.756708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:04.498824 run osmo-stp_10.42.42.5(pid=31296): stderr: | [0;m[38;5;43m20221214024802927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024802927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024802927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024802928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024802928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024802928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024802928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:04.645087 run patchelf(pid=31299): Terminating (SIGINT) 02:48:04.815509 run patchelf(pid=31299): Terminated: ok {rc=0} 02:48:04.938170 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31296): Process ended prematurely: osmo-stp_10.42.42.5(pid=31296) [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31296)] [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:48:04.947590 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 02:48:04.974621 run osmo-hlr_10.42.42.2(pid=31293): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31293)] 02:48:05.021754 run osmo-hlr_10.42.42.2(pid=31293): stdout: | (launched: 2022-12-14_02:48:01.458530) 02:48:05.070507 run osmo-hlr_10.42.42.2(pid=31293): stderr: | [0;m[1;31m20221214024801915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024801916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024801916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024801917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024801917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024801917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024801941 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024801954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024801954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024801955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:48:05.119863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31286): Terminating (SIGTERM) 02:48:05.159275 run iperf3-srv_10.42.42.10(pid=31287): Terminating (SIGTERM) 02:48:05.198578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31288): Terminating (SIGTERM) 02:48:05.237956 run iperf3-srv_10.42.42.10(pid=31289): Terminating (SIGTERM) 02:48:05.277312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31292): Terminating (SIGTERM) 02:48:05.316863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31295): Terminating (SIGTERM) 02:48:05.356175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31298): Terminating (SIGTERM) 02:48:05.395820 --- ParallelTerminationStrategy: PID 31286 died... 02:48:05.414890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31286): Terminated: ok {rc=0} 02:48:05.458442 --- ParallelTerminationStrategy: PID 31287 died... 02:48:05.476695 run iperf3-srv_10.42.42.10(pid=31287): Terminated {rc=256} 02:48:05.520258 --- ParallelTerminationStrategy: PID 31288 died... 02:48:05.538747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31288): Terminated: ok {rc=0} 02:48:05.582141 --- ParallelTerminationStrategy: PID 31289 died... 02:48:05.600504 run iperf3-srv_10.42.42.10(pid=31289): Terminated {rc=256} 02:48:05.643737 --- ParallelTerminationStrategy: PID 31292 died... 02:48:05.662175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31292): Terminated: ok {rc=0} 02:48:05.705898 --- ParallelTerminationStrategy: PID 31295 died... 02:48:05.725200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31295): Terminated: ok {rc=0} 02:48:05.768670 --- ParallelTerminationStrategy: PID 31298 died... 02:48:05.787213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31298): Terminated: ok {rc=0} 02:48:05.872068 bus /gobi_0: Setting Powered False 02:48:06.971900 bus /gobi_0: Setting Powered False 02:48:08.085298 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:48:09.233959 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:09.246062 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:48:09.299730 tst iperf3.py: using LAC 38018 02:48:09.429245 tst iperf3.py: using RAC 23 02:48:09.556573 tst iperf3.py: using CellId 38018 02:48:09.676178 tst iperf3.py: using BVCI 38019 02:48:09.788242 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:09.799138 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:09.809745 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:09.820350 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:09.830890 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:09.841348 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:09.851971 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:09.862434 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:09.873156 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:09.988926 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:48:10.191125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:10.493534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31300): Launched 02:48:10.756513 run iperf3-srv_10.42.42.10(pid=31301): Launched 02:48:10.869519 tst iperf3.py:8: start network... 02:48:11.071111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:48:11.538065 run create_hlr_db(pid=31302): Launched 02:48:11.660744 bus /gobi_6: Setting Powered False 02:48:12.721494 run create_hlr_db(pid=31302): Terminated: ok {rc=0} 02:48:13.162322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31304): Launched 02:48:13.488168 run osmo-hlr_10.42.42.2(pid=31305): Launched 02:48:13.613468 run osmo-stp_10.42.42.5: Starting osmo-stp 02:48:14.180745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31307): Launched 02:48:14.505170 run osmo-stp_10.42.42.5(pid=31308): Launched 02:48:14.629803 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:48:15.191448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31310): Launched 02:48:15.315783 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:48:15.590456 run patchelf(pid=31311): Launched 02:48:15.771350 run osmo-stp_10.42.42.5(pid=31308): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31308)] 02:48:15.929410 run osmo-stp_10.42.42.5(pid=31308): stdout: | (launched: 2022-12-14_02:48:14.445899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:16.062499 run osmo-stp_10.42.42.5(pid=31308): stderr: | [0;m[38;5;43m20221214024814640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024814640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024814640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024814640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024814641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024814641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024814641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:16.196146 run osmo-stp_10.42.42.5(pid=31308): stdout: | (launched: 2022-12-14_02:48:14.445899) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:16.323180 run osmo-stp_10.42.42.5(pid=31308): stderr: | [0;m[38;5;43m20221214024814640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024814640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024814640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024814640 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024814641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024814641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024814641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:16.473924 run patchelf(pid=31311): Terminating (SIGINT) 02:48:16.678716 run patchelf(pid=31311): Terminated: ok {rc=0} 02:48:16.852257 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31308): Process ended prematurely: osmo-stp_10.42.42.5(pid=31308) [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31308)] [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 02:48:16.864407 tst iperf3.py:8: Test FAILED (7.7 sec) 02:48:16.899258 run osmo-hlr_10.42.42.2(pid=31305): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31305)] 02:48:16.967158 run osmo-hlr_10.42.42.2(pid=31305): stdout: | (launched: 2022-12-14_02:48:13.428781) 02:48:17.032408 run osmo-hlr_10.42.42.2(pid=31305): stderr: | [0;m[1;31m20221214024813629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024813629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024813629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024813629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024813629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024813630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024813645 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024813653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024813653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024813653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:48:17.099522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31300): Terminating (SIGTERM) 02:48:17.142440 run iperf3-srv_10.42.42.10(pid=31301): Terminating (SIGTERM) 02:48:17.184754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31304): Terminating (SIGTERM) 02:48:17.226725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31307): Terminating (SIGTERM) 02:48:17.270499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31310): Terminating (SIGTERM) 02:48:17.310764 --- ParallelTerminationStrategy: PID 31300 died... 02:48:17.329449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31300): Terminated: ok {rc=0} 02:48:17.373122 --- ParallelTerminationStrategy: PID 31301 died... 02:48:17.391683 run iperf3-srv_10.42.42.10(pid=31301): Terminated {rc=256} 02:48:17.435215 --- ParallelTerminationStrategy: PID 31304 died... 02:48:17.453715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31304): Terminated: ok {rc=0} 02:48:17.497272 --- ParallelTerminationStrategy: PID 31307 died... 02:48:17.515853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31307): Terminated: ok {rc=0} 02:48:17.559651 --- ParallelTerminationStrategy: PID 31310 died... 02:48:17.578241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31310): Terminated: ok {rc=0} 02:48:17.663907 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:48:18.810769 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:18.822049 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:48:18.871229 tst iperf3m4.py: using LAC 38019 02:48:18.989595 tst iperf3m4.py: using RAC 24 02:48:19.111045 tst iperf3m4.py: using CellId 38019 02:48:19.230834 tst iperf3m4.py: using BVCI 38020 02:48:19.342279 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:19.353049 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:19.363550 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:19.374096 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:19.384497 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:19.395324 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:19.406362 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:19.416693 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:19.427290 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:19.544325 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:19.667412 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:19.788764 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:19.911396 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:48:20.132116 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:20.458117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31312): Launched 02:48:20.742004 run iperf3-srv_10.42.42.10(pid=31313): Launched 02:48:20.856607 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:48:21.059312 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:21.363042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31314): Launched 02:48:21.625892 run iperf3-srv_10.42.42.10(pid=31315): Launched 02:48:21.739079 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:48:21.941669 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:22.244364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31316): Launched 02:48:22.507332 run iperf3-srv_10.42.42.10(pid=31317): Launched 02:48:22.620256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:48:22.822051 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:23.125313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31318): Launched 02:48:23.388083 run iperf3-srv_10.42.42.10(pid=31319): Launched 02:48:23.501065 tst iperf3m4.py:8: start network... 02:48:23.703138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:48:24.172274 run create_hlr_db(pid=31320): Launched 02:48:24.295407 bus /gobi_6: Setting Powered False 02:48:25.355882 run create_hlr_db(pid=31320): Terminated: ok {rc=0} 02:48:25.776244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31322): Launched 02:48:26.079103 run osmo-hlr_10.42.42.2(pid=31323): Launched 02:48:26.193632 run osmo-stp_10.42.42.5: Starting osmo-stp 02:48:26.714835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31325): Launched 02:48:27.017062 run osmo-stp_10.42.42.5(pid=31326): Launched 02:48:27.132569 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:48:27.655351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31328): Launched 02:48:27.770535 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:48:28.027109 run patchelf(pid=31329): Launched 02:48:28.195143 run osmo-stp_10.42.42.5(pid=31326): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31326)] 02:48:28.323026 run osmo-stp_10.42.42.5(pid=31326): stdout: | (launched: 2022-12-14_02:48:26.961102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:28.452123 run osmo-stp_10.42.42.5(pid=31326): stderr: | [0;m[38;5;43m20221214024827132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024827132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024827132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024827133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024827133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024827133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024827133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:28.581232 run osmo-stp_10.42.42.5(pid=31326): stdout: | (launched: 2022-12-14_02:48:26.961102) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:28.704798 run osmo-stp_10.42.42.5(pid=31326): stderr: | [0;m[38;5;43m20221214024827132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024827132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024827132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024827133 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024827133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024827133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024827133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:28.851781 run patchelf(pid=31329): Terminating (SIGINT) 02:48:29.022699 run patchelf(pid=31329): Terminated: ok {rc=0} 02:48:29.145657 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31326): Process ended prematurely: osmo-stp_10.42.42.5(pid=31326) [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31326)] [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 02:48:29.155040 tst iperf3m4.py:8: Test FAILED (10.4 sec) 02:48:29.182397 run osmo-hlr_10.42.42.2(pid=31323): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31323)] 02:48:29.230151 run osmo-hlr_10.42.42.2(pid=31323): stdout: | (launched: 2022-12-14_02:48:26.023401) 02:48:29.279346 run osmo-hlr_10.42.42.2(pid=31323): stderr: | [0;m[1;31m20221214024826201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024826201 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024826202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024826202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024826202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024826202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024826214 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024826222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024826223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024826223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:48:29.329149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31312): Terminating (SIGTERM) 02:48:29.368759 run iperf3-srv_10.42.42.10(pid=31313): Terminating (SIGTERM) 02:48:29.408057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31314): Terminating (SIGTERM) 02:48:29.447497 run iperf3-srv_10.42.42.10(pid=31315): Terminating (SIGTERM) 02:48:29.486799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31316): Terminating (SIGTERM) 02:48:29.526263 run iperf3-srv_10.42.42.10(pid=31317): Terminating (SIGTERM) 02:48:29.565488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31318): Terminating (SIGTERM) 02:48:29.604761 run iperf3-srv_10.42.42.10(pid=31319): Terminating (SIGTERM) 02:48:29.643877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31322): Terminating (SIGTERM) 02:48:29.683269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31325): Terminating (SIGTERM) 02:48:29.722577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31328): Terminating (SIGTERM) 02:48:29.762355 --- ParallelTerminationStrategy: PID 31312 died... 02:48:29.781489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31312): Terminated: ok {rc=0} 02:48:29.825251 --- ParallelTerminationStrategy: PID 31313 died... 02:48:29.843717 run iperf3-srv_10.42.42.10(pid=31313): Terminated {rc=256} 02:48:29.887311 --- ParallelTerminationStrategy: PID 31314 died... 02:48:29.906286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31314): Terminated: ok {rc=0} 02:48:29.950406 --- ParallelTerminationStrategy: PID 31315 died... 02:48:29.968859 run iperf3-srv_10.42.42.10(pid=31315): Terminated {rc=256} 02:48:30.012878 --- ParallelTerminationStrategy: PID 31316 died... 02:48:30.031560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31316): Terminated: ok {rc=0} 02:48:30.075203 --- ParallelTerminationStrategy: PID 31317 died... 02:48:30.093785 run iperf3-srv_10.42.42.10(pid=31317): Terminated {rc=256} 02:48:30.137323 --- ParallelTerminationStrategy: PID 31318 died... 02:48:30.155999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31318): Terminated: ok {rc=0} 02:48:30.199703 --- ParallelTerminationStrategy: PID 31319 died... 02:48:30.218343 run iperf3-srv_10.42.42.10(pid=31319): Terminated {rc=256} 02:48:30.261891 --- ParallelTerminationStrategy: PID 31322 died... 02:48:30.280561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31322): Terminated: ok {rc=0} 02:48:30.324416 --- ParallelTerminationStrategy: PID 31325 died... 02:48:30.343202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31325): Terminated: ok {rc=0} 02:48:30.386964 --- ParallelTerminationStrategy: PID 31328 died... 02:48:30.405662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31328): Terminated: ok {rc=0} 02:48:30.489432 bus /gobi_4: Setting Powered False 02:48:31.591416 bus /gobi_4: Setting Powered False 02:48:32.707476 bus /gobi_1: Setting Powered False 02:48:33.804460 bus /gobi_1: Setting Powered False 02:48:34.919733 bus /gobi_0: Setting Powered False 02:48:36.017646 bus /gobi_0: Setting Powered False 02:48:37.137318 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 02:48:38.241731 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:38.253678 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:48:38.305456 tst ping.py: using LAC 38020 02:48:38.432620 tst ping.py: using RAC 25 02:48:38.557943 tst ping.py: using CellId 38020 02:48:38.684439 tst ping.py: using BVCI 38021 02:48:38.801292 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:38.812470 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:38.823632 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:38.834741 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:38.846188 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:38.857615 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:38.869168 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:38.880514 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:38.995625 tst ping.py:19: start network... 02:48:39.193608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:48:39.652918 run create_hlr_db(pid=31330): Launched 02:48:39.775678 bus /gobi_6: Setting Powered False 02:48:40.835332 run create_hlr_db(pid=31330): Terminated: ok {rc=0} 02:48:41.270624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31332): Launched 02:48:41.590040 run osmo-hlr_10.42.42.2(pid=31333): Launched 02:48:41.712516 run osmo-stp_10.42.42.5: Starting osmo-stp 02:48:42.266824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31335): Launched 02:48:42.586220 run osmo-stp_10.42.42.5(pid=31336): Launched 02:48:42.708408 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:48:43.259790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31338): Launched 02:48:43.382322 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:48:43.651848 run patchelf(pid=31339): Launched 02:48:43.830263 run osmo-stp_10.42.42.5(pid=31336): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31336)] 02:48:43.965674 run osmo-stp_10.42.42.5(pid=31336): stdout: | (launched: 2022-12-14_02:48:42.528275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:44.103108 run osmo-stp_10.42.42.5(pid=31336): stderr: | [0;m[38;5;43m20221214024842718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024842719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024842719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024842719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024842720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024842720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024842720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:44.239966 run osmo-stp_10.42.42.5(pid=31336): stdout: | (launched: 2022-12-14_02:48:42.528275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:44.371434 run osmo-stp_10.42.42.5(pid=31336): stderr: | [0;m[38;5;43m20221214024842718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024842719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024842719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024842719 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024842720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024842720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024842720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:44.527165 run patchelf(pid=31339): Terminating (SIGINT) 02:48:44.707638 run patchelf(pid=31339): Terminated: ok {rc=0} 02:48:44.838419 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31336): Process ended prematurely: osmo-stp_10.42.42.5(pid=31336) [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31336)] [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 02:48:44.847979 tst ping.py:22: Test FAILED (6.6 sec) 02:48:44.876150 run osmo-hlr_10.42.42.2(pid=31333): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31333)] 02:48:44.926853 run osmo-hlr_10.42.42.2(pid=31333): stdout: | (launched: 2022-12-14_02:48:41.531258) 02:48:44.979240 run osmo-hlr_10.42.42.2(pid=31333): stderr: | [0;m[1;31m20221214024841729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024841729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024841729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024841729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024841729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024841729 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024841743 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024841751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024841752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024841752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:48:45.031761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31332): Terminating (SIGTERM) 02:48:45.073608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31335): Terminating (SIGTERM) 02:48:45.115990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31338): Terminating (SIGTERM) 02:48:45.158657 --- ParallelTerminationStrategy: PID 31332 died... 02:48:45.179326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31332): Terminated: ok {rc=0} 02:48:45.226175 --- ParallelTerminationStrategy: PID 31335 died... 02:48:45.246191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31335): Terminated: ok {rc=0} 02:48:45.292556 --- ParallelTerminationStrategy: PID 31338 died... 02:48:45.312635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31338): Terminated: ok {rc=0} 02:48:45.401430 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:48:46.485739 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:46.498328 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:48:46.550877 tst ping_idle_ping.py: using LAC 38021 02:48:46.702885 tst ping_idle_ping.py: using RAC 26 02:48:46.825431 tst ping_idle_ping.py: using CellId 38021 02:48:46.959223 tst ping_idle_ping.py: using BVCI 38022 02:48:47.100121 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:47.112121 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:47.124234 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:47.135928 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:47.148536 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:47.161231 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:47.174069 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:48:47.186639 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:48:47.308539 tst ping_idle_ping.py:24: start network... 02:48:47.508408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:48:47.970179 run create_hlr_db(pid=31340): Launched 02:48:48.092083 bus /gobi_6: Setting Powered False 02:48:49.152570 run create_hlr_db(pid=31340): Terminated: ok {rc=0} 02:48:49.590658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31342): Launched 02:48:49.913608 run osmo-hlr_10.42.42.2(pid=31343): Launched 02:48:50.037282 run osmo-stp_10.42.42.5: Starting osmo-stp 02:48:50.590371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31345): Launched 02:48:50.911443 run osmo-stp_10.42.42.5(pid=31346): Launched 02:48:51.034771 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:48:51.588419 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31348): Launched 02:48:51.711748 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:48:51.985276 run patchelf(pid=31349): Launched 02:48:52.163790 run osmo-stp_10.42.42.5(pid=31346): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31346)] 02:48:52.299823 run osmo-stp_10.42.42.5(pid=31346): stdout: | (launched: 2022-12-14_02:48:50.852806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:52.437550 run osmo-stp_10.42.42.5(pid=31346): stderr: | [0;m[38;5;43m20221214024851043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024851044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024851044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024851044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024851045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024851045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024851045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:52.575153 run osmo-stp_10.42.42.5(pid=31346): stdout: | (launched: 2022-12-14_02:48:50.852806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:48:52.707265 run osmo-stp_10.42.42.5(pid=31346): stderr: | [0;m[38;5;43m20221214024851043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024851044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024851044 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024851044 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024851045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024851045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024851045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:48:52.864135 run patchelf(pid=31349): Terminating (SIGINT) 02:48:53.045587 run patchelf(pid=31349): Terminated: ok {rc=0} 02:48:53.176680 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31346): Process ended prematurely: osmo-stp_10.42.42.5(pid=31346) [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31346)] [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 02:48:53.186877 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 02:48:53.215016 run osmo-hlr_10.42.42.2(pid=31343): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31343)] 02:48:53.265709 run osmo-hlr_10.42.42.2(pid=31343): stdout: | (launched: 2022-12-14_02:48:49.855034) 02:48:53.318209 run osmo-hlr_10.42.42.2(pid=31343): stderr: | [0;m[1;31m20221214024850054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024850054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024850055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024850055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024850055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024850055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024850071 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024850081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024850081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024850081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:48:53.371164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31342): Terminating (SIGTERM) 02:48:53.413203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31345): Terminating (SIGTERM) 02:48:53.456004 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31348): Terminating (SIGTERM) 02:48:53.498631 --- ParallelTerminationStrategy: PID 31342 died... 02:48:53.519139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31342): Terminated: ok {rc=0} 02:48:53.565781 --- ParallelTerminationStrategy: PID 31345 died... 02:48:53.585756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31345): Terminated: ok {rc=0} 02:48:53.632088 --- ParallelTerminationStrategy: PID 31348 died... 02:48:53.652048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31348): Terminated: ok {rc=0} 02:48:53.740268 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:48:55.043249 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:48:55.049766 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:48:55.082359 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:48:55.122156 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:48:55.210208 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:48:55.243033 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:48:55.282182 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:48:55.876065 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:48:55.928837 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:55.940062 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:48:56.010095 tst cs_paging_gprs_active.py: using LAC 38022 02:48:56.145144 tst cs_paging_gprs_active.py: using RAC 27 02:48:56.265616 tst cs_paging_gprs_active.py: using CellId 38022 02:48:56.383412 tst cs_paging_gprs_active.py: using BVCI 38023 02:48:56.493685 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:56.504451 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:56.515242 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:56.525887 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:56.536316 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:56.547305 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:56.558219 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:56.568875 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:48:56.579896 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:48:56.702372 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:48:56.818948 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:48:57.021929 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:57.325423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31353): Launched 02:48:57.589261 run iperf3-srv_10.42.42.10(pid=31354): Launched 02:48:57.702488 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:48:57.904675 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:48:58.208715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31355): Launched 02:48:58.471911 run iperf3-srv_10.42.42.10(pid=31356): Launched 02:48:58.584736 tst cs_paging_gprs_active.py:38: start network... 02:48:58.786830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:48:59.254889 run create_hlr_db(pid=31357): Launched 02:48:59.378637 bus /gobi_6: Setting Powered False 02:49:00.438682 run create_hlr_db(pid=31357): Terminated: ok {rc=0} 02:49:00.907457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31359): Launched 02:49:01.257691 run osmo-hlr_10.42.42.2(pid=31360): Launched 02:49:01.451484 run osmo-stp_10.42.42.5: Starting osmo-stp 02:49:02.153779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31362): Launched 02:49:02.484333 run osmo-stp_10.42.42.5(pid=31363): Launched 02:49:02.599687 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:49:03.121432 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31365): Launched 02:49:03.236417 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:49:03.498671 run patchelf(pid=31366): Launched 02:49:03.667571 run osmo-stp_10.42.42.5(pid=31363): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31363)] 02:49:03.796336 run osmo-stp_10.42.42.5(pid=31363): stdout: | (launched: 2022-12-14_02:49:02.428882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:03.926220 run osmo-stp_10.42.42.5(pid=31363): stderr: | [0;m[38;5;43m20221214024902599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024902599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024902600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024902600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024902602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024902602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024902602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:04.056222 run osmo-stp_10.42.42.5(pid=31363): stdout: | (launched: 2022-12-14_02:49:02.428882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:04.181187 run osmo-stp_10.42.42.5(pid=31363): stderr: | [0;m[38;5;43m20221214024902599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024902599 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024902600 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024902600 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024902602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024902602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024902602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:04.328685 run patchelf(pid=31366): Terminating (SIGINT) 02:49:04.500186 run patchelf(pid=31366): Terminated: ok {rc=0} 02:49:04.623720 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31363): Process ended prematurely: osmo-stp_10.42.42.5(pid=31363) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31363)] [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:49:04.633335 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:49:04.660364 run osmo-hlr_10.42.42.2(pid=31360): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31360)] 02:49:04.707878 run osmo-hlr_10.42.42.2(pid=31360): stdout: | (launched: 2022-12-14_02:49:01.191495) 02:49:04.756913 run osmo-hlr_10.42.42.2(pid=31360): stderr: | [0;m[1;31m20221214024901494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024901494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024901494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024901494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024901494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024901494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024901513 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024901526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024901526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024901526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:49:04.806458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31353): Terminating (SIGTERM) 02:49:04.846333 run iperf3-srv_10.42.42.10(pid=31354): Terminating (SIGTERM) 02:49:04.885837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31355): Terminating (SIGTERM) 02:49:04.925433 run iperf3-srv_10.42.42.10(pid=31356): Terminating (SIGTERM) 02:49:04.964986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31359): Terminating (SIGTERM) 02:49:05.004478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31362): Terminating (SIGTERM) 02:49:05.044213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31365): Terminating (SIGTERM) 02:49:05.084204 --- ParallelTerminationStrategy: PID 31353 died... 02:49:05.103639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31353): Terminated: ok {rc=0} 02:49:05.147525 --- ParallelTerminationStrategy: PID 31354 died... 02:49:05.166271 run iperf3-srv_10.42.42.10(pid=31354): Terminated {rc=256} 02:49:05.210067 --- ParallelTerminationStrategy: PID 31355 died... 02:49:05.228564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31355): Terminated: ok {rc=0} 02:49:05.272266 --- ParallelTerminationStrategy: PID 31356 died... 02:49:05.291022 run iperf3-srv_10.42.42.10(pid=31356): Terminated {rc=256} 02:49:05.334593 --- ParallelTerminationStrategy: PID 31359 died... 02:49:05.353855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31359): Terminated: ok {rc=0} 02:49:05.397673 --- ParallelTerminationStrategy: PID 31362 died... 02:49:05.416145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31362): Terminated: ok {rc=0} 02:49:05.460171 --- ParallelTerminationStrategy: PID 31365 died... 02:49:05.478693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31365): Terminated: ok {rc=0} 02:49:05.563820 bus /gobi_0: Setting Powered False 02:49:06.662250 bus /gobi_0: Setting Powered False 02:49:07.776877 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:49:08.927674 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:08.939516 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:49:09.010468 tst iperf3.py: using LAC 38023 02:49:09.139980 tst iperf3.py: using RAC 28 02:49:09.267265 tst iperf3.py: using CellId 38023 02:49:09.397472 tst iperf3.py: using BVCI 38024 02:49:09.510339 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:09.521341 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:09.532148 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:09.542925 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:09.553471 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:09.564260 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:09.574951 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:09.585509 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:09.596165 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:09.716525 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:49:09.936863 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:10.262651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31367): Launched 02:49:10.545812 run iperf3-srv_10.42.42.10(pid=31368): Launched 02:49:10.668134 tst iperf3.py:8: start network... 02:49:10.888223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:49:11.391089 run create_hlr_db(pid=31369): Launched 02:49:11.514865 bus /gobi_6: Setting Powered False 02:49:12.579647 run create_hlr_db(pid=31369): Terminated: ok {rc=0} 02:49:13.011277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31371): Launched 02:49:13.312392 run osmo-hlr_10.42.42.2(pid=31372): Launched 02:49:13.427750 run osmo-stp_10.42.42.5: Starting osmo-stp 02:49:14.057061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31374): Launched 02:49:14.352284 run osmo-stp_10.42.42.5(pid=31375): Launched 02:49:14.463926 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:49:14.974284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31377): Launched 02:49:15.086898 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:49:15.336690 run patchelf(pid=31378): Launched 02:49:15.501485 run osmo-stp_10.42.42.5(pid=31375): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31375)] 02:49:15.626948 run osmo-stp_10.42.42.5(pid=31375): stdout: | (launched: 2022-12-14_02:49:14.298124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:15.753447 run osmo-stp_10.42.42.5(pid=31375): stderr: | [0;m[38;5;43m20221214024914470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024914470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024914470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024914470 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024914471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024914471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024914471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:15.895122 run osmo-stp_10.42.42.5(pid=31375): stdout: | (launched: 2022-12-14_02:49:14.298124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:16.023667 run osmo-stp_10.42.42.5(pid=31375): stderr: | [0;m[38;5;43m20221214024914470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024914470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024914470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024914470 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024914471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024914471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024914471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:16.170436 run patchelf(pid=31378): Terminating (SIGINT) 02:49:16.342057 run patchelf(pid=31378): Terminated: ok {rc=0} 02:49:16.465842 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31375): Process ended prematurely: osmo-stp_10.42.42.5(pid=31375) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31375)] [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 02:49:16.476492 tst iperf3.py:8: Test FAILED (7.6 sec) 02:49:16.504778 run osmo-hlr_10.42.42.2(pid=31372): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31372)] 02:49:16.552927 run osmo-hlr_10.42.42.2(pid=31372): stdout: | (launched: 2022-12-14_02:49:13.257117) 02:49:16.603260 run osmo-hlr_10.42.42.2(pid=31372): stderr: | [0;m[1;31m20221214024913435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024913435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024913435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024913435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024913435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024913435 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024913447 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024913456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024913456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024913456 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:49:16.654201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31367): Terminating (SIGTERM) 02:49:16.695095 run iperf3-srv_10.42.42.10(pid=31368): Terminating (SIGTERM) 02:49:16.738612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31371): Terminating (SIGTERM) 02:49:16.779912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31374): Terminating (SIGTERM) 02:49:16.821403 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31377): Terminating (SIGTERM) 02:49:16.864116 --- ParallelTerminationStrategy: PID 31367 died... 02:49:16.883616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31367): Terminated: ok {rc=0} 02:49:16.928472 --- ParallelTerminationStrategy: PID 31368 died... 02:49:16.947612 run iperf3-srv_10.42.42.10(pid=31368): Terminated {rc=256} 02:49:16.992378 --- ParallelTerminationStrategy: PID 31371 died... 02:49:17.011661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31371): Terminated: ok {rc=0} 02:49:17.056098 --- ParallelTerminationStrategy: PID 31374 died... 02:49:17.075183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31374): Terminated: ok {rc=0} 02:49:17.119835 --- ParallelTerminationStrategy: PID 31377 died... 02:49:17.139096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31377): Terminated: ok {rc=0} 02:49:17.223554 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:49:18.372008 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:18.383903 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:49:18.454792 tst iperf3m4.py: using LAC 38024 02:49:18.581720 tst iperf3m4.py: using RAC 29 02:49:18.698368 tst iperf3m4.py: using CellId 38024 02:49:18.816893 tst iperf3m4.py: using BVCI 38025 02:49:18.933424 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:18.944572 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:18.955596 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:18.966597 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:18.977903 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:18.989717 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:19.001160 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:19.012500 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:19.024018 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:19.139894 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:19.261751 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:19.376835 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:19.497621 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:49:19.694958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:19.991075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31379): Launched 02:49:20.248226 run iperf3-srv_10.42.42.10(pid=31380): Launched 02:49:20.359828 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:49:20.557189 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:20.854277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31381): Launched 02:49:21.111572 run iperf3-srv_10.42.42.10(pid=31382): Launched 02:49:21.222175 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:49:21.419203 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:21.715452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31383): Launched 02:49:21.972340 run iperf3-srv_10.42.42.10(pid=31384): Launched 02:49:22.082792 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:49:22.279952 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:22.578085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31385): Launched 02:49:22.835499 run iperf3-srv_10.42.42.10(pid=31386): Launched 02:49:22.946467 tst iperf3m4.py:8: start network... 02:49:23.143263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:49:23.604473 run create_hlr_db(pid=31387): Launched 02:49:23.728118 bus /gobi_6: Setting Powered False 02:49:24.791283 run create_hlr_db(pid=31387): Terminated: ok {rc=0} 02:49:25.234846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31389): Launched 02:49:25.552117 run osmo-hlr_10.42.42.2(pid=31390): Launched 02:49:25.674668 run osmo-stp_10.42.42.5: Starting osmo-stp 02:49:26.188833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31392): Launched 02:49:26.485193 run osmo-stp_10.42.42.5(pid=31393): Launched 02:49:26.597275 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:49:27.107958 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31395): Launched 02:49:27.221165 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:49:27.471292 run patchelf(pid=31396): Launched 02:49:27.636755 run osmo-stp_10.42.42.5(pid=31393): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31393)] 02:49:27.762863 run osmo-stp_10.42.42.5(pid=31393): stdout: | (launched: 2022-12-14_02:49:26.430751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:27.889928 run osmo-stp_10.42.42.5(pid=31393): stderr: | [0;m[38;5;43m20221214024926601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024926601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024926601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024926601 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024926602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024926602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024926602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:28.016902 run osmo-stp_10.42.42.5(pid=31393): stdout: | (launched: 2022-12-14_02:49:26.430751) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:28.139221 run osmo-stp_10.42.42.5(pid=31393): stderr: | [0;m[38;5;43m20221214024926601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024926601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024926601 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024926601 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024926602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024926602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024926602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:28.283308 run patchelf(pid=31396): Terminating (SIGINT) 02:49:28.451546 run patchelf(pid=31396): Terminated: ok {rc=0} 02:49:28.572401 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31393): Process ended prematurely: osmo-stp_10.42.42.5(pid=31393) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31393)] [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:49:28.582055 tst iperf3m4.py:8: Test FAILED (10.2 sec) 02:49:28.609226 run osmo-hlr_10.42.42.2(pid=31390): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31390)] 02:49:28.656907 run osmo-hlr_10.42.42.2(pid=31390): stdout: | (launched: 2022-12-14_02:49:25.494312) 02:49:28.706192 run osmo-hlr_10.42.42.2(pid=31390): stderr: | [0;m[1;31m20221214024925691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024925691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024925691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024925691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024925691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024925691 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024925704 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024925711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024925712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024925712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:49:28.755920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31379): Terminating (SIGTERM) 02:49:28.795894 run iperf3-srv_10.42.42.10(pid=31380): Terminating (SIGTERM) 02:49:28.835631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31381): Terminating (SIGTERM) 02:49:28.875441 run iperf3-srv_10.42.42.10(pid=31382): Terminating (SIGTERM) 02:49:28.914971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31383): Terminating (SIGTERM) 02:49:28.954576 run iperf3-srv_10.42.42.10(pid=31384): Terminating (SIGTERM) 02:49:28.993995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31385): Terminating (SIGTERM) 02:49:29.033611 run iperf3-srv_10.42.42.10(pid=31386): Terminating (SIGTERM) 02:49:29.073158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31389): Terminating (SIGTERM) 02:49:29.112881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31392): Terminating (SIGTERM) 02:49:29.152540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31395): Terminating (SIGTERM) 02:49:29.192549 --- ParallelTerminationStrategy: PID 31379 died... 02:49:29.211686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31379): Terminated: ok {rc=0} 02:49:29.255448 --- ParallelTerminationStrategy: PID 31380 died... 02:49:29.273958 run iperf3-srv_10.42.42.10(pid=31380): Terminated {rc=256} 02:49:29.317235 --- ParallelTerminationStrategy: PID 31381 died... 02:49:29.335463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31381): Terminated: ok {rc=0} 02:49:29.378832 --- ParallelTerminationStrategy: PID 31382 died... 02:49:29.397919 run iperf3-srv_10.42.42.10(pid=31382): Terminated {rc=256} 02:49:29.441147 --- ParallelTerminationStrategy: PID 31383 died... 02:49:29.459506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31383): Terminated: ok {rc=0} 02:49:29.503192 --- ParallelTerminationStrategy: PID 31384 died... 02:49:29.521799 run iperf3-srv_10.42.42.10(pid=31384): Terminated {rc=256} 02:49:29.565149 --- ParallelTerminationStrategy: PID 31385 died... 02:49:29.583665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31385): Terminated: ok {rc=0} 02:49:29.627205 --- ParallelTerminationStrategy: PID 31386 died... 02:49:29.645745 run iperf3-srv_10.42.42.10(pid=31386): Terminated {rc=256} 02:49:29.689276 --- ParallelTerminationStrategy: PID 31389 died... 02:49:29.707773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31389): Terminated: ok {rc=0} 02:49:29.751103 --- ParallelTerminationStrategy: PID 31392 died... 02:49:29.769603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31392): Terminated: ok {rc=0} 02:49:29.813128 --- ParallelTerminationStrategy: PID 31395 died... 02:49:29.831585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31395): Terminated: ok {rc=0} 02:49:29.916442 bus /gobi_4: Setting Powered False 02:49:31.016481 bus /gobi_4: Setting Powered False 02:49:32.133541 bus /gobi_1: Setting Powered False 02:49:33.231592 bus /gobi_1: Setting Powered False 02:49:34.347072 bus /gobi_0: Setting Powered False 02:49:35.445200 bus /gobi_0: Setting Powered False 02:49:36.561915 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:49:37.666071 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:37.678802 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:49:37.746664 tst ping.py: using LAC 38025 02:49:37.862729 tst ping.py: using RAC 30 02:49:37.978595 tst ping.py: using CellId 38025 02:49:38.103566 tst ping.py: using BVCI 38026 02:49:38.217397 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:38.228577 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:38.239628 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:38.250737 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:38.262078 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:38.273585 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:38.285068 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:38.297032 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:38.431673 tst ping.py:19: start network... 02:49:38.662867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:49:39.151941 run create_hlr_db(pid=31397): Launched 02:49:39.270635 bus /gobi_6: Setting Powered False 02:49:40.332902 run create_hlr_db(pid=31397): Terminated: ok {rc=0} 02:49:40.753375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31399): Launched 02:49:41.045560 run osmo-hlr_10.42.42.2(pid=31400): Launched 02:49:41.156059 run osmo-stp_10.42.42.5: Starting osmo-stp 02:49:41.673015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31402): Launched 02:49:41.966412 run osmo-stp_10.42.42.5(pid=31403): Launched 02:49:42.078073 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:49:42.584177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31405): Launched 02:49:42.695443 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:49:42.942947 run patchelf(pid=31406): Launched 02:49:43.106171 run osmo-stp_10.42.42.5(pid=31403): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31403)] 02:49:43.229970 run osmo-stp_10.42.42.5(pid=31403): stdout: | (launched: 2022-12-14_02:49:41.911916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:43.355729 run osmo-stp_10.42.42.5(pid=31403): stderr: | [0;m[38;5;43m20221214024942082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024942083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024942083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024942083 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024942084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024942084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024942084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:43.481278 run osmo-stp_10.42.42.5(pid=31403): stdout: | (launched: 2022-12-14_02:49:41.911916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:43.601401 run osmo-stp_10.42.42.5(pid=31403): stderr: | [0;m[38;5;43m20221214024942082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024942083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024942083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024942083 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024942084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024942084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024942084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:43.743479 run patchelf(pid=31406): Terminating (SIGINT) 02:49:43.909185 run patchelf(pid=31406): Terminated: ok {rc=0} 02:49:44.028388 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31403): Process ended prematurely: osmo-stp_10.42.42.5(pid=31403) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31403)] [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 02:49:44.037423 tst ping.py:22: Test FAILED (6.4 sec) 02:49:44.063736 run osmo-hlr_10.42.42.2(pid=31400): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31400)] 02:49:44.110947 run osmo-hlr_10.42.42.2(pid=31400): stdout: | (launched: 2022-12-14_02:49:40.991457) 02:49:44.159723 run osmo-hlr_10.42.42.2(pid=31400): stderr: | [0;m[1;31m20221214024941167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024941167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024941167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024941167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024941167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024941167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024941180 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024941190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024941190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024941190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:49:44.209360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31399): Terminating (SIGTERM) 02:49:44.248835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31402): Terminating (SIGTERM) 02:49:44.288297 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31405): Terminating (SIGTERM) 02:49:44.327902 --- ParallelTerminationStrategy: PID 31399 died... 02:49:44.346813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31399): Terminated: ok {rc=0} 02:49:44.390355 --- ParallelTerminationStrategy: PID 31402 died... 02:49:44.408585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31402): Terminated: ok {rc=0} 02:49:44.452125 --- ParallelTerminationStrategy: PID 31405 died... 02:49:44.470716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31405): Terminated: ok {rc=0} 02:49:44.556509 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:49:45.644345 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:45.655952 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:49:45.730017 tst ping_idle_ping.py: using LAC 38026 02:49:45.855508 tst ping_idle_ping.py: using RAC 31 02:49:45.989543 tst ping_idle_ping.py: using CellId 38026 02:49:46.115817 tst ping_idle_ping.py: using BVCI 38027 02:49:46.224080 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:46.235467 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:46.246713 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:46.257984 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:46.269465 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:46.280861 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:46.292332 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:49:46.303710 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:49:46.419707 tst ping_idle_ping.py:24: start network... 02:49:46.618892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:49:47.085575 run create_hlr_db(pid=31407): Launched 02:49:47.238724 bus /gobi_6: Setting Powered False 02:49:48.297760 run create_hlr_db(pid=31407): Terminated: ok {rc=0} 02:49:48.728601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31409): Launched 02:49:49.042065 run osmo-hlr_10.42.42.2(pid=31410): Launched 02:49:49.162074 run osmo-stp_10.42.42.5: Starting osmo-stp 02:49:49.702116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31412): Launched 02:49:50.018271 run osmo-stp_10.42.42.5(pid=31413): Launched 02:49:50.139103 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:49:50.683915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31415): Launched 02:49:50.800617 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:49:51.048815 run patchelf(pid=31416): Launched 02:49:51.211735 run osmo-stp_10.42.42.5(pid=31413): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31413)] 02:49:51.335982 run osmo-stp_10.42.42.5(pid=31413): stdout: | (launched: 2022-12-14_02:49:49.960759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:51.461407 run osmo-stp_10.42.42.5(pid=31413): stderr: | [0;m[38;5;43m20221214024950153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024950153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024950154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024950154 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024950154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024950155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024950155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:51.586951 run osmo-stp_10.42.42.5(pid=31413): stdout: | (launched: 2022-12-14_02:49:49.960759) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:49:51.707622 run osmo-stp_10.42.42.5(pid=31413): stderr: | [0;m[38;5;43m20221214024950153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214024950153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214024950154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214024950154 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214024950154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214024950155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214024950155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:49:51.850328 run patchelf(pid=31416): Terminating (SIGINT) 02:49:52.017390 run patchelf(pid=31416): Terminated: ok {rc=0} 02:49:52.137239 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31413): Process ended prematurely: osmo-stp_10.42.42.5(pid=31413) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31413)] [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:49:52.146139 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 02:49:52.172537 run osmo-hlr_10.42.42.2(pid=31410): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31410)] 02:49:52.220041 run osmo-hlr_10.42.42.2(pid=31410): stdout: | (launched: 2022-12-14_02:49:48.985267) 02:49:52.269245 run osmo-hlr_10.42.42.2(pid=31410): stderr: | [0;m[1;31m20221214024949179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214024949179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214024949179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214024949179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214024949179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214024949179 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214024949191 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214024949199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214024949199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214024949199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:49:52.318553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31409): Terminating (SIGTERM) 02:49:52.358311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31412): Terminating (SIGTERM) 02:49:52.397840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31415): Terminating (SIGTERM) 02:49:52.437501 --- ParallelTerminationStrategy: PID 31409 died... 02:49:52.456611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31409): Terminated: ok {rc=0} 02:49:52.500616 --- ParallelTerminationStrategy: PID 31412 died... 02:49:52.519226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31412): Terminated: ok {rc=0} 02:49:52.563258 --- ParallelTerminationStrategy: PID 31415 died... 02:49:52.582091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31415): Terminated: ok {rc=0} 02:49:52.667918 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:49:53.970749 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:49:53.976800 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:49:54.008354 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:49:54.046135 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:49:54.129958 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:49:54.161342 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:49:54.198616 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:49:54.798954 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:49:54.851304 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:54.862775 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:49:54.931527 tst cs_paging_gprs_active.py: using LAC 38027 02:49:55.056530 tst cs_paging_gprs_active.py: using RAC 32 02:49:55.180324 tst cs_paging_gprs_active.py: using CellId 38027 02:49:55.304065 tst cs_paging_gprs_active.py: using BVCI 38028 02:49:55.422142 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:55.433349 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:55.444290 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:55.455445 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:55.466754 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:55.478136 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:55.489586 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:55.500849 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:49:55.512519 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:49:55.629522 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:49:55.748835 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:49:55.948748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:56.247954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31420): Launched 02:49:56.507820 run iperf3-srv_10.42.42.10(pid=31421): Launched 02:49:56.620675 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:49:56.819664 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:49:57.118995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31422): Launched 02:49:57.378658 run iperf3-srv_10.42.42.10(pid=31423): Launched 02:49:57.490187 tst cs_paging_gprs_active.py:38: start network... 02:49:57.689520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:49:58.153087 run create_hlr_db(pid=31424): Launched 02:49:58.276212 bus /gobi_6: Setting Powered False 02:49:59.335639 run create_hlr_db(pid=31424): Terminated: ok {rc=0} 02:49:59.772330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31426): Launched 02:50:00.092348 run osmo-hlr_10.42.42.2(pid=31427): Launched 02:50:00.214905 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:00.768631 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31429): Launched 02:50:01.126281 run osmo-stp_10.42.42.5(pid=31430): Launched 02:50:01.416897 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:50:01.968394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31435): Launched 02:50:02.097464 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:50:02.357283 run patchelf(pid=31436): Launched 02:50:02.523824 run osmo-stp_10.42.42.5(pid=31430): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31430)] 02:50:02.650756 run osmo-stp_10.42.42.5(pid=31430): stdout: | (launched: 2022-12-14_02:50:01.068179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:02.779343 run osmo-stp_10.42.42.5(pid=31430): stderr: | [0;m[38;5;43m20221214025001343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025001344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025001344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025001344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025001345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025001345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025001345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:02.907092 run osmo-stp_10.42.42.5(pid=31430): stdout: | (launched: 2022-12-14_02:50:01.068179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:03.029583 run osmo-stp_10.42.42.5(pid=31430): stderr: | [0;m[38;5;43m20221214025001343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025001344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025001344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025001344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025001345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025001345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025001345 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:03.174765 run patchelf(pid=31436): Terminating (SIGINT) 02:50:03.343492 run patchelf(pid=31436): Terminated: ok {rc=0} 02:50:03.465289 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31430): Process ended prematurely: osmo-stp_10.42.42.5(pid=31430) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31430)] [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:50:03.474750 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:50:03.501719 run osmo-hlr_10.42.42.2(pid=31427): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31427)] 02:50:03.549256 run osmo-hlr_10.42.42.2(pid=31427): stdout: | (launched: 2022-12-14_02:50:00.034148) 02:50:03.598663 run osmo-hlr_10.42.42.2(pid=31427): stderr: | [0;m[1;31m20221214025000233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025000233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025000233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025000233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025000234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025000234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025000246 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025000255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025000255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025000255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:50:03.648273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31420): Terminating (SIGTERM) 02:50:03.687697 run iperf3-srv_10.42.42.10(pid=31421): Terminating (SIGTERM) 02:50:03.727036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31422): Terminating (SIGTERM) 02:50:03.766472 run iperf3-srv_10.42.42.10(pid=31423): Terminating (SIGTERM) 02:50:03.805658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31426): Terminating (SIGTERM) 02:50:03.845111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31429): Terminating (SIGTERM) 02:50:03.884574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31435): Terminating (SIGTERM) 02:50:03.924107 --- ParallelTerminationStrategy: PID 31420 died... 02:50:03.942987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31420): Terminated: ok {rc=0} 02:50:03.986254 --- ParallelTerminationStrategy: PID 31421 died... 02:50:04.004629 run iperf3-srv_10.42.42.10(pid=31421): Terminated {rc=256} 02:50:04.048064 --- ParallelTerminationStrategy: PID 31422 died... 02:50:04.066386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31422): Terminated: ok {rc=0} 02:50:04.109881 --- ParallelTerminationStrategy: PID 31423 died... 02:50:04.128072 run iperf3-srv_10.42.42.10(pid=31423): Terminated {rc=256} 02:50:04.171378 --- ParallelTerminationStrategy: PID 31426 died... 02:50:04.189740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31426): Terminated: ok {rc=0} 02:50:04.233059 --- ParallelTerminationStrategy: PID 31429 died... 02:50:04.251665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31429): Terminated: ok {rc=0} 02:50:04.295101 --- ParallelTerminationStrategy: PID 31435 died... 02:50:04.313456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31435): Terminated: ok {rc=0} 02:50:04.398887 bus /gobi_0: Setting Powered False 02:50:05.498173 bus /gobi_0: Setting Powered False 02:50:06.614218 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:50:07.759366 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:07.770772 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:50:07.838716 tst iperf3.py: using LAC 38028 02:50:07.957375 tst iperf3.py: using RAC 33 02:50:08.074499 tst iperf3.py: using CellId 38028 02:50:08.192033 tst iperf3.py: using BVCI 38029 02:50:08.309245 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:08.320910 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:08.332235 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:08.343577 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:08.354846 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:08.366502 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:08.378102 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:08.389498 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:08.400906 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:08.516801 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:50:08.716124 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:09.013473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31437): Launched 02:50:09.272620 run iperf3-srv_10.42.42.10(pid=31438): Launched 02:50:09.384100 tst iperf3.py:8: start network... 02:50:09.582416 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:50:10.043115 run create_hlr_db(pid=31439): Launched 02:50:10.165104 bus /gobi_6: Setting Powered False 02:50:11.224887 run create_hlr_db(pid=31439): Terminated: ok {rc=0} 02:50:11.640160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31441): Launched 02:50:11.937673 run osmo-hlr_10.42.42.2(pid=31442): Launched 02:50:12.049750 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:12.562470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31444): Launched 02:50:12.861570 run osmo-stp_10.42.42.5(pid=31445): Launched 02:50:12.974360 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:50:13.492256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31447): Launched 02:50:13.605911 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:50:13.857201 run patchelf(pid=31448): Launched 02:50:14.022774 run osmo-stp_10.42.42.5(pid=31445): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31445)] 02:50:14.148678 run osmo-stp_10.42.42.5(pid=31445): stdout: | (launched: 2022-12-14_02:50:12.805828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:14.276156 run osmo-stp_10.42.42.5(pid=31445): stderr: | [0;m[38;5;43m20221214025012976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025012976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025012976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025012976 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025012979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025012979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025012979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:14.403692 run osmo-stp_10.42.42.5(pid=31445): stdout: | (launched: 2022-12-14_02:50:12.805828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:14.525635 run osmo-stp_10.42.42.5(pid=31445): stderr: | [0;m[38;5;43m20221214025012976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025012976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025012976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025012976 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025012979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025012979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025012979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:14.670451 run patchelf(pid=31448): Terminating (SIGINT) 02:50:14.840396 run patchelf(pid=31448): Terminated: ok {rc=0} 02:50:14.961753 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31445): Process ended prematurely: osmo-stp_10.42.42.5(pid=31445) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31445)] [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 02:50:14.971236 tst iperf3.py:8: Test FAILED (7.2 sec) 02:50:14.998207 run osmo-hlr_10.42.42.2(pid=31442): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31442)] 02:50:15.046021 run osmo-hlr_10.42.42.2(pid=31442): stdout: | (launched: 2022-12-14_02:50:11.882880) 02:50:15.095583 run osmo-hlr_10.42.42.2(pid=31442): stderr: | [0;m[1;31m20221214025012060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025012060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025012060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025012060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025012060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025012060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025012072 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025012082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025012082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025012082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:50:15.145589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31437): Terminating (SIGTERM) 02:50:15.185326 run iperf3-srv_10.42.42.10(pid=31438): Terminating (SIGTERM) 02:50:15.225160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31441): Terminating (SIGTERM) 02:50:15.265132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31444): Terminating (SIGTERM) 02:50:15.304886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31447): Terminating (SIGTERM) 02:50:15.344670 --- ParallelTerminationStrategy: PID 31437 died... 02:50:15.363170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31437): Terminated: ok {rc=0} 02:50:15.407105 --- ParallelTerminationStrategy: PID 31438 died... 02:50:15.425468 run iperf3-srv_10.42.42.10(pid=31438): Terminated {rc=256} 02:50:15.469651 --- ParallelTerminationStrategy: PID 31441 died... 02:50:15.489070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31441): Terminated: ok {rc=0} 02:50:15.532590 --- ParallelTerminationStrategy: PID 31444 died... 02:50:15.551093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31444): Terminated: ok {rc=0} 02:50:15.594627 --- ParallelTerminationStrategy: PID 31447 died... 02:50:15.613151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31447): Terminated: ok {rc=0} 02:50:15.699226 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:50:16.870767 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:16.888208 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:50:16.969178 tst iperf3m4.py: using LAC 38029 02:50:17.100276 tst iperf3m4.py: using RAC 34 02:50:17.227641 tst iperf3m4.py: using CellId 38029 02:50:17.353898 tst iperf3m4.py: using BVCI 38030 02:50:17.472753 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:17.484289 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:17.495545 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:17.506955 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:17.518470 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:17.530180 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:17.541737 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:17.553037 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:17.564619 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:17.681886 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:17.805281 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:17.926564 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:18.045163 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:50:18.244001 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:18.541833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31449): Launched 02:50:18.800827 run iperf3-srv_10.42.42.10(pid=31450): Launched 02:50:18.911666 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:50:19.109445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:19.406094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31451): Launched 02:50:19.663203 run iperf3-srv_10.42.42.10(pid=31452): Launched 02:50:19.774084 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:50:19.971459 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:20.269139 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31453): Launched 02:50:20.527267 run iperf3-srv_10.42.42.10(pid=31454): Launched 02:50:20.638300 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:50:20.837405 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:21.134781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31455): Launched 02:50:21.392764 run iperf3-srv_10.42.42.10(pid=31456): Launched 02:50:21.503464 tst iperf3m4.py:8: start network... 02:50:21.700527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:50:22.160230 run create_hlr_db(pid=31457): Launched 02:50:22.282127 bus /gobi_6: Setting Powered False 02:50:23.341528 run create_hlr_db(pid=31457): Terminated: ok {rc=0} 02:50:23.777368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31459): Launched 02:50:24.096175 run osmo-hlr_10.42.42.2(pid=31460): Launched 02:50:24.217671 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:24.766755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31462): Launched 02:50:25.086192 run osmo-stp_10.42.42.5(pid=31463): Launched 02:50:25.208009 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:50:25.760395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31465): Launched 02:50:25.883083 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:50:26.154104 run patchelf(pid=31466): Launched 02:50:26.332063 run osmo-stp_10.42.42.5(pid=31463): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31463)] 02:50:26.467852 run osmo-stp_10.42.42.5(pid=31463): stdout: | (launched: 2022-12-14_02:50:25.027988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:26.605230 run osmo-stp_10.42.42.5(pid=31463): stderr: | [0;m[38;5;43m20221214025025220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025025220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025025220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025025221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025025221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025025221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025025222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:26.742657 run osmo-stp_10.42.42.5(pid=31463): stdout: | (launched: 2022-12-14_02:50:25.027988) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:26.875039 run osmo-stp_10.42.42.5(pid=31463): stderr: | [0;m[38;5;43m20221214025025220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025025220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025025220 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025025221 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025025221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025025221 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025025222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:27.031124 run patchelf(pid=31466): Terminating (SIGINT) 02:50:27.211978 run patchelf(pid=31466): Terminated: ok {rc=0} 02:50:27.342573 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31463): Process ended prematurely: osmo-stp_10.42.42.5(pid=31463) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31463)] [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:50:27.352696 tst iperf3m4.py:8: Test FAILED (10.5 sec) 02:50:27.381393 run osmo-hlr_10.42.42.2(pid=31460): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31460)] 02:50:27.431878 run osmo-hlr_10.42.42.2(pid=31460): stdout: | (launched: 2022-12-14_02:50:24.037978) 02:50:27.484376 run osmo-hlr_10.42.42.2(pid=31460): stderr: | [0;m[1;31m20221214025024233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025024233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025024233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025024233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025024233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025024233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025024270 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025024280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025024280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025024280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:50:27.537184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31449): Terminating (SIGTERM) 02:50:27.578790 run iperf3-srv_10.42.42.10(pid=31450): Terminating (SIGTERM) 02:50:27.620698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31451): Terminating (SIGTERM) 02:50:27.663258 run iperf3-srv_10.42.42.10(pid=31452): Terminating (SIGTERM) 02:50:27.705327 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31453): Terminating (SIGTERM) 02:50:27.747209 run iperf3-srv_10.42.42.10(pid=31454): Terminating (SIGTERM) 02:50:27.789738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31455): Terminating (SIGTERM) 02:50:27.832016 run iperf3-srv_10.42.42.10(pid=31456): Terminating (SIGTERM) 02:50:27.873913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31459): Terminating (SIGTERM) 02:50:27.915801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31462): Terminating (SIGTERM) 02:50:27.957500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31465): Terminating (SIGTERM) 02:50:28.000138 --- ParallelTerminationStrategy: PID 31449 died... 02:50:28.020406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31449): Terminated: ok {rc=0} 02:50:28.066635 --- ParallelTerminationStrategy: PID 31450 died... 02:50:28.086516 run iperf3-srv_10.42.42.10(pid=31450): Terminated {rc=256} 02:50:28.132588 --- ParallelTerminationStrategy: PID 31451 died... 02:50:28.152511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31451): Terminated: ok {rc=0} 02:50:28.198689 --- ParallelTerminationStrategy: PID 31452 died... 02:50:28.218458 run iperf3-srv_10.42.42.10(pid=31452): Terminated {rc=256} 02:50:28.264594 --- ParallelTerminationStrategy: PID 31453 died... 02:50:28.284399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31453): Terminated: ok {rc=0} 02:50:28.330537 --- ParallelTerminationStrategy: PID 31454 died... 02:50:28.350445 run iperf3-srv_10.42.42.10(pid=31454): Terminated {rc=256} 02:50:28.396612 --- ParallelTerminationStrategy: PID 31455 died... 02:50:28.416549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31455): Terminated: ok {rc=0} 02:50:28.462933 --- ParallelTerminationStrategy: PID 31456 died... 02:50:28.482717 run iperf3-srv_10.42.42.10(pid=31456): Terminated {rc=256} 02:50:28.528765 --- ParallelTerminationStrategy: PID 31459 died... 02:50:28.548695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31459): Terminated: ok {rc=0} 02:50:28.594774 --- ParallelTerminationStrategy: PID 31462 died... 02:50:28.614677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31462): Terminated: ok {rc=0} 02:50:28.660771 --- ParallelTerminationStrategy: PID 31465 died... 02:50:28.681283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31465): Terminated: ok {rc=0} 02:50:28.770119 bus /gobi_4: Setting Powered False 02:50:29.869606 bus /gobi_4: Setting Powered False 02:50:30.992731 bus /gobi_1: Setting Powered False 02:50:32.103745 bus /gobi_1: Setting Powered False 02:50:33.222122 bus /gobi_0: Setting Powered False 02:50:34.320628 bus /gobi_0: Setting Powered False 02:50:35.435888 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:50:36.534624 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:36.546237 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:50:36.615628 tst ping.py: using LAC 38030 02:50:36.729381 tst ping.py: using RAC 35 02:50:36.845471 tst ping.py: using CellId 38030 02:50:36.969992 tst ping.py: using BVCI 38031 02:50:37.083891 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:37.095144 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:37.106452 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:37.117642 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:37.128889 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:37.140778 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:37.152377 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:37.163821 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:37.278648 tst ping.py:19: start network... 02:50:37.472537 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:50:37.926566 run create_hlr_db(pid=31467): Launched 02:50:38.046139 bus /gobi_6: Setting Powered False 02:50:39.104200 run create_hlr_db(pid=31467): Terminated: ok {rc=0} 02:50:39.513093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31469): Launched 02:50:39.806056 run osmo-hlr_10.42.42.2(pid=31470): Launched 02:50:39.917309 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:40.433995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31472): Launched 02:50:40.724008 run osmo-stp_10.42.42.5(pid=31473): Launched 02:50:40.834577 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:50:41.340142 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31475): Launched 02:50:41.452062 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:50:41.698470 run patchelf(pid=31476): Launched 02:50:41.860687 run osmo-stp_10.42.42.5(pid=31473): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31473)] 02:50:42.010043 run osmo-stp_10.42.42.5(pid=31473): stdout: | (launched: 2022-12-14_02:50:40.670573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:42.135742 run osmo-stp_10.42.42.5(pid=31473): stderr: | [0;m[38;5;43m20221214025040841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025040841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025040842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025040842 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025040843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025040843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025040843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:42.261534 run osmo-stp_10.42.42.5(pid=31473): stdout: | (launched: 2022-12-14_02:50:40.670573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:42.382070 run osmo-stp_10.42.42.5(pid=31473): stderr: | [0;m[38;5;43m20221214025040841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025040841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025040842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025040842 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025040843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025040843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025040843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:42.524460 run patchelf(pid=31476): Terminating (SIGINT) 02:50:42.690519 run patchelf(pid=31476): Terminated: ok {rc=0} 02:50:42.810176 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31473): Process ended prematurely: osmo-stp_10.42.42.5(pid=31473) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31473)] [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 02:50:42.819001 tst ping.py:22: Test FAILED (6.3 sec) 02:50:42.845628 run osmo-hlr_10.42.42.2(pid=31470): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31470)] 02:50:42.893479 run osmo-hlr_10.42.42.2(pid=31470): stdout: | (launched: 2022-12-14_02:50:39.752002) 02:50:42.942374 run osmo-hlr_10.42.42.2(pid=31470): stderr: | [0;m[1;31m20221214025039926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025039926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025039926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025039926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025039926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025039926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025039938 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025039947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025039948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025039948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:50:42.992251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31469): Terminating (SIGTERM) 02:50:43.031758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31472): Terminating (SIGTERM) 02:50:43.071538 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31475): Terminating (SIGTERM) 02:50:43.111301 --- ParallelTerminationStrategy: PID 31469 died... 02:50:43.130327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31469): Terminated: ok {rc=0} 02:50:43.174095 --- ParallelTerminationStrategy: PID 31472 died... 02:50:43.192388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31472): Terminated: ok {rc=0} 02:50:43.235890 --- ParallelTerminationStrategy: PID 31475 died... 02:50:43.254376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31475): Terminated: ok {rc=0} 02:50:43.339754 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:50:44.428035 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:44.440052 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:50:44.511679 tst ping_idle_ping.py: using LAC 38031 02:50:44.627219 tst ping_idle_ping.py: using RAC 36 02:50:44.744683 tst ping_idle_ping.py: using CellId 38031 02:50:44.860403 tst ping_idle_ping.py: using BVCI 38032 02:50:44.977650 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:44.989033 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:45.000265 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:45.011384 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:45.023148 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:45.035044 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:45.047054 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:50:45.059052 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:50:45.174560 tst ping_idle_ping.py:24: start network... 02:50:45.370408 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:50:45.824535 run create_hlr_db(pid=31477): Launched 02:50:46.006076 bus /gobi_6: Setting Powered False 02:50:47.064044 run create_hlr_db(pid=31477): Terminated: ok {rc=0} 02:50:47.505531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31479): Launched 02:50:47.799510 run osmo-hlr_10.42.42.2(pid=31480): Launched 02:50:47.910826 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:48.433736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31482): Launched 02:50:48.729172 run osmo-stp_10.42.42.5(pid=31483): Launched 02:50:48.841582 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:50:49.350415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31485): Launched 02:50:49.462349 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:50:49.710432 run patchelf(pid=31486): Launched 02:50:49.874109 run osmo-stp_10.42.42.5(pid=31483): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31483)] 02:50:49.998801 run osmo-stp_10.42.42.5(pid=31483): stdout: | (launched: 2022-12-14_02:50:48.674932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:50.124752 run osmo-stp_10.42.42.5(pid=31483): stderr: | [0;m[38;5;43m20221214025048846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025048846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025048846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025048846 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025048847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025048847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025048847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:50.250318 run osmo-stp_10.42.42.5(pid=31483): stdout: | (launched: 2022-12-14_02:50:48.674932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:50:50.371323 run osmo-stp_10.42.42.5(pid=31483): stderr: | [0;m[38;5;43m20221214025048846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025048846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025048846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025048846 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025048847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025048847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025048847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:50:50.514435 run patchelf(pid=31486): Terminating (SIGINT) 02:50:50.680940 run patchelf(pid=31486): Terminated: ok {rc=0} 02:50:50.800784 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31483): Process ended prematurely: osmo-stp_10.42.42.5(pid=31483) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31483)] [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:50:50.809802 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:50:50.836410 run osmo-hlr_10.42.42.2(pid=31480): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31480)] 02:50:50.883921 run osmo-hlr_10.42.42.2(pid=31480): stdout: | (launched: 2022-12-14_02:50:47.745486) 02:50:50.933231 run osmo-hlr_10.42.42.2(pid=31480): stderr: | [0;m[1;31m20221214025047923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025047923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025047923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025047923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025047923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025047923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025047936 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025047945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025047946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025047946 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:50:50.982810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31479): Terminating (SIGTERM) 02:50:51.022747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31482): Terminating (SIGTERM) 02:50:51.062588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31485): Terminating (SIGTERM) 02:50:51.102286 --- ParallelTerminationStrategy: PID 31479 died... 02:50:51.121490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31479): Terminated: ok {rc=0} 02:50:51.165214 --- ParallelTerminationStrategy: PID 31482 died... 02:50:51.183788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31482): Terminated: ok {rc=0} 02:50:51.227290 --- ParallelTerminationStrategy: PID 31485 died... 02:50:51.245771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31485): Terminated: ok {rc=0} 02:50:51.330508 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 02:50:52.639875 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:50:52.647296 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 02:50:52.678949 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 02:50:52.716470 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 02:50:52.807916 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 02:50:52.840339 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 02:50:52.877568 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 02:50:53.482977 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 02:50:53.537850 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:53.549480 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:50:53.601364 tst cs_paging_gprs_active.py: using LAC 38032 02:50:53.725118 tst cs_paging_gprs_active.py: using RAC 37 02:50:53.849762 tst cs_paging_gprs_active.py: using CellId 38032 02:50:53.973781 tst cs_paging_gprs_active.py: using BVCI 38033 02:50:54.083532 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:54.094863 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:54.105964 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:54.116804 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:54.128386 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:54.139962 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:54.151476 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:54.162862 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:50:54.174612 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:50:54.293277 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:50:54.411875 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:50:54.611789 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:54.911066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31491): Launched 02:50:55.172212 run iperf3-srv_10.42.42.10(pid=31492): Launched 02:50:55.284383 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:50:55.483850 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:50:55.784735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31493): Launched 02:50:56.045604 run iperf3-srv_10.42.42.10(pid=31494): Launched 02:50:56.157664 tst cs_paging_gprs_active.py:38: start network... 02:50:56.357085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:50:56.821372 run create_hlr_db(pid=31495): Launched 02:50:56.943389 bus /gobi_6: Setting Powered False 02:50:58.003001 run create_hlr_db(pid=31495): Terminated: ok {rc=0} 02:50:58.440090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31497): Launched 02:50:58.761288 run osmo-hlr_10.42.42.2(pid=31498): Launched 02:50:58.885073 run osmo-stp_10.42.42.5: Starting osmo-stp 02:50:59.438111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31500): Launched 02:50:59.757666 run osmo-stp_10.42.42.5(pid=31501): Launched 02:50:59.881136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:00.433715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31503): Launched 02:51:00.555315 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:00.825558 run patchelf(pid=31504): Launched 02:51:01.038104 run osmo-stp_10.42.42.5(pid=31501): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31501)] 02:51:01.170951 run osmo-stp_10.42.42.5(pid=31501): stdout: | (launched: 2022-12-14_02:50:59.699666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:01.304286 run osmo-stp_10.42.42.5(pid=31501): stderr: | [0;m[38;5;43m20221214025059891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025059891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025059891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025059891 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025059892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025059892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025059892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:01.436458 run osmo-stp_10.42.42.5(pid=31501): stdout: | (launched: 2022-12-14_02:50:59.699666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:01.564741 run osmo-stp_10.42.42.5(pid=31501): stderr: | [0;m[38;5;43m20221214025059891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025059891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025059891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025059891 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025059892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025059892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025059892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:01.716031 run patchelf(pid=31504): Terminating (SIGINT) 02:51:01.910210 run patchelf(pid=31504): Terminated: ok {rc=0} 02:51:02.063026 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31501): Process ended prematurely: osmo-stp_10.42.42.5(pid=31501) [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31501)] [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 02:51:02.074003 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 02:51:02.104233 run osmo-hlr_10.42.42.2(pid=31498): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31498)] 02:51:02.159670 run osmo-hlr_10.42.42.2(pid=31498): stdout: | (launched: 2022-12-14_02:50:58.702791) 02:51:02.212930 run osmo-hlr_10.42.42.2(pid=31498): stderr: | [0;m[1;31m20221214025058898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025058898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025058898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025058898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025058898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025058898 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025058911 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025058920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025058921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025058921 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:51:02.266770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31491): Terminating (SIGTERM) 02:51:02.308322 run iperf3-srv_10.42.42.10(pid=31492): Terminating (SIGTERM) 02:51:02.350182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31493): Terminating (SIGTERM) 02:51:02.391941 run iperf3-srv_10.42.42.10(pid=31494): Terminating (SIGTERM) 02:51:02.433616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31497): Terminating (SIGTERM) 02:51:02.475577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31500): Terminating (SIGTERM) 02:51:02.517331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31503): Terminating (SIGTERM) 02:51:02.559210 --- ParallelTerminationStrategy: PID 31491 died... 02:51:02.579441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31491): Terminated: ok {rc=0} 02:51:02.625798 --- ParallelTerminationStrategy: PID 31492 died... 02:51:02.645424 run iperf3-srv_10.42.42.10(pid=31492): Terminated {rc=256} 02:51:02.691376 --- ParallelTerminationStrategy: PID 31493 died... 02:51:02.711076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31493): Terminated: ok {rc=0} 02:51:02.757239 --- ParallelTerminationStrategy: PID 31494 died... 02:51:02.776891 run iperf3-srv_10.42.42.10(pid=31494): Terminated {rc=256} 02:51:02.823245 --- ParallelTerminationStrategy: PID 31497 died... 02:51:02.843052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31497): Terminated: ok {rc=0} 02:51:02.889236 --- ParallelTerminationStrategy: PID 31500 died... 02:51:02.908833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31500): Terminated: ok {rc=0} 02:51:02.955287 --- ParallelTerminationStrategy: PID 31503 died... 02:51:02.975025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31503): Terminated: ok {rc=0} 02:51:03.063238 bus /gobi_0: Setting Powered False 02:51:04.162042 bus /gobi_0: Setting Powered False 02:51:05.277475 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 02:51:06.419637 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:06.431328 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:51:06.485062 tst iperf3.py: using LAC 38033 02:51:06.611979 tst iperf3.py: using RAC 38 02:51:06.736880 tst iperf3.py: using CellId 38033 02:51:06.861558 tst iperf3.py: using BVCI 38034 02:51:06.970288 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:06.981563 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:06.992475 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:07.003480 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:07.014467 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:07.025458 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:07.036421 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:07.047592 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:07.058705 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:07.179696 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:51:07.395584 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:07.716612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31505): Launched 02:51:07.995701 run iperf3-srv_10.42.42.10(pid=31506): Launched 02:51:08.115991 tst iperf3.py:8: start network... 02:51:08.331188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:51:08.827451 run create_hlr_db(pid=31507): Launched 02:51:08.950660 bus /gobi_6: Setting Powered False 02:51:10.013857 run create_hlr_db(pid=31507): Terminated: ok {rc=0} 02:51:10.441744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31509): Launched 02:51:10.740023 run osmo-hlr_10.42.42.2(pid=31510): Launched 02:51:10.853180 run osmo-stp_10.42.42.5: Starting osmo-stp 02:51:11.382953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31512): Launched 02:51:11.680398 run osmo-stp_10.42.42.5(pid=31513): Launched 02:51:11.794770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:12.311462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31515): Launched 02:51:12.424726 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:12.676649 run patchelf(pid=31516): Launched 02:51:12.842251 run osmo-stp_10.42.42.5(pid=31513): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31513)] 02:51:12.968196 run osmo-stp_10.42.42.5(pid=31513): stdout: | (launched: 2022-12-14_02:51:11.625735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:13.095888 run osmo-stp_10.42.42.5(pid=31513): stderr: | [0;m[38;5;43m20221214025111796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025111796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025111797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025111797 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025111799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025111799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025111799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:13.224402 run osmo-stp_10.42.42.5(pid=31513): stdout: | (launched: 2022-12-14_02:51:11.625735) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:13.346947 run osmo-stp_10.42.42.5(pid=31513): stderr: | [0;m[38;5;43m20221214025111796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025111796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025111797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025111797 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025111799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025111799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025111799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:13.491818 run patchelf(pid=31516): Terminating (SIGINT) 02:51:13.660562 run patchelf(pid=31516): Terminated: ok {rc=0} 02:51:13.782706 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31513): Process ended prematurely: osmo-stp_10.42.42.5(pid=31513) [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31513)] [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 02:51:13.792102 tst iperf3.py:8: Test FAILED (7.4 sec) 02:51:13.819214 run osmo-hlr_10.42.42.2(pid=31510): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31510)] 02:51:13.866784 run osmo-hlr_10.42.42.2(pid=31510): stdout: | (launched: 2022-12-14_02:51:10.685393) 02:51:13.916067 run osmo-hlr_10.42.42.2(pid=31510): stderr: | [0;m[1;31m20221214025110862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025110862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025110862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025110862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025110862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025110862 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025110874 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025110883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025110883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025110883 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:51:13.965772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31505): Terminating (SIGTERM) 02:51:14.005424 run iperf3-srv_10.42.42.10(pid=31506): Terminating (SIGTERM) 02:51:14.045094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31509): Terminating (SIGTERM) 02:51:14.084974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31512): Terminating (SIGTERM) 02:51:14.124648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31515): Terminating (SIGTERM) 02:51:14.164476 --- ParallelTerminationStrategy: PID 31505 died... 02:51:14.183528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31505): Terminated: ok {rc=0} 02:51:14.227298 --- ParallelTerminationStrategy: PID 31506 died... 02:51:14.245713 run iperf3-srv_10.42.42.10(pid=31506): Terminated {rc=256} 02:51:14.289129 --- ParallelTerminationStrategy: PID 31509 died... 02:51:14.307473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31509): Terminated: ok {rc=0} 02:51:14.351168 --- ParallelTerminationStrategy: PID 31512 died... 02:51:14.369655 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31512): Terminated: ok {rc=0} 02:51:14.413351 --- ParallelTerminationStrategy: PID 31515 died... 02:51:14.431928 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31515): Terminated: ok {rc=0} 02:51:14.518161 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 02:51:15.663664 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:15.675427 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:51:15.727131 tst iperf3m4.py: using LAC 38034 02:51:15.862497 tst iperf3m4.py: using RAC 39 02:51:16.011707 tst iperf3m4.py: using CellId 38034 02:51:16.141767 tst iperf3m4.py: using BVCI 38035 02:51:16.263242 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:16.275968 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:16.288488 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:16.301340 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:16.314942 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:16.328383 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:16.342189 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:16.355542 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:16.368894 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:16.517468 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:16.673995 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:16.803681 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:16.932704 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:51:17.175452 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:17.508023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31517): Launched 02:51:17.786655 run iperf3-srv_10.42.42.10(pid=31518): Launched 02:51:17.907212 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:51:18.122927 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:18.443052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31519): Launched 02:51:18.721592 run iperf3-srv_10.42.42.10(pid=31520): Launched 02:51:18.842090 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:51:19.057205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:19.377403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31521): Launched 02:51:19.655348 run iperf3-srv_10.42.42.10(pid=31522): Launched 02:51:19.775571 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:51:19.990895 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:51:20.311386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31523): Launched 02:51:20.589563 run iperf3-srv_10.42.42.10(pid=31524): Launched 02:51:20.708931 tst iperf3m4.py:8: start network... 02:51:20.924415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:51:21.419995 run create_hlr_db(pid=31525): Launched 02:51:21.542015 bus /gobi_6: Setting Powered False 02:51:22.600752 run create_hlr_db(pid=31525): Terminated: ok {rc=0} 02:51:23.026580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31527): Launched 02:51:23.325522 run osmo-hlr_10.42.42.2(pid=31528): Launched 02:51:23.438212 run osmo-stp_10.42.42.5: Starting osmo-stp 02:51:23.968491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31530): Launched 02:51:24.264729 run osmo-stp_10.42.42.5(pid=31531): Launched 02:51:24.378703 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:24.891668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31533): Launched 02:51:25.004800 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:25.256720 run patchelf(pid=31534): Launched 02:51:25.422963 run osmo-stp_10.42.42.5(pid=31531): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31531)] 02:51:25.548738 run osmo-stp_10.42.42.5(pid=31531): stdout: | (launched: 2022-12-14_02:51:24.210263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:25.676022 run osmo-stp_10.42.42.5(pid=31531): stderr: | [0;m[38;5;43m20221214025124377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025124377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025124378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025124378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025124380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025124380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025124380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:25.803320 run osmo-stp_10.42.42.5(pid=31531): stdout: | (launched: 2022-12-14_02:51:24.210263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:25.925173 run osmo-stp_10.42.42.5(pid=31531): stderr: | [0;m[38;5;43m20221214025124377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025124377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025124378 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025124378 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025124380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025124380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025124380 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:26.069782 run patchelf(pid=31534): Terminating (SIGINT) 02:51:26.237583 run patchelf(pid=31534): Terminated: ok {rc=0} 02:51:26.358753 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31531): Process ended prematurely: osmo-stp_10.42.42.5(pid=31531) [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31531)] [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 02:51:26.368227 tst iperf3m4.py:8: Test FAILED (10.7 sec) 02:51:26.395417 run osmo-hlr_10.42.42.2(pid=31528): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31528)] 02:51:26.442816 run osmo-hlr_10.42.42.2(pid=31528): stdout: | (launched: 2022-12-14_02:51:23.269726) 02:51:26.491880 run osmo-hlr_10.42.42.2(pid=31528): stderr: | [0;m[1;31m20221214025123447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025123447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025123447 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025123448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025123448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025123448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025123460 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025123471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025123471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025123471 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:51:26.542019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31517): Terminating (SIGTERM) 02:51:26.581818 run iperf3-srv_10.42.42.10(pid=31518): Terminating (SIGTERM) 02:51:26.621203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31519): Terminating (SIGTERM) 02:51:26.660490 run iperf3-srv_10.42.42.10(pid=31520): Terminating (SIGTERM) 02:51:26.699792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31521): Terminating (SIGTERM) 02:51:26.739217 run iperf3-srv_10.42.42.10(pid=31522): Terminating (SIGTERM) 02:51:26.778433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31523): Terminating (SIGTERM) 02:51:26.817861 run iperf3-srv_10.42.42.10(pid=31524): Terminating (SIGTERM) 02:51:26.857111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31527): Terminating (SIGTERM) 02:51:26.896448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31530): Terminating (SIGTERM) 02:51:26.935769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31533): Terminating (SIGTERM) 02:51:26.975358 --- ParallelTerminationStrategy: PID 31517 died... 02:51:26.994411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31517): Terminated: ok {rc=0} 02:51:27.037993 --- ParallelTerminationStrategy: PID 31518 died... 02:51:27.056341 run iperf3-srv_10.42.42.10(pid=31518): Terminated {rc=256} 02:51:27.099841 --- ParallelTerminationStrategy: PID 31519 died... 02:51:27.118447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31519): Terminated: ok {rc=0} 02:51:27.163160 --- ParallelTerminationStrategy: PID 31520 died... 02:51:27.181634 run iperf3-srv_10.42.42.10(pid=31520): Terminated {rc=256} 02:51:27.224923 --- ParallelTerminationStrategy: PID 31521 died... 02:51:27.243893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31521): Terminated: ok {rc=0} 02:51:27.287479 --- ParallelTerminationStrategy: PID 31522 died... 02:51:27.306167 run iperf3-srv_10.42.42.10(pid=31522): Terminated {rc=256} 02:51:27.350090 --- ParallelTerminationStrategy: PID 31523 died... 02:51:27.368710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31523): Terminated: ok {rc=0} 02:51:27.412151 --- ParallelTerminationStrategy: PID 31524 died... 02:51:27.430621 run iperf3-srv_10.42.42.10(pid=31524): Terminated {rc=256} 02:51:27.474107 --- ParallelTerminationStrategy: PID 31527 died... 02:51:27.492776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31527): Terminated: ok {rc=0} 02:51:27.536351 --- ParallelTerminationStrategy: PID 31530 died... 02:51:27.554990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31530): Terminated: ok {rc=0} 02:51:27.598881 --- ParallelTerminationStrategy: PID 31533 died... 02:51:27.617541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31533): Terminated: ok {rc=0} 02:51:27.703344 bus /gobi_4: Setting Powered False 02:51:28.802540 bus /gobi_4: Setting Powered False 02:51:29.921821 bus /gobi_1: Setting Powered False 02:51:31.017287 bus /gobi_1: Setting Powered False 02:51:32.142050 bus /gobi_0: Setting Powered False 02:51:33.244024 bus /gobi_0: Setting Powered False 02:51:34.362024 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 02:51:35.464469 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:35.476279 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:51:35.527023 tst ping.py: using LAC 38035 02:51:35.652246 tst ping.py: using RAC 40 02:51:35.778804 tst ping.py: using CellId 38035 02:51:35.904497 tst ping.py: using BVCI 38036 02:51:36.019373 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:36.031204 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:36.042759 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:36.054242 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:36.066157 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:36.078105 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:36.090011 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:36.101834 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:36.219006 tst ping.py:19: start network... 02:51:36.413634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:51:36.864614 run create_hlr_db(pid=31535): Launched 02:51:36.984129 bus /gobi_6: Setting Powered False 02:51:38.042727 run create_hlr_db(pid=31535): Terminated: ok {rc=0} 02:51:38.471169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31537): Launched 02:51:38.785626 run osmo-hlr_10.42.42.2(pid=31538): Launched 02:51:38.906253 run osmo-stp_10.42.42.5: Starting osmo-stp 02:51:39.453616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31540): Launched 02:51:39.767690 run osmo-stp_10.42.42.5(pid=31541): Launched 02:51:39.888327 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:40.433056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31543): Launched 02:51:40.553635 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:40.820670 run patchelf(pid=31544): Launched 02:51:40.996408 run osmo-stp_10.42.42.5(pid=31541): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31541)] 02:51:41.129985 run osmo-stp_10.42.42.5(pid=31541): stdout: | (launched: 2022-12-14_02:51:39.710358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:41.265166 run osmo-stp_10.42.42.5(pid=31541): stderr: | [0;m[38;5;43m20221214025139902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025139902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025139902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025139903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025139903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025139903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025139903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:41.400202 run osmo-stp_10.42.42.5(pid=31541): stdout: | (launched: 2022-12-14_02:51:39.710358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:41.530382 run osmo-stp_10.42.42.5(pid=31541): stderr: | [0;m[38;5;43m20221214025139902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025139902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025139902 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025139903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025139903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025139903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025139903 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:41.683983 run patchelf(pid=31544): Terminating (SIGINT) 02:51:41.862604 run patchelf(pid=31544): Terminated: ok {rc=0} 02:51:41.991017 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31541): Process ended prematurely: osmo-stp_10.42.42.5(pid=31541) [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31541)] [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 02:51:42.000559 tst ping.py:22: Test FAILED (6.5 sec) 02:51:42.028502 run osmo-hlr_10.42.42.2(pid=31538): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31538)] 02:51:42.079040 run osmo-hlr_10.42.42.2(pid=31538): stdout: | (launched: 2022-12-14_02:51:38.728398) 02:51:42.131051 run osmo-hlr_10.42.42.2(pid=31538): stderr: | [0;m[1;31m20221214025138927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025138927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025138927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025138927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025138927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025138927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025138939 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025138948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025138948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025138948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:51:42.183650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31537): Terminating (SIGTERM) 02:51:42.225357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31540): Terminating (SIGTERM) 02:51:42.267916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31543): Terminating (SIGTERM) 02:51:42.310002 --- ParallelTerminationStrategy: PID 31537 died... 02:51:42.330252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31537): Terminated: ok {rc=0} 02:51:42.376378 --- ParallelTerminationStrategy: PID 31540 died... 02:51:42.396166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31540): Terminated: ok {rc=0} 02:51:42.442395 --- ParallelTerminationStrategy: PID 31543 died... 02:51:42.462396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31543): Terminated: ok {rc=0} 02:51:42.550025 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 02:51:43.636020 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:43.647983 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 02:51:43.703514 tst ping_idle_ping.py: using LAC 38036 02:51:43.826623 tst ping_idle_ping.py: using RAC 41 02:51:43.950506 tst ping_idle_ping.py: using CellId 38036 02:51:44.065834 tst ping_idle_ping.py: using BVCI 38037 02:51:44.172771 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:44.184173 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:44.195322 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:44.206526 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:44.218132 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:44.229665 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:44.241239 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 02:51:44.252898 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 02:51:44.371376 tst ping_idle_ping.py:24: start network... 02:51:44.583716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:51:45.074752 run create_hlr_db(pid=31545): Launched 02:51:45.195153 bus /gobi_6: Setting Powered False 02:51:46.267482 run create_hlr_db(pid=31545): Terminated: ok {rc=0} 02:51:46.723747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31547): Launched 02:51:47.067177 run osmo-hlr_10.42.42.2(pid=31548): Launched 02:51:47.269781 run osmo-stp_10.42.42.5: Starting osmo-stp 02:51:47.787030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31550): Launched 02:51:48.080018 run osmo-stp_10.42.42.5(pid=31551): Launched 02:51:48.190921 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:48.695560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31553): Launched 02:51:48.807542 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:49.055721 run patchelf(pid=31554): Launched 02:51:49.218623 run osmo-stp_10.42.42.5(pid=31551): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31551)] 02:51:49.342835 run osmo-stp_10.42.42.5(pid=31551): stdout: | (launched: 2022-12-14_02:51:48.025967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:49.468269 run osmo-stp_10.42.42.5(pid=31551): stderr: | [0;m[38;5;43m20221214025148194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025148194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025148194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025148195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025148195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025148195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025148195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:49.594663 run osmo-stp_10.42.42.5(pid=31551): stdout: | (launched: 2022-12-14_02:51:48.025967) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:49.715076 run osmo-stp_10.42.42.5(pid=31551): stderr: | [0;m[38;5;43m20221214025148194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025148194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025148194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025148195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025148195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025148195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025148195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:49.857766 run patchelf(pid=31554): Terminating (SIGINT) 02:51:50.023269 run patchelf(pid=31554): Terminated: ok {rc=0} 02:51:50.142821 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31551): Process ended prematurely: osmo-stp_10.42.42.5(pid=31551) [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31551)] [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 02:51:50.151715 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 02:51:50.178181 run osmo-hlr_10.42.42.2(pid=31548): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31548)] 02:51:50.225445 run osmo-hlr_10.42.42.2(pid=31548): stdout: | (launched: 2022-12-14_02:51:46.996706) 02:51:50.274143 run osmo-hlr_10.42.42.2(pid=31548): stderr: | [0;m[1;31m20221214025147233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025147233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025147233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025147233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025147233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025147233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025147245 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025147253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025147253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025147254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:51:50.323948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31547): Terminating (SIGTERM) 02:51:50.363424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31550): Terminating (SIGTERM) 02:51:50.402975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31553): Terminating (SIGTERM) 02:51:50.442720 --- ParallelTerminationStrategy: PID 31547 died... 02:51:50.461836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31547): Terminated: ok {rc=0} 02:51:50.505351 --- ParallelTerminationStrategy: PID 31550 died... 02:51:50.523852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31550): Terminated: ok {rc=0} 02:51:50.567153 --- ParallelTerminationStrategy: PID 31553 died... 02:51:50.585747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31553): Terminated: ok {rc=0} 02:51:50.671037 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:51:51.977837 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:51:51.984274 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:51:52.015707 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:51:52.049501 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:51:52.100872 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:51:52.132672 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:51:52.166276 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:51:52.732056 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2398 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:51:52.737298 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:51:52.748881 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:51:52.815097 tst switch_tch_pdch.py: using LAC 38037 02:51:52.929396 tst switch_tch_pdch.py: using RAC 42 02:51:53.044837 tst switch_tch_pdch.py: using CellId 38037 02:51:53.169448 tst switch_tch_pdch.py: using BVCI 38038 02:51:53.285671 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:51:53.297382 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:51:53.308635 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:51:53.320004 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:51:53.331596 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:51:53.343139 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:51:53.355193 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:51:53.366910 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:51:53.482786 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:51:53.602064 tst switch_tch_pdch.py:51: start network... 02:51:53.814315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:51:54.301540 run create_hlr_db(pid=31560): Launched 02:51:54.421153 bus /gobi_6: Setting Powered False 02:51:55.483623 run create_hlr_db(pid=31560): Terminated: ok {rc=0} 02:51:55.904380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31562): Launched 02:51:56.197401 run osmo-hlr_10.42.42.2(pid=31563): Launched 02:51:56.308321 run osmo-stp_10.42.42.5: Starting osmo-stp 02:51:56.829174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31565): Launched 02:51:57.121309 run osmo-stp_10.42.42.5(pid=31566): Launched 02:51:57.232099 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:51:57.738278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31568): Launched 02:51:57.850065 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:51:58.097884 run patchelf(pid=31569): Launched 02:51:58.259947 run osmo-stp_10.42.42.5(pid=31566): ERR: Terminated: ERROR {rc=1} [trial-2398↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31566)] 02:51:58.384165 run osmo-stp_10.42.42.5(pid=31566): stdout: | (launched: 2022-12-14_02:51:57.067284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:58.509986 run osmo-stp_10.42.42.5(pid=31566): stderr: | [0;m[38;5;43m20221214025157236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025157237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025157237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025157237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025157238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025157238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025157238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:58.635904 run osmo-stp_10.42.42.5(pid=31566): stdout: | (launched: 2022-12-14_02:51:57.067284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:51:58.755909 run osmo-stp_10.42.42.5(pid=31566): stderr: | [0;m[38;5;43m20221214025157236 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025157237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025157237 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025157237 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025157238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025157238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025157238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:51:58.898561 run patchelf(pid=31569): Terminating (SIGINT) 02:51:59.064660 run patchelf(pid=31569): Terminated: ok {rc=0} 02:51:59.183969 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31566): Process ended prematurely: osmo-stp_10.42.42.5(pid=31566) [trial-2398↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31566)] [trial-2398↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:51:59.193016 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 02:51:59.219317 run osmo-hlr_10.42.42.2(pid=31563): ERR: Terminated: ERROR {rc=237} [trial-2398↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31563)] 02:51:59.266729 run osmo-hlr_10.42.42.2(pid=31563): stdout: | (launched: 2022-12-14_02:51:56.143171) 02:51:59.315877 run osmo-hlr_10.42.42.2(pid=31563): stderr: | [0;m[1;31m20221214025156320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025156320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025156320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025156320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025156320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025156320 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025156332 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025156342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025156342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025156342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:51:59.365511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31562): Terminating (SIGTERM) 02:51:59.405285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31565): Terminating (SIGTERM) 02:51:59.445059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31568): Terminating (SIGTERM) 02:51:59.484840 --- ParallelTerminationStrategy: PID 31562 died... 02:51:59.503854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31562): Terminated: ok {rc=0} 02:51:59.547500 --- ParallelTerminationStrategy: PID 31565 died... 02:51:59.566350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31565): Terminated: ok {rc=0} 02:51:59.610230 --- ParallelTerminationStrategy: PID 31568 died... 02:51:59.628663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31568): Terminated: ok {rc=0} 02:51:59.713736 bus /gobi_0: Setting Powered False 02:52:00.812491 bus /gobi_0: Setting Powered False 02:52:01.937508 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:52:03.183781 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:52:03.189981 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:52:03.222204 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:52:03.256444 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:52:03.308885 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:52:03.342108 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:52:03.377058 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:52:03.928281 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2398 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:52:03.933392 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:52:03.944028 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:52:04.011726 tst switch_tch_pdch.py: using LAC 38038 02:52:04.126571 tst switch_tch_pdch.py: using RAC 43 02:52:04.240877 tst switch_tch_pdch.py: using CellId 38038 02:52:04.364291 tst switch_tch_pdch.py: using BVCI 38039 02:52:04.478398 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:52:04.490246 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:52:04.501586 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:52:04.512663 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:52:04.524044 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:52:04.535492 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:52:04.547073 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:52:04.558540 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:52:04.673853 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:52:04.788408 tst switch_tch_pdch.py:51: start network... 02:52:04.982939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:52:05.410026 run create_hlr_db(pid=31573): Launched 02:52:05.530287 bus /gobi_6: Setting Powered False 02:52:06.589236 run create_hlr_db(pid=31573): Terminated: ok {rc=0} 02:52:06.973584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31575): Launched 02:52:07.265351 run osmo-hlr_10.42.42.2(pid=31576): Launched 02:52:07.376184 run osmo-stp_10.42.42.5: Starting osmo-stp 02:52:07.853668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31578): Launched 02:52:08.145925 run osmo-stp_10.42.42.5(pid=31579): Launched 02:52:08.255908 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:52:08.734878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31581): Launched 02:52:08.846453 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:52:09.092781 run patchelf(pid=31582): Launched 02:52:09.255100 run osmo-stp_10.42.42.5(pid=31579): ERR: Terminated: ERROR {rc=1} [trial-2398↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31579)] 02:52:09.378870 run osmo-stp_10.42.42.5(pid=31579): stdout: | (launched: 2022-12-14_02:52:08.091755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:09.504102 run osmo-stp_10.42.42.5(pid=31579): stderr: | [0;m[38;5;43m20221214025208260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025208260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025208260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025208261 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025208263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025208263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025208263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:09.629789 run osmo-stp_10.42.42.5(pid=31579): stdout: | (launched: 2022-12-14_02:52:08.091755) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:09.751116 run osmo-stp_10.42.42.5(pid=31579): stderr: | [0;m[38;5;43m20221214025208260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025208260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025208260 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025208261 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025208263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025208263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025208263 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:09.893441 run patchelf(pid=31582): Terminating (SIGINT) 02:52:10.058581 run patchelf(pid=31582): Terminated: ok {rc=0} 02:52:10.178228 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31579): Process ended prematurely: osmo-stp_10.42.42.5(pid=31579) [trial-2398↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31579)] [trial-2398↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 02:52:10.187188 tst switch_tch_pdch.py:54: Test FAILED (6.2 sec) 02:52:10.213539 run osmo-hlr_10.42.42.2(pid=31576): ERR: Terminated: ERROR {rc=237} [trial-2398↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31576)] 02:52:10.261017 run osmo-hlr_10.42.42.2(pid=31576): stdout: | (launched: 2022-12-14_02:52:07.211544) 02:52:10.309963 run osmo-hlr_10.42.42.2(pid=31576): stderr: | [0;m[1;31m20221214025207386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025207386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025207386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025207386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025207386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025207386 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025207399 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025207407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025207407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025207407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:52:10.359573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31575): Terminating (SIGTERM) 02:52:10.399123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31578): Terminating (SIGTERM) 02:52:10.438585 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31581): Terminating (SIGTERM) 02:52:10.478271 --- ParallelTerminationStrategy: PID 31575 died... 02:52:10.497198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31575): Terminated: ok {rc=0} 02:52:10.540736 --- ParallelTerminationStrategy: PID 31578 died... 02:52:10.559179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31578): Terminated: ok {rc=0} 02:52:10.602547 --- ParallelTerminationStrategy: PID 31581 died... 02:52:10.621045 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31581): Terminated: ok {rc=0} 02:52:10.704358 bus /gobi_0: Setting Powered False 02:52:11.802291 bus /gobi_0: Setting Powered False 02:52:12.920159 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_sms:trx-lms --------------------------------------------------------------------- 02:52:14.167007 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:52:14.171324 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 02:52:14.203772 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 02:52:14.211263 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 02:52:14.262926 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 02:52:14.296614 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 02:52:14.303532 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 02:52:14.840644 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 02:52:14.846733 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 02:52:14.857751 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 02:52:14.903799 tst mo_mt_sms.py: using LAC 38039 02:52:15.019254 tst mo_mt_sms.py: using RAC 44 02:52:15.132854 tst mo_mt_sms.py: using CellId 38039 02:52:15.246280 tst mo_mt_sms.py: using BVCI 38040 02:52:15.353219 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 02:52:15.470718 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 02:52:15.583425 tst mo_mt_sms.py:9: start nitb and bts... 02:52:15.780465 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:52:16.394198 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31586): Launched 02:52:16.710902 run osmo-nitb_10.42.42.2(pid=31587): Launched 02:52:16.899243 run osmo-nitb_10.42.42.2(pid=31587): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31587)] 02:52:17.032490 run osmo-nitb_10.42.42.2(pid=31587): stdout: | (launched: 2022-12-14_02:52:16.647858) 02:52:17.167461 run osmo-nitb_10.42.42.2(pid=31587): stderr: | (launched: 2022-12-14_02:52:16.692116) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:52:17.301354 run osmo-nitb_10.42.42.2(pid=31587): stdout: | (launched: 2022-12-14_02:52:16.647858) 02:52:17.428461 run osmo-nitb_10.42.42.2(pid=31587): stderr: | (launched: 2022-12-14_02:52:16.692116) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31587): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31587) [trial-2398↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31587)] 02:52:17.846911 tst osmo-nitb_10.42.42.2(pid=31587): stdout: | (launched: 2022-12-14_02:52:16.647858) 02:52:17.965185 tst osmo-nitb_10.42.42.2(pid=31587): stderr: | (launched: 2022-12-14_02:52:16.692116) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:52:18.103461 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=31587): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31587) [trial-2398↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31587)] [trial-2398↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 02:52:18.111872 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 02:52:18.118406 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31586): Terminating (SIGTERM) 02:52:18.326513 --- ParallelTerminationStrategy: PID 31586 died... 02:52:18.347296 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31586): Terminated: ok {rc=0} 02:52:18.432437 bus /sierra_3: Setting Powered False 02:52:19.533684 bus /sierra_3: Setting Powered False 02:52:20.649693 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 sms:trx-lms --------------------------------------------------------------------- 02:52:21.845956 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:52:21.851353 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 02:52:21.886945 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 02:52:21.914593 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 02:52:21.967353 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 02:52:22.001132 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 02:52:22.028922 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 02:52:22.573186 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 02:52:22.578594 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:22.589804 tst sms:trx-lms: Using 1 x bts (candidates: 1) 02:52:22.637967 tst mo_mt_sms.py: using LAC 38040 02:52:22.763090 tst mo_mt_sms.py: using RAC 45 02:52:22.886292 tst mo_mt_sms.py: using CellId 38040 02:52:23.008929 tst mo_mt_sms.py: using BVCI 38041 02:52:23.123184 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:23.134211 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:23.145231 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:23.155973 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:23.167256 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:23.178560 tst sms:trx-lms: Using 1 x modem (candidates: 2) 02:52:23.295887 tst sms:trx-lms: Using 1 x modem (candidates: 2) 02:52:23.414244 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:52:23.868476 run create_hlr_db(pid=31592): Launched 02:52:23.989517 bus /sierra_2: Setting Powered False 02:52:25.048622 run create_hlr_db(pid=31592): Terminated: ok {rc=0} 02:52:25.479254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31594): Launched 02:52:25.794497 run osmo-hlr_10.42.42.2(pid=31595): Launched 02:52:25.915623 run osmo-stp_10.42.42.5: Starting osmo-stp 02:52:26.465062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31597): Launched 02:52:26.778548 run osmo-stp_10.42.42.5(pid=31598): Launched 02:52:26.898597 run osmo-msc_10.42.42.6: Starting osmo-msc 02:52:27.466715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31600): Launched 02:52:27.780655 run osmo-msc_10.42.42.6(pid=31601): Launched 02:52:27.956178 run osmo-stp_10.42.42.5(pid=31598): ERR: Terminated: ERROR {rc=1} [trial-2398↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31598)] 02:52:28.089605 run osmo-stp_10.42.42.5(pid=31598): stdout: | (launched: 2022-12-14_02:52:26.721481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:28.223416 run osmo-stp_10.42.42.5(pid=31598): stderr: | [0;m[38;5;43m20221214025226911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025226911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025226912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025226912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025226912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025226913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025226913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:28.356631 run osmo-stp_10.42.42.5(pid=31598): stdout: | (launched: 2022-12-14_02:52:26.721481) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:28.482042 run osmo-stp_10.42.42.5(pid=31598): stderr: | [0;m[38;5;43m20221214025226911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025226911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025226912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025226912 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025226912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025226913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025226913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:28.631912 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=31598): Process ended prematurely: osmo-stp_10.42.42.5(pid=31598) [trial-2398↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31598)] [trial-2398↪sms:trx-lms↪mo_mt_sms.py:16] 02:52:28.641045 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 02:52:28.668482 run osmo-hlr_10.42.42.2(pid=31595): ERR: Terminated: ERROR {rc=237} [trial-2398↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31595)] 02:52:28.719494 run osmo-hlr_10.42.42.2(pid=31595): stdout: | (launched: 2022-12-14_02:52:25.737264) 02:52:28.771617 run osmo-hlr_10.42.42.2(pid=31595): stderr: | [0;m[1;31m20221214025225934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025225934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025225934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025225934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025225934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025225934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025225946 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025225954 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025225955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025225955 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:52:28.844405 run osmo-msc_10.42.42.6(pid=31601): ERR: Terminated: ERROR {rc=2} [trial-2398↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31601)] 02:52:28.894309 run osmo-msc_10.42.42.6(pid=31601): stdout: | (launched: 2022-12-14_02:52:27.723507) 02:52:28.946685 run osmo-msc_10.42.42.6(pid=31601): stderr: | [0;m[38;5;43m20221214025228043 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025228043 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f58ff844c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025228043 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025228043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025228043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025228043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025228045 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025228045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025228046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025228046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:52:28.998978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31594): Terminating (SIGTERM) 02:52:29.040688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31597): Terminating (SIGTERM) 02:52:29.083189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31600): Terminating (SIGTERM) 02:52:29.125257 --- ParallelTerminationStrategy: PID 31594 died... 02:52:29.145524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31594): Terminated: ok {rc=0} 02:52:29.191816 --- ParallelTerminationStrategy: PID 31597 died... 02:52:29.211505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31597): Terminated: ok {rc=0} 02:52:29.257545 --- ParallelTerminationStrategy: PID 31600 died... 02:52:29.277235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31600): Terminated: ok {rc=0} 02:52:29.364089 bus /sierra_3: Setting Powered False 02:52:30.461863 bus /sierra_3: Setting Powered False 02:52:31.588635 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_ussd:trx-lms --------------------------------------------------------------------- 02:52:32.833561 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:52:32.837608 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 02:52:32.870696 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 02:52:32.879273 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 02:52:32.915038 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 02:52:32.949640 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 02:52:32.956519 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 02:52:33.474850 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2398 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 02:52:33.479916 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 02:52:33.490921 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 02:52:33.539935 tst assert_extension.py: using LAC 38041 02:52:33.662317 tst assert_extension.py: using RAC 46 02:52:33.790305 tst assert_extension.py: using CellId 38041 02:52:33.917132 tst assert_extension.py: using BVCI 38042 02:52:34.032736 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 02:52:34.147327 tst assert_extension.py:10: start nitb and bts... 02:52:34.343495 run osmo-nitb_10.42.42.2: Starting osmo-nitb 02:52:34.942022 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31606): Launched 02:52:35.234608 run osmo-nitb_10.42.42.2(pid=31607): Launched 02:52:35.396809 run osmo-nitb_10.42.42.2(pid=31607): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31607)] 02:52:35.528123 run osmo-nitb_10.42.42.2(pid=31607): stdout: | (launched: 2022-12-14_02:52:35.180512) 02:52:35.660884 run osmo-nitb_10.42.42.2(pid=31607): stderr: | (launched: 2022-12-14_02:52:35.224260) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:52:35.793767 run osmo-nitb_10.42.42.2(pid=31607): stdout: | (launched: 2022-12-14_02:52:35.180512) 02:52:35.921860 run osmo-nitb_10.42.42.2(pid=31607): stderr: | (launched: 2022-12-14_02:52:35.224260) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31607): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31607) [trial-2398↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31607)] 02:52:36.344792 tst osmo-nitb_10.42.42.2(pid=31607): stdout: | (launched: 2022-12-14_02:52:35.180512) 02:52:36.462604 tst osmo-nitb_10.42.42.2(pid=31607): stderr: | (launched: 2022-12-14_02:52:35.224260) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 02:52:36.601453 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=31607): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31607) [trial-2398↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31607)] [trial-2398↪nitb_ussd:trx-lms↪assert_extension.py:12] 02:52:36.609829 tst assert_extension.py:12: Test FAILED (3.1 sec) 02:52:36.616299 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31606): Terminating (SIGTERM) 02:52:36.824755 --- ParallelTerminationStrategy: PID 31606 died... 02:52:36.845321 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31606): Terminated: ok {rc=0} 02:52:36.931282 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 ussd:trx-lms --------------------------------------------------------------------- 02:52:38.111939 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:52:38.116705 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 02:52:38.149059 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 02:52:38.175148 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 02:52:38.209813 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 02:52:38.242108 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 02:52:38.268082 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 02:52:38.795672 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2398 ussd:trx-lms assert_extension.py ---------------------------------------------- 02:52:38.802271 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:38.813842 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 02:52:38.865882 tst assert_extension.py: using LAC 38042 02:52:38.982927 tst assert_extension.py: using RAC 47 02:52:39.100470 tst assert_extension.py: using CellId 38042 02:52:39.215529 tst assert_extension.py: using BVCI 38043 02:52:39.321091 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:39.331408 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:39.341772 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:39.351933 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:39.362239 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 02:52:39.372322 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 02:52:39.490484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:52:39.978835 run create_hlr_db(pid=31611): Launched 02:52:40.099560 bus /sierra_2: Setting Powered False 02:52:41.161281 run create_hlr_db(pid=31611): Terminated: ok {rc=0} 02:52:41.599943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31613): Launched 02:52:41.915347 run osmo-hlr_10.42.42.2(pid=31614): Launched 02:52:42.035643 run osmo-stp_10.42.42.5: Starting osmo-stp 02:52:42.575457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31616): Launched 02:52:42.891017 run osmo-stp_10.42.42.5(pid=31617): Launched 02:52:43.011162 run osmo-msc_10.42.42.6: Starting osmo-msc 02:52:43.579227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31619): Launched 02:52:43.893620 run osmo-msc_10.42.42.6(pid=31620): Launched 02:52:44.070100 run osmo-stp_10.42.42.5(pid=31617): ERR: Terminated: ERROR {rc=1} [trial-2398↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31617)] 02:52:44.203759 run osmo-stp_10.42.42.5(pid=31617): stdout: | (launched: 2022-12-14_02:52:42.833189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:44.337661 run osmo-stp_10.42.42.5(pid=31617): stderr: | [0;m[38;5;43m20221214025243023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025243023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025243023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025243024 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025243024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025243024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025243024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:44.470772 run osmo-stp_10.42.42.5(pid=31617): stdout: | (launched: 2022-12-14_02:52:42.833189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:44.595845 run osmo-stp_10.42.42.5(pid=31617): stderr: | [0;m[38;5;43m20221214025243023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025243023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025243023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025243024 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025243024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025243024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025243024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:44.745949 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=31617): Process ended prematurely: osmo-stp_10.42.42.5(pid=31617) [trial-2398↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31617)] [trial-2398↪ussd:trx-lms↪assert_extension.py:17] 02:52:44.754888 tst assert_extension.py:17: Test FAILED (5.9 sec) 02:52:44.782038 run osmo-hlr_10.42.42.2(pid=31614): ERR: Terminated: ERROR {rc=237} [trial-2398↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31614)] 02:52:44.832645 run osmo-hlr_10.42.42.2(pid=31614): stdout: | (launched: 2022-12-14_02:52:41.857865) 02:52:44.884900 run osmo-hlr_10.42.42.2(pid=31614): stderr: | [0;m[1;31m20221214025242053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025242053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025242053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025242053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025242053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025242053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025242066 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025242074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025242075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025242075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:52:44.957612 run osmo-msc_10.42.42.6(pid=31620): ERR: Terminated: ERROR {rc=2} [trial-2398↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31620)] 02:52:45.007646 run osmo-msc_10.42.42.6(pid=31620): stdout: | (launched: 2022-12-14_02:52:43.836122) 02:52:45.059536 run osmo-msc_10.42.42.6(pid=31620): stderr: | [0;m[38;5;43m20221214025244158 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025244158 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffa2c4d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025244158 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025244158 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025244159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025244159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025244160 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025244161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025244161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025244161 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:52:45.111588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31613): Terminating (SIGTERM) 02:52:45.153659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31616): Terminating (SIGTERM) 02:52:45.195932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31619): Terminating (SIGTERM) 02:52:45.238534 --- ParallelTerminationStrategy: PID 31613 died... 02:52:45.258937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31613): Terminated: ok {rc=0} 02:52:45.305408 --- ParallelTerminationStrategy: PID 31616 died... 02:52:45.325325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31616): Terminated: ok {rc=0} 02:52:45.371495 --- ParallelTerminationStrategy: PID 31619 died... 02:52:45.391358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31619): Terminated: ok {rc=0} 02:52:45.478832 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 02:52:46.734788 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:52:46.745912 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 02:52:46.793959 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 02:52:46.829514 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 02:52:46.888319 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 02:52:46.934928 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 02:52:46.971318 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 02:52:47.500664 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 02:52:47.553141 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:47.564579 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:52:47.634917 tst mo_mt_call.py: using LAC 38043 02:52:47.761430 tst mo_mt_call.py: using RAC 48 02:52:47.878864 tst mo_mt_call.py: using CellId 38043 02:52:47.998194 tst mo_mt_call.py: using BVCI 38044 02:52:48.105848 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:48.117013 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:48.127919 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:48.139000 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:48.150192 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:48.161285 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:52:48.282182 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:52:48.398119 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:52:48.861709 run create_hlr_db(pid=31625): Launched 02:52:48.983549 bus /sierra_2: Setting Powered False 02:52:50.043121 run create_hlr_db(pid=31625): Terminated: ok {rc=0} 02:52:50.480934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31627): Launched 02:52:50.800785 run osmo-hlr_10.42.42.2(pid=31628): Launched 02:52:50.923282 run osmo-stp_10.42.42.5: Starting osmo-stp 02:52:51.474925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31630): Launched 02:52:51.794851 run osmo-stp_10.42.42.5(pid=31631): Launched 02:52:51.951028 run osmo-msc_10.42.42.6: Starting osmo-msc 02:52:52.530310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31633): Launched 02:52:52.849143 run osmo-msc_10.42.42.6(pid=31634): Launched 02:52:53.026787 run osmo-stp_10.42.42.5(pid=31631): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31631)] 02:52:53.161666 run osmo-stp_10.42.42.5(pid=31631): stdout: | (launched: 2022-12-14_02:52:51.736700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:53.297336 run osmo-stp_10.42.42.5(pid=31631): stderr: | [0;m[38;5;43m20221214025251964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025251964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025251965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025251965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025251967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025251967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025251968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:53.432638 run osmo-stp_10.42.42.5(pid=31631): stdout: | (launched: 2022-12-14_02:52:51.736700) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:52:53.560843 run osmo-stp_10.42.42.5(pid=31631): stderr: | [0;m[38;5;43m20221214025251964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025251964 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025251965 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025251965 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025251967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025251967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025251968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:52:53.713658 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31631): Process ended prematurely: osmo-stp_10.42.42.5(pid=31631) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31631)] [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 02:52:53.723493 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 02:52:53.751320 run osmo-hlr_10.42.42.2(pid=31628): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31628)] 02:52:53.802113 run osmo-hlr_10.42.42.2(pid=31628): stdout: | (launched: 2022-12-14_02:52:50.742469) 02:52:53.854715 run osmo-hlr_10.42.42.2(pid=31628): stderr: | [0;m[1;31m20221214025250938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025250938 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025250939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025250939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025250939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025250939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025250963 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025250973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025250973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025250973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:52:53.927210 run osmo-msc_10.42.42.6(pid=31634): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31634)] 02:52:53.976861 run osmo-msc_10.42.42.6(pid=31634): stdout: | (launched: 2022-12-14_02:52:52.790891) 02:52:54.028694 run osmo-msc_10.42.42.6(pid=31634): stderr: | [0;m[38;5;43m20221214025253112 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025253112 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efe367e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025253112 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025253112 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025253113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025253113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025253114 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025253115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025253115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025253115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:52:54.081386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31627): Terminating (SIGTERM) 02:52:54.123067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31630): Terminating (SIGTERM) 02:52:54.165627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31633): Terminating (SIGTERM) 02:52:54.208053 --- ParallelTerminationStrategy: PID 31627 died... 02:52:54.228485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31627): Terminated: ok {rc=0} 02:52:54.275236 --- ParallelTerminationStrategy: PID 31630 died... 02:52:54.295360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31630): Terminated: ok {rc=0} 02:52:54.342054 --- ParallelTerminationStrategy: PID 31633 died... 02:52:54.362249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31633): Terminated: ok {rc=0} 02:52:54.451668 bus /sierra_3: Setting Powered False 02:52:55.550791 bus /sierra_3: Setting Powered False 02:52:56.667297 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 02:52:57.816105 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:57.828160 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 02:52:57.900293 tst mo_mt_call_osmux.py: using LAC 38044 02:52:58.025575 tst mo_mt_call_osmux.py: using RAC 49 02:52:58.153492 tst mo_mt_call_osmux.py: using CellId 38044 02:52:58.273838 tst mo_mt_call_osmux.py: using BVCI 38045 02:52:58.382102 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:58.393337 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:58.404294 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:58.415359 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:58.426656 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 02:52:58.437840 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:52:58.557557 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 02:52:58.678179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:52:59.137719 run create_hlr_db(pid=31636): Launched 02:52:59.259008 bus /sierra_2: Setting Powered False 02:53:00.318816 run create_hlr_db(pid=31636): Terminated: ok {rc=0} 02:53:00.754747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31638): Launched 02:53:01.136559 run osmo-hlr_10.42.42.2(pid=31639): Launched 02:53:01.367128 run osmo-stp_10.42.42.5: Starting osmo-stp 02:53:02.062083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31641): Launched 02:53:02.389698 run osmo-stp_10.42.42.5(pid=31642): Launched 02:53:02.513551 run osmo-msc_10.42.42.6: Starting osmo-msc 02:53:03.068031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31644): Launched 02:53:03.365157 run osmo-msc_10.42.42.6(pid=31645): Launched 02:53:03.531275 run osmo-stp_10.42.42.5(pid=31642): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31642)] 02:53:03.656637 run osmo-stp_10.42.42.5(pid=31642): stdout: | (launched: 2022-12-14_02:53:02.321115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:03.781952 run osmo-stp_10.42.42.5(pid=31642): stderr: | [0;m[38;5;43m20221214025302511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025302511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025302511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025302512 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025302512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025302512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025302512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:03.905783 run osmo-stp_10.42.42.5(pid=31642): stdout: | (launched: 2022-12-14_02:53:02.321115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:04.023860 run osmo-stp_10.42.42.5(pid=31642): stderr: | [0;m[38;5;43m20221214025302511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025302511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025302511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025302512 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025302512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025302512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025302512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:04.166529 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31642): Process ended prematurely: osmo-stp_10.42.42.5(pid=31642) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31642)] [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 02:53:04.175652 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 02:53:04.201864 run osmo-hlr_10.42.42.2(pid=31639): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31639)] 02:53:04.249304 run osmo-hlr_10.42.42.2(pid=31639): stdout: | (launched: 2022-12-14_02:53:01.057068) 02:53:04.298452 run osmo-hlr_10.42.42.2(pid=31639): stderr: | [0;m[1;31m20221214025301294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025301294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025301294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025301294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025301294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025301294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025301316 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025301331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025301331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025301331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:53:04.366654 run osmo-msc_10.42.42.6(pid=31645): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31645)] 02:53:04.413513 run osmo-msc_10.42.42.6(pid=31645): stdout: | (launched: 2022-12-14_02:53:03.310662) 02:53:04.463650 run osmo-msc_10.42.42.6(pid=31645): stderr: | [0;m[38;5;43m20221214025303584 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025303584 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc3e5876c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025303584 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025303584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025303584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025303584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025303586 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025303586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025303587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025303587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:53:04.512731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31638): Terminating (SIGTERM) 02:53:04.552118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31641): Terminating (SIGTERM) 02:53:04.591559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31644): Terminating (SIGTERM) 02:53:04.631094 --- ParallelTerminationStrategy: PID 31638 died... 02:53:04.650131 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31638): Terminated: ok {rc=0} 02:53:04.693782 --- ParallelTerminationStrategy: PID 31641 died... 02:53:04.712151 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31641): Terminated: ok {rc=0} 02:53:04.755689 --- ParallelTerminationStrategy: PID 31644 died... 02:53:04.774203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31644): Terminated: ok {rc=0} 02:53:04.859435 bus /sierra_3: Setting Powered False 02:53:05.958707 bus /sierra_3: Setting Powered False 02:53:07.070167 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 02:53:08.314180 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:53:08.320562 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 02:53:08.352531 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 02:53:08.378701 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 02:53:08.428759 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 02:53:08.461162 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 02:53:08.487193 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 02:53:09.037983 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 02:53:09.091797 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:09.103294 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:53:09.173833 tst mo_mt_call.py: using LAC 38045 02:53:09.291829 tst mo_mt_call.py: using RAC 50 02:53:09.410692 tst mo_mt_call.py: using CellId 38045 02:53:09.530127 tst mo_mt_call.py: using BVCI 38046 02:53:09.639940 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:09.651050 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:09.662076 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:09.672699 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:09.683706 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:09.694607 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:53:09.810257 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:53:09.924592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:53:10.385643 run create_hlr_db(pid=31650): Launched 02:53:10.508322 bus /sierra_2: Setting Powered False 02:53:11.567995 run create_hlr_db(pid=31650): Terminated: ok {rc=0} 02:53:12.005641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31652): Launched 02:53:12.326674 run osmo-hlr_10.42.42.2(pid=31653): Launched 02:53:12.449185 run osmo-stp_10.42.42.5: Starting osmo-stp 02:53:13.000721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31655): Launched 02:53:13.319623 run osmo-stp_10.42.42.5(pid=31656): Launched 02:53:13.441601 run osmo-msc_10.42.42.6: Starting osmo-msc 02:53:14.023617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31658): Launched 02:53:14.327890 run osmo-msc_10.42.42.6(pid=31659): Launched 02:53:14.495175 run osmo-stp_10.42.42.5(pid=31656): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31656)] 02:53:14.621738 run osmo-stp_10.42.42.5(pid=31656): stdout: | (launched: 2022-12-14_02:53:13.261828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:14.750249 run osmo-stp_10.42.42.5(pid=31656): stderr: | [0;m[38;5;43m20221214025313453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025313453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025313454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025313454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025313455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025313455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025313455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:14.875117 run osmo-stp_10.42.42.5(pid=31656): stdout: | (launched: 2022-12-14_02:53:13.261828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:14.995050 run osmo-stp_10.42.42.5(pid=31656): stderr: | [0;m[38;5;43m20221214025313453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025313453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025313454 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025313454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025313455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025313455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025313455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:15.138398 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31656): Process ended prematurely: osmo-stp_10.42.42.5(pid=31656) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31656)] [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 02:53:15.147542 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:53:15.173884 run osmo-hlr_10.42.42.2(pid=31653): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31653)] 02:53:15.221859 run osmo-hlr_10.42.42.2(pid=31653): stdout: | (launched: 2022-12-14_02:53:12.268483) 02:53:15.271524 run osmo-hlr_10.42.42.2(pid=31653): stderr: | [0;m[1;31m20221214025312465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025312465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025312466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025312466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025312466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025312466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025312502 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025312511 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025312512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025312512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:53:15.340423 run osmo-msc_10.42.42.6(pid=31659): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31659)] 02:53:15.388208 run osmo-msc_10.42.42.6(pid=31659): stdout: | (launched: 2022-12-14_02:53:14.273339) 02:53:15.437465 run osmo-msc_10.42.42.6(pid=31659): stderr: | [0;m[38;5;43m20221214025314546 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025314546 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1129d30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025314546 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025314546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025314547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025314547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025314548 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025314549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025314549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025314549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:53:15.487308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31652): Terminating (SIGTERM) 02:53:15.527261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31655): Terminating (SIGTERM) 02:53:15.566953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31658): Terminating (SIGTERM) 02:53:15.606939 --- ParallelTerminationStrategy: PID 31652 died... 02:53:15.626300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31652): Terminated: ok {rc=0} 02:53:15.670354 --- ParallelTerminationStrategy: PID 31655 died... 02:53:15.689090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31655): Terminated: ok {rc=0} 02:53:15.733101 --- ParallelTerminationStrategy: PID 31658 died... 02:53:15.751847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31658): Terminated: ok {rc=0} 02:53:15.841888 bus /sierra_3: Setting Powered False 02:53:16.960195 bus /sierra_3: Setting Powered False 02:53:18.074072 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 02:53:19.223060 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:19.235161 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 02:53:19.306712 tst mo_mt_call_osmux.py: using LAC 38046 02:53:19.433953 tst mo_mt_call_osmux.py: using RAC 51 02:53:19.560236 tst mo_mt_call_osmux.py: using CellId 38046 02:53:19.685740 tst mo_mt_call_osmux.py: using BVCI 38047 02:53:19.801846 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:19.813309 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:19.824528 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:19.835918 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:19.847611 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 02:53:19.859662 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:53:19.975705 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 02:53:20.095528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:53:20.592604 run create_hlr_db(pid=31661): Launched 02:53:20.718273 bus /sierra_2: Setting Powered False 02:53:21.778630 run create_hlr_db(pid=31661): Terminated: ok {rc=0} 02:53:22.216362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31663): Launched 02:53:22.536648 run osmo-hlr_10.42.42.2(pid=31664): Launched 02:53:22.659101 run osmo-stp_10.42.42.5: Starting osmo-stp 02:53:23.214102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31666): Launched 02:53:23.533243 run osmo-stp_10.42.42.5(pid=31667): Launched 02:53:23.655254 run osmo-msc_10.42.42.6: Starting osmo-msc 02:53:24.238947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31669): Launched 02:53:24.558678 run osmo-msc_10.42.42.6(pid=31670): Launched 02:53:24.737188 run osmo-stp_10.42.42.5(pid=31667): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31667)] 02:53:24.873780 run osmo-stp_10.42.42.5(pid=31667): stdout: | (launched: 2022-12-14_02:53:23.475185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:25.010066 run osmo-stp_10.42.42.5(pid=31667): stderr: | [0;m[38;5;43m20221214025323665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025323666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025323666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025323666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025323668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025323669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025323669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:25.146068 run osmo-stp_10.42.42.5(pid=31667): stdout: | (launched: 2022-12-14_02:53:23.475185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:25.274004 run osmo-stp_10.42.42.5(pid=31667): stderr: | [0;m[38;5;43m20221214025323665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025323666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025323666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025323666 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025323668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025323669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025323669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:25.427080 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31667): Process ended prematurely: osmo-stp_10.42.42.5(pid=31667) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31667)] [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 02:53:25.436587 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:53:25.464326 run osmo-hlr_10.42.42.2(pid=31664): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31664)] 02:53:25.515404 run osmo-hlr_10.42.42.2(pid=31664): stdout: | (launched: 2022-12-14_02:53:22.478556) 02:53:25.567974 run osmo-hlr_10.42.42.2(pid=31664): stderr: | [0;m[1;31m20221214025322678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025322678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025322678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025322678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025322678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025322678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025322691 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025322699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025322699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025322699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:53:25.641080 run osmo-msc_10.42.42.6(pid=31670): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31670)] 02:53:25.691452 run osmo-msc_10.42.42.6(pid=31670): stdout: | (launched: 2022-12-14_02:53:24.500521) 02:53:25.743990 run osmo-msc_10.42.42.6(pid=31670): stderr: | [0;m[38;5;43m20221214025324820 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025324820 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9f32362c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025324820 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025324820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025324820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025324820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025324822 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025324823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025324823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025324823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:53:25.796736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31663): Terminating (SIGTERM) 02:53:25.838844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31666): Terminating (SIGTERM) 02:53:25.881548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31669): Terminating (SIGTERM) 02:53:25.924277 --- ParallelTerminationStrategy: PID 31663 died... 02:53:25.944787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31663): Terminated: ok {rc=0} 02:53:25.991765 --- ParallelTerminationStrategy: PID 31666 died... 02:53:26.011671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31666): Terminated: ok {rc=0} 02:53:26.058034 --- ParallelTerminationStrategy: PID 31669 died... 02:53:26.078072 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31669): Terminated: ok {rc=0} 02:53:26.166854 bus /sierra_3: Setting Powered False 02:53:27.265437 bus /sierra_3: Setting Powered False 02:53:28.380414 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 02:53:29.629983 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:53:29.636435 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 02:53:29.669112 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 02:53:29.695501 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 02:53:29.744817 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 02:53:29.777107 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 02:53:29.803538 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 02:53:30.355878 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 02:53:30.404194 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:30.415473 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:53:30.482545 tst mo_mt_call.py: using LAC 38047 02:53:30.598614 tst mo_mt_call.py: using RAC 52 02:53:30.716926 tst mo_mt_call.py: using CellId 38047 02:53:30.833657 tst mo_mt_call.py: using BVCI 38048 02:53:30.971138 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:30.983884 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:30.996051 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:31.008177 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:31.021572 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:31.035719 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:53:31.159945 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:53:31.313264 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:53:31.809747 run create_hlr_db(pid=31675): Launched 02:53:31.951503 bus /sierra_2: Setting Powered False 02:53:33.011334 run create_hlr_db(pid=31675): Terminated: ok {rc=0} 02:53:33.450841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31677): Launched 02:53:33.773144 run osmo-hlr_10.42.42.2(pid=31678): Launched 02:53:33.896774 run osmo-stp_10.42.42.5: Starting osmo-stp 02:53:34.414564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31680): Launched 02:53:34.713034 run osmo-stp_10.42.42.5(pid=31681): Launched 02:53:34.826856 run osmo-msc_10.42.42.6: Starting osmo-msc 02:53:35.366639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31683): Launched 02:53:35.665873 run osmo-msc_10.42.42.6(pid=31684): Launched 02:53:35.833327 run osmo-stp_10.42.42.5(pid=31681): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31681)] 02:53:35.959762 run osmo-stp_10.42.42.5(pid=31681): stdout: | (launched: 2022-12-14_02:53:34.658137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:36.085860 run osmo-stp_10.42.42.5(pid=31681): stderr: | [0;m[38;5;43m20221214025334827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025334827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025334828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025334828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025334830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025334830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025334830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:36.210400 run osmo-stp_10.42.42.5(pid=31681): stdout: | (launched: 2022-12-14_02:53:34.658137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:36.329620 run osmo-stp_10.42.42.5(pid=31681): stderr: | [0;m[38;5;43m20221214025334827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025334827 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025334828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025334828 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025334830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025334830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025334830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:36.472732 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31681): Process ended prematurely: osmo-stp_10.42.42.5(pid=31681) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31681)] [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 02:53:36.481925 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 02:53:36.508015 run osmo-hlr_10.42.42.2(pid=31678): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31678)] 02:53:36.555739 run osmo-hlr_10.42.42.2(pid=31678): stdout: | (launched: 2022-12-14_02:53:33.714788) 02:53:36.604880 run osmo-hlr_10.42.42.2(pid=31678): stderr: | [0;m[1;31m20221214025333914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025333914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025333914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025333914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025333914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025333914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025333927 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025333935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025333935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025333935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:53:36.673316 run osmo-msc_10.42.42.6(pid=31684): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31684)] 02:53:36.720442 run osmo-msc_10.42.42.6(pid=31684): stdout: | (launched: 2022-12-14_02:53:35.610003) 02:53:36.769259 run osmo-msc_10.42.42.6(pid=31684): stderr: | [0;m[38;5;43m20221214025335883 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025335883 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdb70134c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025335883 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025335883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025335883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025335883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025335885 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025335885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025335886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025335886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:53:36.818503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31677): Terminating (SIGTERM) 02:53:36.858181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31680): Terminating (SIGTERM) 02:53:36.897739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31683): Terminating (SIGTERM) 02:53:36.937529 --- ParallelTerminationStrategy: PID 31677 died... 02:53:36.956789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31677): Terminated: ok {rc=0} 02:53:37.000461 --- ParallelTerminationStrategy: PID 31680 died... 02:53:37.019248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31680): Terminated: ok {rc=0} 02:53:37.063127 --- ParallelTerminationStrategy: PID 31683 died... 02:53:37.081871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31683): Terminated: ok {rc=0} 02:53:37.165142 bus /sierra_3: Setting Powered False 02:53:38.263312 bus /sierra_3: Setting Powered False 02:53:39.378587 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 02:53:40.524420 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:40.536253 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 02:53:40.604417 tst mo_mt_call_osmux.py: using LAC 38048 02:53:40.726347 tst mo_mt_call_osmux.py: using RAC 53 02:53:40.843735 tst mo_mt_call_osmux.py: using CellId 38048 02:53:40.960081 tst mo_mt_call_osmux.py: using BVCI 38049 02:53:41.078410 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:41.090167 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:41.101608 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:41.112734 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:41.124391 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 02:53:41.135949 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:53:41.252499 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 02:53:41.373773 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:53:41.871094 run create_hlr_db(pid=31686): Launched 02:53:41.993537 bus /sierra_2: Setting Powered False 02:53:43.057556 run create_hlr_db(pid=31686): Terminated: ok {rc=0} 02:53:43.486346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31688): Launched 02:53:43.785871 run osmo-hlr_10.42.42.2(pid=31689): Launched 02:53:43.899872 run osmo-stp_10.42.42.5: Starting osmo-stp 02:53:44.430560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31691): Launched 02:53:44.728155 run osmo-stp_10.42.42.5(pid=31692): Launched 02:53:44.841167 run osmo-msc_10.42.42.6: Starting osmo-msc 02:53:45.379752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31694): Launched 02:53:45.677888 run osmo-msc_10.42.42.6(pid=31695): Launched 02:53:45.871153 run osmo-stp_10.42.42.5(pid=31692): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31692)] 02:53:46.136916 run osmo-stp_10.42.42.5(pid=31692): stdout: | (launched: 2022-12-14_02:53:44.673468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:46.317520 run osmo-stp_10.42.42.5(pid=31692): stderr: | [0;m[38;5;43m20221214025344844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025344844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025344844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025344845 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025344845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025344845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025344845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:46.447447 run osmo-stp_10.42.42.5(pid=31692): stdout: | (launched: 2022-12-14_02:53:44.673468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:46.569863 run osmo-stp_10.42.42.5(pid=31692): stderr: | [0;m[38;5;43m20221214025344844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025344844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025344844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025344845 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025344845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025344845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025344845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:46.716632 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31692): Process ended prematurely: osmo-stp_10.42.42.5(pid=31692) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31692)] [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 02:53:46.726314 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 02:53:46.754059 run osmo-hlr_10.42.42.2(pid=31689): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31689)] 02:53:46.803507 run osmo-hlr_10.42.42.2(pid=31689): stdout: | (launched: 2022-12-14_02:53:43.731414) 02:53:46.854021 run osmo-hlr_10.42.42.2(pid=31689): stderr: | [0;m[1;31m20221214025343908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025343908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025343908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025343908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025343908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025343908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025343921 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025343931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025343931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025343932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:53:46.924893 run osmo-msc_10.42.42.6(pid=31695): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31695)] 02:53:46.973724 run osmo-msc_10.42.42.6(pid=31695): stdout: | (launched: 2022-12-14_02:53:45.622973) 02:53:47.024178 run osmo-msc_10.42.42.6(pid=31695): stderr: | [0;m[38;5;43m20221214025345971 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025345972 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb44777fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025345972 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025345972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025345972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025345972 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025345974 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025345974 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025345975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025345975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:53:47.074911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31688): Terminating (SIGTERM) 02:53:47.115693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31691): Terminating (SIGTERM) 02:53:47.156339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31694): Terminating (SIGTERM) 02:53:47.197255 --- ParallelTerminationStrategy: PID 31688 died... 02:53:47.216641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31688): Terminated: ok {rc=0} 02:53:47.261292 --- ParallelTerminationStrategy: PID 31691 died... 02:53:47.280429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31691): Terminated: ok {rc=0} 02:53:47.325268 --- ParallelTerminationStrategy: PID 31694 died... 02:53:47.343887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31694): Terminated: ok {rc=0} 02:53:47.428160 bus /sierra_3: Setting Powered False 02:53:48.526121 bus /sierra_3: Setting Powered False 02:53:49.641663 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 02:53:50.884743 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:53:50.891979 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 02:53:50.924582 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 02:53:50.951078 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 02:53:51.000585 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 02:53:51.032845 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 02:53:51.058774 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 02:53:51.610113 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 02:53:51.657972 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:53:51.668914 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:53:51.739689 tst mo_mt_call.py: using LAC 38049 02:53:51.856872 tst mo_mt_call.py: using RAC 54 02:53:51.972520 tst mo_mt_call.py: using CellId 38049 02:53:52.088517 tst mo_mt_call.py: using BVCI 38050 02:53:52.196192 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:53:52.207178 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:53:52.217934 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:53:52.228607 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:53:52.239441 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:53:52.250257 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:53:52.370744 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:53:52.489111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:53:52.985984 run create_hlr_db(pid=31702): Launched 02:53:53.109396 bus /sierra_2: Setting Powered False 02:53:54.172448 run create_hlr_db(pid=31702): Terminated: ok {rc=0} 02:53:54.618145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31704): Launched 02:53:54.937037 run osmo-hlr_10.42.42.2(pid=31705): Launched 02:53:55.059389 run osmo-stp_10.42.42.5: Starting osmo-stp 02:53:55.574445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31707): Launched 02:53:55.873047 run osmo-stp_10.42.42.5(pid=31708): Launched 02:53:55.987493 run osmo-msc_10.42.42.6: Starting osmo-msc 02:53:56.527384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31710): Launched 02:53:56.825291 run osmo-msc_10.42.42.6(pid=31711): Launched 02:53:56.992197 run osmo-stp_10.42.42.5(pid=31708): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31708)] 02:53:57.118679 run osmo-stp_10.42.42.5(pid=31708): stdout: | (launched: 2022-12-14_02:53:55.818091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:57.245198 run osmo-stp_10.42.42.5(pid=31708): stderr: | [0;m[38;5;43m20221214025355989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025355989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025355989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025355990 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025355990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025355990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025355990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:57.369121 run osmo-stp_10.42.42.5(pid=31708): stdout: | (launched: 2022-12-14_02:53:55.818091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:53:57.487575 run osmo-stp_10.42.42.5(pid=31708): stderr: | [0;m[38;5;43m20221214025355989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025355989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025355989 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025355990 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025355990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025355990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025355990 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:53:57.629668 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31708): Process ended prematurely: osmo-stp_10.42.42.5(pid=31708) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31708)] [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 02:53:57.638601 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:53:57.665067 run osmo-hlr_10.42.42.2(pid=31705): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31705)] 02:53:57.713046 run osmo-hlr_10.42.42.2(pid=31705): stdout: | (launched: 2022-12-14_02:53:54.878763) 02:53:57.762606 run osmo-hlr_10.42.42.2(pid=31705): stderr: | [0;m[1;31m20221214025355076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025355076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025355076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025355077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025355077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025355077 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025355088 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025355096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025355096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025355097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:53:57.831566 run osmo-msc_10.42.42.6(pid=31711): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31711)] 02:53:57.880039 run osmo-msc_10.42.42.6(pid=31711): stdout: | (launched: 2022-12-14_02:53:56.769999) 02:53:57.929796 run osmo-msc_10.42.42.6(pid=31711): stderr: | [0;m[38;5;43m20221214025357043 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025357043 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f38c7cf2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025357043 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025357043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025357043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025357043 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025357045 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025357046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025357046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025357046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:53:57.979879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31704): Terminating (SIGTERM) 02:53:58.019455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31707): Terminating (SIGTERM) 02:53:58.059003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31710): Terminating (SIGTERM) 02:53:58.098825 --- ParallelTerminationStrategy: PID 31704 died... 02:53:58.117846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31704): Terminated: ok {rc=0} 02:53:58.161608 --- ParallelTerminationStrategy: PID 31707 died... 02:53:58.180064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31707): Terminated: ok {rc=0} 02:53:58.223763 --- ParallelTerminationStrategy: PID 31710 died... 02:53:58.242513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31710): Terminated: ok {rc=0} 02:53:58.328170 bus /sierra_3: Setting Powered False 02:53:59.427557 bus /sierra_3: Setting Powered False 02:54:00.544097 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 02:54:01.721971 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:01.737044 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 02:54:01.821071 tst mo_mt_call_osmux.py: using LAC 38050 02:54:01.960079 tst mo_mt_call_osmux.py: using RAC 55 02:54:02.102939 tst mo_mt_call_osmux.py: using CellId 38050 02:54:02.264410 tst mo_mt_call_osmux.py: using BVCI 38051 02:54:02.408863 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:02.423694 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:02.438371 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:02.454341 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:02.473168 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 02:54:02.488890 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:54:02.641038 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 02:54:02.790106 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:54:03.422391 run create_hlr_db(pid=31854): Launched 02:54:03.618340 bus /sierra_2: Setting Powered False 02:54:04.679192 run create_hlr_db(pid=31854): Terminated: ok {rc=0} 02:54:05.153714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31984): Launched 02:54:05.475540 run osmo-hlr_10.42.42.2(pid=31985): Launched 02:54:05.711514 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:06.439186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31989): Launched 02:54:06.769706 run osmo-stp_10.42.42.5(pid=31990): Launched 02:54:07.006147 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:07.733771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31992): Launched 02:54:08.069446 run osmo-msc_10.42.42.6(pid=31993): Launched 02:54:08.424771 run osmo-stp_10.42.42.5(pid=31990): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31990)] 02:54:08.710959 run osmo-stp_10.42.42.5(pid=31990): stdout: | (launched: 2022-12-14_02:54:06.700908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:08.880638 run osmo-stp_10.42.42.5(pid=31990): stderr: | [0;m[38;5;43m20221214025407032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025407037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025407037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025407038 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025407038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025407038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025407038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:09.022367 run osmo-stp_10.42.42.5(pid=31990): stdout: | (launched: 2022-12-14_02:54:06.700908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:09.158892 run osmo-stp_10.42.42.5(pid=31990): stderr: | [0;m[38;5;43m20221214025407032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025407037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025407037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025407038 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025407038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025407038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025407038 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:09.320214 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31990): Process ended prematurely: osmo-stp_10.42.42.5(pid=31990) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31990)] [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 02:54:09.331276 tst mo_mt_call_osmux.py:8: Test FAILED (7.7 sec) 02:54:09.360902 run osmo-hlr_10.42.42.2(pid=31985): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31985)] 02:54:09.416412 run osmo-hlr_10.42.42.2(pid=31985): stdout: | (launched: 2022-12-14_02:54:05.412203) 02:54:09.471713 run osmo-hlr_10.42.42.2(pid=31985): stderr: | [0;m[1;31m20221214025405753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025405753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025405753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025405753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025405753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025405754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025405773 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025405786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025405786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025405786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:54:09.548673 run osmo-msc_10.42.42.6(pid=31993): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31993)] 02:54:09.602867 run osmo-msc_10.42.42.6(pid=31993): stdout: | (launched: 2022-12-14_02:54:08.008287) 02:54:09.658286 run osmo-msc_10.42.42.6(pid=31993): stderr: | [0;m[38;5;43m20221214025408491 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025408491 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9e8fda1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025408491 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025408491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025408491 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025408492 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025408502 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025408502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025408502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025408502 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:54:09.714846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31984): Terminating (SIGTERM) 02:54:09.759144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31989): Terminating (SIGTERM) 02:54:09.807672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31992): Terminating (SIGTERM) 02:54:09.854981 --- ParallelTerminationStrategy: PID 31984 died... 02:54:09.877878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31984): Terminated: ok {rc=0} 02:54:09.930002 --- ParallelTerminationStrategy: PID 31989 died... 02:54:09.951096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31989): Terminated: ok {rc=0} 02:54:10.000207 --- ParallelTerminationStrategy: PID 31992 died... 02:54:10.022175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31992): Terminated: ok {rc=0} 02:54:10.117889 bus /sierra_3: Setting Powered False 02:54:11.222690 bus /sierra_3: Setting Powered False 02:54:12.348133 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 02:54:13.614555 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:54:13.622600 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 02:54:13.659896 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 02:54:13.690635 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 02:54:13.744770 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 02:54:13.780238 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 02:54:13.809839 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 02:54:14.362886 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 02:54:14.420361 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:14.432863 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:54:14.505955 tst mo_mt_call.py: using LAC 38051 02:54:14.636921 tst mo_mt_call.py: using RAC 56 02:54:14.768330 tst mo_mt_call.py: using CellId 38051 02:54:14.899860 tst mo_mt_call.py: using BVCI 38052 02:54:15.023264 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:15.035749 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:15.048505 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:15.060915 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:15.076069 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:15.089211 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:54:15.215220 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:54:15.342141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:54:15.887549 run create_hlr_db(pid=31998): Launched 02:54:16.108827 bus /sierra_2: Setting Powered False 02:54:17.207794 run create_hlr_db(pid=31998): Terminated: ok {rc=0} 02:54:17.802868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32000): Launched 02:54:18.171403 run osmo-hlr_10.42.42.2(pid=32001): Launched 02:54:18.386441 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:19.038886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32003): Launched 02:54:19.388161 run osmo-stp_10.42.42.5(pid=32004): Launched 02:54:19.641006 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:20.328229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32006): Launched 02:54:20.675939 run osmo-msc_10.42.42.6(pid=32007): Launched 02:54:21.051691 run osmo-stp_10.42.42.5(pid=32004): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32004)] 02:54:21.335691 run osmo-stp_10.42.42.5(pid=32004): stdout: | (launched: 2022-12-14_02:54:19.325457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:21.506168 run osmo-stp_10.42.42.5(pid=32004): stderr: | [0;m[38;5;43m20221214025419629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025419630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025419630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025419630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025419631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025419631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025419631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:21.647554 run osmo-stp_10.42.42.5(pid=32004): stdout: | (launched: 2022-12-14_02:54:19.325457) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:21.785100 run osmo-stp_10.42.42.5(pid=32004): stderr: | [0;m[38;5;43m20221214025419629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025419630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025419630 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025419630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025419631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025419631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025419631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:21.948050 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32004): Process ended prematurely: osmo-stp_10.42.42.5(pid=32004) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32004)] [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 02:54:21.958839 tst mo_mt_call.py:8: Test FAILED (7.6 sec) 02:54:21.988126 run osmo-hlr_10.42.42.2(pid=32001): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32001)] 02:54:22.043735 run osmo-hlr_10.42.42.2(pid=32001): stdout: | (launched: 2022-12-14_02:54:18.114402) 02:54:22.100883 run osmo-hlr_10.42.42.2(pid=32001): stderr: | [0;m[1;31m20221214025418317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025418317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025418317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025418317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025418317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025418317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025418335 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025418350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025418350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025418350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:54:22.176816 run osmo-msc_10.42.42.6(pid=32007): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32007)] 02:54:22.230352 run osmo-msc_10.42.42.6(pid=32007): stdout: | (launched: 2022-12-14_02:54:20.614462) 02:54:22.286770 run osmo-msc_10.42.42.6(pid=32007): stderr: | [0;m[38;5;43m20221214025421120 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025421120 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f10df7b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025421120 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025421121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025421121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025421121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025421123 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025421123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025421123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025421123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:54:22.346222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32000): Terminating (SIGTERM) 02:54:22.390240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32003): Terminating (SIGTERM) 02:54:22.437421 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32006): Terminating (SIGTERM) 02:54:22.485607 --- ParallelTerminationStrategy: PID 32000 died... 02:54:22.508170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32000): Terminated: ok {rc=0} 02:54:22.560486 --- ParallelTerminationStrategy: PID 32003 died... 02:54:22.581901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32003): Terminated: ok {rc=0} 02:54:22.630995 --- ParallelTerminationStrategy: PID 32006 died... 02:54:22.652882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32006): Terminated: ok {rc=0} 02:54:22.747779 bus /sierra_3: Setting Powered False 02:54:23.854725 bus /sierra_3: Setting Powered False 02:54:24.975091 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 02:54:26.121320 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:26.133046 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 02:54:26.201921 tst mo_mt_call_osmux.py: using LAC 38052 02:54:26.321461 tst mo_mt_call_osmux.py: using RAC 57 02:54:26.440315 tst mo_mt_call_osmux.py: using CellId 38052 02:54:26.560456 tst mo_mt_call_osmux.py: using BVCI 38053 02:54:26.671778 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:26.682831 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:26.693621 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:26.704353 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:26.715181 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 02:54:26.726023 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:54:26.842190 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 02:54:26.963987 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:54:27.467702 run create_hlr_db(pid=32010): Launched 02:54:27.591940 bus /sierra_2: Setting Powered False 02:54:28.656932 run create_hlr_db(pid=32010): Terminated: ok {rc=0} 02:54:29.108558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32012): Launched 02:54:29.432233 run osmo-hlr_10.42.42.2(pid=32013): Launched 02:54:29.556217 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:30.113963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32015): Launched 02:54:30.438184 run osmo-stp_10.42.42.5(pid=32016): Launched 02:54:30.563231 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:31.178273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32018): Launched 02:54:31.519422 run osmo-msc_10.42.42.6(pid=32019): Launched 02:54:31.902473 run osmo-stp_10.42.42.5(pid=32016): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32016)] 02:54:32.246793 run osmo-stp_10.42.42.5(pid=32016): stdout: | (launched: 2022-12-14_02:54:30.378966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:32.396349 run osmo-stp_10.42.42.5(pid=32016): stderr: | [0;m[38;5;43m20221214025430573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025430573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025430574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025430574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025430574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025430575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025430575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:32.523396 run osmo-stp_10.42.42.5(pid=32016): stdout: | (launched: 2022-12-14_02:54:30.378966) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:32.644043 run osmo-stp_10.42.42.5(pid=32016): stderr: | [0;m[38;5;43m20221214025430573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025430573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025430574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025430574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025430574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025430575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025430575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:32.790539 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32016): Process ended prematurely: osmo-stp_10.42.42.5(pid=32016) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32016)] [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 02:54:32.799841 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 02:54:32.826579 run osmo-hlr_10.42.42.2(pid=32013): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32013)] 02:54:32.874997 run osmo-hlr_10.42.42.2(pid=32013): stdout: | (launched: 2022-12-14_02:54:29.373163) 02:54:32.925728 run osmo-hlr_10.42.42.2(pid=32013): stderr: | [0;m[1;31m20221214025429571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025429571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025429571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025429571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025429571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025429571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025429583 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025429591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025429591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025429591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:54:32.996053 run osmo-msc_10.42.42.6(pid=32019): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32019)] 02:54:33.044268 run osmo-msc_10.42.42.6(pid=32019): stdout: | (launched: 2022-12-14_02:54:31.459014) 02:54:33.093991 run osmo-msc_10.42.42.6(pid=32019): stderr: | [0;m[38;5;43m20221214025432008 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025432008 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f181b7e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025432008 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025432008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025432008 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025432009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025432017 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025432019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025432019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025432019 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:54:33.144029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32012): Terminating (SIGTERM) 02:54:33.184011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32015): Terminating (SIGTERM) 02:54:33.223962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32018): Terminating (SIGTERM) 02:54:33.264150 --- ParallelTerminationStrategy: PID 32012 died... 02:54:33.283496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32012): Terminated: ok {rc=0} 02:54:33.327790 --- ParallelTerminationStrategy: PID 32015 died... 02:54:33.346691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32015): Terminated: ok {rc=0} 02:54:33.390706 --- ParallelTerminationStrategy: PID 32018 died... 02:54:33.409387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32018): Terminated: ok {rc=0} 02:54:33.496708 bus /sierra_3: Setting Powered False 02:54:34.596518 bus /sierra_3: Setting Powered False 02:54:35.711691 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:54:36.960188 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:54:36.967024 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:54:36.999498 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 02:54:37.025765 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:54:37.076473 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:54:37.108993 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 02:54:37.135208 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:54:37.686322 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 02:54:37.735945 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:37.747034 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:54:37.816866 tst mo_mt_call.py: using LAC 38053 02:54:37.936035 tst mo_mt_call.py: using RAC 58 02:54:38.056485 tst mo_mt_call.py: using CellId 38053 02:54:38.177474 tst mo_mt_call.py: using BVCI 38054 02:54:38.286998 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:38.298096 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:38.308922 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:38.319881 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:38.330810 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:38.341784 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:54:38.462394 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:54:38.580296 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:54:39.050912 run create_hlr_db(pid=32024): Launched 02:54:39.174987 bus /sierra_2: Setting Powered False 02:54:40.236049 run create_hlr_db(pid=32024): Terminated: ok {rc=0} 02:54:40.660865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32026): Launched 02:54:40.965261 run osmo-hlr_10.42.42.2(pid=32027): Launched 02:54:41.080437 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:41.618697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32029): Launched 02:54:41.923552 run osmo-stp_10.42.42.5(pid=32030): Launched 02:54:42.038683 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:42.587474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32032): Launched 02:54:42.892691 run osmo-msc_10.42.42.6(pid=32033): Launched 02:54:43.063206 run osmo-stp_10.42.42.5(pid=32030): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32030)] 02:54:43.191756 run osmo-stp_10.42.42.5(pid=32030): stdout: | (launched: 2022-12-14_02:54:41.867312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:43.320152 run osmo-stp_10.42.42.5(pid=32030): stderr: | [0;m[38;5;43m20221214025442037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025442037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025442038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025442038 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025442040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025442041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025442041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:43.446090 run osmo-stp_10.42.42.5(pid=32030): stdout: | (launched: 2022-12-14_02:54:41.867312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:43.566500 run osmo-stp_10.42.42.5(pid=32030): stderr: | [0;m[38;5;43m20221214025442037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025442037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025442038 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025442038 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025442040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025442041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025442041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:43.710565 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32030): Process ended prematurely: osmo-stp_10.42.42.5(pid=32030) [trial-2398↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32030)] [trial-2398↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 02:54:43.719492 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 02:54:43.745886 run osmo-hlr_10.42.42.2(pid=32027): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32027)] 02:54:43.794113 run osmo-hlr_10.42.42.2(pid=32027): stdout: | (launched: 2022-12-14_02:54:40.909284) 02:54:43.844036 run osmo-hlr_10.42.42.2(pid=32027): stderr: | [0;m[1;31m20221214025441086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025441086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025441086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025441086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025441086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025441086 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025441098 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025441107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025441107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025441107 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:54:43.913626 run osmo-msc_10.42.42.6(pid=32033): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32033)] 02:54:43.961689 run osmo-msc_10.42.42.6(pid=32033): stdout: | (launched: 2022-12-14_02:54:42.835691) 02:54:44.011396 run osmo-msc_10.42.42.6(pid=32033): stderr: | [0;m[38;5;43m20221214025443110 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025443110 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f38c3717c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025443110 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025443110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025443110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025443110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025443112 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025443112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025443113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025443113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:54:44.061609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32026): Terminating (SIGTERM) 02:54:44.101523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32029): Terminating (SIGTERM) 02:54:44.141384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32032): Terminating (SIGTERM) 02:54:44.181303 --- ParallelTerminationStrategy: PID 32026 died... 02:54:44.200310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32026): Terminated: ok {rc=0} 02:54:44.244174 --- ParallelTerminationStrategy: PID 32029 died... 02:54:44.262759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32029): Terminated: ok {rc=0} 02:54:44.306360 --- ParallelTerminationStrategy: PID 32032 died... 02:54:44.324817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32032): Terminated: ok {rc=0} 02:54:44.407971 bus /sierra_3: Setting Powered False 02:54:45.505975 bus /sierra_3: Setting Powered False 02:54:46.625179 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 02:54:47.769706 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:47.781598 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:54:47.850914 tst mo_mt_call_osmux.py: using LAC 38054 02:54:47.994268 tst mo_mt_call_osmux.py: using RAC 59 02:54:48.129277 tst mo_mt_call_osmux.py: using CellId 38054 02:54:48.257665 tst mo_mt_call_osmux.py: using BVCI 38055 02:54:48.368378 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:48.379523 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:48.390510 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:48.401391 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:48.412327 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 02:54:48.423226 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:54:48.543461 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:54:48.661861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:54:49.134126 run create_hlr_db(pid=32035): Launched 02:54:49.260035 bus /sierra_2: Setting Powered False 02:54:50.321369 run create_hlr_db(pid=32035): Terminated: ok {rc=0} 02:54:50.765548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32037): Launched 02:54:51.092046 run osmo-hlr_10.42.42.2(pid=32038): Launched 02:54:51.216554 run osmo-stp_10.42.42.5: Starting osmo-stp 02:54:51.776003 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32040): Launched 02:54:52.101365 run osmo-stp_10.42.42.5(pid=32041): Launched 02:54:52.225329 run osmo-msc_10.42.42.6: Starting osmo-msc 02:54:52.821526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32043): Launched 02:54:53.148672 run osmo-msc_10.42.42.6(pid=32044): Launched 02:54:53.331477 run osmo-stp_10.42.42.5(pid=32041): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32041)] 02:54:53.469874 run osmo-stp_10.42.42.5(pid=32041): stdout: | (launched: 2022-12-14_02:54:52.041834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:53.608235 run osmo-stp_10.42.42.5(pid=32041): stderr: | [0;m[38;5;43m20221214025452234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025452234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025452234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025452235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025452235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025452235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025452235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:53.746007 run osmo-stp_10.42.42.5(pid=32041): stdout: | (launched: 2022-12-14_02:54:52.041834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:54:53.876688 run osmo-stp_10.42.42.5(pid=32041): stderr: | [0;m[38;5;43m20221214025452234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025452234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025452234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025452235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025452235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025452235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025452235 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:54:54.033080 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32041): Process ended prematurely: osmo-stp_10.42.42.5(pid=32041) [trial-2398↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32041)] [trial-2398↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 02:54:54.042858 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 02:54:54.071049 run osmo-hlr_10.42.42.2(pid=32038): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32038)] 02:54:54.122663 run osmo-hlr_10.42.42.2(pid=32038): stdout: | (launched: 2022-12-14_02:54:51.032208) 02:54:54.175705 run osmo-hlr_10.42.42.2(pid=32038): stderr: | [0;m[1;31m20221214025451232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025451232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025451232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025451232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025451232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025451232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025451247 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025451257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025451257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025451257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:54:54.248872 run osmo-msc_10.42.42.6(pid=32044): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32044)] 02:54:54.299112 run osmo-msc_10.42.42.6(pid=32044): stdout: | (launched: 2022-12-14_02:54:53.089079) 02:54:54.351786 run osmo-msc_10.42.42.6(pid=32044): stderr: | [0;m[38;5;43m20221214025453409 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025453409 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0ba1256c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025453409 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025453409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025453409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025453410 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025453411 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025453412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025453412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025453412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:54:54.404451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32037): Terminating (SIGTERM) 02:54:54.446846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32040): Terminating (SIGTERM) 02:54:54.489410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32043): Terminating (SIGTERM) 02:54:54.532124 --- ParallelTerminationStrategy: PID 32037 died... 02:54:54.552800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32037): Terminated: ok {rc=0} 02:54:54.599532 --- ParallelTerminationStrategy: PID 32040 died... 02:54:54.619659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32040): Terminated: ok {rc=0} 02:54:54.666080 --- ParallelTerminationStrategy: PID 32043 died... 02:54:54.686238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32043): Terminated: ok {rc=0} 02:54:54.775053 bus /sierra_3: Setting Powered False 02:54:55.874385 bus /sierra_3: Setting Powered False 02:54:56.991947 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:54:58.243589 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:54:58.249978 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:54:58.283422 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 02:54:58.310656 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 02:54:58.363101 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:54:58.395640 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 02:54:58.422315 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 02:54:58.976169 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 02:54:59.029974 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:54:59.041356 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:54:59.110364 tst mo_mt_call.py: using LAC 38055 02:54:59.236141 tst mo_mt_call.py: using RAC 60 02:54:59.362439 tst mo_mt_call.py: using CellId 38055 02:54:59.488517 tst mo_mt_call.py: using BVCI 38056 02:54:59.607004 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:54:59.618363 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:54:59.629577 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:54:59.640557 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:54:59.651959 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:54:59.663414 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:54:59.781354 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:54:59.901819 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:55:00.408176 run create_hlr_db(pid=32049): Launched 02:55:00.531780 bus /sierra_2: Setting Powered False 02:55:01.594585 run create_hlr_db(pid=32049): Terminated: ok {rc=0} 02:55:02.055223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32054): Launched 02:55:02.396002 run osmo-hlr_10.42.42.2(pid=32055): Launched 02:55:02.522449 run osmo-stp_10.42.42.5: Starting osmo-stp 02:55:03.082857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32057): Launched 02:55:03.410274 run osmo-stp_10.42.42.5(pid=32058): Launched 02:55:03.535885 run osmo-msc_10.42.42.6: Starting osmo-msc 02:55:04.125765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32060): Launched 02:55:04.452579 run osmo-msc_10.42.42.6(pid=32061): Launched 02:55:04.635535 run osmo-stp_10.42.42.5(pid=32058): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32058)] 02:55:04.773984 run osmo-stp_10.42.42.5(pid=32058): stdout: | (launched: 2022-12-14_02:55:03.350726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:04.913353 run osmo-stp_10.42.42.5(pid=32058): stderr: | [0;m[38;5;43m20221214025503542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025503542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025503543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025503543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025503545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025503546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025503546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:05.051214 run osmo-stp_10.42.42.5(pid=32058): stdout: | (launched: 2022-12-14_02:55:03.350726) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:05.181825 run osmo-stp_10.42.42.5(pid=32058): stderr: | [0;m[38;5;43m20221214025503542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025503542 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025503543 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025503543 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025503545 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025503546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025503546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:05.337892 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32058): Process ended prematurely: osmo-stp_10.42.42.5(pid=32058) [trial-2398↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32058)] [trial-2398↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 02:55:05.347595 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 02:55:05.375525 run osmo-hlr_10.42.42.2(pid=32055): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32055)] 02:55:05.426818 run osmo-hlr_10.42.42.2(pid=32055): stdout: | (launched: 2022-12-14_02:55:02.335957) 02:55:05.479844 run osmo-hlr_10.42.42.2(pid=32055): stderr: | [0;m[1;31m20221214025502533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025502533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025502533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025502533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025502533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025502533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025502547 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025502556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025502557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025502557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:55:05.553299 run osmo-msc_10.42.42.6(pid=32061): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32061)] 02:55:05.603777 run osmo-msc_10.42.42.6(pid=32061): stdout: | (launched: 2022-12-14_02:55:04.393056) 02:55:05.656795 run osmo-msc_10.42.42.6(pid=32061): stderr: | [0;m[38;5;43m20221214025504715 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025504715 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7eff2bffac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025504716 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025504716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025504716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025504716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025504718 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025504718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025504718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025504718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:55:05.709874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32054): Terminating (SIGTERM) 02:55:05.752017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32057): Terminating (SIGTERM) 02:55:05.795090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32060): Terminating (SIGTERM) 02:55:05.837905 --- ParallelTerminationStrategy: PID 32054 died... 02:55:05.858573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32054): Terminated: ok {rc=0} 02:55:05.905756 --- ParallelTerminationStrategy: PID 32057 died... 02:55:05.925784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32057): Terminated: ok {rc=0} 02:55:05.972511 --- ParallelTerminationStrategy: PID 32060 died... 02:55:05.992627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32060): Terminated: ok {rc=0} 02:55:06.083048 bus /sierra_3: Setting Powered False 02:55:07.182642 bus /sierra_3: Setting Powered False 02:55:08.301453 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 02:55:09.448277 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:09.459978 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:55:09.529705 tst mo_mt_call_osmux.py: using LAC 38056 02:55:09.651713 tst mo_mt_call_osmux.py: using RAC 61 02:55:09.772744 tst mo_mt_call_osmux.py: using CellId 38056 02:55:09.902674 tst mo_mt_call_osmux.py: using BVCI 38057 02:55:10.023442 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:10.034758 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:10.045872 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:10.057337 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:10.068717 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 02:55:10.080215 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:55:10.202721 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 02:55:10.320421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:55:10.790285 run create_hlr_db(pid=32063): Launched 02:55:10.916476 bus /sierra_2: Setting Powered False 02:55:11.977579 run create_hlr_db(pid=32063): Terminated: ok {rc=0} 02:55:12.401711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32065): Launched 02:55:12.706075 run osmo-hlr_10.42.42.2(pid=32066): Launched 02:55:12.821203 run osmo-stp_10.42.42.5: Starting osmo-stp 02:55:13.360909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32068): Launched 02:55:13.662875 run osmo-stp_10.42.42.5(pid=32069): Launched 02:55:13.777580 run osmo-msc_10.42.42.6: Starting osmo-msc 02:55:14.326035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32071): Launched 02:55:14.628734 run osmo-msc_10.42.42.6(pid=32072): Launched 02:55:14.798149 run osmo-stp_10.42.42.5(pid=32069): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32069)] 02:55:14.926505 run osmo-stp_10.42.42.5(pid=32069): stdout: | (launched: 2022-12-14_02:55:13.607033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:15.053920 run osmo-stp_10.42.42.5(pid=32069): stderr: | [0;m[38;5;43m20221214025513778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025513778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025513779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025513779 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025513781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025513781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025513781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:15.181232 run osmo-stp_10.42.42.5(pid=32069): stdout: | (launched: 2022-12-14_02:55:13.607033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:15.302356 run osmo-stp_10.42.42.5(pid=32069): stderr: | [0;m[38;5;43m20221214025513778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025513778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025513779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025513779 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025513781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025513781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025513781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:15.447522 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32069): Process ended prematurely: osmo-stp_10.42.42.5(pid=32069) [trial-2398↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32069)] [trial-2398↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 02:55:15.456541 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 02:55:15.483575 run osmo-hlr_10.42.42.2(pid=32066): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32066)] 02:55:15.532291 run osmo-hlr_10.42.42.2(pid=32066): stdout: | (launched: 2022-12-14_02:55:12.650308) 02:55:15.582299 run osmo-hlr_10.42.42.2(pid=32066): stderr: | [0;m[1;31m20221214025512826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025512826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025512826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025512826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025512826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025512826 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025512838 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025512847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025512848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025512848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:55:15.651462 run osmo-msc_10.42.42.6(pid=32072): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32072)] 02:55:15.700097 run osmo-msc_10.42.42.6(pid=32072): stdout: | (launched: 2022-12-14_02:55:14.572516) 02:55:15.749948 run osmo-msc_10.42.42.6(pid=32072): stderr: | [0;m[38;5;43m20221214025514846 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025514846 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f31a0f2dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025514846 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025514846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025514846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025514846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025514848 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025514849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025514849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025514849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:55:15.800058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32065): Terminating (SIGTERM) 02:55:15.853994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32068): Terminating (SIGTERM) 02:55:15.900261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32071): Terminating (SIGTERM) 02:55:15.947487 --- ParallelTerminationStrategy: PID 32065 died... 02:55:15.966894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32065): Terminated: ok {rc=0} 02:55:16.011895 --- ParallelTerminationStrategy: PID 32068 died... 02:55:16.031903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32068): Terminated: ok {rc=0} 02:55:16.077785 --- ParallelTerminationStrategy: PID 32071 died... 02:55:16.097405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32071): Terminated: ok {rc=0} 02:55:16.183005 bus /sierra_3: Setting Powered False 02:55:17.286372 bus /sierra_3: Setting Powered False 02:55:18.402108 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 emergency:trx-lms --------------------------------------------------------------------- 02:55:19.654695 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:55:19.660600 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 02:55:19.693656 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 02:55:19.725176 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 02:55:19.812936 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 02:55:19.846690 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 02:55:19.874480 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 02:55:20.457907 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2398 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 02:55:20.463122 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:20.474445 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 02:55:20.532221 tst emergency_mo_mt_call.py: using LAC 38057 02:55:20.657856 tst emergency_mo_mt_call.py: using RAC 62 02:55:20.782692 tst emergency_mo_mt_call.py: using CellId 38057 02:55:20.908713 tst emergency_mo_mt_call.py: using BVCI 38058 02:55:21.027177 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:21.038366 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:21.049251 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:21.060134 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:21.071758 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:21.083420 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:55:21.205394 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:55:21.325546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:55:21.787295 run create_hlr_db(pid=32077): Launched 02:55:21.910236 bus /sierra_2: Setting Powered False 02:55:22.970040 run create_hlr_db(pid=32077): Terminated: ok {rc=0} 02:55:23.408044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32079): Launched 02:55:23.728388 run osmo-hlr_10.42.42.2(pid=32080): Launched 02:55:23.851376 run osmo-stp_10.42.42.5: Starting osmo-stp 02:55:24.401200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32082): Launched 02:55:24.719561 run osmo-stp_10.42.42.5(pid=32083): Launched 02:55:24.850449 tst emergency_mo_mt_call.py: using MSISDN 8465 02:55:25.016386 run osmo-msc_10.42.42.6: Starting osmo-msc 02:55:25.591132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32085): Launched 02:55:25.911835 run osmo-msc_10.42.42.6(pid=32086): Launched 02:55:26.091668 run osmo-stp_10.42.42.5(pid=32083): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32083)] 02:55:26.226867 run osmo-stp_10.42.42.5(pid=32083): stdout: | (launched: 2022-12-14_02:55:24.661367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:26.362188 run osmo-stp_10.42.42.5(pid=32083): stderr: | [0;m[38;5;43m20221214025524854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025524854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025524855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025524855 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025524856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025524856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025524856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:26.496592 run osmo-stp_10.42.42.5(pid=32083): stdout: | (launched: 2022-12-14_02:55:24.661367) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:26.624119 run osmo-stp_10.42.42.5(pid=32083): stderr: | [0;m[38;5;43m20221214025524854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025524854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025524855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025524855 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025524856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025524856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025524856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:26.775936 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=32083): Process ended prematurely: osmo-stp_10.42.42.5(pid=32083) [trial-2398↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32083)] [trial-2398↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 02:55:26.785033 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 02:55:26.812137 run osmo-hlr_10.42.42.2(pid=32080): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32080)] 02:55:26.862799 run osmo-hlr_10.42.42.2(pid=32080): stdout: | (launched: 2022-12-14_02:55:23.669916) 02:55:26.915477 run osmo-hlr_10.42.42.2(pid=32080): stderr: | [0;m[1;31m20221214025523868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025523868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025523868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025523868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025523868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025523868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025523881 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025523889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025523889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025523889 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:55:26.988083 run osmo-msc_10.42.42.6(pid=32086): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32086)] 02:55:27.038419 run osmo-msc_10.42.42.6(pid=32086): stdout: | (launched: 2022-12-14_02:55:25.852897) 02:55:27.090622 run osmo-msc_10.42.42.6(pid=32086): stderr: | [0;m[38;5;43m20221214025526173 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025526174 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6faf9ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025526174 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025526174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025526174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025526174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025526176 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025526176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025526176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025526176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:55:27.143399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32079): Terminating (SIGTERM) 02:55:27.184828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32082): Terminating (SIGTERM) 02:55:27.227447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32085): Terminating (SIGTERM) 02:55:27.269973 --- ParallelTerminationStrategy: PID 32079 died... 02:55:27.290392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32079): Terminated: ok {rc=0} 02:55:27.337157 --- ParallelTerminationStrategy: PID 32082 died... 02:55:27.357068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32082): Terminated: ok {rc=0} 02:55:27.403303 --- ParallelTerminationStrategy: PID 32085 died... 02:55:27.423192 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32085): Terminated: ok {rc=0} 02:55:27.510972 bus /sierra_3: Setting Powered False 02:55:28.611624 bus /sierra_3: Setting Powered False 02:55:29.729416 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 02:55:30.816135 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:30.827539 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 02:55:30.883137 tst emergency_preemptive_call.py: using LAC 38058 02:55:31.019298 tst emergency_preemptive_call.py: using RAC 63 02:55:31.141372 tst emergency_preemptive_call.py: using CellId 38058 02:55:31.275723 tst emergency_preemptive_call.py: using BVCI 38059 02:55:31.386660 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:31.398595 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:31.410161 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:31.421800 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:31.433509 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 02:55:31.445089 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:55:31.584540 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:55:31.722767 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:55:31.848375 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 02:55:31.975752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:55:32.482282 run create_hlr_db(pid=32088): Launched 02:55:32.607309 bus /sierra_2: Setting Powered False 02:55:33.670198 run create_hlr_db(pid=32088): Terminated: ok {rc=0} 02:55:34.097581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32090): Launched 02:55:34.396645 run osmo-hlr_10.42.42.2(pid=32091): Launched 02:55:34.512609 run osmo-stp_10.42.42.5: Starting osmo-stp 02:55:35.026469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32093): Launched 02:55:35.324929 run osmo-stp_10.42.42.5(pid=32094): Launched 02:55:35.448406 tst emergency_preemptive_call.py: using MSISDN 8466 02:55:35.599887 run osmo-msc_10.42.42.6: Starting osmo-msc 02:55:36.133485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32096): Launched 02:55:36.430853 run osmo-msc_10.42.42.6(pid=32097): Launched 02:55:36.597531 run osmo-stp_10.42.42.5(pid=32094): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32094)] 02:55:36.723361 run osmo-stp_10.42.42.5(pid=32094): stdout: | (launched: 2022-12-14_02:55:35.268864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:36.849210 run osmo-stp_10.42.42.5(pid=32094): stderr: | [0;m[38;5;43m20221214025535438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025535438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025535438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025535439 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025535441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025535442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025535442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:36.972654 run osmo-stp_10.42.42.5(pid=32094): stdout: | (launched: 2022-12-14_02:55:35.268864) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:37.090098 run osmo-stp_10.42.42.5(pid=32094): stderr: | [0;m[38;5;43m20221214025535438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025535438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025535438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025535439 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025535441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025535442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025535442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:37.231243 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=32094): Process ended prematurely: osmo-stp_10.42.42.5(pid=32094) [trial-2398↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32094)] [trial-2398↪emergency:trx-lms↪emergency_preemptive_call.py:32] 02:55:37.239464 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 02:55:37.265658 run osmo-hlr_10.42.42.2(pid=32091): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32091)] 02:55:37.314776 run osmo-hlr_10.42.42.2(pid=32091): stdout: | (launched: 2022-12-14_02:55:34.341438) 02:55:37.364531 run osmo-hlr_10.42.42.2(pid=32091): stderr: | [0;m[1;31m20221214025534519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025534519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025534519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025534519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025534519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025534519 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025534532 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025534540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025534541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025534541 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:55:37.433851 run osmo-msc_10.42.42.6(pid=32097): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32097)] 02:55:37.482038 run osmo-msc_10.42.42.6(pid=32097): stdout: | (launched: 2022-12-14_02:55:36.375780) 02:55:37.531591 run osmo-msc_10.42.42.6(pid=32097): stderr: | [0;m[38;5;43m20221214025536647 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214025536647 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8b964b8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214025536647 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214025536647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214025536647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214025536647 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214025536649 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214025536650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214025536650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214025536650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 02:55:37.581665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32090): Terminating (SIGTERM) 02:55:37.621452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32093): Terminating (SIGTERM) 02:55:37.661350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32096): Terminating (SIGTERM) 02:55:37.701404 --- ParallelTerminationStrategy: PID 32090 died... 02:55:37.720515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32090): Terminated: ok {rc=0} 02:55:37.764437 --- ParallelTerminationStrategy: PID 32093 died... 02:55:37.783104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32093): Terminated: ok {rc=0} 02:55:37.827109 --- ParallelTerminationStrategy: PID 32096 died... 02:55:37.845727 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32096): Terminated: ok {rc=0} 02:55:37.931917 bus /sierra_9: Setting Powered False 02:55:39.030988 bus /sierra_9: Setting Powered False 02:55:40.146973 bus /sierra_8: Setting Powered False 02:55:41.245524 bus /sierra_8: Setting Powered False 02:55:42.357420 bus /sierra_3: Setting Powered False 02:55:43.454458 bus /sierra_3: Setting Powered False 02:55:44.572722 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-lms --------------------------------------------------------------------- 02:55:45.856860 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:55:45.865861 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 02:55:45.903000 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 02:55:45.945694 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 02:55:46.041572 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 02:55:46.078871 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 02:55:46.121564 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 02:55:46.732704 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 02:55:46.805148 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:46.819391 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 02:55:46.875733 tst cs_paging_gprs_active.py: using LAC 38059 02:55:47.027399 tst cs_paging_gprs_active.py: using RAC 64 02:55:47.185152 tst cs_paging_gprs_active.py: using CellId 38059 02:55:47.307293 tst cs_paging_gprs_active.py: using BVCI 38060 02:55:47.419255 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:47.429842 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:47.440004 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:47.450292 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:47.460528 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:47.470925 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:47.481745 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:47.491899 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:47.502392 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:55:47.623981 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:55:47.742443 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:55:47.945813 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:55:48.251776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32102): Launched 02:55:48.518490 run iperf3-srv_10.42.42.10(pid=32103): Launched 02:55:48.634590 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:55:48.837680 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:55:49.144047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32104): Launched 02:55:49.410794 run iperf3-srv_10.42.42.10(pid=32105): Launched 02:55:49.524687 tst cs_paging_gprs_active.py:38: start network... 02:55:49.727926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:55:50.198092 run create_hlr_db(pid=32106): Launched 02:55:50.322212 bus /sierra_2: Setting Powered False 02:55:51.382247 run create_hlr_db(pid=32106): Terminated: ok {rc=0} 02:55:51.827763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32108): Launched 02:55:52.155334 run osmo-hlr_10.42.42.2(pid=32112): Launched 02:55:52.281218 run osmo-stp_10.42.42.5: Starting osmo-stp 02:55:52.844736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32114): Launched 02:55:53.173499 run osmo-stp_10.42.42.5(pid=32115): Launched 02:55:53.299152 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:55:53.863207 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32117): Launched 02:55:53.990554 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:55:54.266205 run patchelf(pid=32118): Launched 02:55:54.447944 run osmo-stp_10.42.42.5(pid=32115): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32115)] 02:55:54.585868 run osmo-stp_10.42.42.5(pid=32115): stdout: | (launched: 2022-12-14_02:55:53.113684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:54.724811 run osmo-stp_10.42.42.5(pid=32115): stderr: | [0;m[38;5;43m20221214025553307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025553307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025553307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025553308 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025553308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025553308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025553308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:54.863572 run osmo-stp_10.42.42.5(pid=32115): stdout: | (launched: 2022-12-14_02:55:53.113684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:55:54.997415 run osmo-stp_10.42.42.5(pid=32115): stderr: | [0;m[38;5;43m20221214025553307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025553307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025553307 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025553308 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025553308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025553308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025553308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:55:55.155741 run patchelf(pid=32118): Terminating (SIGINT) 02:55:55.338859 run patchelf(pid=32118): Terminated: ok {rc=0} 02:55:55.471044 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32115): Process ended prematurely: osmo-stp_10.42.42.5(pid=32115) [trial-2398↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32115)] [trial-2398↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 02:55:55.481389 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 02:55:55.509968 run osmo-hlr_10.42.42.2(pid=32112): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32112)] 02:55:55.560861 run osmo-hlr_10.42.42.2(pid=32112): stdout: | (launched: 2022-12-14_02:55:52.095603) 02:55:55.613335 run osmo-hlr_10.42.42.2(pid=32112): stderr: | [0;m[1;31m20221214025552294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025552294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025552294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025552295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025552295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025552295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025552307 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025552317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025552317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025552317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:55:55.665907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32102): Terminating (SIGTERM) 02:55:55.707770 run iperf3-srv_10.42.42.10(pid=32103): Terminating (SIGTERM) 02:55:55.750205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32104): Terminating (SIGTERM) 02:55:55.792337 run iperf3-srv_10.42.42.10(pid=32105): Terminating (SIGTERM) 02:55:55.834382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32108): Terminating (SIGTERM) 02:55:55.876378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32114): Terminating (SIGTERM) 02:55:55.918362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32117): Terminating (SIGTERM) 02:55:55.960893 --- ParallelTerminationStrategy: PID 32102 died... 02:55:55.981396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32102): Terminated: ok {rc=0} 02:55:56.027888 --- ParallelTerminationStrategy: PID 32103 died... 02:55:56.047837 run iperf3-srv_10.42.42.10(pid=32103): Terminated {rc=256} 02:55:56.094241 --- ParallelTerminationStrategy: PID 32104 died... 02:55:56.114164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32104): Terminated: ok {rc=0} 02:55:56.160497 --- ParallelTerminationStrategy: PID 32105 died... 02:55:56.180505 run iperf3-srv_10.42.42.10(pid=32105): Terminated {rc=256} 02:55:56.226723 --- ParallelTerminationStrategy: PID 32108 died... 02:55:56.246610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32108): Terminated: ok {rc=0} 02:55:56.292709 --- ParallelTerminationStrategy: PID 32114 died... 02:55:56.312638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32114): Terminated: ok {rc=0} 02:55:56.359033 --- ParallelTerminationStrategy: PID 32117 died... 02:55:56.378851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32117): Terminated: ok {rc=0} 02:55:56.467099 bus /gobi_0: Setting Powered False 02:55:57.565135 bus /gobi_0: Setting Powered False 02:55:58.681178 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms iperf3.py ---------------------------------------------- 02:55:59.830713 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:55:59.842732 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 02:55:59.895856 tst iperf3.py: using LAC 38060 02:56:00.025151 tst iperf3.py: using RAC 65 02:56:00.158253 tst iperf3.py: using CellId 38060 02:56:00.285639 tst iperf3.py: using BVCI 38061 02:56:00.404500 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:00.415638 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:00.426474 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:00.437326 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:00.448376 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:00.459522 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:00.470746 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:00.482295 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:00.493596 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:00.610696 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:56:00.815302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:01.164260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32119): Launched 02:56:01.547913 run iperf3-srv_10.42.42.10(pid=32120): Launched 02:56:01.727351 tst iperf3.py:8: start network... 02:56:01.936668 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:56:02.422307 run create_hlr_db(pid=32121): Launched 02:56:02.548063 bus /gobi_6: Setting Powered False 02:56:03.613048 run create_hlr_db(pid=32121): Terminated: ok {rc=0} 02:56:04.068571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32124): Launched 02:56:04.395581 run osmo-hlr_10.42.42.2(pid=32125): Launched 02:56:04.522565 run osmo-stp_10.42.42.5: Starting osmo-stp 02:56:05.090203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32127): Launched 02:56:05.417004 run osmo-stp_10.42.42.5(pid=32128): Launched 02:56:05.544622 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:56:06.107894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32130): Launched 02:56:06.232813 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:56:06.509306 run patchelf(pid=32131): Launched 02:56:06.691744 run osmo-stp_10.42.42.5(pid=32128): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32128)] 02:56:06.829724 run osmo-stp_10.42.42.5(pid=32128): stdout: | (launched: 2022-12-14_02:56:05.357082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:06.969659 run osmo-stp_10.42.42.5(pid=32128): stderr: | [0;m[38;5;43m20221214025605552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025605553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025605553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025605553 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025605554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025605554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025605554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:07.109788 run osmo-stp_10.42.42.5(pid=32128): stdout: | (launched: 2022-12-14_02:56:05.357082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:07.243869 run osmo-stp_10.42.42.5(pid=32128): stderr: | [0;m[38;5;43m20221214025605552 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025605553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025605553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025605553 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025605554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025605554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025605554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:07.402866 run patchelf(pid=32131): Terminating (SIGINT) 02:56:07.587398 run patchelf(pid=32131): Terminated: ok {rc=0} 02:56:07.720211 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32128): Process ended prematurely: osmo-stp_10.42.42.5(pid=32128) [trial-2398↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32128)] [trial-2398↪gprs:trx-lms↪iperf3.py:8] 02:56:07.730544 tst iperf3.py:8: Test FAILED (7.9 sec) 02:56:07.759319 run osmo-hlr_10.42.42.2(pid=32125): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32125)] 02:56:07.810509 run osmo-hlr_10.42.42.2(pid=32125): stdout: | (launched: 2022-12-14_02:56:04.335742) 02:56:07.863570 run osmo-hlr_10.42.42.2(pid=32125): stderr: | [0;m[1;31m20221214025604535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025604535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025604535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025604535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025604535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025604535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025604547 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025604555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025604556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025604556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:56:07.916562 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32119): Terminating (SIGTERM) 02:56:07.959348 run iperf3-srv_10.42.42.10(pid=32120): Terminating (SIGTERM) 02:56:08.001895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32124): Terminating (SIGTERM) 02:56:08.044575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32127): Terminating (SIGTERM) 02:56:08.087039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32130): Terminating (SIGTERM) 02:56:08.129706 --- ParallelTerminationStrategy: PID 32119 died... 02:56:08.150557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32119): Terminated: ok {rc=0} 02:56:08.197538 --- ParallelTerminationStrategy: PID 32120 died... 02:56:08.217565 run iperf3-srv_10.42.42.10(pid=32120): Terminated {rc=256} 02:56:08.264421 --- ParallelTerminationStrategy: PID 32124 died... 02:56:08.284449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32124): Terminated: ok {rc=0} 02:56:08.331097 --- ParallelTerminationStrategy: PID 32127 died... 02:56:08.351282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32127): Terminated: ok {rc=0} 02:56:08.397783 --- ParallelTerminationStrategy: PID 32130 died... 02:56:08.418006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32130): Terminated: ok {rc=0} 02:56:08.506723 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms iperf3m4.py ---------------------------------------------- 02:56:09.657864 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:09.669976 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 02:56:09.720517 tst iperf3m4.py: using LAC 38061 02:56:09.850403 tst iperf3m4.py: using RAC 66 02:56:09.980096 tst iperf3m4.py: using CellId 38061 02:56:10.108031 tst iperf3m4.py: using BVCI 38062 02:56:10.229187 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:10.240506 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:10.251655 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:10.262806 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:10.274528 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:10.286375 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:10.298385 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:10.310167 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:10.322362 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:10.444176 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:10.569588 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:10.687829 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:10.806060 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:56:11.010771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:11.316881 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32132): Launched 02:56:11.585525 run iperf3-srv_10.42.42.10(pid=32133): Launched 02:56:11.699461 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:56:11.902916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:12.208222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32134): Launched 02:56:12.475933 run iperf3-srv_10.42.42.10(pid=32135): Launched 02:56:12.590124 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:56:12.793120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:13.098665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32136): Launched 02:56:13.363231 run iperf3-srv_10.42.42.10(pid=32137): Launched 02:56:13.476633 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:56:13.680297 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:13.984676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32138): Launched 02:56:14.250927 run iperf3-srv_10.42.42.10(pid=32139): Launched 02:56:14.364471 tst iperf3m4.py:8: start network... 02:56:14.567145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:56:15.037805 run create_hlr_db(pid=32140): Launched 02:56:15.163219 bus /gobi_6: Setting Powered False 02:56:16.228884 run create_hlr_db(pid=32140): Terminated: ok {rc=0} 02:56:16.661073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32142): Launched 02:56:16.982389 run osmo-hlr_10.42.42.2(pid=32143): Launched 02:56:17.215543 run osmo-stp_10.42.42.5: Starting osmo-stp 02:56:17.779423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32145): Launched 02:56:18.107189 run osmo-stp_10.42.42.5(pid=32146): Launched 02:56:18.232941 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:56:18.794509 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32148): Launched 02:56:18.920294 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:56:19.185706 run patchelf(pid=32149): Launched 02:56:19.355971 run osmo-stp_10.42.42.5(pid=32146): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32146)] 02:56:19.484705 run osmo-stp_10.42.42.5(pid=32146): stdout: | (launched: 2022-12-14_02:56:18.047470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:19.614279 run osmo-stp_10.42.42.5(pid=32146): stderr: | [0;m[38;5;43m20221214025618242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025618242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025618243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025618243 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025618243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025618244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025618244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:19.744747 run osmo-stp_10.42.42.5(pid=32146): stdout: | (launched: 2022-12-14_02:56:18.047470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:19.868901 run osmo-stp_10.42.42.5(pid=32146): stderr: | [0;m[38;5;43m20221214025618242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025618242 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025618243 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025618243 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025618243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025618244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025618244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:20.015716 run patchelf(pid=32149): Terminating (SIGINT) 02:56:20.186513 run patchelf(pid=32149): Terminated: ok {rc=0} 02:56:20.309362 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32146): Process ended prematurely: osmo-stp_10.42.42.5(pid=32146) [trial-2398↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32146)] [trial-2398↪gprs:trx-lms↪iperf3m4.py:8] 02:56:20.318808 tst iperf3m4.py:8: Test FAILED (10.7 sec) 02:56:20.346072 run osmo-hlr_10.42.42.2(pid=32143): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32143)] 02:56:20.393642 run osmo-hlr_10.42.42.2(pid=32143): stdout: | (launched: 2022-12-14_02:56:16.925443) 02:56:20.442906 run osmo-hlr_10.42.42.2(pid=32143): stderr: | [0;m[1;31m20221214025617235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025617235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025617235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025617235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025617235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025617235 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025617248 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025617256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025617256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025617256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:56:20.492564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32132): Terminating (SIGTERM) 02:56:20.532430 run iperf3-srv_10.42.42.10(pid=32133): Terminating (SIGTERM) 02:56:20.571891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32134): Terminating (SIGTERM) 02:56:20.611764 run iperf3-srv_10.42.42.10(pid=32135): Terminating (SIGTERM) 02:56:20.651397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32136): Terminating (SIGTERM) 02:56:20.691195 run iperf3-srv_10.42.42.10(pid=32137): Terminating (SIGTERM) 02:56:20.730903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32138): Terminating (SIGTERM) 02:56:20.770635 run iperf3-srv_10.42.42.10(pid=32139): Terminating (SIGTERM) 02:56:20.810305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32142): Terminating (SIGTERM) 02:56:20.850095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32145): Terminating (SIGTERM) 02:56:20.889803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32148): Terminating (SIGTERM) 02:56:20.929729 --- ParallelTerminationStrategy: PID 32132 died... 02:56:20.948912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32132): Terminated: ok {rc=0} 02:56:20.993123 --- ParallelTerminationStrategy: PID 32133 died... 02:56:21.011756 run iperf3-srv_10.42.42.10(pid=32133): Terminated {rc=256} 02:56:21.055499 --- ParallelTerminationStrategy: PID 32134 died... 02:56:21.074251 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32134): Terminated: ok {rc=0} 02:56:21.118183 --- ParallelTerminationStrategy: PID 32135 died... 02:56:21.136747 run iperf3-srv_10.42.42.10(pid=32135): Terminated {rc=256} 02:56:21.180806 --- ParallelTerminationStrategy: PID 32136 died... 02:56:21.200059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32136): Terminated: ok {rc=0} 02:56:21.243963 --- ParallelTerminationStrategy: PID 32137 died... 02:56:21.262662 run iperf3-srv_10.42.42.10(pid=32137): Terminated {rc=256} 02:56:21.306979 --- ParallelTerminationStrategy: PID 32138 died... 02:56:21.325737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32138): Terminated: ok {rc=0} 02:56:21.369605 --- ParallelTerminationStrategy: PID 32139 died... 02:56:21.388290 run iperf3-srv_10.42.42.10(pid=32139): Terminated {rc=256} 02:56:21.432167 --- ParallelTerminationStrategy: PID 32142 died... 02:56:21.451102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32142): Terminated: ok {rc=0} 02:56:21.494848 --- ParallelTerminationStrategy: PID 32145 died... 02:56:21.513687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32145): Terminated: ok {rc=0} 02:56:21.557748 --- ParallelTerminationStrategy: PID 32148 died... 02:56:21.576541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32148): Terminated: ok {rc=0} 02:56:21.660122 bus /gobi_4: Setting Powered False 02:56:22.758576 bus /gobi_4: Setting Powered False 02:56:23.874495 bus /gobi_1: Setting Powered False 02:56:24.973427 bus /gobi_1: Setting Powered False 02:56:26.091898 bus /gobi_0: Setting Powered False 02:56:27.191073 bus /gobi_0: Setting Powered False 02:56:28.305299 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms ping.py ---------------------------------------------- 02:56:29.405070 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:29.416478 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 02:56:29.466222 tst ping.py: using LAC 38062 02:56:29.584715 tst ping.py: using RAC 67 02:56:29.701051 tst ping.py: using CellId 38062 02:56:29.818063 tst ping.py: using BVCI 38063 02:56:29.926808 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:29.937524 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:29.948035 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:29.958617 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:29.968856 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:29.979685 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:29.990708 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:30.001265 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:30.122280 tst ping.py:19: start network... 02:56:30.337717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:56:30.833763 run create_hlr_db(pid=32150): Launched 02:56:30.974939 bus /gobi_6: Setting Powered False 02:56:32.032757 run create_hlr_db(pid=32150): Terminated: ok {rc=0} 02:56:32.457194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32152): Launched 02:56:32.755367 run osmo-hlr_10.42.42.2(pid=32153): Launched 02:56:32.868411 run osmo-stp_10.42.42.5: Starting osmo-stp 02:56:33.399143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32155): Launched 02:56:33.698775 run osmo-stp_10.42.42.5(pid=32156): Launched 02:56:33.812863 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:56:34.326348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32158): Launched 02:56:34.442472 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:56:34.695141 run patchelf(pid=32159): Launched 02:56:34.861485 run osmo-stp_10.42.42.5(pid=32156): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32156)] 02:56:34.987927 run osmo-stp_10.42.42.5(pid=32156): stdout: | (launched: 2022-12-14_02:56:33.643064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:35.116082 run osmo-stp_10.42.42.5(pid=32156): stderr: | [0;m[38;5;43m20221214025633814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025633814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025633814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025633815 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025633815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025633815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025633815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:35.244128 run osmo-stp_10.42.42.5(pid=32156): stdout: | (launched: 2022-12-14_02:56:33.643064) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:35.366861 run osmo-stp_10.42.42.5(pid=32156): stderr: | [0;m[38;5;43m20221214025633814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025633814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025633814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025633815 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025633815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025633815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025633815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:35.512428 run patchelf(pid=32159): Terminating (SIGINT) 02:56:35.682095 run patchelf(pid=32159): Terminated: ok {rc=0} 02:56:35.804641 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32156): Process ended prematurely: osmo-stp_10.42.42.5(pid=32156) [trial-2398↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32156)] [trial-2398↪gprs:trx-lms↪ping.py:22] 02:56:35.813756 tst ping.py:22: Test FAILED (6.4 sec) 02:56:35.840729 run osmo-hlr_10.42.42.2(pid=32153): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32153)] 02:56:35.888651 run osmo-hlr_10.42.42.2(pid=32153): stdout: | (launched: 2022-12-14_02:56:32.700210) 02:56:35.938421 run osmo-hlr_10.42.42.2(pid=32153): stderr: | [0;m[1;31m20221214025632876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025632876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025632876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025632876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025632876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025632876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025632888 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025632897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025632897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025632897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:56:35.988750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32152): Terminating (SIGTERM) 02:56:36.029173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32155): Terminating (SIGTERM) 02:56:36.069482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32158): Terminating (SIGTERM) 02:56:36.110246 --- ParallelTerminationStrategy: PID 32152 died... 02:56:36.129907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32152): Terminated: ok {rc=0} 02:56:36.174507 --- ParallelTerminationStrategy: PID 32155 died... 02:56:36.193592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32155): Terminated: ok {rc=0} 02:56:36.238310 --- ParallelTerminationStrategy: PID 32158 died... 02:56:36.257402 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32158): Terminated: ok {rc=0} 02:56:36.341098 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 02:56:37.428101 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:37.440031 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 02:56:37.491968 tst ping_idle_ping.py: using LAC 38063 02:56:37.612885 tst ping_idle_ping.py: using RAC 68 02:56:37.730737 tst ping_idle_ping.py: using CellId 38063 02:56:37.851294 tst ping_idle_ping.py: using BVCI 38064 02:56:37.961307 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:37.972025 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:37.982742 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:37.993327 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:38.004035 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:38.014378 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:38.024778 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 02:56:38.035778 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 02:56:38.151780 tst ping_idle_ping.py:24: start network... 02:56:38.352917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:56:38.819226 run create_hlr_db(pid=32160): Launched 02:56:38.942447 bus /gobi_6: Setting Powered False 02:56:40.001953 run create_hlr_db(pid=32160): Terminated: ok {rc=0} 02:56:40.443279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32162): Launched 02:56:40.766426 run osmo-hlr_10.42.42.2(pid=32163): Launched 02:56:40.890155 run osmo-stp_10.42.42.5: Starting osmo-stp 02:56:41.406881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32165): Launched 02:56:41.706361 run osmo-stp_10.42.42.5(pid=32166): Launched 02:56:41.823379 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:56:42.338697 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32168): Launched 02:56:42.453208 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:56:42.706639 run patchelf(pid=32169): Launched 02:56:42.875082 run osmo-stp_10.42.42.5(pid=32166): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32166)] 02:56:43.001903 run osmo-stp_10.42.42.5(pid=32166): stdout: | (launched: 2022-12-14_02:56:41.650737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:43.130490 run osmo-stp_10.42.42.5(pid=32166): stderr: | [0;m[38;5;43m20221214025641822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025641822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025641822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025641823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025641823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025641823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025641823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:43.258684 run osmo-stp_10.42.42.5(pid=32166): stdout: | (launched: 2022-12-14_02:56:41.650737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:43.381753 run osmo-stp_10.42.42.5(pid=32166): stderr: | [0;m[38;5;43m20221214025641822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025641822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025641822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025641823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025641823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025641823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025641823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:43.527169 run patchelf(pid=32169): Terminating (SIGINT) 02:56:43.695996 run patchelf(pid=32169): Terminated: ok {rc=0} 02:56:43.819129 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32166): Process ended prematurely: osmo-stp_10.42.42.5(pid=32166) [trial-2398↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32166)] [trial-2398↪gprs:trx-lms↪ping_idle_ping.py:27] 02:56:43.828437 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 02:56:43.855518 run osmo-hlr_10.42.42.2(pid=32163): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32163)] 02:56:43.903735 run osmo-hlr_10.42.42.2(pid=32163): stdout: | (launched: 2022-12-14_02:56:40.707313) 02:56:43.953623 run osmo-hlr_10.42.42.2(pid=32163): stderr: | [0;m[1;31m20221214025640908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025640908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025640908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025640908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025640908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025640908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025640920 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025640928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025640928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025640928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:56:44.003717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32162): Terminating (SIGTERM) 02:56:44.043923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32165): Terminating (SIGTERM) 02:56:44.083984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32168): Terminating (SIGTERM) 02:56:44.124443 --- ParallelTerminationStrategy: PID 32162 died... 02:56:44.143809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32162): Terminated: ok {rc=0} 02:56:44.188142 --- ParallelTerminationStrategy: PID 32165 died... 02:56:44.207217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32165): Terminated: ok {rc=0} 02:56:44.251351 --- ParallelTerminationStrategy: PID 32168 died... 02:56:44.270399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32168): Terminated: ok {rc=0} 02:56:44.357182 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 02:56:45.655662 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:56:45.661563 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 02:56:45.694332 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 02:56:45.732692 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 02:56:45.819803 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 02:56:45.854048 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 02:56:45.898118 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 02:56:46.490412 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 02:56:46.545863 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:46.557393 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:56:46.610076 tst cs_paging_gprs_active.py: using LAC 38064 02:56:46.741165 tst cs_paging_gprs_active.py: using RAC 69 02:56:46.869799 tst cs_paging_gprs_active.py: using CellId 38064 02:56:47.006789 tst cs_paging_gprs_active.py: using BVCI 38065 02:56:47.158028 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:47.178411 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:47.199208 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:47.216149 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:47.230531 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:47.244684 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:47.257150 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:47.268284 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:47.280886 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:56:47.402183 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:56:47.524261 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:56:47.745706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:48.060785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32173): Launched 02:56:48.328230 run iperf3-srv_10.42.42.10(pid=32174): Launched 02:56:48.443045 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:56:48.646554 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:56:48.953438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32175): Launched 02:56:49.219243 run iperf3-srv_10.42.42.10(pid=32176): Launched 02:56:49.335379 tst cs_paging_gprs_active.py:38: start network... 02:56:49.539607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:56:50.012327 run create_hlr_db(pid=32177): Launched 02:56:50.137074 bus /gobi_6: Setting Powered False 02:56:51.201893 run create_hlr_db(pid=32177): Terminated: ok {rc=0} 02:56:51.636704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32179): Launched 02:56:51.942286 run osmo-hlr_10.42.42.2(pid=32180): Launched 02:56:52.059726 run osmo-stp_10.42.42.5: Starting osmo-stp 02:56:52.580696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32182): Launched 02:56:52.884913 run osmo-stp_10.42.42.5(pid=32183): Launched 02:56:53.000890 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:56:53.525135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32185): Launched 02:56:53.640882 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:56:53.898227 run patchelf(pid=32186): Launched 02:56:54.071096 run osmo-stp_10.42.42.5(pid=32183): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32183)] 02:56:54.199377 run osmo-stp_10.42.42.5(pid=32183): stdout: | (launched: 2022-12-14_02:56:52.828588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:54.329476 run osmo-stp_10.42.42.5(pid=32183): stderr: | [0;m[38;5;43m20221214025653002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025653002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025653002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025653003 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025653003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025653003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025653003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:54.459423 run osmo-stp_10.42.42.5(pid=32183): stdout: | (launched: 2022-12-14_02:56:52.828588) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:56:54.583808 run osmo-stp_10.42.42.5(pid=32183): stderr: | [0;m[38;5;43m20221214025653002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025653002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025653002 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025653003 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025653003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025653003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025653003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:56:54.731370 run patchelf(pid=32186): Terminating (SIGINT) 02:56:54.903190 run patchelf(pid=32186): Terminated: ok {rc=0} 02:56:55.026643 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32183): Process ended prematurely: osmo-stp_10.42.42.5(pid=32183) [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32183)] [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 02:56:55.036162 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 02:56:55.063202 run osmo-hlr_10.42.42.2(pid=32180): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32180)] 02:56:55.111116 run osmo-hlr_10.42.42.2(pid=32180): stdout: | (launched: 2022-12-14_02:56:51.885789) 02:56:55.160865 run osmo-hlr_10.42.42.2(pid=32180): stderr: | [0;m[1;31m20221214025652065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025652065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025652065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025652065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025652065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025652065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025652078 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025652086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025652086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025652087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:56:55.211007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32173): Terminating (SIGTERM) 02:56:55.250668 run iperf3-srv_10.42.42.10(pid=32174): Terminating (SIGTERM) 02:56:55.290049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32175): Terminating (SIGTERM) 02:56:55.329465 run iperf3-srv_10.42.42.10(pid=32176): Terminating (SIGTERM) 02:56:55.368723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32179): Terminating (SIGTERM) 02:56:55.408050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32182): Terminating (SIGTERM) 02:56:55.447453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32185): Terminating (SIGTERM) 02:56:55.487110 --- ParallelTerminationStrategy: PID 32173 died... 02:56:55.506148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32173): Terminated: ok {rc=0} 02:56:55.549939 --- ParallelTerminationStrategy: PID 32174 died... 02:56:55.568264 run iperf3-srv_10.42.42.10(pid=32174): Terminated {rc=256} 02:56:55.611936 --- ParallelTerminationStrategy: PID 32175 died... 02:56:55.630608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32175): Terminated: ok {rc=0} 02:56:55.674178 --- ParallelTerminationStrategy: PID 32176 died... 02:56:55.692627 run iperf3-srv_10.42.42.10(pid=32176): Terminated {rc=256} 02:56:55.736064 --- ParallelTerminationStrategy: PID 32179 died... 02:56:55.754634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32179): Terminated: ok {rc=0} 02:56:55.798428 --- ParallelTerminationStrategy: PID 32182 died... 02:56:55.817105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32182): Terminated: ok {rc=0} 02:56:55.860773 --- ParallelTerminationStrategy: PID 32185 died... 02:56:55.879500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32185): Terminated: ok {rc=0} 02:56:55.965471 bus /gobi_0: Setting Powered False 02:56:57.065342 bus /gobi_0: Setting Powered False 02:56:58.180316 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 02:56:59.330188 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:59.342430 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:56:59.393686 tst iperf3.py: using LAC 38065 02:56:59.522982 tst iperf3.py: using RAC 70 02:56:59.650232 tst iperf3.py: using CellId 38065 02:56:59.779579 tst iperf3.py: using BVCI 38066 02:56:59.891830 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:59.902861 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:59.913740 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:59.924397 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:59.935093 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:59.945830 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:59.958279 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:59.969175 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:56:59.980116 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:00.100345 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:57:00.321153 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:00.648328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32187): Launched 02:57:00.985688 run iperf3-srv_10.42.42.10(pid=32188): Launched 02:57:01.160921 tst iperf3.py:8: start network... 02:57:01.404275 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:57:01.919391 run create_hlr_db(pid=32189): Launched 02:57:02.085183 bus /gobi_6: Setting Powered False 02:57:03.150168 run create_hlr_db(pid=32189): Terminated: ok {rc=0} 02:57:03.593226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32191): Launched 02:57:03.898757 run osmo-hlr_10.42.42.2(pid=32192): Launched 02:57:04.017779 run osmo-stp_10.42.42.5: Starting osmo-stp 02:57:04.560429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32194): Launched 02:57:04.865440 run osmo-stp_10.42.42.5(pid=32195): Launched 02:57:04.981640 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:57:05.506823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32197): Launched 02:57:05.622524 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:57:05.880069 run patchelf(pid=32198): Launched 02:57:06.050254 run osmo-stp_10.42.42.5(pid=32195): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32195)] 02:57:06.178985 run osmo-stp_10.42.42.5(pid=32195): stdout: | (launched: 2022-12-14_02:57:04.808312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:06.308825 run osmo-stp_10.42.42.5(pid=32195): stderr: | [0;m[38;5;43m20221214025704981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025704981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025704981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025704981 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025704982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025704982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025704982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:06.439108 run osmo-stp_10.42.42.5(pid=32195): stdout: | (launched: 2022-12-14_02:57:04.808312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:06.563962 run osmo-stp_10.42.42.5(pid=32195): stderr: | [0;m[38;5;43m20221214025704981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025704981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025704981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025704981 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025704982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025704982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025704982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:06.711781 run patchelf(pid=32198): Terminating (SIGINT) 02:57:06.883654 run patchelf(pid=32198): Terminated: ok {rc=0} 02:57:07.007571 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32195): Process ended prematurely: osmo-stp_10.42.42.5(pid=32195) [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32195)] [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 02:57:07.017086 tst iperf3.py:8: Test FAILED (7.7 sec) 02:57:07.044007 run osmo-hlr_10.42.42.2(pid=32192): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32192)] 02:57:07.091917 run osmo-hlr_10.42.42.2(pid=32192): stdout: | (launched: 2022-12-14_02:57:03.842271) 02:57:07.141622 run osmo-hlr_10.42.42.2(pid=32192): stderr: | [0;m[1;31m20221214025704020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025704020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025704020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025704020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025704020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025704020 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025704032 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025704040 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025704041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025704041 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:57:07.191757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32187): Terminating (SIGTERM) 02:57:07.231764 run iperf3-srv_10.42.42.10(pid=32188): Terminating (SIGTERM) 02:57:07.271411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32191): Terminating (SIGTERM) 02:57:07.311456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32194): Terminating (SIGTERM) 02:57:07.351496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32197): Terminating (SIGTERM) 02:57:07.391747 --- ParallelTerminationStrategy: PID 32187 died... 02:57:07.411210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32187): Terminated: ok {rc=0} 02:57:07.455333 --- ParallelTerminationStrategy: PID 32188 died... 02:57:07.474180 run iperf3-srv_10.42.42.10(pid=32188): Terminated {rc=256} 02:57:07.517975 --- ParallelTerminationStrategy: PID 32191 died... 02:57:07.536707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32191): Terminated: ok {rc=0} 02:57:07.580583 --- ParallelTerminationStrategy: PID 32194 died... 02:57:07.599336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32194): Terminated: ok {rc=0} 02:57:07.643215 --- ParallelTerminationStrategy: PID 32197 died... 02:57:07.662032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32197): Terminated: ok {rc=0} 02:57:07.748051 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 02:57:08.895478 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:08.907024 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:57:08.957721 tst iperf3m4.py: using LAC 38066 02:57:09.078440 tst iperf3m4.py: using RAC 71 02:57:09.200023 tst iperf3m4.py: using CellId 38066 02:57:09.321540 tst iperf3m4.py: using BVCI 38067 02:57:09.441747 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:09.453060 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:09.464045 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:09.475188 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:09.486568 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:09.497963 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:09.509505 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:09.521117 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:09.532861 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:09.650792 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:09.775027 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:09.892397 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:10.009196 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:57:10.214984 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:10.521385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32199): Launched 02:57:10.787662 run iperf3-srv_10.42.42.10(pid=32200): Launched 02:57:10.902353 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:57:11.106721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:11.413774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32201): Launched 02:57:11.680357 run iperf3-srv_10.42.42.10(pid=32202): Launched 02:57:11.794404 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:57:11.997721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:12.304587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32203): Launched 02:57:12.570483 run iperf3-srv_10.42.42.10(pid=32204): Launched 02:57:12.686105 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:57:12.889159 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:13.195145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32205): Launched 02:57:13.460729 run iperf3-srv_10.42.42.10(pid=32206): Launched 02:57:13.574846 tst iperf3m4.py:8: start network... 02:57:13.777779 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:57:14.250646 run create_hlr_db(pid=32207): Launched 02:57:14.375366 bus /gobi_6: Setting Powered False 02:57:15.436011 run create_hlr_db(pid=32207): Terminated: ok {rc=0} 02:57:15.893627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32209): Launched 02:57:16.245640 run osmo-hlr_10.42.42.2(pid=32210): Launched 02:57:16.492100 run osmo-stp_10.42.42.5: Starting osmo-stp 02:57:17.177857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32212): Launched 02:57:17.501639 run osmo-stp_10.42.42.5(pid=32213): Launched 02:57:17.617583 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:57:18.159073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32215): Launched 02:57:18.276419 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:57:18.533535 run patchelf(pid=32216): Launched 02:57:18.702584 run osmo-stp_10.42.42.5(pid=32213): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32213)] 02:57:18.830757 run osmo-stp_10.42.42.5(pid=32213): stdout: | (launched: 2022-12-14_02:57:17.444744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:18.960482 run osmo-stp_10.42.42.5(pid=32213): stderr: | [0;m[38;5;43m20221214025717615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025717615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025717616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025717616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025717618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025717618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025717619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:19.090162 run osmo-stp_10.42.42.5(pid=32213): stdout: | (launched: 2022-12-14_02:57:17.444744) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:19.214452 run osmo-stp_10.42.42.5(pid=32213): stderr: | [0;m[38;5;43m20221214025717615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025717615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025717616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025717616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025717618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025717618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025717619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:19.361816 run patchelf(pid=32216): Terminating (SIGINT) 02:57:19.532646 run patchelf(pid=32216): Terminated: ok {rc=0} 02:57:19.655906 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32213): Process ended prematurely: osmo-stp_10.42.42.5(pid=32213) [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32213)] [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 02:57:19.665514 tst iperf3m4.py:8: Test FAILED (10.8 sec) 02:57:19.692728 run osmo-hlr_10.42.42.2(pid=32210): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32210)] 02:57:19.740928 run osmo-hlr_10.42.42.2(pid=32210): stdout: | (launched: 2022-12-14_02:57:16.183638) 02:57:19.790632 run osmo-hlr_10.42.42.2(pid=32210): stderr: | [0;m[1;31m20221214025716422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025716422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025716423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025716423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025716423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025716423 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025716438 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025716459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025716459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025716459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:57:19.840596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32199): Terminating (SIGTERM) 02:57:19.880716 run iperf3-srv_10.42.42.10(pid=32200): Terminating (SIGTERM) 02:57:19.920853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32201): Terminating (SIGTERM) 02:57:19.961244 run iperf3-srv_10.42.42.10(pid=32202): Terminating (SIGTERM) 02:57:20.001299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32203): Terminating (SIGTERM) 02:57:20.041481 run iperf3-srv_10.42.42.10(pid=32204): Terminating (SIGTERM) 02:57:20.081729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32205): Terminating (SIGTERM) 02:57:20.122411 run iperf3-srv_10.42.42.10(pid=32206): Terminating (SIGTERM) 02:57:20.162556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32209): Terminating (SIGTERM) 02:57:20.202875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32212): Terminating (SIGTERM) 02:57:20.242953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32215): Terminating (SIGTERM) 02:57:20.283290 --- ParallelTerminationStrategy: PID 32199 died... 02:57:20.302791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32199): Terminated: ok {rc=0} 02:57:20.347468 --- ParallelTerminationStrategy: PID 32200 died... 02:57:20.366291 run iperf3-srv_10.42.42.10(pid=32200): Terminated {rc=256} 02:57:20.410356 --- ParallelTerminationStrategy: PID 32201 died... 02:57:20.429513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32201): Terminated: ok {rc=0} 02:57:20.474003 --- ParallelTerminationStrategy: PID 32202 died... 02:57:20.492663 run iperf3-srv_10.42.42.10(pid=32202): Terminated {rc=256} 02:57:20.537242 --- ParallelTerminationStrategy: PID 32203 died... 02:57:20.555813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32203): Terminated: ok {rc=0} 02:57:20.600267 --- ParallelTerminationStrategy: PID 32204 died... 02:57:20.618978 run iperf3-srv_10.42.42.10(pid=32204): Terminated {rc=256} 02:57:20.663000 --- ParallelTerminationStrategy: PID 32205 died... 02:57:20.681948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32205): Terminated: ok {rc=0} 02:57:20.726144 --- ParallelTerminationStrategy: PID 32206 died... 02:57:20.744990 run iperf3-srv_10.42.42.10(pid=32206): Terminated {rc=256} 02:57:20.788866 --- ParallelTerminationStrategy: PID 32209 died... 02:57:20.808323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32209): Terminated: ok {rc=0} 02:57:20.852460 --- ParallelTerminationStrategy: PID 32212 died... 02:57:20.871164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32212): Terminated: ok {rc=0} 02:57:20.915237 --- ParallelTerminationStrategy: PID 32215 died... 02:57:20.934121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32215): Terminated: ok {rc=0} 02:57:21.020032 bus /gobi_4: Setting Powered False 02:57:22.120835 bus /gobi_4: Setting Powered False 02:57:23.237863 bus /gobi_1: Setting Powered False 02:57:24.337696 bus /gobi_1: Setting Powered False 02:57:25.457091 bus /gobi_0: Setting Powered False 02:57:26.555581 bus /gobi_0: Setting Powered False 02:57:27.672050 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 02:57:28.774657 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:28.786427 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:57:28.836577 tst ping.py: using LAC 38067 02:57:28.964433 tst ping.py: using RAC 72 02:57:29.094365 tst ping.py: using CellId 38067 02:57:29.222940 tst ping.py: using BVCI 38068 02:57:29.341224 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:29.352684 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:29.363802 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:29.374898 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:29.386828 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:29.398669 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:29.410902 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:29.422958 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:29.544458 tst ping.py:19: start network... 02:57:29.760685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:57:30.257972 run create_hlr_db(pid=32217): Launched 02:57:30.381836 bus /gobi_6: Setting Powered False 02:57:31.464149 run create_hlr_db(pid=32217): Terminated: ok {rc=0} 02:57:32.001725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32219): Launched 02:57:32.325781 run osmo-hlr_10.42.42.2(pid=32220): Launched 02:57:32.449393 run osmo-stp_10.42.42.5: Starting osmo-stp 02:57:33.009058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32222): Launched 02:57:33.330662 run osmo-stp_10.42.42.5(pid=32223): Launched 02:57:33.454643 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:57:34.007739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32225): Launched 02:57:34.131479 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:57:34.402621 run patchelf(pid=32226): Launched 02:57:34.582574 run osmo-stp_10.42.42.5(pid=32223): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32223)] 02:57:34.718176 run osmo-stp_10.42.42.5(pid=32223): stdout: | (launched: 2022-12-14_02:57:33.271564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:34.854667 run osmo-stp_10.42.42.5(pid=32223): stderr: | [0;m[38;5;43m20221214025733464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025733464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025733464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025733464 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025733465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025733465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025733465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:34.992324 run osmo-stp_10.42.42.5(pid=32223): stdout: | (launched: 2022-12-14_02:57:33.271564) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:35.124244 run osmo-stp_10.42.42.5(pid=32223): stderr: | [0;m[38;5;43m20221214025733464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025733464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025733464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025733464 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025733465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025733465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025733465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:35.280050 run patchelf(pid=32226): Terminating (SIGINT) 02:57:35.460614 run patchelf(pid=32226): Terminated: ok {rc=0} 02:57:35.591024 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32223): Process ended prematurely: osmo-stp_10.42.42.5(pid=32223) [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32223)] [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 02:57:35.600757 tst ping.py:22: Test FAILED (6.8 sec) 02:57:35.629147 run osmo-hlr_10.42.42.2(pid=32220): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32220)] 02:57:35.680077 run osmo-hlr_10.42.42.2(pid=32220): stdout: | (launched: 2022-12-14_02:57:32.266797) 02:57:35.732821 run osmo-hlr_10.42.42.2(pid=32220): stderr: | [0;m[1;31m20221214025732466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025732466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025732466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025732466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025732466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025732466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025732482 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025732490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025732490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025732490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:57:35.786974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32219): Terminating (SIGTERM) 02:57:35.831012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32222): Terminating (SIGTERM) 02:57:35.870714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32225): Terminating (SIGTERM) 02:57:35.910969 --- ParallelTerminationStrategy: PID 32219 died... 02:57:35.930146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32219): Terminated: ok {rc=0} 02:57:35.974683 --- ParallelTerminationStrategy: PID 32222 died... 02:57:35.993333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32222): Terminated: ok {rc=0} 02:57:36.037216 --- ParallelTerminationStrategy: PID 32225 died... 02:57:36.055888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32225): Terminated: ok {rc=0} 02:57:36.141275 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 02:57:37.228515 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:37.240095 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 02:57:37.295299 tst ping_idle_ping.py: using LAC 38068 02:57:37.421343 tst ping_idle_ping.py: using RAC 73 02:57:37.546278 tst ping_idle_ping.py: using CellId 38068 02:57:37.672249 tst ping_idle_ping.py: using BVCI 38069 02:57:37.789384 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:37.800599 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:37.811754 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:37.822998 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:37.834407 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:37.845907 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:37.857574 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 02:57:37.868927 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 02:57:37.986478 tst ping_idle_ping.py:24: start network... 02:57:38.186993 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:57:38.683633 run create_hlr_db(pid=32227): Launched 02:57:38.806894 bus /gobi_6: Setting Powered False 02:57:39.870658 run create_hlr_db(pid=32227): Terminated: ok {rc=0} 02:57:40.319443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32229): Launched 02:57:40.641985 run osmo-hlr_10.42.42.2(pid=32230): Launched 02:57:40.766305 run osmo-stp_10.42.42.5: Starting osmo-stp 02:57:41.323543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32232): Launched 02:57:41.646884 run osmo-stp_10.42.42.5(pid=32233): Launched 02:57:41.771537 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:57:42.328433 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32235): Launched 02:57:42.453122 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:57:42.725261 run patchelf(pid=32236): Launched 02:57:42.904124 run osmo-stp_10.42.42.5(pid=32233): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32233)] 02:57:43.040915 run osmo-stp_10.42.42.5(pid=32233): stdout: | (launched: 2022-12-14_02:57:41.587752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:43.178687 run osmo-stp_10.42.42.5(pid=32233): stderr: | [0;m[38;5;43m20221214025741780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025741781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025741781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025741781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025741782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025741782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025741782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:43.316133 run osmo-stp_10.42.42.5(pid=32233): stdout: | (launched: 2022-12-14_02:57:41.587752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:43.448022 run osmo-stp_10.42.42.5(pid=32233): stderr: | [0;m[38;5;43m20221214025741780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025741781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025741781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025741781 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025741782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025741782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025741782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:43.604720 run patchelf(pid=32236): Terminating (SIGINT) 02:57:43.786214 run patchelf(pid=32236): Terminated: ok {rc=0} 02:57:43.917391 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32233): Process ended prematurely: osmo-stp_10.42.42.5(pid=32233) [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32233)] [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 02:57:43.927087 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 02:57:43.955217 run osmo-hlr_10.42.42.2(pid=32230): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32230)] 02:57:44.006542 run osmo-hlr_10.42.42.2(pid=32230): stdout: | (launched: 2022-12-14_02:57:40.582896) 02:57:44.059609 run osmo-hlr_10.42.42.2(pid=32230): stderr: | [0;m[1;31m20221214025740781 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025740782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025740782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025740782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025740782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025740782 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025740795 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025740803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025740803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025740803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:57:44.112282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32229): Terminating (SIGTERM) 02:57:44.154284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32232): Terminating (SIGTERM) 02:57:44.197158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32235): Terminating (SIGTERM) 02:57:44.239942 --- ParallelTerminationStrategy: PID 32229 died... 02:57:44.260545 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32229): Terminated: ok {rc=0} 02:57:44.307564 --- ParallelTerminationStrategy: PID 32232 died... 02:57:44.327812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32232): Terminated: ok {rc=0} 02:57:44.375077 --- ParallelTerminationStrategy: PID 32235 died... 02:57:44.395123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32235): Terminated: ok {rc=0} 02:57:44.483508 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 02:57:45.784054 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:57:45.790063 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 02:57:45.822376 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 02:57:45.878565 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 02:57:45.980482 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 02:57:46.015643 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 02:57:46.066937 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 02:57:46.706526 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 02:57:46.779419 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:46.795255 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:57:46.884687 tst cs_paging_gprs_active.py: using LAC 38069 02:57:47.018689 tst cs_paging_gprs_active.py: using RAC 74 02:57:47.180559 tst cs_paging_gprs_active.py: using CellId 38069 02:57:47.326699 tst cs_paging_gprs_active.py: using BVCI 38070 02:57:47.448490 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:47.460015 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:47.471372 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:47.482736 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:47.494772 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:47.507035 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:47.519342 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:47.531383 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:47.543436 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:57:47.663645 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:57:47.779477 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:57:47.983715 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:48.290151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32243): Launched 02:57:48.558841 run iperf3-srv_10.42.42.10(pid=32244): Launched 02:57:48.674215 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:57:48.876575 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:57:49.182006 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32245): Launched 02:57:49.447498 run iperf3-srv_10.42.42.10(pid=32246): Launched 02:57:49.562952 tst cs_paging_gprs_active.py:38: start network... 02:57:49.765276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:57:50.235539 run create_hlr_db(pid=32247): Launched 02:57:50.360090 bus /gobi_6: Setting Powered False 02:57:51.421175 run create_hlr_db(pid=32247): Terminated: ok {rc=0} 02:57:51.849744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32249): Launched 02:57:52.176739 run osmo-hlr_10.42.42.2(pid=32250): Launched 02:57:52.302482 run osmo-stp_10.42.42.5: Starting osmo-stp 02:57:52.863997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32252): Launched 02:57:53.192578 run osmo-stp_10.42.42.5(pid=32253): Launched 02:57:53.318692 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:57:53.882454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32255): Launched 02:57:54.008732 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:57:54.292586 run patchelf(pid=32256): Launched 02:57:54.475552 run osmo-stp_10.42.42.5(pid=32253): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32253)] 02:57:54.614747 run osmo-stp_10.42.42.5(pid=32253): stdout: | (launched: 2022-12-14_02:57:53.132730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:54.755093 run osmo-stp_10.42.42.5(pid=32253): stderr: | [0;m[38;5;43m20221214025753326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025753326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025753326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025753327 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025753329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025753329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025753329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:54.895556 run osmo-stp_10.42.42.5(pid=32253): stdout: | (launched: 2022-12-14_02:57:53.132730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:57:55.030611 run osmo-stp_10.42.42.5(pid=32253): stderr: | [0;m[38;5;43m20221214025753326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025753326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025753326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025753327 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025753329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025753329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025753329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:57:55.190532 run patchelf(pid=32256): Terminating (SIGINT) 02:57:55.375537 run patchelf(pid=32256): Terminated: ok {rc=0} 02:57:55.509161 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32253): Process ended prematurely: osmo-stp_10.42.42.5(pid=32253) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32253)] [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 02:57:55.519379 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 02:57:55.548096 run osmo-hlr_10.42.42.2(pid=32250): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32250)] 02:57:55.598965 run osmo-hlr_10.42.42.2(pid=32250): stdout: | (launched: 2022-12-14_02:57:52.117228) 02:57:55.651218 run osmo-hlr_10.42.42.2(pid=32250): stderr: | [0;m[1;31m20221214025752317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025752317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025752317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025752317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025752317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025752317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025752330 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025752338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025752339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025752339 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:57:55.703755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32243): Terminating (SIGTERM) 02:57:55.745546 run iperf3-srv_10.42.42.10(pid=32244): Terminating (SIGTERM) 02:57:55.787611 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32245): Terminating (SIGTERM) 02:57:55.829737 run iperf3-srv_10.42.42.10(pid=32246): Terminating (SIGTERM) 02:57:55.871584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32249): Terminating (SIGTERM) 02:57:55.913740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32252): Terminating (SIGTERM) 02:57:55.955675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32255): Terminating (SIGTERM) 02:57:55.998466 --- ParallelTerminationStrategy: PID 32243 died... 02:57:56.018935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32243): Terminated: ok {rc=0} 02:57:56.065491 --- ParallelTerminationStrategy: PID 32244 died... 02:57:56.085351 run iperf3-srv_10.42.42.10(pid=32244): Terminated {rc=256} 02:57:56.131362 --- ParallelTerminationStrategy: PID 32245 died... 02:57:56.151236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32245): Terminated: ok {rc=0} 02:57:56.197601 --- ParallelTerminationStrategy: PID 32246 died... 02:57:56.217578 run iperf3-srv_10.42.42.10(pid=32246): Terminated {rc=256} 02:57:56.263669 --- ParallelTerminationStrategy: PID 32249 died... 02:57:56.283632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32249): Terminated: ok {rc=0} 02:57:56.329857 --- ParallelTerminationStrategy: PID 32252 died... 02:57:56.349814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32252): Terminated: ok {rc=0} 02:57:56.395974 --- ParallelTerminationStrategy: PID 32255 died... 02:57:56.415916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32255): Terminated: ok {rc=0} 02:57:56.503642 bus /gobi_0: Setting Powered False 02:57:57.603976 bus /gobi_0: Setting Powered False 02:57:58.720624 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 02:57:59.867020 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:57:59.878614 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:57:59.953144 tst iperf3.py: using LAC 38070 02:58:00.071404 tst iperf3.py: using RAC 75 02:58:00.193517 tst iperf3.py: using CellId 38070 02:58:00.323123 tst iperf3.py: using BVCI 38071 02:58:00.442535 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:00.454186 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:00.465642 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:00.476725 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:00.488362 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:00.499786 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:00.511351 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:00.522833 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:00.534462 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:00.652127 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:58:00.868522 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:01.204795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32257): Launched 02:58:01.508926 run iperf3-srv_10.42.42.10(pid=32258): Launched 02:58:01.646087 tst iperf3.py:8: start network... 02:58:01.875318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:58:02.386516 run create_hlr_db(pid=32259): Launched 02:58:02.511660 bus /gobi_6: Setting Powered False 02:58:03.573332 run create_hlr_db(pid=32259): Terminated: ok {rc=0} 02:58:04.019477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32261): Launched 02:58:04.349063 run osmo-hlr_10.42.42.2(pid=32262): Launched 02:58:04.475343 run osmo-stp_10.42.42.5: Starting osmo-stp 02:58:05.041084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32264): Launched 02:58:05.369280 run osmo-stp_10.42.42.5(pid=32265): Launched 02:58:05.495347 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:58:06.060151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32267): Launched 02:58:06.185168 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:58:06.445457 run patchelf(pid=32268): Launched 02:58:06.615662 run osmo-stp_10.42.42.5(pid=32265): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32265)] 02:58:06.744350 run osmo-stp_10.42.42.5(pid=32265): stdout: | (launched: 2022-12-14_02:58:05.309439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:06.874487 run osmo-stp_10.42.42.5(pid=32265): stderr: | [0;m[38;5;43m20221214025805503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025805503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025805503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025805504 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025805506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025805506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025805506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:07.004147 run osmo-stp_10.42.42.5(pid=32265): stdout: | (launched: 2022-12-14_02:58:05.309439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:07.128729 run osmo-stp_10.42.42.5(pid=32265): stderr: | [0;m[38;5;43m20221214025805503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025805503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025805503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025805504 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025805506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025805506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025805506 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:07.276217 run patchelf(pid=32268): Terminating (SIGINT) 02:58:07.447516 run patchelf(pid=32268): Terminated: ok {rc=0} 02:58:07.571102 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32265): Process ended prematurely: osmo-stp_10.42.42.5(pid=32265) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32265)] [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 02:58:07.580490 tst iperf3.py:8: Test FAILED (7.8 sec) 02:58:07.607672 run osmo-hlr_10.42.42.2(pid=32262): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32262)] 02:58:07.655165 run osmo-hlr_10.42.42.2(pid=32262): stdout: | (launched: 2022-12-14_02:58:04.289275) 02:58:07.705133 run osmo-hlr_10.42.42.2(pid=32262): stderr: | [0;m[1;31m20221214025804488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025804488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025804488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025804488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025804488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025804488 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025804501 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025804509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025804509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025804509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:58:07.754902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32257): Terminating (SIGTERM) 02:58:07.794846 run iperf3-srv_10.42.42.10(pid=32258): Terminating (SIGTERM) 02:58:07.834652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32261): Terminating (SIGTERM) 02:58:07.874149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32264): Terminating (SIGTERM) 02:58:07.913783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32267): Terminating (SIGTERM) 02:58:07.953800 --- ParallelTerminationStrategy: PID 32257 died... 02:58:07.973211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32257): Terminated: ok {rc=0} 02:58:08.017446 --- ParallelTerminationStrategy: PID 32258 died... 02:58:08.036207 run iperf3-srv_10.42.42.10(pid=32258): Terminated {rc=256} 02:58:08.079983 --- ParallelTerminationStrategy: PID 32261 died... 02:58:08.098899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32261): Terminated: ok {rc=0} 02:58:08.142744 --- ParallelTerminationStrategy: PID 32264 died... 02:58:08.161606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32264): Terminated: ok {rc=0} 02:58:08.205396 --- ParallelTerminationStrategy: PID 32267 died... 02:58:08.224094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32267): Terminated: ok {rc=0} 02:58:08.309609 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 02:58:09.456894 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:09.468630 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:58:09.539147 tst iperf3m4.py: using LAC 38071 02:58:09.658358 tst iperf3m4.py: using RAC 76 02:58:09.779662 tst iperf3m4.py: using CellId 38071 02:58:09.899293 tst iperf3m4.py: using BVCI 38072 02:58:10.011454 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:10.022328 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:10.033022 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:10.043717 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:10.054274 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:10.064823 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:10.075494 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:10.086614 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:10.097539 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:10.214835 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:10.337629 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:10.456361 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:10.577820 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:58:10.798806 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:11.127198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32269): Launched 02:58:11.412642 run iperf3-srv_10.42.42.10(pid=32270): Launched 02:58:11.535478 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:58:11.755302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:12.084187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32271): Launched 02:58:12.368102 run iperf3-srv_10.42.42.10(pid=32272): Launched 02:58:12.490940 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:58:12.710933 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:13.038735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32273): Launched 02:58:13.324398 run iperf3-srv_10.42.42.10(pid=32274): Launched 02:58:13.447006 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:58:13.666806 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:13.994729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32275): Launched 02:58:14.281380 run iperf3-srv_10.42.42.10(pid=32276): Launched 02:58:14.403451 tst iperf3m4.py:8: start network... 02:58:14.622845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:58:15.129611 run create_hlr_db(pid=32277): Launched 02:58:15.255074 bus /gobi_6: Setting Powered False 02:58:16.320726 run create_hlr_db(pid=32277): Terminated: ok {rc=0} 02:58:16.827836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32279): Launched 02:58:17.159623 run osmo-hlr_10.42.42.2(pid=32280): Launched 02:58:17.287960 run osmo-stp_10.42.42.5: Starting osmo-stp 02:58:17.818136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32282): Launched 02:58:18.116872 run osmo-stp_10.42.42.5(pid=32283): Launched 02:58:18.230230 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:58:18.745308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32285): Launched 02:58:18.859466 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:58:19.112079 run patchelf(pid=32286): Launched 02:58:19.278278 run osmo-stp_10.42.42.5(pid=32283): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32283)] 02:58:19.404662 run osmo-stp_10.42.42.5(pid=32283): stdout: | (launched: 2022-12-14_02:58:18.061546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:19.532157 run osmo-stp_10.42.42.5(pid=32283): stderr: | [0;m[38;5;43m20221214025818231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025818231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025818232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025818232 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025818233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025818233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025818233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:19.659864 run osmo-stp_10.42.42.5(pid=32283): stdout: | (launched: 2022-12-14_02:58:18.061546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:19.782027 run osmo-stp_10.42.42.5(pid=32283): stderr: | [0;m[38;5;43m20221214025818231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025818231 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025818232 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025818232 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025818233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025818233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025818233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:19.926939 run patchelf(pid=32286): Terminating (SIGINT) 02:58:20.096163 run patchelf(pid=32286): Terminated: ok {rc=0} 02:58:20.217519 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32283): Process ended prematurely: osmo-stp_10.42.42.5(pid=32283) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32283)] [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 02:58:20.226889 tst iperf3m4.py:8: Test FAILED (10.8 sec) 02:58:20.254232 run osmo-hlr_10.42.42.2(pid=32280): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32280)] 02:58:20.301711 run osmo-hlr_10.42.42.2(pid=32280): stdout: | (launched: 2022-12-14_02:58:17.089648) 02:58:20.351050 run osmo-hlr_10.42.42.2(pid=32280): stderr: | [0;m[1;31m20221214025817336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025817336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025817336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025817336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025817336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025817336 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025817349 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025817359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025817359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025817359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:58:20.401067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32269): Terminating (SIGTERM) 02:58:20.440622 run iperf3-srv_10.42.42.10(pid=32270): Terminating (SIGTERM) 02:58:20.480310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32271): Terminating (SIGTERM) 02:58:20.520278 run iperf3-srv_10.42.42.10(pid=32272): Terminating (SIGTERM) 02:58:20.560133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32273): Terminating (SIGTERM) 02:58:20.600261 run iperf3-srv_10.42.42.10(pid=32274): Terminating (SIGTERM) 02:58:20.640091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32275): Terminating (SIGTERM) 02:58:20.679839 run iperf3-srv_10.42.42.10(pid=32276): Terminating (SIGTERM) 02:58:20.719636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32279): Terminating (SIGTERM) 02:58:20.759426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32282): Terminating (SIGTERM) 02:58:20.799301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32285): Terminating (SIGTERM) 02:58:20.839463 --- ParallelTerminationStrategy: PID 32269 died... 02:58:20.858787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32269): Terminated: ok {rc=0} 02:58:20.902729 --- ParallelTerminationStrategy: PID 32270 died... 02:58:20.921562 run iperf3-srv_10.42.42.10(pid=32270): Terminated {rc=256} 02:58:20.965996 --- ParallelTerminationStrategy: PID 32271 died... 02:58:20.985352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32271): Terminated: ok {rc=0} 02:58:21.029387 --- ParallelTerminationStrategy: PID 32272 died... 02:58:21.048105 run iperf3-srv_10.42.42.10(pid=32272): Terminated {rc=256} 02:58:21.091997 --- ParallelTerminationStrategy: PID 32273 died... 02:58:21.110892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32273): Terminated: ok {rc=0} 02:58:21.155138 --- ParallelTerminationStrategy: PID 32274 died... 02:58:21.173963 run iperf3-srv_10.42.42.10(pid=32274): Terminated {rc=256} 02:58:21.217824 --- ParallelTerminationStrategy: PID 32275 died... 02:58:21.236647 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32275): Terminated: ok {rc=0} 02:58:21.280757 --- ParallelTerminationStrategy: PID 32276 died... 02:58:21.299643 run iperf3-srv_10.42.42.10(pid=32276): Terminated {rc=256} 02:58:21.343648 --- ParallelTerminationStrategy: PID 32279 died... 02:58:21.362488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32279): Terminated: ok {rc=0} 02:58:21.406582 --- ParallelTerminationStrategy: PID 32282 died... 02:58:21.425460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32282): Terminated: ok {rc=0} 02:58:21.469534 --- ParallelTerminationStrategy: PID 32285 died... 02:58:21.488472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32285): Terminated: ok {rc=0} 02:58:21.574794 bus /gobi_4: Setting Powered False 02:58:22.674434 bus /gobi_4: Setting Powered False 02:58:23.790245 bus /gobi_1: Setting Powered False 02:58:24.889687 bus /gobi_1: Setting Powered False 02:58:26.005226 bus /gobi_0: Setting Powered False 02:58:27.105711 bus /gobi_0: Setting Powered False 02:58:28.224006 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 02:58:29.326302 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:29.338358 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:58:29.408689 tst ping.py: using LAC 38072 02:58:29.532524 tst ping.py: using RAC 77 02:58:29.656076 tst ping.py: using CellId 38072 02:58:29.779505 tst ping.py: using BVCI 38073 02:58:29.887033 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:29.897886 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:29.908679 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:29.919403 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:29.930086 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:29.940855 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:29.951564 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:29.962122 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:30.079976 tst ping.py:19: start network... 02:58:30.291948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:58:30.780940 run create_hlr_db(pid=32287): Launched 02:58:30.940560 bus /gobi_6: Setting Powered False 02:58:31.998592 run create_hlr_db(pid=32287): Terminated: ok {rc=0} 02:58:32.458791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32289): Launched 02:58:32.776005 run osmo-hlr_10.42.42.2(pid=32290): Launched 02:58:32.896763 run osmo-stp_10.42.42.5: Starting osmo-stp 02:58:33.444694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32292): Launched 02:58:33.760782 run osmo-stp_10.42.42.5(pid=32293): Launched 02:58:33.881553 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:58:34.429109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32295): Launched 02:58:34.550442 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:58:34.818410 run patchelf(pid=32296): Launched 02:58:34.994576 run osmo-stp_10.42.42.5(pid=32293): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32293)] 02:58:35.129530 run osmo-stp_10.42.42.5(pid=32293): stdout: | (launched: 2022-12-14_02:58:33.703030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:35.265196 run osmo-stp_10.42.42.5(pid=32293): stderr: | [0;m[38;5;43m20221214025833895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025833895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025833895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025833896 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025833896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025833896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025833896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:35.401105 run osmo-stp_10.42.42.5(pid=32293): stdout: | (launched: 2022-12-14_02:58:33.703030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:35.531315 run osmo-stp_10.42.42.5(pid=32293): stderr: | [0;m[38;5;43m20221214025833895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025833895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025833895 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025833896 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025833896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025833896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025833896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:35.685393 run patchelf(pid=32296): Terminating (SIGINT) 02:58:35.863729 run patchelf(pid=32296): Terminated: ok {rc=0} 02:58:35.992843 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32293): Process ended prematurely: osmo-stp_10.42.42.5(pid=32293) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32293)] [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 02:58:36.002395 tst ping.py:22: Test FAILED (6.7 sec) 02:58:36.030966 run osmo-hlr_10.42.42.2(pid=32290): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32290)] 02:58:36.081994 run osmo-hlr_10.42.42.2(pid=32290): stdout: | (launched: 2022-12-14_02:58:32.718204) 02:58:36.133939 run osmo-hlr_10.42.42.2(pid=32290): stderr: | [0;m[1;31m20221214025832917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025832917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025832917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025832917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025832917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025832917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025832930 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025832938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025832939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025832939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:58:36.186456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32289): Terminating (SIGTERM) 02:58:36.228085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32292): Terminating (SIGTERM) 02:58:36.270274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32295): Terminating (SIGTERM) 02:58:36.312615 --- ParallelTerminationStrategy: PID 32289 died... 02:58:36.333065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32289): Terminated: ok {rc=0} 02:58:36.379312 --- ParallelTerminationStrategy: PID 32292 died... 02:58:36.399088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32292): Terminated: ok {rc=0} 02:58:36.445343 --- ParallelTerminationStrategy: PID 32295 died... 02:58:36.464934 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32295): Terminated: ok {rc=0} 02:58:36.553019 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 02:58:37.639964 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:37.651944 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 02:58:37.725366 tst ping_idle_ping.py: using LAC 38073 02:58:37.851666 tst ping_idle_ping.py: using RAC 78 02:58:37.976288 tst ping_idle_ping.py: using CellId 38073 02:58:38.103340 tst ping_idle_ping.py: using BVCI 38074 02:58:38.219689 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:38.231018 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:38.242174 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:38.253243 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:38.265075 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:38.276800 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:38.288730 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 02:58:38.300610 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 02:58:38.418250 tst ping_idle_ping.py:24: start network... 02:58:38.616099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:58:39.076791 run create_hlr_db(pid=32297): Launched 02:58:39.198816 bus /gobi_6: Setting Powered False 02:58:40.258870 run create_hlr_db(pid=32297): Terminated: ok {rc=0} 02:58:40.671532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32299): Launched 02:58:40.966630 run osmo-hlr_10.42.42.2(pid=32300): Launched 02:58:41.078171 run osmo-stp_10.42.42.5: Starting osmo-stp 02:58:41.598712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32302): Launched 02:58:41.893567 run osmo-stp_10.42.42.5(pid=32303): Launched 02:58:42.005572 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:58:42.518871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32305): Launched 02:58:42.631628 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:58:42.882094 run patchelf(pid=32306): Launched 02:58:43.046761 run osmo-stp_10.42.42.5(pid=32303): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32303)] 02:58:43.172196 run osmo-stp_10.42.42.5(pid=32303): stdout: | (launched: 2022-12-14_02:58:41.838705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:43.299178 run osmo-stp_10.42.42.5(pid=32303): stderr: | [0;m[38;5;43m20221214025842007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025842007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025842007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025842008 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025842008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025842008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025842008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:43.425778 run osmo-stp_10.42.42.5(pid=32303): stdout: | (launched: 2022-12-14_02:58:41.838705) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:43.547130 run osmo-stp_10.42.42.5(pid=32303): stderr: | [0;m[38;5;43m20221214025842007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025842007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025842007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025842008 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025842008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025842008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025842008 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:43.690841 run patchelf(pid=32306): Terminating (SIGINT) 02:58:43.858242 run patchelf(pid=32306): Terminated: ok {rc=0} 02:58:43.978801 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32303): Process ended prematurely: osmo-stp_10.42.42.5(pid=32303) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32303)] [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 02:58:43.987578 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 02:58:44.014274 run osmo-hlr_10.42.42.2(pid=32300): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32300)] 02:58:44.061725 run osmo-hlr_10.42.42.2(pid=32300): stdout: | (launched: 2022-12-14_02:58:40.912169) 02:58:44.110966 run osmo-hlr_10.42.42.2(pid=32300): stderr: | [0;m[1;31m20221214025841088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025841088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025841088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025841088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025841088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025841088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025841100 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025841108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025841109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025841109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:58:44.160285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32299): Terminating (SIGTERM) 02:58:44.200272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32302): Terminating (SIGTERM) 02:58:44.240161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32305): Terminating (SIGTERM) 02:58:44.280286 --- ParallelTerminationStrategy: PID 32299 died... 02:58:44.299767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32299): Terminated: ok {rc=0} 02:58:44.344031 --- ParallelTerminationStrategy: PID 32302 died... 02:58:44.362907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32302): Terminated: ok {rc=0} 02:58:44.406851 --- ParallelTerminationStrategy: PID 32305 died... 02:58:44.425677 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32305): Terminated: ok {rc=0} 02:58:44.511217 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 02:58:45.813739 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:58:45.820140 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 02:58:45.868625 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 02:58:45.909574 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 02:58:46.001593 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 02:58:46.039243 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 02:58:46.081655 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 02:58:46.704261 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 02:58:46.759711 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:46.770944 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:58:46.842755 tst cs_paging_gprs_active.py: using LAC 38074 02:58:47.015672 tst cs_paging_gprs_active.py: using RAC 79 02:58:47.166635 tst cs_paging_gprs_active.py: using CellId 38074 02:58:47.321345 tst cs_paging_gprs_active.py: using BVCI 38075 02:58:47.436487 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:47.447752 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:47.458819 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:47.471386 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:47.482588 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:47.493196 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:47.503765 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:47.514241 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:47.524883 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:58:47.640749 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:58:47.767045 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 02:58:47.984372 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:48.308025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32310): Launched 02:58:48.588729 run iperf3-srv_10.42.42.10(pid=32311): Launched 02:58:48.710910 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 02:58:48.929296 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:58:49.253593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32312): Launched 02:58:49.533133 run iperf3-srv_10.42.42.10(pid=32313): Launched 02:58:49.654179 tst cs_paging_gprs_active.py:38: start network... 02:58:49.871105 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:58:50.370687 run create_hlr_db(pid=32314): Launched 02:58:50.493661 bus /gobi_6: Setting Powered False 02:58:51.557855 run create_hlr_db(pid=32314): Terminated: ok {rc=0} 02:58:51.987319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32316): Launched 02:58:52.286344 run osmo-hlr_10.42.42.2(pid=32317): Launched 02:58:52.401220 run osmo-stp_10.42.42.5: Starting osmo-stp 02:58:52.918448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32319): Launched 02:58:53.218106 run osmo-stp_10.42.42.5(pid=32320): Launched 02:58:53.332726 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:58:53.849262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32322): Launched 02:58:53.963662 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:58:54.217192 run patchelf(pid=32323): Launched 02:58:54.385824 run osmo-stp_10.42.42.5(pid=32320): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32320)] 02:58:54.512294 run osmo-stp_10.42.42.5(pid=32320): stdout: | (launched: 2022-12-14_02:58:53.162993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:54.640222 run osmo-stp_10.42.42.5(pid=32320): stderr: | [0;m[38;5;43m20221214025853334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025853334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025853334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025853335 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025853335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025853335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025853335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:54.768546 run osmo-stp_10.42.42.5(pid=32320): stdout: | (launched: 2022-12-14_02:58:53.162993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:58:54.892353 run osmo-stp_10.42.42.5(pid=32320): stderr: | [0;m[38;5;43m20221214025853334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025853334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025853334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025853335 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025853335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025853335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025853335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:58:55.038052 run patchelf(pid=32323): Terminating (SIGINT) 02:58:55.207497 run patchelf(pid=32323): Terminated: ok {rc=0} 02:58:55.329583 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32320): Process ended prematurely: osmo-stp_10.42.42.5(pid=32320) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32320)] [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 02:58:55.338926 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 02:58:55.365818 run osmo-hlr_10.42.42.2(pid=32317): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32317)] 02:58:55.413105 run osmo-hlr_10.42.42.2(pid=32317): stdout: | (launched: 2022-12-14_02:58:52.231477) 02:58:55.462011 run osmo-hlr_10.42.42.2(pid=32317): stderr: | [0;m[1;31m20221214025852408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025852408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025852408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025852408 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025852409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025852409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025852420 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025852429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025852429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025852429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:58:55.511537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32310): Terminating (SIGTERM) 02:58:55.551111 run iperf3-srv_10.42.42.10(pid=32311): Terminating (SIGTERM) 02:58:55.590527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32312): Terminating (SIGTERM) 02:58:55.629758 run iperf3-srv_10.42.42.10(pid=32313): Terminating (SIGTERM) 02:58:55.668919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32316): Terminating (SIGTERM) 02:58:55.708226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32319): Terminating (SIGTERM) 02:58:55.747467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32322): Terminating (SIGTERM) 02:58:55.787072 --- ParallelTerminationStrategy: PID 32310 died... 02:58:55.806036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32310): Terminated: ok {rc=0} 02:58:55.849850 --- ParallelTerminationStrategy: PID 32311 died... 02:58:55.868161 run iperf3-srv_10.42.42.10(pid=32311): Terminated {rc=256} 02:58:55.911835 --- ParallelTerminationStrategy: PID 32312 died... 02:58:55.930341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32312): Terminated: ok {rc=0} 02:58:55.973528 --- ParallelTerminationStrategy: PID 32313 died... 02:58:55.992052 run iperf3-srv_10.42.42.10(pid=32313): Terminated {rc=256} 02:58:56.035484 --- ParallelTerminationStrategy: PID 32316 died... 02:58:56.054049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32316): Terminated: ok {rc=0} 02:58:56.097394 --- ParallelTerminationStrategy: PID 32319 died... 02:58:56.116002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32319): Terminated: ok {rc=0} 02:58:56.159397 --- ParallelTerminationStrategy: PID 32322 died... 02:58:56.178059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32322): Terminated: ok {rc=0} 02:58:56.260793 bus /gobi_0: Setting Powered False 02:58:57.358458 bus /gobi_0: Setting Powered False 02:58:58.473940 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 02:58:59.621726 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:58:59.633772 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:58:59.705390 tst iperf3.py: using LAC 38075 02:58:59.826692 tst iperf3.py: using RAC 80 02:58:59.944426 tst iperf3.py: using CellId 38075 02:59:00.060587 tst iperf3.py: using BVCI 38076 02:59:00.169621 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:00.180442 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:00.191162 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:00.201710 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:00.212314 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:00.222863 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:00.233490 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:00.244318 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:00.255385 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:00.374547 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 02:59:00.595113 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:59:00.944609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32324): Launched 02:59:01.245707 run iperf3-srv_10.42.42.10(pid=32325): Launched 02:59:01.369818 tst iperf3.py:8: start network... 02:59:01.575503 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:59:02.054183 run create_hlr_db(pid=32326): Launched 02:59:02.210992 bus /gobi_6: Setting Powered False 02:59:03.270609 run create_hlr_db(pid=32326): Terminated: ok {rc=0} 02:59:03.687280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32328): Launched 02:59:03.986342 run osmo-hlr_10.42.42.2(pid=32329): Launched 02:59:04.099195 run osmo-stp_10.42.42.5: Starting osmo-stp 02:59:04.613908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32331): Launched 02:59:04.913575 run osmo-stp_10.42.42.5(pid=32332): Launched 02:59:05.027709 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:59:05.542539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32334): Launched 02:59:05.656255 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:59:05.908450 run patchelf(pid=32335): Launched 02:59:06.075018 run osmo-stp_10.42.42.5(pid=32332): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32332)] 02:59:06.201793 run osmo-stp_10.42.42.5(pid=32332): stdout: | (launched: 2022-12-14_02:59:04.858266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:06.329811 run osmo-stp_10.42.42.5(pid=32332): stderr: | [0;m[38;5;43m20221214025905029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025905029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025905029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025905029 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025905030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025905030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025905030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:06.458401 run osmo-stp_10.42.42.5(pid=32332): stdout: | (launched: 2022-12-14_02:59:04.858266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:06.581130 run osmo-stp_10.42.42.5(pid=32332): stderr: | [0;m[38;5;43m20221214025905029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025905029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025905029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025905029 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025905030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025905030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025905030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:06.726920 run patchelf(pid=32335): Terminating (SIGINT) 02:59:06.896215 run patchelf(pid=32335): Terminated: ok {rc=0} 02:59:07.019071 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32332): Process ended prematurely: osmo-stp_10.42.42.5(pid=32332) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32332)] [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 02:59:07.028426 tst iperf3.py:8: Test FAILED (7.4 sec) 02:59:07.055493 run osmo-hlr_10.42.42.2(pid=32329): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32329)] 02:59:07.102526 run osmo-hlr_10.42.42.2(pid=32329): stdout: | (launched: 2022-12-14_02:59:03.931621) 02:59:07.151317 run osmo-hlr_10.42.42.2(pid=32329): stderr: | [0;m[1;31m20221214025904106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025904106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025904106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025904106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025904106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025904106 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025904119 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025904129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025904130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025904130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:59:07.201185 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32324): Terminating (SIGTERM) 02:59:07.240640 run iperf3-srv_10.42.42.10(pid=32325): Terminating (SIGTERM) 02:59:07.279974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32328): Terminating (SIGTERM) 02:59:07.319399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32331): Terminating (SIGTERM) 02:59:07.358795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32334): Terminating (SIGTERM) 02:59:07.398501 --- ParallelTerminationStrategy: PID 32324 died... 02:59:07.417333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32324): Terminated: ok {rc=0} 02:59:07.461048 --- ParallelTerminationStrategy: PID 32325 died... 02:59:07.479465 run iperf3-srv_10.42.42.10(pid=32325): Terminated {rc=256} 02:59:07.523030 --- ParallelTerminationStrategy: PID 32328 died... 02:59:07.541808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32328): Terminated: ok {rc=0} 02:59:07.585369 --- ParallelTerminationStrategy: PID 32331 died... 02:59:07.604022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32331): Terminated: ok {rc=0} 02:59:07.647498 --- ParallelTerminationStrategy: PID 32334 died... 02:59:07.666302 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32334): Terminated: ok {rc=0} 02:59:07.751515 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 02:59:08.898773 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:08.910415 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:59:08.980005 tst iperf3m4.py: using LAC 38076 02:59:09.100035 tst iperf3m4.py: using RAC 81 02:59:09.220242 tst iperf3m4.py: using CellId 38076 02:59:09.339956 tst iperf3m4.py: using BVCI 38077 02:59:09.448751 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:09.459814 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:09.470599 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:09.481394 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:09.492057 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:09.502868 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:09.513804 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:09.524439 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:09.535415 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:09.657227 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:09.779611 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:09.895537 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:10.016355 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 02:59:10.234546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:59:10.557614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32336): Launched 02:59:10.838845 run iperf3-srv_10.42.42.10(pid=32337): Launched 02:59:10.960475 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 02:59:11.179368 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:59:11.502679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32338): Launched 02:59:11.783545 run iperf3-srv_10.42.42.10(pid=32339): Launched 02:59:11.931439 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 02:59:12.132910 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:59:12.433556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32340): Launched 02:59:12.694631 run iperf3-srv_10.42.42.10(pid=32341): Launched 02:59:12.807100 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 02:59:13.007875 run iperf3-srv_10.42.42.10: Starting iperf3-srv 02:59:13.309267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32342): Launched 02:59:13.570376 run iperf3-srv_10.42.42.10(pid=32343): Launched 02:59:13.682864 tst iperf3m4.py:8: start network... 02:59:13.882950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:59:14.347515 run create_hlr_db(pid=32344): Launched 02:59:14.470304 bus /gobi_6: Setting Powered False 02:59:15.530618 run create_hlr_db(pid=32344): Terminated: ok {rc=0} 02:59:15.989705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32346): Launched 02:59:16.349670 run osmo-hlr_10.42.42.2(pid=32347): Launched 02:59:16.593820 run osmo-stp_10.42.42.5: Starting osmo-stp 02:59:17.247290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32349): Launched 02:59:17.586245 run osmo-stp_10.42.42.5(pid=32350): Launched 02:59:17.710096 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:59:18.264330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32352): Launched 02:59:18.387823 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:59:18.659437 run patchelf(pid=32353): Launched 02:59:18.838665 run osmo-stp_10.42.42.5(pid=32350): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32350)] 02:59:18.974361 run osmo-stp_10.42.42.5(pid=32350): stdout: | (launched: 2022-12-14_02:59:17.527534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:19.113183 run osmo-stp_10.42.42.5(pid=32350): stderr: | [0;m[38;5;43m20221214025917720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025917720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025917720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025917721 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025917721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025917721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025917721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:19.250624 run osmo-stp_10.42.42.5(pid=32350): stdout: | (launched: 2022-12-14_02:59:17.527534) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:19.382947 run osmo-stp_10.42.42.5(pid=32350): stderr: | [0;m[38;5;43m20221214025917720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025917720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025917720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025917721 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025917721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025917721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025917721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:19.539991 run patchelf(pid=32353): Terminating (SIGINT) 02:59:19.722091 run patchelf(pid=32353): Terminated: ok {rc=0} 02:59:19.852763 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32350): Process ended prematurely: osmo-stp_10.42.42.5(pid=32350) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32350)] [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 02:59:19.863001 tst iperf3m4.py:8: Test FAILED (11.0 sec) 02:59:19.891727 run osmo-hlr_10.42.42.2(pid=32347): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32347)] 02:59:19.942607 run osmo-hlr_10.42.42.2(pid=32347): stdout: | (launched: 2022-12-14_02:59:16.282651) 02:59:19.994941 run osmo-hlr_10.42.42.2(pid=32347): stderr: | [0;m[1;31m20221214025916485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025916485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025916485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025916485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025916485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025916485 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025916502 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025916523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025916523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025916523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:59:20.047664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32336): Terminating (SIGTERM) 02:59:20.089606 run iperf3-srv_10.42.42.10(pid=32337): Terminating (SIGTERM) 02:59:20.131708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32338): Terminating (SIGTERM) 02:59:20.174204 run iperf3-srv_10.42.42.10(pid=32339): Terminating (SIGTERM) 02:59:20.216186 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32340): Terminating (SIGTERM) 02:59:20.258334 run iperf3-srv_10.42.42.10(pid=32341): Terminating (SIGTERM) 02:59:20.300394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32342): Terminating (SIGTERM) 02:59:20.342529 run iperf3-srv_10.42.42.10(pid=32343): Terminating (SIGTERM) 02:59:20.384487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32346): Terminating (SIGTERM) 02:59:20.427036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32349): Terminating (SIGTERM) 02:59:20.469328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32352): Terminating (SIGTERM) 02:59:20.511915 --- ParallelTerminationStrategy: PID 32336 died... 02:59:20.532242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32336): Terminated: ok {rc=0} 02:59:20.578731 --- ParallelTerminationStrategy: PID 32337 died... 02:59:20.598921 run iperf3-srv_10.42.42.10(pid=32337): Terminated {rc=256} 02:59:20.644869 --- ParallelTerminationStrategy: PID 32338 died... 02:59:20.665319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32338): Terminated: ok {rc=0} 02:59:20.711574 --- ParallelTerminationStrategy: PID 32339 died... 02:59:20.731319 run iperf3-srv_10.42.42.10(pid=32339): Terminated {rc=256} 02:59:20.777270 --- ParallelTerminationStrategy: PID 32340 died... 02:59:20.796893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32340): Terminated: ok {rc=0} 02:59:20.843254 --- ParallelTerminationStrategy: PID 32341 died... 02:59:20.863028 run iperf3-srv_10.42.42.10(pid=32341): Terminated {rc=256} 02:59:20.909232 --- ParallelTerminationStrategy: PID 32342 died... 02:59:20.928913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32342): Terminated: ok {rc=0} 02:59:20.975102 --- ParallelTerminationStrategy: PID 32343 died... 02:59:20.994868 run iperf3-srv_10.42.42.10(pid=32343): Terminated {rc=256} 02:59:21.041112 --- ParallelTerminationStrategy: PID 32346 died... 02:59:21.060710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32346): Terminated: ok {rc=0} 02:59:21.107430 --- ParallelTerminationStrategy: PID 32349 died... 02:59:21.127315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32349): Terminated: ok {rc=0} 02:59:21.173396 --- ParallelTerminationStrategy: PID 32352 died... 02:59:21.193281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32352): Terminated: ok {rc=0} 02:59:21.281502 bus /gobi_4: Setting Powered False 02:59:22.380057 bus /gobi_4: Setting Powered False 02:59:23.494826 bus /gobi_1: Setting Powered False 02:59:24.590821 bus /gobi_1: Setting Powered False 02:59:25.705110 bus /gobi_0: Setting Powered False 02:59:26.802248 bus /gobi_0: Setting Powered False 02:59:27.918269 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 02:59:29.020282 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:29.031761 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:59:29.101629 tst ping.py: using LAC 38077 02:59:29.218053 tst ping.py: using RAC 82 02:59:29.333680 tst ping.py: using CellId 38077 02:59:29.450862 tst ping.py: using BVCI 38078 02:59:29.558932 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:29.569792 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:29.580383 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:29.590917 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:29.601422 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:29.611903 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:29.622569 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:29.633775 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:29.747384 tst ping.py:19: start network... 02:59:29.943854 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:59:30.399367 run create_hlr_db(pid=32355): Launched 02:59:30.519898 bus /gobi_6: Setting Powered False 02:59:31.582263 run create_hlr_db(pid=32355): Terminated: ok {rc=0} 02:59:32.040535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32357): Launched 02:59:32.371509 run osmo-hlr_10.42.42.2(pid=32358): Launched 02:59:32.494007 run osmo-stp_10.42.42.5: Starting osmo-stp 02:59:33.044812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32360): Launched 02:59:33.362981 run osmo-stp_10.42.42.5(pid=32361): Launched 02:59:33.484390 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:59:34.032147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32363): Launched 02:59:34.154700 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:59:34.422779 run patchelf(pid=32364): Launched 02:59:34.599667 run osmo-stp_10.42.42.5(pid=32361): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32361)] 02:59:34.734306 run osmo-stp_10.42.42.5(pid=32361): stdout: | (launched: 2022-12-14_02:59:33.304329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:34.870321 run osmo-stp_10.42.42.5(pid=32361): stderr: | [0;m[38;5;43m20221214025933495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025933495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025933496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025933496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025933497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025933497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025933497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:35.006690 run osmo-stp_10.42.42.5(pid=32361): stdout: | (launched: 2022-12-14_02:59:33.304329) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:35.137747 run osmo-stp_10.42.42.5(pid=32361): stderr: | [0;m[38;5;43m20221214025933495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025933495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025933496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025933496 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025933497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025933497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025933497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:35.292839 run patchelf(pid=32364): Terminating (SIGINT) 02:59:35.473082 run patchelf(pid=32364): Terminated: ok {rc=0} 02:59:35.603368 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32361): Process ended prematurely: osmo-stp_10.42.42.5(pid=32361) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32361)] [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 02:59:35.613110 tst ping.py:22: Test FAILED (6.6 sec) 02:59:35.641492 run osmo-hlr_10.42.42.2(pid=32358): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32358)] 02:59:35.692629 run osmo-hlr_10.42.42.2(pid=32358): stdout: | (launched: 2022-12-14_02:59:32.313575) 02:59:35.745422 run osmo-hlr_10.42.42.2(pid=32358): stderr: | [0;m[1;31m20221214025932510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025932510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025932510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025932510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025932510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025932510 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025932538 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025932547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025932547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025932547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:59:35.798328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32357): Terminating (SIGTERM) 02:59:35.840496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32360): Terminating (SIGTERM) 02:59:35.883518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32363): Terminating (SIGTERM) 02:59:35.926516 --- ParallelTerminationStrategy: PID 32357 died... 02:59:35.947165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32357): Terminated: ok {rc=0} 02:59:35.993935 --- ParallelTerminationStrategy: PID 32360 died... 02:59:36.014135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32360): Terminated: ok {rc=0} 02:59:36.061119 --- ParallelTerminationStrategy: PID 32363 died... 02:59:36.080918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32363): Terminated: ok {rc=0} 02:59:36.169495 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 02:59:37.257821 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:37.270271 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 02:59:37.345049 tst ping_idle_ping.py: using LAC 38078 02:59:37.471856 tst ping_idle_ping.py: using RAC 83 02:59:37.597374 tst ping_idle_ping.py: using CellId 38078 02:59:37.722903 tst ping_idle_ping.py: using BVCI 38079 02:59:37.838512 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:37.849802 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:37.860773 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:37.871814 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:37.883060 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:37.894412 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:37.905890 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 02:59:37.917234 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 02:59:38.033221 tst ping_idle_ping.py:24: start network... 02:59:38.230362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:59:38.691476 run create_hlr_db(pid=32365): Launched 02:59:38.813332 bus /gobi_6: Setting Powered False 02:59:39.873173 run create_hlr_db(pid=32365): Terminated: ok {rc=0} 02:59:40.313460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32367): Launched 02:59:40.631689 run osmo-hlr_10.42.42.2(pid=32368): Launched 02:59:40.753956 run osmo-stp_10.42.42.5: Starting osmo-stp 02:59:41.303903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32370): Launched 02:59:41.621437 run osmo-stp_10.42.42.5(pid=32371): Launched 02:59:41.743846 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:59:42.294527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32373): Launched 02:59:42.416559 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:59:42.685250 run patchelf(pid=32374): Launched 02:59:42.861807 run osmo-stp_10.42.42.5(pid=32371): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32371)] 02:59:42.996229 run osmo-stp_10.42.42.5(pid=32371): stdout: | (launched: 2022-12-14_02:59:41.563441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:43.132664 run osmo-stp_10.42.42.5(pid=32371): stderr: | [0;m[38;5;43m20221214025941754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025941755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025941755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025941755 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025941756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025941756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025941756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:43.269064 run osmo-stp_10.42.42.5(pid=32371): stdout: | (launched: 2022-12-14_02:59:41.563441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:43.399395 run osmo-stp_10.42.42.5(pid=32371): stderr: | [0;m[38;5;43m20221214025941754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025941755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025941755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025941755 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025941756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025941756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025941756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:43.553786 run patchelf(pid=32374): Terminating (SIGINT) 02:59:43.733268 run patchelf(pid=32374): Terminated: ok {rc=0} 02:59:43.862567 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32371): Process ended prematurely: osmo-stp_10.42.42.5(pid=32371) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32371)] [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 02:59:43.872197 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 02:59:43.900403 run osmo-hlr_10.42.42.2(pid=32368): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32368)] 02:59:43.951082 run osmo-hlr_10.42.42.2(pid=32368): stdout: | (launched: 2022-12-14_02:59:40.573971) 02:59:44.003968 run osmo-hlr_10.42.42.2(pid=32368): stderr: | [0;m[1;31m20221214025940772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025940772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025940772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025940772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025940772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025940772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025940784 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025940792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025940792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025940792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:59:44.057519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32367): Terminating (SIGTERM) 02:59:44.099460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32370): Terminating (SIGTERM) 02:59:44.141989 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32373): Terminating (SIGTERM) 02:59:44.184588 --- ParallelTerminationStrategy: PID 32367 died... 02:59:44.205254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32367): Terminated: ok {rc=0} 02:59:44.252221 --- ParallelTerminationStrategy: PID 32370 died... 02:59:44.272511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32370): Terminated: ok {rc=0} 02:59:44.319297 --- ParallelTerminationStrategy: PID 32373 died... 02:59:44.339648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32373): Terminated: ok {rc=0} 02:59:44.427753 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 02:59:45.737627 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:59:45.744804 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 02:59:45.779453 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 02:59:45.814880 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 02:59:45.884832 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 02:59:45.922976 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 02:59:45.959146 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 02:59:46.515593 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2398 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 02:59:46.521772 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:59:46.533908 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 02:59:46.605811 tst switch_tch_pdch.py: using LAC 38079 02:59:46.731526 tst switch_tch_pdch.py: using RAC 84 02:59:46.850532 tst switch_tch_pdch.py: using CellId 38079 02:59:46.976583 tst switch_tch_pdch.py: using BVCI 38080 02:59:47.095000 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:59:47.107569 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:59:47.120370 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:59:47.132658 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:59:47.146148 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:59:47.159435 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:59:47.172593 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 02:59:47.185840 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:59:47.311111 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 02:59:47.435379 tst switch_tch_pdch.py:51: start network... 02:59:47.633811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:59:48.122017 run create_hlr_db(pid=32378): Launched 02:59:48.243648 bus /gobi_6: Setting Powered False 02:59:49.306178 run create_hlr_db(pid=32378): Terminated: ok {rc=0} 02:59:49.746986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32380): Launched 02:59:50.063999 run osmo-hlr_10.42.42.2(pid=32381): Launched 02:59:50.185448 run osmo-stp_10.42.42.5: Starting osmo-stp 02:59:50.732042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32383): Launched 02:59:51.048720 run osmo-stp_10.42.42.5(pid=32384): Launched 02:59:51.170620 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 02:59:51.716235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32386): Launched 02:59:51.836840 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 02:59:52.103889 run patchelf(pid=32387): Launched 02:59:52.279821 run osmo-stp_10.42.42.5(pid=32384): ERR: Terminated: ERROR {rc=1} [trial-2398↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32384)] 02:59:52.413476 run osmo-stp_10.42.42.5(pid=32384): stdout: | (launched: 2022-12-14_02:59:50.991086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:52.548747 run osmo-stp_10.42.42.5(pid=32384): stderr: | [0;m[38;5;43m20221214025951182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025951182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025951183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025951183 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025951183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025951184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025951184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:52.684287 run osmo-stp_10.42.42.5(pid=32384): stdout: | (launched: 2022-12-14_02:59:50.991086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 02:59:52.814528 run osmo-stp_10.42.42.5(pid=32384): stderr: | [0;m[38;5;43m20221214025951182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214025951182 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214025951183 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214025951183 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214025951183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214025951184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214025951184 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 02:59:52.968503 run patchelf(pid=32387): Terminating (SIGINT) 02:59:53.147528 run patchelf(pid=32387): Terminated: ok {rc=0} 02:59:53.276391 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32384): Process ended prematurely: osmo-stp_10.42.42.5(pid=32384) [trial-2398↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32384)] [trial-2398↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 02:59:53.285837 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 02:59:53.313643 run osmo-hlr_10.42.42.2(pid=32381): ERR: Terminated: ERROR {rc=237} [trial-2398↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32381)] 02:59:53.364090 run osmo-hlr_10.42.42.2(pid=32381): stdout: | (launched: 2022-12-14_02:59:50.005956) 02:59:53.416241 run osmo-hlr_10.42.42.2(pid=32381): stderr: | [0;m[1;31m20221214025950203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214025950203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214025950203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214025950203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214025950203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214025950203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214025950216 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214025950224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214025950225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214025950225 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 02:59:53.468475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32380): Terminating (SIGTERM) 02:59:53.510297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32383): Terminating (SIGTERM) 02:59:53.552205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32386): Terminating (SIGTERM) 02:59:53.594218 --- ParallelTerminationStrategy: PID 32380 died... 02:59:53.614592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32380): Terminated: ok {rc=0} 02:59:53.660835 --- ParallelTerminationStrategy: PID 32383 died... 02:59:53.680623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32383): Terminated: ok {rc=0} 02:59:53.726640 --- ParallelTerminationStrategy: PID 32386 died... 02:59:53.746470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32386): Terminated: ok {rc=0} 02:59:53.833158 bus /gobi_0: Setting Powered False 02:59:54.930380 bus /gobi_0: Setting Powered False 02:59:56.046208 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 02:59:57.298366 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 02:59:57.305347 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 02:59:57.338286 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 02:59:57.373338 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 02:59:57.429693 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 02:59:57.462628 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 02:59:57.496259 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 02:59:58.045521 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2398 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 02:59:58.050719 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:59:58.061735 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 02:59:58.129696 tst switch_tch_pdch.py: using LAC 38080 02:59:58.243899 tst switch_tch_pdch.py: using RAC 85 02:59:58.368677 tst switch_tch_pdch.py: using CellId 38080 02:59:58.493225 tst switch_tch_pdch.py: using BVCI 38081 02:59:58.608360 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:59:58.619754 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:59:58.630795 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:59:58.642166 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:59:58.653503 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:59:58.664839 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:59:58.676363 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 02:59:58.687724 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:59:58.803434 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 02:59:58.920481 tst switch_tch_pdch.py:51: start network... 02:59:59.118270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 02:59:59.550710 run create_hlr_db(pid=32392): Launched 02:59:59.672818 bus /gobi_6: Setting Powered False 03:00:00.732055 run create_hlr_db(pid=32392): Terminated: ok {rc=0} 03:00:01.176386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32394): Launched 03:00:01.538571 run osmo-hlr_10.42.42.2(pid=32401): Launched 03:00:01.701839 run osmo-stp_10.42.42.5: Starting osmo-stp 03:00:02.485745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32411): Launched 03:00:02.834217 run osmo-stp_10.42.42.5(pid=32419): Launched 03:00:03.055820 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:00:03.590474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32430): Launched 03:00:03.702458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:00:03.949712 run patchelf(pid=32431): Launched 03:00:04.112805 run osmo-stp_10.42.42.5(pid=32419): ERR: Terminated: ERROR {rc=1} [trial-2398↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32419)] 03:00:04.236688 run osmo-stp_10.42.42.5(pid=32419): stdout: | (launched: 2022-12-14_03:00:02.770285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:04.362777 run osmo-stp_10.42.42.5(pid=32419): stderr: | [0;m[38;5;43m20221214030002979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030002979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030002979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030002980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030002980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030002980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030002980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:04.488392 run osmo-stp_10.42.42.5(pid=32419): stdout: | (launched: 2022-12-14_03:00:02.770285) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:04.608395 run osmo-stp_10.42.42.5(pid=32419): stderr: | [0;m[38;5;43m20221214030002979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030002979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030002979 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030002980 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030002980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030002980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030002980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:04.750546 run patchelf(pid=32431): Terminating (SIGINT) 03:00:04.917196 run patchelf(pid=32431): Terminated: ok {rc=0} 03:00:05.037149 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=32419): Process ended prematurely: osmo-stp_10.42.42.5(pid=32419) [trial-2398↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32419)] [trial-2398↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 03:00:05.046022 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 03:00:05.072389 run osmo-hlr_10.42.42.2(pid=32401): ERR: Terminated: ERROR {rc=237} [trial-2398↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32401)] 03:00:05.119264 run osmo-hlr_10.42.42.2(pid=32401): stdout: | (launched: 2022-12-14_03:00:01.461334) 03:00:05.168348 run osmo-hlr_10.42.42.2(pid=32401): stderr: | [0;m[1;31m20221214030001890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030001891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030001891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030001891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030001891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030001891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030001914 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030001932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030001933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030001933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:00:05.217558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32394): Terminating (SIGTERM) 03:00:05.256802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32411): Terminating (SIGTERM) 03:00:05.296029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32430): Terminating (SIGTERM) 03:00:05.335545 --- ParallelTerminationStrategy: PID 32394 died... 03:00:05.354341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32394): Terminated: ok {rc=0} 03:00:05.397653 --- ParallelTerminationStrategy: PID 32411 died... 03:00:05.415814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32411): Terminated: ok {rc=0} 03:00:05.460057 --- ParallelTerminationStrategy: PID 32430 died... 03:00:05.478733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32430): Terminated: ok {rc=0} 03:00:05.564119 bus /gobi_0: Setting Powered False 03:00:06.662353 bus /gobi_0: Setting Powered False 03:00:07.775899 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 03:00:09.026730 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:00:09.031188 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:00:09.061107 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 03:00:09.068643 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:00:09.120553 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:00:09.149953 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 03:00:09.156834 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:00:09.696207 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 03:00:09.701684 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 03:00:09.712795 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:00:09.758297 tst mo_mt_sms.py: using LAC 38081 03:00:09.884660 tst mo_mt_sms.py: using RAC 86 03:00:10.000621 tst mo_mt_sms.py: using CellId 38081 03:00:10.115724 tst mo_mt_sms.py: using BVCI 38082 03:00:10.221890 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:00:10.338532 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:00:10.452921 tst mo_mt_sms.py:9: start nitb and bts... 03:00:10.651086 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:00:11.250902 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32436): Launched 03:00:11.544877 run osmo-nitb_10.42.42.2(pid=32437): Launched 03:00:11.708594 run osmo-nitb_10.42.42.2(pid=32437): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32437)] 03:00:11.841080 run osmo-nitb_10.42.42.2(pid=32437): stdout: | (launched: 2022-12-14_03:00:11.491125) 03:00:11.975101 run osmo-nitb_10.42.42.2(pid=32437): stderr: | (launched: 2022-12-14_03:00:11.534701) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:00:12.109202 run osmo-nitb_10.42.42.2(pid=32437): stdout: | (launched: 2022-12-14_03:00:11.491125) 03:00:12.237387 run osmo-nitb_10.42.42.2(pid=32437): stderr: | (launched: 2022-12-14_03:00:11.534701) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32437): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32437) [trial-2398↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32437)] 03:00:12.655940 tst osmo-nitb_10.42.42.2(pid=32437): stdout: | (launched: 2022-12-14_03:00:11.491125) 03:00:12.773867 tst osmo-nitb_10.42.42.2(pid=32437): stderr: | (launched: 2022-12-14_03:00:11.534701) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:00:12.913363 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=32437): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32437) [trial-2398↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32437)] [trial-2398↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 03:00:12.921731 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 03:00:12.928328 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32436): Terminating (SIGTERM) 03:00:13.136610 --- ParallelTerminationStrategy: PID 32436 died... 03:00:13.157187 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32436): Terminated: ok {rc=0} 03:00:13.240914 bus /sierra_3: Setting Powered False 03:00:14.338677 bus /sierra_3: Setting Powered False 03:00:15.462688 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 03:00:16.663277 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:00:16.671199 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:00:16.712744 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:00:16.746194 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:00:16.811740 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:00:16.873422 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:00:16.915367 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:00:17.413116 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 03:00:17.418614 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:17.429913 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:00:17.474424 tst mo_mt_sms.py: using LAC 38082 03:00:17.600160 tst mo_mt_sms.py: using RAC 87 03:00:17.723596 tst mo_mt_sms.py: using CellId 38082 03:00:17.847384 tst mo_mt_sms.py: using BVCI 38083 03:00:17.962254 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:17.973322 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:17.984179 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:17.995013 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:18.006461 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:18.017895 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:00:18.134657 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:00:18.251364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:00:18.707726 run create_hlr_db(pid=325): Launched 03:00:18.829009 bus /sierra_2: Setting Powered False 03:00:19.887817 run create_hlr_db(pid=325): Terminated: ok {rc=0} 03:00:20.320567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=327): Launched 03:00:20.636686 run osmo-hlr_10.42.42.2(pid=328): Launched 03:00:20.757627 run osmo-stp_10.42.42.5: Starting osmo-stp 03:00:21.301758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=330): Launched 03:00:21.617459 run osmo-stp_10.42.42.5(pid=331): Launched 03:00:21.738944 run osmo-msc_10.42.42.6: Starting osmo-msc 03:00:22.316559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=333): Launched 03:00:22.635285 run osmo-msc_10.42.42.6(pid=334): Launched 03:00:22.812492 run osmo-stp_10.42.42.5(pid=331): ERR: Terminated: ERROR {rc=1} [trial-2398↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=331)] 03:00:22.947474 run osmo-stp_10.42.42.5(pid=331): stdout: | (launched: 2022-12-14_03:00:21.559801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:23.083030 run osmo-stp_10.42.42.5(pid=331): stderr: | [0;m[38;5;43m20221214030021751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030021751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030021751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030021752 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030021752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030021752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030021752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:23.217526 run osmo-stp_10.42.42.5(pid=331): stdout: | (launched: 2022-12-14_03:00:21.559801) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:23.344195 run osmo-stp_10.42.42.5(pid=331): stderr: | [0;m[38;5;43m20221214030021751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030021751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030021751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030021752 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030021752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030021752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030021752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:23.495923 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=331): Process ended prematurely: osmo-stp_10.42.42.5(pid=331) [trial-2398↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=331)] [trial-2398↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 03:00:23.505303 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 03:00:23.533081 run osmo-hlr_10.42.42.2(pid=328): ERR: Terminated: ERROR {rc=237} [trial-2398↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=328)] 03:00:23.585066 run osmo-hlr_10.42.42.2(pid=328): stdout: | (launched: 2022-12-14_03:00:20.579504) 03:00:23.638226 run osmo-hlr_10.42.42.2(pid=328): stderr: | [0;m[1;31m20221214030020778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030020778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030020779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030020779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030020779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030020779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030020791 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030020800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030020800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030020800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:00:23.712320 run osmo-msc_10.42.42.6(pid=334): ERR: Terminated: ERROR {rc=2} [trial-2398↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=334)] 03:00:23.762934 run osmo-msc_10.42.42.6(pid=334): stdout: | (launched: 2022-12-14_03:00:22.577606) 03:00:23.816391 run osmo-msc_10.42.42.6(pid=334): stderr: | [0;m[38;5;43m20221214030022897 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030022897 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fab2fa00c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030022897 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030022897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030022898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030022898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030022899 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030022900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030022900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030022900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:00:23.870874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=327): Terminating (SIGTERM) 03:00:23.913534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=330): Terminating (SIGTERM) 03:00:23.958025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=333): Terminating (SIGTERM) 03:00:24.003811 --- ParallelTerminationStrategy: PID 327 died... 03:00:24.024754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=327): Terminated: ok {rc=0} 03:00:24.074247 --- ParallelTerminationStrategy: PID 330 died... 03:00:24.095117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=330): Terminated: ok {rc=0} 03:00:24.142958 --- ParallelTerminationStrategy: PID 333 died... 03:00:24.163774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=333): Terminated: ok {rc=0} 03:00:24.252646 bus /sierra_3: Setting Powered False 03:00:25.354218 bus /sierra_3: Setting Powered False 03:00:26.473653 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 03:00:27.707666 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:00:27.712525 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:00:27.743130 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 03:00:27.754482 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 03:00:27.790861 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:00:27.822770 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 03:00:27.830657 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 03:00:28.346213 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2398 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 03:00:28.353247 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 03:00:28.365586 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:00:28.413088 tst assert_extension.py: using LAC 38083 03:00:28.539937 tst assert_extension.py: using RAC 88 03:00:28.665625 tst assert_extension.py: using CellId 38083 03:00:28.793679 tst assert_extension.py: using BVCI 38084 03:00:28.915775 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 03:00:29.037090 tst assert_extension.py:10: start nitb and bts... 03:00:29.258984 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:00:29.921875 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=528): Launched 03:00:30.239046 run osmo-nitb_10.42.42.2(pid=529): Launched 03:00:30.415490 run osmo-nitb_10.42.42.2(pid=529): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=529)] 03:00:30.557053 run osmo-nitb_10.42.42.2(pid=529): stdout: | (launched: 2022-12-14_03:00:30.181414) 03:00:30.700515 run osmo-nitb_10.42.42.2(pid=529): stderr: | (launched: 2022-12-14_03:00:30.228576) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:00:30.849845 run osmo-nitb_10.42.42.2(pid=529): stdout: | (launched: 2022-12-14_03:00:30.181414) 03:00:30.998021 run osmo-nitb_10.42.42.2(pid=529): stderr: | (launched: 2022-12-14_03:00:30.228576) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=529): Process ended prematurely: osmo-nitb_10.42.42.2(pid=529) [trial-2398↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=529)] 03:00:31.359370 tst osmo-nitb_10.42.42.2(pid=529): stdout: | (launched: 2022-12-14_03:00:30.181414) 03:00:31.482502 tst osmo-nitb_10.42.42.2(pid=529): stderr: | (launched: 2022-12-14_03:00:30.228576) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:00:31.627822 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=529): Process ended prematurely: osmo-nitb_10.42.42.2(pid=529) [trial-2398↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=529)] [trial-2398↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 03:00:31.637255 tst assert_extension.py:12: Test FAILED (3.3 sec) 03:00:31.644810 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=528): Terminating (SIGTERM) 03:00:31.857863 --- ParallelTerminationStrategy: PID 528 died... 03:00:31.878312 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=528): Terminated: ok {rc=0} 03:00:31.965705 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 03:00:33.143096 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:00:33.148320 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:00:33.179955 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:00:33.207950 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 03:00:33.247949 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:00:33.278370 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:00:33.306151 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 03:00:33.830506 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2398 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 03:00:33.836427 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:33.847610 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:00:33.891028 tst assert_extension.py: using LAC 38084 03:00:34.009690 tst assert_extension.py: using RAC 89 03:00:34.125173 tst assert_extension.py: using CellId 38084 03:00:34.239287 tst assert_extension.py: using BVCI 38085 03:00:34.345912 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:34.356697 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:34.367400 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:34.378128 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:34.389091 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:00:34.399960 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 03:00:34.515068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:00:34.969751 run create_hlr_db(pid=534): Launched 03:00:35.090211 bus /sierra_2: Setting Powered False 03:00:36.149249 run create_hlr_db(pid=534): Terminated: ok {rc=0} 03:00:36.582172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=536): Launched 03:00:36.899137 run osmo-hlr_10.42.42.2(pid=537): Launched 03:00:37.019911 run osmo-stp_10.42.42.5: Starting osmo-stp 03:00:37.566094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=539): Launched 03:00:37.883683 run osmo-stp_10.42.42.5(pid=540): Launched 03:00:38.005067 run osmo-msc_10.42.42.6: Starting osmo-msc 03:00:38.576414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=542): Launched 03:00:38.892742 run osmo-msc_10.42.42.6(pid=543): Launched 03:00:39.070926 run osmo-stp_10.42.42.5(pid=540): ERR: Terminated: ERROR {rc=1} [trial-2398↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=540)] 03:00:39.205173 run osmo-stp_10.42.42.5(pid=540): stdout: | (launched: 2022-12-14_03:00:37.825308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:39.339641 run osmo-stp_10.42.42.5(pid=540): stderr: | [0;m[38;5;43m20221214030038015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030038015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030038016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030038016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030038016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030038016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030038017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:39.473671 run osmo-stp_10.42.42.5(pid=540): stdout: | (launched: 2022-12-14_03:00:37.825308) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:39.600072 run osmo-stp_10.42.42.5(pid=540): stderr: | [0;m[38;5;43m20221214030038015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030038015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030038016 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030038016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030038016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030038016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030038017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:39.751320 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=540): Process ended prematurely: osmo-stp_10.42.42.5(pid=540) [trial-2398↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=540)] [trial-2398↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 03:00:39.760057 tst assert_extension.py:17: Test FAILED (5.9 sec) 03:00:39.787280 run osmo-hlr_10.42.42.2(pid=537): ERR: Terminated: ERROR {rc=237} [trial-2398↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=537)] 03:00:39.837638 run osmo-hlr_10.42.42.2(pid=537): stdout: | (launched: 2022-12-14_03:00:36.841492) 03:00:39.889715 run osmo-hlr_10.42.42.2(pid=537): stderr: | [0;m[1;31m20221214030037038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030037038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030037038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030037038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030037038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030037038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030037050 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030037058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030037058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030037058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:00:39.961858 run osmo-msc_10.42.42.6(pid=543): ERR: Terminated: ERROR {rc=2} [trial-2398↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=543)] 03:00:40.011461 run osmo-msc_10.42.42.6(pid=543): stdout: | (launched: 2022-12-14_03:00:38.835159) 03:00:40.063128 run osmo-msc_10.42.42.6(pid=543): stderr: | [0;m[38;5;43m20221214030039155 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030039155 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe63c3f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030039155 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030039155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030039155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030039155 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030039157 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030039157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030039158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030039158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:00:40.115697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=536): Terminating (SIGTERM) 03:00:40.157487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=539): Terminating (SIGTERM) 03:00:40.199617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=542): Terminating (SIGTERM) 03:00:40.241671 --- ParallelTerminationStrategy: PID 536 died... 03:00:40.261936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=536): Terminated: ok {rc=0} 03:00:40.307758 --- ParallelTerminationStrategy: PID 539 died... 03:00:40.327509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=539): Terminated: ok {rc=0} 03:00:40.373448 --- ParallelTerminationStrategy: PID 542 died... 03:00:40.393226 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=542): Terminated: ok {rc=0} 03:00:40.479888 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:00:41.690511 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:00:41.697606 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:00:41.727384 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:00:41.756919 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:00:41.810881 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:00:41.842105 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:00:41.870091 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:00:42.417833 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:00:42.467680 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:42.479018 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:00:42.543440 tst mo_mt_call.py: using LAC 38085 03:00:42.661363 tst mo_mt_call.py: using RAC 90 03:00:42.779064 tst mo_mt_call.py: using CellId 38085 03:00:42.896700 tst mo_mt_call.py: using BVCI 38086 03:00:43.015818 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:43.027620 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:43.039314 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:43.051008 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:43.063332 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:43.075706 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:00:43.192515 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:00:43.308042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:00:43.772443 run create_hlr_db(pid=548): Launched 03:00:43.895723 bus /sierra_2: Setting Powered False 03:00:44.955427 run create_hlr_db(pid=548): Terminated: ok {rc=0} 03:00:45.394811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=550): Launched 03:00:45.717366 run osmo-hlr_10.42.42.2(pid=551): Launched 03:00:45.848904 run osmo-stp_10.42.42.5: Starting osmo-stp 03:00:46.561918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=553): Launched 03:00:46.899406 run osmo-stp_10.42.42.5(pid=554): Launched 03:00:47.086919 run osmo-msc_10.42.42.6: Starting osmo-msc 03:00:47.731776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=556): Launched 03:00:48.031277 run osmo-msc_10.42.42.6(pid=557): Launched 03:00:48.198582 run osmo-stp_10.42.42.5(pid=554): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=554)] 03:00:48.324608 run osmo-stp_10.42.42.5(pid=554): stdout: | (launched: 2022-12-14_03:00:46.832788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:48.451780 run osmo-stp_10.42.42.5(pid=554): stderr: | [0;m[38;5;43m20221214030047137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030047137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030047138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030047138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030047138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030047138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030047138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:48.576264 run osmo-stp_10.42.42.5(pid=554): stdout: | (launched: 2022-12-14_03:00:46.832788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:48.695462 run osmo-stp_10.42.42.5(pid=554): stderr: | [0;m[38;5;43m20221214030047137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030047137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030047138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030047138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030047138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030047138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030047138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:48.837820 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=554): Process ended prematurely: osmo-stp_10.42.42.5(pid=554) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=554)] [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:00:48.846762 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:00:48.873175 run osmo-hlr_10.42.42.2(pid=551): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=551)] 03:00:48.920233 run osmo-hlr_10.42.42.2(pid=551): stdout: | (launched: 2022-12-14_03:00:45.658790) 03:00:48.969077 run osmo-hlr_10.42.42.2(pid=551): stderr: | [0;m[1;31m20221214030045891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030045891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030045891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030045891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030045891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030045891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030045910 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030045930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030045931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030045931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:00:49.037413 run osmo-msc_10.42.42.6(pid=557): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=557)] 03:00:49.084528 run osmo-msc_10.42.42.6(pid=557): stdout: | (launched: 2022-12-14_03:00:47.976627) 03:00:49.133417 run osmo-msc_10.42.42.6(pid=557): stderr: | [0;m[38;5;43m20221214030048247 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030048247 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8fc5c34c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030048247 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030048247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030048247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030048248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030048249 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030048250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030048250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030048250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:00:49.182396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=550): Terminating (SIGTERM) 03:00:49.221672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=553): Terminating (SIGTERM) 03:00:49.261044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=556): Terminating (SIGTERM) 03:00:49.300417 --- ParallelTerminationStrategy: PID 550 died... 03:00:49.319595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=550): Terminated: ok {rc=0} 03:00:49.363191 --- ParallelTerminationStrategy: PID 553 died... 03:00:49.381809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=553): Terminated: ok {rc=0} 03:00:49.425356 --- ParallelTerminationStrategy: PID 556 died... 03:00:49.443527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=556): Terminated: ok {rc=0} 03:00:49.529385 bus /sierra_3: Setting Powered False 03:00:50.627017 bus /sierra_3: Setting Powered False 03:00:51.740857 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:00:52.884652 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:52.896391 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:00:52.960732 tst mo_mt_call_osmux.py: using LAC 38086 03:00:53.078080 tst mo_mt_call_osmux.py: using RAC 91 03:00:53.197440 tst mo_mt_call_osmux.py: using CellId 38086 03:00:53.314218 tst mo_mt_call_osmux.py: using BVCI 38087 03:00:53.424534 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:53.435812 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:53.446848 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:53.457784 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:53.468812 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:00:53.479804 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:00:53.600246 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:00:53.717478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:00:54.183048 run create_hlr_db(pid=561): Launched 03:00:54.308684 bus /sierra_2: Setting Powered False 03:00:55.371679 run create_hlr_db(pid=561): Terminated: ok {rc=0} 03:00:55.819963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=563): Launched 03:00:56.143262 run osmo-hlr_10.42.42.2(pid=564): Launched 03:00:56.266869 run osmo-stp_10.42.42.5: Starting osmo-stp 03:00:56.822718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=566): Launched 03:00:57.146113 run osmo-stp_10.42.42.5(pid=567): Launched 03:00:57.269235 run osmo-msc_10.42.42.6: Starting osmo-msc 03:00:57.856738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=569): Launched 03:00:58.180458 run osmo-msc_10.42.42.6(pid=570): Launched 03:00:58.360829 run osmo-stp_10.42.42.5(pid=567): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=567)] 03:00:58.497895 run osmo-stp_10.42.42.5(pid=567): stdout: | (launched: 2022-12-14_03:00:57.087195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:58.634940 run osmo-stp_10.42.42.5(pid=567): stderr: | [0;m[38;5;43m20221214030057279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030057279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030057280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030057280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030057282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030057282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030057283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:58.771266 run osmo-stp_10.42.42.5(pid=567): stdout: | (launched: 2022-12-14_03:00:57.087195) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:00:58.900172 run osmo-stp_10.42.42.5(pid=567): stderr: | [0;m[38;5;43m20221214030057279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030057279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030057280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030057280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030057282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030057282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030057283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:00:59.054181 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=567): Process ended prematurely: osmo-stp_10.42.42.5(pid=567) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=567)] [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:00:59.063840 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:00:59.091932 run osmo-hlr_10.42.42.2(pid=564): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=564)] 03:00:59.142717 run osmo-hlr_10.42.42.2(pid=564): stdout: | (launched: 2022-12-14_03:00:56.084324) 03:00:59.195197 run osmo-hlr_10.42.42.2(pid=564): stderr: | [0;m[1;31m20221214030056283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030056284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030056284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030056284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030056284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030056284 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030056294 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030056302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030056303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030056303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:00:59.267582 run osmo-msc_10.42.42.6(pid=570): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=570)] 03:00:59.317267 run osmo-msc_10.42.42.6(pid=570): stdout: | (launched: 2022-12-14_03:00:58.121700) 03:00:59.368769 run osmo-msc_10.42.42.6(pid=570): stderr: | [0;m[38;5;43m20221214030058441 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030058441 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff14c046c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030058441 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030058441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030058442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030058442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030058444 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030058445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030058445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030058445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:00:59.420807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=563): Terminating (SIGTERM) 03:00:59.462800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=566): Terminating (SIGTERM) 03:00:59.504773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=569): Terminating (SIGTERM) 03:00:59.547140 --- ParallelTerminationStrategy: PID 563 died... 03:00:59.567757 run pcap-recorder_any(filters='host 10.42.42.2')(pid=563): Terminated: ok {rc=0} 03:00:59.614527 --- ParallelTerminationStrategy: PID 566 died... 03:00:59.634542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=566): Terminated: ok {rc=0} 03:00:59.680796 --- ParallelTerminationStrategy: PID 569 died... 03:00:59.701317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=569): Terminated: ok {rc=0} 03:00:59.788555 bus /sierra_3: Setting Powered False 03:01:00.905089 bus /sierra_3: Setting Powered False 03:01:02.041214 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:01:03.299080 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:01:03.306292 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:01:03.335679 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:01:03.363920 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:01:03.417425 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:01:03.446355 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:01:03.472653 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:01:04.023399 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:01:04.072291 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:04.083459 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:01:04.150323 tst mo_mt_call.py: using LAC 38087 03:01:04.270062 tst mo_mt_call.py: using RAC 92 03:01:04.388734 tst mo_mt_call.py: using CellId 38087 03:01:04.508083 tst mo_mt_call.py: using BVCI 38088 03:01:04.618368 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:04.629542 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:04.640448 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:04.651388 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:04.662458 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:04.673355 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:01:04.793439 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:01:04.913495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:05.414192 run create_hlr_db(pid=575): Launched 03:01:05.538021 bus /sierra_2: Setting Powered False 03:01:06.601557 run create_hlr_db(pid=575): Terminated: ok {rc=0} 03:01:07.031282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=577): Launched 03:01:07.331064 run osmo-hlr_10.42.42.2(pid=578): Launched 03:01:07.445740 run osmo-stp_10.42.42.5: Starting osmo-stp 03:01:07.964684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=580): Launched 03:01:08.263933 run osmo-stp_10.42.42.5(pid=581): Launched 03:01:08.378613 run osmo-msc_10.42.42.6: Starting osmo-msc 03:01:08.921146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=583): Launched 03:01:09.221322 run osmo-msc_10.42.42.6(pid=584): Launched 03:01:09.389119 run osmo-stp_10.42.42.5(pid=581): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=581)] 03:01:09.516016 run osmo-stp_10.42.42.5(pid=581): stdout: | (launched: 2022-12-14_03:01:08.209226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:09.642891 run osmo-stp_10.42.42.5(pid=581): stderr: | [0;m[38;5;43m20221214030108381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030108381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030108382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030108382 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030108383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030108383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030108383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:09.767810 run osmo-stp_10.42.42.5(pid=581): stdout: | (launched: 2022-12-14_03:01:08.209226) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:09.887022 run osmo-stp_10.42.42.5(pid=581): stderr: | [0;m[38;5;43m20221214030108381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030108381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030108382 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030108382 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030108383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030108383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030108383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:10.030566 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=581): Process ended prematurely: osmo-stp_10.42.42.5(pid=581) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=581)] [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:01:10.039298 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 03:01:10.065472 run osmo-hlr_10.42.42.2(pid=578): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=578)] 03:01:10.112793 run osmo-hlr_10.42.42.2(pid=578): stdout: | (launched: 2022-12-14_03:01:07.275958) 03:01:10.161655 run osmo-hlr_10.42.42.2(pid=578): stderr: | [0;m[1;31m20221214030107453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030107453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030107453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030107453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030107453 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030107454 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030107466 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030107478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030107478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030107478 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:01:10.230056 run osmo-msc_10.42.42.6(pid=584): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=584)] 03:01:10.276794 run osmo-msc_10.42.42.6(pid=584): stdout: | (launched: 2022-12-14_03:01:09.166347) 03:01:10.325612 run osmo-msc_10.42.42.6(pid=584): stderr: | [0;m[38;5;43m20221214030109434 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030109435 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f728b784c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030109435 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030109435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030109435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030109435 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030109437 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030109437 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030109438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030109438 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:01:10.374417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=577): Terminating (SIGTERM) 03:01:10.413661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=580): Terminating (SIGTERM) 03:01:10.452808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=583): Terminating (SIGTERM) 03:01:10.492308 --- ParallelTerminationStrategy: PID 577 died... 03:01:10.511329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=577): Terminated: ok {rc=0} 03:01:10.554659 --- ParallelTerminationStrategy: PID 580 died... 03:01:10.572836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=580): Terminated: ok {rc=0} 03:01:10.616253 --- ParallelTerminationStrategy: PID 583 died... 03:01:10.634706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=583): Terminated: ok {rc=0} 03:01:10.716685 bus /sierra_3: Setting Powered False 03:01:11.811132 bus /sierra_3: Setting Powered False 03:01:12.922197 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:01:14.068493 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:14.081068 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:01:14.150334 tst mo_mt_call_osmux.py: using LAC 38088 03:01:14.279450 tst mo_mt_call_osmux.py: using RAC 93 03:01:14.406916 tst mo_mt_call_osmux.py: using CellId 38088 03:01:14.535564 tst mo_mt_call_osmux.py: using BVCI 38089 03:01:14.655229 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:14.666951 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:14.678541 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:14.689965 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:14.701815 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:01:14.713546 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:01:14.830485 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:01:14.950869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:15.417403 run create_hlr_db(pid=586): Launched 03:01:15.541146 bus /sierra_2: Setting Powered False 03:01:16.634354 run create_hlr_db(pid=586): Terminated: ok {rc=0} 03:01:17.074468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=588): Launched 03:01:17.421741 run osmo-hlr_10.42.42.2(pid=589): Launched 03:01:17.545831 run osmo-stp_10.42.42.5: Starting osmo-stp 03:01:18.105737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=592): Launched 03:01:18.428799 run osmo-stp_10.42.42.5(pid=593): Launched 03:01:18.552545 run osmo-msc_10.42.42.6: Starting osmo-msc 03:01:19.138278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=595): Launched 03:01:19.461336 run osmo-msc_10.42.42.6(pid=596): Launched 03:01:19.642033 run osmo-stp_10.42.42.5(pid=593): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=593)] 03:01:19.779443 run osmo-stp_10.42.42.5(pid=593): stdout: | (launched: 2022-12-14_03:01:18.370193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:19.917825 run osmo-stp_10.42.42.5(pid=593): stderr: | [0;m[38;5;43m20221214030118565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030118565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030118566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030118566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030118567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030118567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030118567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:20.054646 run osmo-stp_10.42.42.5(pid=593): stdout: | (launched: 2022-12-14_03:01:18.370193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:20.184609 run osmo-stp_10.42.42.5(pid=593): stderr: | [0;m[38;5;43m20221214030118565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030118565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030118566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030118566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030118567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030118567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030118567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:20.339561 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=593): Process ended prematurely: osmo-stp_10.42.42.5(pid=593) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=593)] [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:01:20.349218 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 03:01:20.377077 run osmo-hlr_10.42.42.2(pid=589): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=589)] 03:01:20.427724 run osmo-hlr_10.42.42.2(pid=589): stdout: | (launched: 2022-12-14_03:01:17.363242) 03:01:20.479967 run osmo-hlr_10.42.42.2(pid=589): stderr: | [0;m[1;31m20221214030117561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030117561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030117561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030117561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030117561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030117561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030117574 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030117582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030117582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030117582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:01:20.552468 run osmo-msc_10.42.42.6(pid=596): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=596)] 03:01:20.602375 run osmo-msc_10.42.42.6(pid=596): stdout: | (launched: 2022-12-14_03:01:19.402254) 03:01:20.654386 run osmo-msc_10.42.42.6(pid=596): stderr: | [0;m[38;5;43m20221214030119726 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030119726 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f019f4bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030119727 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030119727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030119727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030119727 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030119729 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030119729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030119729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030119729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:01:20.706136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=588): Terminating (SIGTERM) 03:01:20.748368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=592): Terminating (SIGTERM) 03:01:20.790550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=595): Terminating (SIGTERM) 03:01:20.833452 --- ParallelTerminationStrategy: PID 588 died... 03:01:20.854118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=588): Terminated: ok {rc=0} 03:01:20.900452 --- ParallelTerminationStrategy: PID 592 died... 03:01:20.920250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=592): Terminated: ok {rc=0} 03:01:20.966479 --- ParallelTerminationStrategy: PID 595 died... 03:01:20.986532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=595): Terminated: ok {rc=0} 03:01:21.074525 bus /sierra_3: Setting Powered False 03:01:22.169651 bus /sierra_3: Setting Powered False 03:01:23.282184 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:01:24.529307 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:01:24.535668 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:01:24.564079 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:01:24.591451 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:01:24.641499 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:01:24.670601 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:01:24.697453 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:01:25.249171 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:01:25.298298 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:25.309639 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:01:25.373583 tst mo_mt_call.py: using LAC 38089 03:01:25.491676 tst mo_mt_call.py: using RAC 94 03:01:25.610238 tst mo_mt_call.py: using CellId 38089 03:01:25.728922 tst mo_mt_call.py: using BVCI 38090 03:01:25.837492 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:25.848520 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:25.859485 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:25.870454 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:25.881643 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:25.892638 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:01:26.012798 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:01:26.130449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:26.597514 run create_hlr_db(pid=601): Launched 03:01:26.720465 bus /sierra_2: Setting Powered False 03:01:27.780760 run create_hlr_db(pid=601): Terminated: ok {rc=0} 03:01:28.222317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=603): Launched 03:01:28.546802 run osmo-hlr_10.42.42.2(pid=604): Launched 03:01:28.671371 run osmo-stp_10.42.42.5: Starting osmo-stp 03:01:29.227478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=606): Launched 03:01:29.549832 run osmo-stp_10.42.42.5(pid=607): Launched 03:01:29.674138 run osmo-msc_10.42.42.6: Starting osmo-msc 03:01:30.261954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=609): Launched 03:01:30.585648 run osmo-msc_10.42.42.6(pid=610): Launched 03:01:30.766398 run osmo-stp_10.42.42.5(pid=607): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=607)] 03:01:31.015594 run osmo-stp_10.42.42.5(pid=607): stdout: | (launched: 2022-12-14_03:01:29.490764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:31.251112 run osmo-stp_10.42.42.5(pid=607): stderr: | [0;m[38;5;43m20221214030129683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030129683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030129683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030129683 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030129684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030129684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030129684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:31.392729 run osmo-stp_10.42.42.5(pid=607): stdout: | (launched: 2022-12-14_03:01:29.490764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:31.520081 run osmo-stp_10.42.42.5(pid=607): stderr: | [0;m[38;5;43m20221214030129683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030129683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030129683 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030129683 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030129684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030129684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030129684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:31.669576 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=607): Process ended prematurely: osmo-stp_10.42.42.5(pid=607) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=607)] [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:01:31.679842 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:01:31.707006 run osmo-hlr_10.42.42.2(pid=604): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=604)] 03:01:31.755224 run osmo-hlr_10.42.42.2(pid=604): stdout: | (launched: 2022-12-14_03:01:28.487585) 03:01:31.805493 run osmo-hlr_10.42.42.2(pid=604): stderr: | [0;m[1;31m20221214030128685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030128685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030128685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030128685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030128685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030128685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030128744 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030128754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030128754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030128754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:01:31.875862 run osmo-msc_10.42.42.6(pid=610): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=610)] 03:01:31.925610 run osmo-msc_10.42.42.6(pid=610): stdout: | (launched: 2022-12-14_03:01:30.526665) 03:01:31.975700 run osmo-msc_10.42.42.6(pid=610): stderr: | [0;m[38;5;43m20221214030130870 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030130870 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f582482dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030130870 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030130870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030130870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030130871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030130873 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030130874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030130874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030130874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:01:32.026114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=603): Terminating (SIGTERM) 03:01:32.067795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=606): Terminating (SIGTERM) 03:01:32.112759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=609): Terminating (SIGTERM) 03:01:32.156588 --- ParallelTerminationStrategy: PID 603 died... 03:01:32.176355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=603): Terminated: ok {rc=0} 03:01:32.222774 --- ParallelTerminationStrategy: PID 606 died... 03:01:32.242243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=606): Terminated: ok {rc=0} 03:01:32.287790 --- ParallelTerminationStrategy: PID 609 died... 03:01:32.307150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=609): Terminated: ok {rc=0} 03:01:32.392560 bus /sierra_3: Setting Powered False 03:01:33.493144 bus /sierra_3: Setting Powered False 03:01:34.608151 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:01:35.752873 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:35.764745 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:01:35.834193 tst mo_mt_call_osmux.py: using LAC 38090 03:01:35.953239 tst mo_mt_call_osmux.py: using RAC 95 03:01:36.069179 tst mo_mt_call_osmux.py: using CellId 38090 03:01:36.186527 tst mo_mt_call_osmux.py: using BVCI 38091 03:01:36.296353 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:36.307707 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:36.318765 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:36.329890 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:36.341223 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:01:36.352041 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:01:36.471793 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:01:36.589360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:37.056747 run create_hlr_db(pid=612): Launched 03:01:37.180113 bus /sierra_2: Setting Powered False 03:01:38.241260 run create_hlr_db(pid=612): Terminated: ok {rc=0} 03:01:38.659529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=614): Launched 03:01:38.959257 run osmo-hlr_10.42.42.2(pid=615): Launched 03:01:39.073316 run osmo-stp_10.42.42.5: Starting osmo-stp 03:01:39.589102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=617): Launched 03:01:39.889458 run osmo-stp_10.42.42.5(pid=618): Launched 03:01:40.005648 run osmo-msc_10.42.42.6: Starting osmo-msc 03:01:40.547664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=620): Launched 03:01:40.847934 run osmo-msc_10.42.42.6(pid=621): Launched 03:01:41.015822 run osmo-stp_10.42.42.5(pid=618): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=618)] 03:01:41.143246 run osmo-stp_10.42.42.5(pid=618): stdout: | (launched: 2022-12-14_03:01:39.834462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:41.270110 run osmo-stp_10.42.42.5(pid=618): stderr: | [0;m[38;5;43m20221214030140006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030140006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030140006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030140007 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030140007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030140007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030140007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:41.394669 run osmo-stp_10.42.42.5(pid=618): stdout: | (launched: 2022-12-14_03:01:39.834462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:41.514021 run osmo-stp_10.42.42.5(pid=618): stderr: | [0;m[38;5;43m20221214030140006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030140006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030140006 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030140007 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030140007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030140007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030140007 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:41.656599 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=618): Process ended prematurely: osmo-stp_10.42.42.5(pid=618) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=618)] [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:01:41.665528 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 03:01:41.691762 run osmo-hlr_10.42.42.2(pid=615): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=615)] 03:01:41.738975 run osmo-hlr_10.42.42.2(pid=615): stdout: | (launched: 2022-12-14_03:01:38.904218) 03:01:41.788088 run osmo-hlr_10.42.42.2(pid=615): stderr: | [0;m[1;31m20221214030139080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030139080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030139080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030139080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030139080 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030139081 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030139128 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030139138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030139138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030139138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:01:41.857899 run osmo-msc_10.42.42.6(pid=621): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=621)] 03:01:41.905186 run osmo-msc_10.42.42.6(pid=621): stdout: | (launched: 2022-12-14_03:01:40.792473) 03:01:41.953888 run osmo-msc_10.42.42.6(pid=621): stderr: | [0;m[38;5;43m20221214030141063 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030141063 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8827adcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030141063 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030141063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030141063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030141063 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030141065 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030141065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030141066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030141066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:01:42.003106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=614): Terminating (SIGTERM) 03:01:42.042376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=617): Terminating (SIGTERM) 03:01:42.081557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=620): Terminating (SIGTERM) 03:01:42.121317 --- ParallelTerminationStrategy: PID 614 died... 03:01:42.140380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=614): Terminated: ok {rc=0} 03:01:42.183998 --- ParallelTerminationStrategy: PID 617 died... 03:01:42.203081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=617): Terminated: ok {rc=0} 03:01:42.246471 --- ParallelTerminationStrategy: PID 620 died... 03:01:42.265013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=620): Terminated: ok {rc=0} 03:01:42.349215 bus /sierra_3: Setting Powered False 03:01:43.446750 bus /sierra_3: Setting Powered False 03:01:44.559101 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 03:01:45.803455 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:01:45.810606 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 03:01:45.845852 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 03:01:45.876352 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 03:01:45.943151 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 03:01:45.981858 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 03:01:46.010476 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 03:01:46.582334 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 03:01:46.655066 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:46.671329 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:01:46.756597 tst mo_mt_call.py: using LAC 38091 03:01:46.888761 tst mo_mt_call.py: using RAC 96 03:01:47.017900 tst mo_mt_call.py: using CellId 38091 03:01:47.148648 tst mo_mt_call.py: using BVCI 38092 03:01:47.269981 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:47.283586 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:47.296104 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:47.308785 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:47.322159 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:47.335436 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:01:47.455497 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:01:47.570932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:48.037288 run create_hlr_db(pid=626): Launched 03:01:48.160868 bus /sierra_2: Setting Powered False 03:01:49.225105 run create_hlr_db(pid=626): Terminated: ok {rc=0} 03:01:49.675987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=628): Launched 03:01:49.999762 run osmo-hlr_10.42.42.2(pid=629): Launched 03:01:50.123992 run osmo-stp_10.42.42.5: Starting osmo-stp 03:01:50.685265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=631): Launched 03:01:51.008300 run osmo-stp_10.42.42.5(pid=632): Launched 03:01:51.132112 run osmo-msc_10.42.42.6: Starting osmo-msc 03:01:51.716496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=634): Launched 03:01:52.040050 run osmo-msc_10.42.42.6(pid=635): Launched 03:01:52.222735 run osmo-stp_10.42.42.5(pid=632): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=632)] 03:01:52.359755 run osmo-stp_10.42.42.5(pid=632): stdout: | (launched: 2022-12-14_03:01:50.949434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:52.497632 run osmo-stp_10.42.42.5(pid=632): stderr: | [0;m[38;5;43m20221214030151143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030151143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030151143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030151144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030151144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030151144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030151144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:52.634140 run osmo-stp_10.42.42.5(pid=632): stdout: | (launched: 2022-12-14_03:01:50.949434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:01:52.763347 run osmo-stp_10.42.42.5(pid=632): stderr: | [0;m[38;5;43m20221214030151143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030151143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030151143 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030151144 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030151144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030151144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030151144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:01:52.917695 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=632): Process ended prematurely: osmo-stp_10.42.42.5(pid=632) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=632)] [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 03:01:52.927366 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 03:01:52.955332 run osmo-hlr_10.42.42.2(pid=629): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=629)] 03:01:53.006416 run osmo-hlr_10.42.42.2(pid=629): stdout: | (launched: 2022-12-14_03:01:49.940927) 03:01:53.058462 run osmo-hlr_10.42.42.2(pid=629): stderr: | [0;m[1;31m20221214030150140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030150140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030150140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030150140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030150140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030150140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030150154 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030150162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030150162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030150162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:01:53.130964 run osmo-msc_10.42.42.6(pid=635): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=635)] 03:01:53.180580 run osmo-msc_10.42.42.6(pid=635): stdout: | (launched: 2022-12-14_03:01:51.981305) 03:01:53.232204 run osmo-msc_10.42.42.6(pid=635): stderr: | [0;m[38;5;43m20221214030152305 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030152305 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa920777c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030152305 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030152305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030152305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030152305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030152307 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030152307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030152307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030152308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:01:53.284479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=628): Terminating (SIGTERM) 03:01:53.326466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=631): Terminating (SIGTERM) 03:01:53.368551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=634): Terminating (SIGTERM) 03:01:53.411053 --- ParallelTerminationStrategy: PID 628 died... 03:01:53.431672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=628): Terminated: ok {rc=0} 03:01:53.478310 --- ParallelTerminationStrategy: PID 631 died... 03:01:53.498534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=631): Terminated: ok {rc=0} 03:01:53.545039 --- ParallelTerminationStrategy: PID 634 died... 03:01:53.565163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=634): Terminated: ok {rc=0} 03:01:53.652546 bus /sierra_3: Setting Powered False 03:01:54.750784 bus /sierra_3: Setting Powered False 03:01:55.866039 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 03:01:57.014715 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:57.027290 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 03:01:57.094267 tst mo_mt_call_osmux.py: using LAC 38092 03:01:57.220367 tst mo_mt_call_osmux.py: using RAC 97 03:01:57.347336 tst mo_mt_call_osmux.py: using CellId 38092 03:01:57.473343 tst mo_mt_call_osmux.py: using BVCI 38093 03:01:57.592617 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:57.604557 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:57.616195 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:57.627809 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:57.639950 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 03:01:57.652119 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:01:57.769886 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 03:01:57.886191 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:01:58.352177 run create_hlr_db(pid=637): Launched 03:01:58.475302 bus /sierra_2: Setting Powered False 03:01:59.535130 run create_hlr_db(pid=637): Terminated: ok {rc=0} 03:01:59.974407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=639): Launched 03:02:00.298802 run osmo-hlr_10.42.42.2(pid=640): Launched 03:02:00.423371 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:01.017662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=642): Launched 03:02:01.361657 run osmo-stp_10.42.42.5(pid=643): Launched 03:02:01.557949 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:02.317652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=645): Launched 03:02:02.618882 run osmo-msc_10.42.42.6(pid=646): Launched 03:02:02.786054 run osmo-stp_10.42.42.5(pid=643): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=643)] 03:02:02.913114 run osmo-stp_10.42.42.5(pid=643): stdout: | (launched: 2022-12-14_03:02:01.291407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:03.040459 run osmo-stp_10.42.42.5(pid=643): stderr: | [0;m[38;5;43m20221214030201610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030201610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030201610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030201610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030201611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030201611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030201611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:03.165895 run osmo-stp_10.42.42.5(pid=643): stdout: | (launched: 2022-12-14_03:02:01.291407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:03.285534 run osmo-stp_10.42.42.5(pid=643): stderr: | [0;m[38;5;43m20221214030201610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030201610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030201610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030201610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030201611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030201611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030201611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:03.429299 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=643): Process ended prematurely: osmo-stp_10.42.42.5(pid=643) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=643)] [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 03:02:03.438296 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 03:02:03.464617 run osmo-hlr_10.42.42.2(pid=640): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=640)] 03:02:03.512051 run osmo-hlr_10.42.42.2(pid=640): stdout: | (launched: 2022-12-14_03:02:00.240093) 03:02:03.561066 run osmo-hlr_10.42.42.2(pid=640): stderr: | [0;m[1;31m20221214030200436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030200436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030200436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030200436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030200436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030200436 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030200448 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030200457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030200457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030200457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:03.629479 run osmo-msc_10.42.42.6(pid=646): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=646)] 03:02:03.676430 run osmo-msc_10.42.42.6(pid=646): stdout: | (launched: 2022-12-14_03:02:02.563562) 03:02:03.725144 run osmo-msc_10.42.42.6(pid=646): stderr: | [0;m[38;5;43m20221214030202836 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030202836 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe718cb3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030202836 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030202836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030202836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030202836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030202839 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030202839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030202839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030202839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:03.774281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=639): Terminating (SIGTERM) 03:02:03.813782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=642): Terminating (SIGTERM) 03:02:03.853317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=645): Terminating (SIGTERM) 03:02:03.893736 --- ParallelTerminationStrategy: PID 639 died... 03:02:03.913127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=639): Terminated: ok {rc=0} 03:02:03.956845 --- ParallelTerminationStrategy: PID 642 died... 03:02:03.975576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=642): Terminated: ok {rc=0} 03:02:04.019037 --- ParallelTerminationStrategy: PID 645 died... 03:02:04.037855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=645): Terminated: ok {rc=0} 03:02:04.123475 bus /sierra_3: Setting Powered False 03:02:05.221670 bus /sierra_3: Setting Powered False 03:02:06.335340 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:02:07.577548 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:02:07.583942 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:02:07.611982 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:02:07.638029 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:02:07.689307 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:02:07.719016 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:02:07.746506 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:02:08.298598 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:02:08.347632 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:08.358952 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:02:08.422907 tst mo_mt_call.py: using LAC 38093 03:02:08.543001 tst mo_mt_call.py: using RAC 98 03:02:08.662788 tst mo_mt_call.py: using CellId 38093 03:02:08.782069 tst mo_mt_call.py: using BVCI 38094 03:02:08.891024 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:08.902179 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:08.913201 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:08.923986 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:08.934933 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:08.945927 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:02:09.065218 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:02:09.179921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:09.645125 run create_hlr_db(pid=654): Launched 03:02:09.767590 bus /sierra_2: Setting Powered False 03:02:10.827604 run create_hlr_db(pid=654): Terminated: ok {rc=0} 03:02:11.268106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=656): Launched 03:02:11.591279 run osmo-hlr_10.42.42.2(pid=657): Launched 03:02:11.714688 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:12.269649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=659): Launched 03:02:12.592100 run osmo-stp_10.42.42.5(pid=660): Launched 03:02:12.714762 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:13.297703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=662): Launched 03:02:13.621182 run osmo-msc_10.42.42.6(pid=663): Launched 03:02:13.800918 run osmo-stp_10.42.42.5(pid=660): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=660)] 03:02:13.937453 run osmo-stp_10.42.42.5(pid=660): stdout: | (launched: 2022-12-14_03:02:12.533476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:14.074376 run osmo-stp_10.42.42.5(pid=660): stderr: | [0;m[38;5;43m20221214030212728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030212728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030212728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030212729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030212729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030212729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030212729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:14.210782 run osmo-stp_10.42.42.5(pid=660): stdout: | (launched: 2022-12-14_03:02:12.533476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:14.339982 run osmo-stp_10.42.42.5(pid=660): stderr: | [0;m[38;5;43m20221214030212728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030212728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030212728 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030212729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030212729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030212729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030212729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:14.494839 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=660): Process ended prematurely: osmo-stp_10.42.42.5(pid=660) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=660)] [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:02:14.504244 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:02:14.531993 run osmo-hlr_10.42.42.2(pid=657): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=657)] 03:02:14.582734 run osmo-hlr_10.42.42.2(pid=657): stdout: | (launched: 2022-12-14_03:02:11.532363) 03:02:14.634551 run osmo-hlr_10.42.42.2(pid=657): stderr: | [0;m[1;31m20221214030211731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030211731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030211731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030211731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030211731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030211731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030211743 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030211751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030211751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030211751 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:14.706957 run osmo-msc_10.42.42.6(pid=663): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=663)] 03:02:14.756617 run osmo-msc_10.42.42.6(pid=663): stdout: | (launched: 2022-12-14_03:02:13.562090) 03:02:14.808640 run osmo-msc_10.42.42.6(pid=663): stderr: | [0;m[38;5;43m20221214030213883 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030213883 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6c15703c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030213884 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030213884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030213884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030213884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030213886 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030213886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030213886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030213886 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:14.860511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=656): Terminating (SIGTERM) 03:02:14.902296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=659): Terminating (SIGTERM) 03:02:14.944022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=662): Terminating (SIGTERM) 03:02:14.986569 --- ParallelTerminationStrategy: PID 656 died... 03:02:15.006825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=656): Terminated: ok {rc=0} 03:02:15.053100 --- ParallelTerminationStrategy: PID 659 died... 03:02:15.072872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=659): Terminated: ok {rc=0} 03:02:15.119345 --- ParallelTerminationStrategy: PID 662 died... 03:02:15.139227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=662): Terminated: ok {rc=0} 03:02:15.227363 bus /sierra_3: Setting Powered False 03:02:16.334276 bus /sierra_3: Setting Powered False 03:02:17.457358 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:02:18.602330 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:18.614078 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:02:18.679063 tst mo_mt_call_osmux.py: using LAC 38094 03:02:18.797850 tst mo_mt_call_osmux.py: using RAC 99 03:02:18.917190 tst mo_mt_call_osmux.py: using CellId 38094 03:02:19.034541 tst mo_mt_call_osmux.py: using BVCI 38095 03:02:19.143018 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:19.154192 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:19.165166 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:19.176087 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:19.187083 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:02:19.197955 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:02:19.315701 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:02:19.431536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:19.898133 run create_hlr_db(pid=665): Launched 03:02:20.020081 bus /sierra_2: Setting Powered False 03:02:21.080728 run create_hlr_db(pid=665): Terminated: ok {rc=0} 03:02:21.521512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=667): Launched 03:02:21.845410 run osmo-hlr_10.42.42.2(pid=668): Launched 03:02:21.969978 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:22.530877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=670): Launched 03:02:22.853771 run osmo-stp_10.42.42.5(pid=671): Launched 03:02:22.977105 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:23.560809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=673): Launched 03:02:23.884258 run osmo-msc_10.42.42.6(pid=674): Launched 03:02:24.054200 run osmo-stp_10.42.42.5(pid=671): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=671)] 03:02:24.182687 run osmo-stp_10.42.42.5(pid=671): stdout: | (launched: 2022-12-14_03:02:22.794879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:24.309410 run osmo-stp_10.42.42.5(pid=671): stderr: | [0;m[38;5;43m20221214030222987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030222987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030222987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030222988 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030222988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030222988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030222988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:24.434535 run osmo-stp_10.42.42.5(pid=671): stdout: | (launched: 2022-12-14_03:02:22.794879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:24.555026 run osmo-stp_10.42.42.5(pid=671): stderr: | [0;m[38;5;43m20221214030222987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030222987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030222987 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030222988 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030222988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030222988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030222988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:24.698450 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=671): Process ended prematurely: osmo-stp_10.42.42.5(pid=671) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=671)] [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:02:24.707339 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:02:24.733427 run osmo-hlr_10.42.42.2(pid=668): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=668)] 03:02:24.780587 run osmo-hlr_10.42.42.2(pid=668): stdout: | (launched: 2022-12-14_03:02:21.786745) 03:02:24.829523 run osmo-hlr_10.42.42.2(pid=668): stderr: | [0;m[1;31m20221214030221986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030221986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030221986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030221986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030221986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030221986 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030222002 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030222012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030222012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030222012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:24.897552 run osmo-msc_10.42.42.6(pid=674): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=674)] 03:02:24.944355 run osmo-msc_10.42.42.6(pid=674): stdout: | (launched: 2022-12-14_03:02:23.825536) 03:02:24.993141 run osmo-msc_10.42.42.6(pid=674): stderr: | [0;m[38;5;43m20221214030224097 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030224097 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f566442ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030224097 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030224097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030224097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030224097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030224099 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030224099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030224100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030224100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:25.042052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=667): Terminating (SIGTERM) 03:02:25.081154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=670): Terminating (SIGTERM) 03:02:25.120094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=673): Terminating (SIGTERM) 03:02:25.159387 --- ParallelTerminationStrategy: PID 667 died... 03:02:25.178192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=667): Terminated: ok {rc=0} 03:02:25.221344 --- ParallelTerminationStrategy: PID 670 died... 03:02:25.239624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=670): Terminated: ok {rc=0} 03:02:25.283009 --- ParallelTerminationStrategy: PID 673 died... 03:02:25.301409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=673): Terminated: ok {rc=0} 03:02:25.382949 bus /sierra_3: Setting Powered False 03:02:26.480573 bus /sierra_3: Setting Powered False 03:02:27.595933 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:02:28.842389 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:02:28.849398 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:02:28.878856 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:02:28.906770 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:02:28.958570 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:02:28.987856 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:02:29.015770 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:02:29.568404 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:02:29.621905 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:29.633799 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:02:29.701851 tst mo_mt_call.py: using LAC 38095 03:02:29.830365 tst mo_mt_call.py: using RAC 100 03:02:29.951042 tst mo_mt_call.py: using CellId 38095 03:02:30.071793 tst mo_mt_call.py: using BVCI 38096 03:02:30.180682 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:30.192080 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:30.203096 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:30.214464 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:30.225667 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:30.236525 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:02:30.356693 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:02:30.474237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:30.974604 run create_hlr_db(pid=679): Launched 03:02:31.130560 bus /sierra_2: Setting Powered False 03:02:32.196425 run create_hlr_db(pid=679): Terminated: ok {rc=0} 03:02:32.648838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=681): Launched 03:02:32.972105 run osmo-hlr_10.42.42.2(pid=682): Launched 03:02:33.095563 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:33.652862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=684): Launched 03:02:33.975113 run osmo-stp_10.42.42.5(pid=685): Launched 03:02:34.098993 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:34.685288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=687): Launched 03:02:35.008063 run osmo-msc_10.42.42.6(pid=688): Launched 03:02:35.189869 run osmo-stp_10.42.42.5(pid=685): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=685)] 03:02:35.327455 run osmo-stp_10.42.42.5(pid=685): stdout: | (launched: 2022-12-14_03:02:33.916126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:35.465263 run osmo-stp_10.42.42.5(pid=685): stderr: | [0;m[38;5;43m20221214030234108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030234108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030234108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030234109 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030234109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030234109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030234109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:35.601984 run osmo-stp_10.42.42.5(pid=685): stdout: | (launched: 2022-12-14_03:02:33.916126) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:35.731565 run osmo-stp_10.42.42.5(pid=685): stderr: | [0;m[38;5;43m20221214030234108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030234108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030234108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030234109 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030234109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030234109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030234109 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:35.886250 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=685): Process ended prematurely: osmo-stp_10.42.42.5(pid=685) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=685)] [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:02:35.895720 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 03:02:35.923547 run osmo-hlr_10.42.42.2(pid=682): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=682)] 03:02:35.974131 run osmo-hlr_10.42.42.2(pid=682): stdout: | (launched: 2022-12-14_03:02:32.913455) 03:02:36.025882 run osmo-hlr_10.42.42.2(pid=682): stderr: | [0;m[1;31m20221214030233115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030233115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030233115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030233115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030233115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030233115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030233127 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030233135 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030233136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030233136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:36.098655 run osmo-msc_10.42.42.6(pid=688): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=688)] 03:02:36.148468 run osmo-msc_10.42.42.6(pid=688): stdout: | (launched: 2022-12-14_03:02:34.949179) 03:02:36.200369 run osmo-msc_10.42.42.6(pid=688): stderr: | [0;m[38;5;43m20221214030235268 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030235268 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f635e2aec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030235268 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030235268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030235268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030235268 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030235272 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030235272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030235272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030235272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:36.252813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=681): Terminating (SIGTERM) 03:02:36.294317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=684): Terminating (SIGTERM) 03:02:36.336662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=687): Terminating (SIGTERM) 03:02:36.379162 --- ParallelTerminationStrategy: PID 681 died... 03:02:36.399474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=681): Terminated: ok {rc=0} 03:02:36.445647 --- ParallelTerminationStrategy: PID 684 died... 03:02:36.465351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=684): Terminated: ok {rc=0} 03:02:36.511438 --- ParallelTerminationStrategy: PID 687 died... 03:02:36.531275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=687): Terminated: ok {rc=0} 03:02:36.618900 bus /sierra_3: Setting Powered False 03:02:37.717855 bus /sierra_3: Setting Powered False 03:02:38.833547 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:02:39.980441 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:39.992733 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:02:40.060819 tst mo_mt_call_osmux.py: using LAC 38096 03:02:40.188324 tst mo_mt_call_osmux.py: using RAC 101 03:02:40.315319 tst mo_mt_call_osmux.py: using CellId 38096 03:02:40.444300 tst mo_mt_call_osmux.py: using BVCI 38097 03:02:40.562311 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:40.574205 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:40.585681 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:40.597218 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:40.609137 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:02:40.620902 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:02:40.739772 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:02:40.859287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:41.361494 run create_hlr_db(pid=690): Launched 03:02:41.484183 bus /sierra_2: Setting Powered False 03:02:42.548811 run create_hlr_db(pid=690): Terminated: ok {rc=0} 03:02:42.978085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=692): Launched 03:02:43.278663 run osmo-hlr_10.42.42.2(pid=693): Launched 03:02:43.392113 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:43.912800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=695): Launched 03:02:44.213446 run osmo-stp_10.42.42.5(pid=696): Launched 03:02:44.327159 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:44.869971 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=698): Launched 03:02:45.169861 run osmo-msc_10.42.42.6(pid=699): Launched 03:02:45.338032 run osmo-stp_10.42.42.5(pid=696): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=696)] 03:02:45.464910 run osmo-stp_10.42.42.5(pid=696): stdout: | (launched: 2022-12-14_03:02:44.157977) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:45.591673 run osmo-stp_10.42.42.5(pid=696): stderr: | [0;m[38;5;43m20221214030244330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030244330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030244330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030244330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030244331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030244331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030244331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:45.716710 run osmo-stp_10.42.42.5(pid=696): stdout: | (launched: 2022-12-14_03:02:44.157977) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:45.849981 run osmo-stp_10.42.42.5(pid=696): stderr: | [0;m[38;5;43m20221214030244330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030244330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030244330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030244330 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030244331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030244331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030244331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:46.031020 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=696): Process ended prematurely: osmo-stp_10.42.42.5(pid=696) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=696)] [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:02:46.041629 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 03:02:46.071042 run osmo-hlr_10.42.42.2(pid=693): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=693)] 03:02:46.126459 run osmo-hlr_10.42.42.2(pid=693): stdout: | (launched: 2022-12-14_03:02:43.223009) 03:02:46.181098 run osmo-hlr_10.42.42.2(pid=693): stderr: | [0;m[1;31m20221214030243398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030243398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030243398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030243398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030243398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030243399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030243411 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030243420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030243420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030243420 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:46.256569 run osmo-msc_10.42.42.6(pid=699): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=699)] 03:02:46.310726 run osmo-msc_10.42.42.6(pid=699): stdout: | (launched: 2022-12-14_03:02:45.114810) 03:02:46.365110 run osmo-msc_10.42.42.6(pid=699): stderr: | [0;m[38;5;43m20221214030245384 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030245384 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7e482c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030245385 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030245385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030245385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030245385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030245387 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030245387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030245387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030245387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:46.419798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=692): Terminating (SIGTERM) 03:02:46.463140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=695): Terminating (SIGTERM) 03:02:46.510479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=698): Terminating (SIGTERM) 03:02:46.558465 --- ParallelTerminationStrategy: PID 692 died... 03:02:46.581198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=692): Terminated: ok {rc=0} 03:02:46.631170 --- ParallelTerminationStrategy: PID 695 died... 03:02:46.653038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=695): Terminated: ok {rc=0} 03:02:46.703992 --- ParallelTerminationStrategy: PID 698 died... 03:02:46.724660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=698): Terminated: ok {rc=0} 03:02:46.817065 bus /sierra_3: Setting Powered False 03:02:47.915661 bus /sierra_3: Setting Powered False 03:02:49.031037 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:02:50.282226 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:02:50.288419 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:02:50.317923 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 03:02:50.345778 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 03:02:50.398416 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:02:50.428170 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 03:02:50.455843 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 03:02:51.005597 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 03:02:51.059081 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:51.070700 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:02:51.138943 tst mo_mt_call.py: using LAC 38097 03:02:51.265879 tst mo_mt_call.py: using RAC 102 03:02:51.394491 tst mo_mt_call.py: using CellId 38097 03:02:51.521687 tst mo_mt_call.py: using BVCI 38098 03:02:51.632138 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:51.643419 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:51.654324 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:51.665294 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:51.676378 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:02:51.687441 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:02:51.807504 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:02:51.923876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:02:52.390677 run create_hlr_db(pid=704): Launched 03:02:52.514596 bus /sierra_2: Setting Powered False 03:02:53.574751 run create_hlr_db(pid=704): Terminated: ok {rc=0} 03:02:54.017160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=706): Launched 03:02:54.340472 run osmo-hlr_10.42.42.2(pid=707): Launched 03:02:54.464249 run osmo-stp_10.42.42.5: Starting osmo-stp 03:02:55.025443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=709): Launched 03:02:55.348336 run osmo-stp_10.42.42.5(pid=710): Launched 03:02:55.470928 run osmo-msc_10.42.42.6: Starting osmo-msc 03:02:56.054844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=712): Launched 03:02:56.380047 run osmo-msc_10.42.42.6(pid=713): Launched 03:02:56.561395 run osmo-stp_10.42.42.5(pid=710): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=710)] 03:02:56.698123 run osmo-stp_10.42.42.5(pid=710): stdout: | (launched: 2022-12-14_03:02:55.289843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:56.835397 run osmo-stp_10.42.42.5(pid=710): stderr: | [0;m[38;5;43m20221214030255481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030255481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030255481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030255481 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030255484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030255484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030255484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:56.971722 run osmo-stp_10.42.42.5(pid=710): stdout: | (launched: 2022-12-14_03:02:55.289843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:02:57.101325 run osmo-stp_10.42.42.5(pid=710): stderr: | [0;m[38;5;43m20221214030255481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030255481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030255481 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030255481 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030255484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030255484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030255484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:02:57.256368 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=710): Process ended prematurely: osmo-stp_10.42.42.5(pid=710) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=710)] [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 03:02:57.266229 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:02:57.294066 run osmo-hlr_10.42.42.2(pid=707): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=707)] 03:02:57.344386 run osmo-hlr_10.42.42.2(pid=707): stdout: | (launched: 2022-12-14_03:02:54.281699) 03:02:57.395984 run osmo-hlr_10.42.42.2(pid=707): stderr: | [0;m[1;31m20221214030254481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030254481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030254481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030254481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030254481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030254481 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030254492 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030254500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030254500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030254500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:02:57.468224 run osmo-msc_10.42.42.6(pid=713): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=713)] 03:02:57.517790 run osmo-msc_10.42.42.6(pid=713): stdout: | (launched: 2022-12-14_03:02:56.321311) 03:02:57.569966 run osmo-msc_10.42.42.6(pid=713): stderr: | [0;m[38;5;43m20221214030256641 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030256641 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1bb79c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030256641 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030256641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030256641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030256642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030256643 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030256644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030256644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030256644 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:02:57.621901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=706): Terminating (SIGTERM) 03:02:57.663413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=709): Terminating (SIGTERM) 03:02:57.705447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=712): Terminating (SIGTERM) 03:02:57.747796 --- ParallelTerminationStrategy: PID 706 died... 03:02:57.768217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=706): Terminated: ok {rc=0} 03:02:57.814796 --- ParallelTerminationStrategy: PID 709 died... 03:02:57.834696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=709): Terminated: ok {rc=0} 03:02:57.880850 --- ParallelTerminationStrategy: PID 712 died... 03:02:57.900892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=712): Terminated: ok {rc=0} 03:02:57.988776 bus /sierra_3: Setting Powered False 03:02:59.086447 bus /sierra_3: Setting Powered False 03:03:00.200364 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 03:03:01.355163 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:01.368138 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:03:01.436536 tst mo_mt_call_osmux.py: using LAC 38098 03:03:01.557137 tst mo_mt_call_osmux.py: using RAC 103 03:03:01.699716 tst mo_mt_call_osmux.py: using CellId 38098 03:03:01.838868 tst mo_mt_call_osmux.py: using BVCI 38099 03:03:01.990175 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:02.006008 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:02.020670 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:02.034940 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:02.051405 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 03:03:02.065451 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:03:02.184933 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 03:03:02.307233 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:03:02.811616 run create_hlr_db(pid=716): Launched 03:03:02.935474 bus /sierra_2: Setting Powered False 03:03:03.995616 run create_hlr_db(pid=716): Terminated: ok {rc=0} 03:03:04.447292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=718): Launched 03:03:04.771431 run osmo-hlr_10.42.42.2(pid=719): Launched 03:03:04.894766 run osmo-stp_10.42.42.5: Starting osmo-stp 03:03:05.448656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=721): Launched 03:03:05.770278 run osmo-stp_10.42.42.5(pid=722): Launched 03:03:05.893385 run osmo-msc_10.42.42.6: Starting osmo-msc 03:03:06.481723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=724): Launched 03:03:06.805492 run osmo-msc_10.42.42.6(pid=725): Launched 03:03:06.986461 run osmo-stp_10.42.42.5(pid=722): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=722)] 03:03:07.122782 run osmo-stp_10.42.42.5(pid=722): stdout: | (launched: 2022-12-14_03:03:05.711598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:07.260794 run osmo-stp_10.42.42.5(pid=722): stderr: | [0;m[38;5;43m20221214030305906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030305906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030305906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030305907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030305907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030305907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030305907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:07.397208 run osmo-stp_10.42.42.5(pid=722): stdout: | (launched: 2022-12-14_03:03:05.711598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:07.526331 run osmo-stp_10.42.42.5(pid=722): stderr: | [0;m[38;5;43m20221214030305906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030305906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030305906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030305907 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030305907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030305907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030305907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:07.682678 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=722): Process ended prematurely: osmo-stp_10.42.42.5(pid=722) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=722)] [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 03:03:07.692183 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 03:03:07.719826 run osmo-hlr_10.42.42.2(pid=719): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=719)] 03:03:07.770303 run osmo-hlr_10.42.42.2(pid=719): stdout: | (launched: 2022-12-14_03:03:04.712606) 03:03:07.822548 run osmo-hlr_10.42.42.2(pid=719): stderr: | [0;m[1;31m20221214030304915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030304915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030304915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030304915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030304915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030304915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030304929 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030304937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030304937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030304937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:03:07.895725 run osmo-msc_10.42.42.6(pid=725): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=725)] 03:03:07.945467 run osmo-msc_10.42.42.6(pid=725): stdout: | (launched: 2022-12-14_03:03:06.746094) 03:03:07.997831 run osmo-msc_10.42.42.6(pid=725): stderr: | [0;m[38;5;43m20221214030307067 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030307067 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8d4f9cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030307067 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030307067 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030307068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030307068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030307070 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030307070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030307070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030307070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:03:08.050203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=718): Terminating (SIGTERM) 03:03:08.092006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=721): Terminating (SIGTERM) 03:03:08.134258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=724): Terminating (SIGTERM) 03:03:08.176844 --- ParallelTerminationStrategy: PID 718 died... 03:03:08.197447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=718): Terminated: ok {rc=0} 03:03:08.243680 --- ParallelTerminationStrategy: PID 721 died... 03:03:08.263396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=721): Terminated: ok {rc=0} 03:03:08.309373 --- ParallelTerminationStrategy: PID 724 died... 03:03:08.328830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=724): Terminated: ok {rc=0} 03:03:08.417738 bus /sierra_3: Setting Powered False 03:03:09.515304 bus /sierra_3: Setting Powered False 03:03:10.631747 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 03:03:11.872442 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:03:11.876923 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:03:11.905660 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:03:11.932388 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 03:03:12.015827 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:03:12.044327 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:03:12.070419 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 03:03:12.654688 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2398 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 03:03:12.659860 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:12.670848 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:03:12.715411 tst emergency_mo_mt_call.py: using LAC 38099 03:03:12.832266 tst emergency_mo_mt_call.py: using RAC 104 03:03:12.952905 tst emergency_mo_mt_call.py: using CellId 38099 03:03:13.068860 tst emergency_mo_mt_call.py: using BVCI 38100 03:03:13.175632 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:13.186485 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:13.197028 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:13.207616 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:13.218356 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:13.229015 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:13.348398 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:13.464826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:03:13.923148 run create_hlr_db(pid=730): Launched 03:03:14.045284 bus /sierra_2: Setting Powered False 03:03:15.104554 run create_hlr_db(pid=730): Terminated: ok {rc=0} 03:03:15.539493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=732): Launched 03:03:15.861647 run osmo-hlr_10.42.42.2(pid=733): Launched 03:03:16.052029 run osmo-stp_10.42.42.5: Starting osmo-stp 03:03:16.895888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=735): Launched 03:03:17.235211 run osmo-stp_10.42.42.5(pid=736): Launched 03:03:17.410906 tst emergency_mo_mt_call.py: using MSISDN 8467 03:03:17.576940 run osmo-msc_10.42.42.6: Starting osmo-msc 03:03:18.151236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=738): Launched 03:03:18.470184 run osmo-msc_10.42.42.6(pid=739): Launched 03:03:18.648686 run osmo-stp_10.42.42.5(pid=736): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=736)] 03:03:18.783551 run osmo-stp_10.42.42.5(pid=736): stdout: | (launched: 2022-12-14_03:03:17.173438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:18.919187 run osmo-stp_10.42.42.5(pid=736): stderr: | [0;m[38;5;43m20221214030317414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030317414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030317414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030317414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030317415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030317415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030317415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:19.053774 run osmo-stp_10.42.42.5(pid=736): stdout: | (launched: 2022-12-14_03:03:17.173438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:19.182368 run osmo-stp_10.42.42.5(pid=736): stderr: | [0;m[38;5;43m20221214030317414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030317414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030317414 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030317414 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030317415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030317415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030317415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:19.334349 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=736): Process ended prematurely: osmo-stp_10.42.42.5(pid=736) [trial-2398↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=736)] [trial-2398↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 03:03:19.343148 tst emergency_mo_mt_call.py:19: Test FAILED (6.7 sec) 03:03:19.370789 run osmo-hlr_10.42.42.2(pid=733): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=733)] 03:03:19.421432 run osmo-hlr_10.42.42.2(pid=733): stdout: | (launched: 2022-12-14_03:03:15.785610) 03:03:19.473249 run osmo-hlr_10.42.42.2(pid=733): stderr: | [0;m[1;31m20221214030316130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030316130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030316130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030316130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030316130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030316130 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030316148 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030316178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030316179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030316179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:03:19.546085 run osmo-msc_10.42.42.6(pid=739): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=739)] 03:03:19.595805 run osmo-msc_10.42.42.6(pid=739): stdout: | (launched: 2022-12-14_03:03:18.412075) 03:03:19.648047 run osmo-msc_10.42.42.6(pid=739): stderr: | [0;m[38;5;43m20221214030318734 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030318734 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe4bc5f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030318734 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030318734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030318734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030318735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030318736 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030318737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030318737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030318737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:03:19.700173 run pcap-recorder_any(filters='host 10.42.42.2')(pid=732): Terminating (SIGTERM) 03:03:19.742029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=735): Terminating (SIGTERM) 03:03:19.784574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=738): Terminating (SIGTERM) 03:03:19.827257 --- ParallelTerminationStrategy: PID 732 died... 03:03:19.847851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=732): Terminated: ok {rc=0} 03:03:19.894140 --- ParallelTerminationStrategy: PID 735 died... 03:03:19.913982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=735): Terminated: ok {rc=0} 03:03:19.960088 --- ParallelTerminationStrategy: PID 738 died... 03:03:19.980051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=738): Terminated: ok {rc=0} 03:03:20.067989 bus /sierra_3: Setting Powered False 03:03:21.166351 bus /sierra_3: Setting Powered False 03:03:22.281082 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 03:03:23.366587 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:23.378647 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:03:23.427171 tst emergency_preemptive_call.py: using LAC 38100 03:03:23.543911 tst emergency_preemptive_call.py: using RAC 105 03:03:23.660357 tst emergency_preemptive_call.py: using CellId 38100 03:03:23.776094 tst emergency_preemptive_call.py: using BVCI 38101 03:03:23.882072 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:23.892804 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:23.903333 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:23.913844 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:23.924311 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:03:23.934852 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:24.048378 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:24.162612 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:24.281617 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:24.400128 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:03:24.858686 run create_hlr_db(pid=741): Launched 03:03:24.980587 bus /sierra_2: Setting Powered False 03:03:26.040148 run create_hlr_db(pid=741): Terminated: ok {rc=0} 03:03:26.474622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=743): Launched 03:03:26.793059 run osmo-hlr_10.42.42.2(pid=744): Launched 03:03:26.915215 run osmo-stp_10.42.42.5: Starting osmo-stp 03:03:27.463238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=746): Launched 03:03:27.781045 run osmo-stp_10.42.42.5(pid=747): Launched 03:03:27.915485 tst emergency_preemptive_call.py: using MSISDN 8468 03:03:28.081645 run osmo-msc_10.42.42.6: Starting osmo-msc 03:03:28.652384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=749): Launched 03:03:28.969755 run osmo-msc_10.42.42.6(pid=750): Launched 03:03:29.147433 run osmo-stp_10.42.42.5(pid=747): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=747)] 03:03:29.282929 run osmo-stp_10.42.42.5(pid=747): stdout: | (launched: 2022-12-14_03:03:27.722957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:29.418320 run osmo-stp_10.42.42.5(pid=747): stderr: | [0;m[38;5;43m20221214030327917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030327918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030327918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030327918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030327919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030327919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030327919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:29.552617 run osmo-stp_10.42.42.5(pid=747): stdout: | (launched: 2022-12-14_03:03:27.722957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:29.679580 run osmo-stp_10.42.42.5(pid=747): stderr: | [0;m[38;5;43m20221214030327917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030327918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030327918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030327918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030327919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030327919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030327919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:29.831683 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=747): Process ended prematurely: osmo-stp_10.42.42.5(pid=747) [trial-2398↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=747)] [trial-2398↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 03:03:29.840695 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 03:03:29.868220 run osmo-hlr_10.42.42.2(pid=744): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=744)] 03:03:29.919002 run osmo-hlr_10.42.42.2(pid=744): stdout: | (launched: 2022-12-14_03:03:26.735075) 03:03:29.970928 run osmo-hlr_10.42.42.2(pid=744): stderr: | [0;m[1;31m20221214030326934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030326934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030326934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030326934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030326934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030326934 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030326982 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030326992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030326992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030326992 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:03:30.043645 run osmo-msc_10.42.42.6(pid=750): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=750)] 03:03:30.093226 run osmo-msc_10.42.42.6(pid=750): stdout: | (launched: 2022-12-14_03:03:28.911936) 03:03:30.145354 run osmo-msc_10.42.42.6(pid=750): stderr: | [0;m[38;5;43m20221214030329233 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030329233 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5c4071ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030329233 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030329233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030329233 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030329234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030329235 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030329236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030329236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030329236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:03:30.197926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=743): Terminating (SIGTERM) 03:03:30.239700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=746): Terminating (SIGTERM) 03:03:30.282156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=749): Terminating (SIGTERM) 03:03:30.324710 --- ParallelTerminationStrategy: PID 743 died... 03:03:30.345401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=743): Terminated: ok {rc=0} 03:03:30.391746 --- ParallelTerminationStrategy: PID 746 died... 03:03:30.411766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=746): Terminated: ok {rc=0} 03:03:30.458158 --- ParallelTerminationStrategy: PID 749 died... 03:03:30.478096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=749): Terminated: ok {rc=0} 03:03:30.566015 bus /sierra_9: Setting Powered False 03:03:31.666729 bus /sierra_9: Setting Powered False 03:03:32.784301 bus /sierra_8: Setting Powered False 03:03:33.882004 bus /sierra_8: Setting Powered False 03:03:34.992553 bus /sierra_3: Setting Powered False 03:03:36.089284 bus /sierra_3: Setting Powered False 03:03:37.205995 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 03:03:38.481622 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:03:38.486400 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 03:03:38.515809 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 03:03:38.555429 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 03:03:38.644330 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 03:03:38.673350 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 03:03:38.711923 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 03:03:39.303907 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 03:03:39.358341 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:39.369579 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:03:39.415571 tst cs_paging_gprs_active.py: using LAC 38101 03:03:39.545163 tst cs_paging_gprs_active.py: using RAC 106 03:03:39.665711 tst cs_paging_gprs_active.py: using CellId 38101 03:03:39.784685 tst cs_paging_gprs_active.py: using BVCI 38102 03:03:39.894815 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:39.905716 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:39.916291 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:39.926850 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:39.937946 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:39.948470 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:39.960433 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:39.971600 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:39.982767 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:40.104087 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:40.222153 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:03:40.442628 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:03:40.768618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=755): Launched 03:03:41.050600 run iperf3-srv_10.42.42.10(pid=756): Launched 03:03:41.173015 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:03:41.392093 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:03:41.717569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=757): Launched 03:03:41.999873 run iperf3-srv_10.42.42.10(pid=758): Launched 03:03:42.121924 tst cs_paging_gprs_active.py:38: start network... 03:03:42.341287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:03:42.844463 run create_hlr_db(pid=759): Launched 03:03:42.968212 bus /sierra_2: Setting Powered False 03:03:44.032918 run create_hlr_db(pid=759): Terminated: ok {rc=0} 03:03:44.464308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=761): Launched 03:03:44.766932 run osmo-hlr_10.42.42.2(pid=762): Launched 03:03:44.881420 run osmo-stp_10.42.42.5: Starting osmo-stp 03:03:45.413922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=764): Launched 03:03:45.715118 run osmo-stp_10.42.42.5(pid=765): Launched 03:03:45.830199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:03:46.505784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=767): Launched 03:03:46.644424 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:03:46.929975 run patchelf(pid=768): Launched 03:03:47.128601 run osmo-stp_10.42.42.5(pid=765): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=765)] 03:03:47.268413 run osmo-stp_10.42.42.5(pid=765): stdout: | (launched: 2022-12-14_03:03:45.659605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:47.407976 run osmo-stp_10.42.42.5(pid=765): stderr: | [0;m[38;5;43m20221214030345838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030345838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030345838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030345838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030345839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030345839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030345839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:47.547412 run osmo-stp_10.42.42.5(pid=765): stdout: | (launched: 2022-12-14_03:03:45.659605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:47.681898 run osmo-stp_10.42.42.5(pid=765): stderr: | [0;m[38;5;43m20221214030345838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030345838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030345838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030345838 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030345839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030345839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030345839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:47.840191 run patchelf(pid=768): Terminating (SIGINT) 03:03:48.024259 run patchelf(pid=768): Terminated: ok {rc=0} 03:03:48.157378 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=765): Process ended prematurely: osmo-stp_10.42.42.5(pid=765) [trial-2398↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=765)] [trial-2398↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 03:03:48.168015 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 03:03:48.196799 run osmo-hlr_10.42.42.2(pid=762): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=762)] 03:03:48.248097 run osmo-hlr_10.42.42.2(pid=762): stdout: | (launched: 2022-12-14_03:03:44.710963) 03:03:48.301147 run osmo-hlr_10.42.42.2(pid=762): stderr: | [0;m[1;31m20221214030344887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030344887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030344887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030344887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030344887 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030344888 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030344900 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030344910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030344910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030344910 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:03:48.354367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=755): Terminating (SIGTERM) 03:03:48.396426 run iperf3-srv_10.42.42.10(pid=756): Terminating (SIGTERM) 03:03:48.439413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=757): Terminating (SIGTERM) 03:03:48.482115 run iperf3-srv_10.42.42.10(pid=758): Terminating (SIGTERM) 03:03:48.524484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=761): Terminating (SIGTERM) 03:03:48.566969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=764): Terminating (SIGTERM) 03:03:48.609479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=767): Terminating (SIGTERM) 03:03:48.652356 --- ParallelTerminationStrategy: PID 755 died... 03:03:48.672710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=755): Terminated: ok {rc=0} 03:03:48.719576 --- ParallelTerminationStrategy: PID 756 died... 03:03:48.739678 run iperf3-srv_10.42.42.10(pid=756): Terminated {rc=256} 03:03:48.786383 --- ParallelTerminationStrategy: PID 757 died... 03:03:48.806628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=757): Terminated: ok {rc=0} 03:03:48.853118 --- ParallelTerminationStrategy: PID 758 died... 03:03:48.873122 run iperf3-srv_10.42.42.10(pid=758): Terminated {rc=256} 03:03:48.919707 --- ParallelTerminationStrategy: PID 761 died... 03:03:48.939848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=761): Terminated: ok {rc=0} 03:03:48.986440 --- ParallelTerminationStrategy: PID 764 died... 03:03:49.006611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=764): Terminated: ok {rc=0} 03:03:49.053302 --- ParallelTerminationStrategy: PID 767 died... 03:03:49.073484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=767): Terminated: ok {rc=0} 03:03:49.163211 bus /gobi_0: Setting Powered False 03:03:50.261210 bus /gobi_0: Setting Powered False 03:03:51.379259 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 03:03:52.529769 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:52.541760 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:03:52.590319 tst iperf3.py: using LAC 38102 03:03:52.717614 tst iperf3.py: using RAC 107 03:03:52.845302 tst iperf3.py: using CellId 38102 03:03:52.964772 tst iperf3.py: using BVCI 38103 03:03:53.073804 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:53.084416 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:53.094950 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:53.105489 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:53.116287 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:53.127320 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:53.138457 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:53.149394 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:03:53.160488 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:03:53.275861 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:03:53.477010 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:03:53.779007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=769): Launched 03:03:54.040366 run iperf3-srv_10.42.42.10(pid=770): Launched 03:03:54.152926 tst iperf3.py:8: start network... 03:03:54.353747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:03:54.818929 run create_hlr_db(pid=771): Launched 03:03:54.942470 bus /gobi_6: Setting Powered False 03:03:56.002224 run create_hlr_db(pid=771): Terminated: ok {rc=0} 03:03:56.443213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=773): Launched 03:03:56.767793 run osmo-hlr_10.42.42.2(pid=774): Launched 03:03:56.892163 run osmo-stp_10.42.42.5: Starting osmo-stp 03:03:57.454739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=776): Launched 03:03:57.779211 run osmo-stp_10.42.42.5(pid=777): Launched 03:03:57.903148 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:03:58.462242 run pcap-recorder_any(filters='host 10.42.42.6')(pid=779): Launched 03:03:58.586667 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:03:58.861166 run patchelf(pid=780): Launched 03:03:59.041760 run osmo-stp_10.42.42.5(pid=777): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=777)] 03:03:59.179527 run osmo-stp_10.42.42.5(pid=777): stdout: | (launched: 2022-12-14_03:03:57.719860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:59.319173 run osmo-stp_10.42.42.5(pid=777): stderr: | [0;m[38;5;43m20221214030357912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030357912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030357912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030357913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030357915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030357915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030357915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:59.458333 run osmo-stp_10.42.42.5(pid=777): stdout: | (launched: 2022-12-14_03:03:57.719860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:03:59.591813 run osmo-stp_10.42.42.5(pid=777): stderr: | [0;m[38;5;43m20221214030357912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030357912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030357912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030357913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030357915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030357915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030357915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:03:59.750073 run patchelf(pid=780): Terminating (SIGINT) 03:03:59.933531 run patchelf(pid=780): Terminated: ok {rc=0} 03:04:00.065910 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=777): Process ended prematurely: osmo-stp_10.42.42.5(pid=777) [trial-2398↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=777)] [trial-2398↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 03:04:00.076035 tst iperf3.py:8: Test FAILED (7.6 sec) 03:04:00.104695 run osmo-hlr_10.42.42.2(pid=774): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=774)] 03:04:00.155356 run osmo-hlr_10.42.42.2(pid=774): stdout: | (launched: 2022-12-14_03:03:56.708584) 03:04:00.208302 run osmo-hlr_10.42.42.2(pid=774): stderr: | [0;m[1;31m20221214030356908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030356908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030356908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030356908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030356908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030356908 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030356920 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030356928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030356928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030356928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:04:00.260792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=769): Terminating (SIGTERM) 03:04:00.302940 run iperf3-srv_10.42.42.10(pid=770): Terminating (SIGTERM) 03:04:00.345281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=773): Terminating (SIGTERM) 03:04:00.387591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=776): Terminating (SIGTERM) 03:04:00.429861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=779): Terminating (SIGTERM) 03:04:00.472513 --- ParallelTerminationStrategy: PID 769 died... 03:04:00.493198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=769): Terminated: ok {rc=0} 03:04:00.540283 --- ParallelTerminationStrategy: PID 770 died... 03:04:00.560601 run iperf3-srv_10.42.42.10(pid=770): Terminated {rc=256} 03:04:00.607256 --- ParallelTerminationStrategy: PID 773 died... 03:04:00.627471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=773): Terminated: ok {rc=0} 03:04:00.674049 --- ParallelTerminationStrategy: PID 776 died... 03:04:00.694238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=776): Terminated: ok {rc=0} 03:04:00.740838 --- ParallelTerminationStrategy: PID 779 died... 03:04:00.761513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=779): Terminated: ok {rc=0} 03:04:00.852399 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 03:04:02.032130 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:02.049074 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:04:02.098346 tst iperf3m4.py: using LAC 38103 03:04:02.265443 tst iperf3m4.py: using RAC 108 03:04:02.395444 tst iperf3m4.py: using CellId 38103 03:04:02.523804 tst iperf3m4.py: using BVCI 38104 03:04:02.642316 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:02.653755 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:02.664861 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:02.676044 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:02.687559 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:02.699087 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:02.710259 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:02.721321 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:02.733242 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:04:02.853958 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:04:02.973675 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:04:03.090099 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:04:03.214803 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:04:03.434533 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:03.759721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=781): Launched 03:04:04.041914 run iperf3-srv_10.42.42.10(pid=782): Launched 03:04:04.163622 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:04:04.383717 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:04.709315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=783): Launched 03:04:04.991862 run iperf3-srv_10.42.42.10(pid=784): Launched 03:04:05.114001 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:04:05.333444 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:05.658538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=785): Launched 03:04:05.940592 run iperf3-srv_10.42.42.10(pid=786): Launched 03:04:06.062406 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:04:06.281702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:06.606965 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=787): Launched 03:04:06.890033 run iperf3-srv_10.42.42.10(pid=788): Launched 03:04:07.012180 tst iperf3m4.py:8: start network... 03:04:07.232453 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:04:07.738144 run create_hlr_db(pid=789): Launched 03:04:07.861541 bus /gobi_6: Setting Powered False 03:04:08.926183 run create_hlr_db(pid=789): Terminated: ok {rc=0} 03:04:09.377487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=791): Launched 03:04:09.702004 run osmo-hlr_10.42.42.2(pid=792): Launched 03:04:09.826879 run osmo-stp_10.42.42.5: Starting osmo-stp 03:04:10.486704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=794): Launched 03:04:10.801960 run osmo-stp_10.42.42.5(pid=795): Launched 03:04:10.923027 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:04:11.469784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=797): Launched 03:04:11.590327 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:04:11.857246 run patchelf(pid=798): Launched 03:04:12.033334 run osmo-stp_10.42.42.5(pid=795): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=795)] 03:04:12.167346 run osmo-stp_10.42.42.5(pid=795): stdout: | (launched: 2022-12-14_03:04:10.744477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:12.303289 run osmo-stp_10.42.42.5(pid=795): stderr: | [0;m[38;5;43m20221214030410937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030410937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030410937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030410937 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030410938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030410938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030410938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:12.439112 run osmo-stp_10.42.42.5(pid=795): stdout: | (launched: 2022-12-14_03:04:10.744477) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:12.569103 run osmo-stp_10.42.42.5(pid=795): stderr: | [0;m[38;5;43m20221214030410937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030410937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030410937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030410937 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030410938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030410938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030410938 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:12.723257 run patchelf(pid=798): Terminating (SIGINT) 03:04:12.902480 run patchelf(pid=798): Terminated: ok {rc=0} 03:04:13.031930 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=795): Process ended prematurely: osmo-stp_10.42.42.5(pid=795) [trial-2398↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=795)] [trial-2398↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 03:04:13.042119 tst iperf3m4.py:8: Test FAILED (11.1 sec) 03:04:13.070692 run osmo-hlr_10.42.42.2(pid=792): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=792)] 03:04:13.120707 run osmo-hlr_10.42.42.2(pid=792): stdout: | (launched: 2022-12-14_03:04:09.642722) 03:04:13.173160 run osmo-hlr_10.42.42.2(pid=792): stderr: | [0;m[1;31m20221214030409841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030409841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030409841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030409841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030409841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030409841 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030409853 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030409861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030409862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030409862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:04:13.225290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=781): Terminating (SIGTERM) 03:04:13.266469 run iperf3-srv_10.42.42.10(pid=782): Terminating (SIGTERM) 03:04:13.307803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=783): Terminating (SIGTERM) 03:04:13.350467 run iperf3-srv_10.42.42.10(pid=784): Terminating (SIGTERM) 03:04:13.392669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=785): Terminating (SIGTERM) 03:04:13.434510 run iperf3-srv_10.42.42.10(pid=786): Terminating (SIGTERM) 03:04:13.477316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=787): Terminating (SIGTERM) 03:04:13.518943 run iperf3-srv_10.42.42.10(pid=788): Terminating (SIGTERM) 03:04:13.560391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=791): Terminating (SIGTERM) 03:04:13.602466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=794): Terminating (SIGTERM) 03:04:13.644480 run pcap-recorder_any(filters='host 10.42.42.6')(pid=797): Terminating (SIGTERM) 03:04:13.686361 --- ParallelTerminationStrategy: PID 781 died... 03:04:13.706635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=781): Terminated: ok {rc=0} 03:04:13.752808 --- ParallelTerminationStrategy: PID 782 died... 03:04:13.772532 run iperf3-srv_10.42.42.10(pid=782): Terminated {rc=256} 03:04:13.818344 --- ParallelTerminationStrategy: PID 783 died... 03:04:13.838061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=783): Terminated: ok {rc=0} 03:04:13.883894 --- ParallelTerminationStrategy: PID 784 died... 03:04:13.903545 run iperf3-srv_10.42.42.10(pid=784): Terminated {rc=256} 03:04:13.949409 --- ParallelTerminationStrategy: PID 785 died... 03:04:13.969237 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=785): Terminated: ok {rc=0} 03:04:14.015306 --- ParallelTerminationStrategy: PID 786 died... 03:04:14.035046 run iperf3-srv_10.42.42.10(pid=786): Terminated {rc=256} 03:04:14.080926 --- ParallelTerminationStrategy: PID 787 died... 03:04:14.100730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=787): Terminated: ok {rc=0} 03:04:14.146664 --- ParallelTerminationStrategy: PID 788 died... 03:04:14.166479 run iperf3-srv_10.42.42.10(pid=788): Terminated {rc=256} 03:04:14.212655 --- ParallelTerminationStrategy: PID 791 died... 03:04:14.232586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=791): Terminated: ok {rc=0} 03:04:14.278648 --- ParallelTerminationStrategy: PID 794 died... 03:04:14.298433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=794): Terminated: ok {rc=0} 03:04:14.344707 --- ParallelTerminationStrategy: PID 797 died... 03:04:14.364482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=797): Terminated: ok {rc=0} 03:04:14.452305 bus /gobi_4: Setting Powered False 03:04:15.551156 bus /gobi_4: Setting Powered False 03:04:16.671316 bus /gobi_1: Setting Powered False 03:04:17.768411 bus /gobi_1: Setting Powered False 03:04:18.884006 bus /gobi_0: Setting Powered False 03:04:19.984729 bus /gobi_0: Setting Powered False 03:04:21.101695 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 03:04:22.204538 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:22.216030 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:04:22.260598 tst ping.py: using LAC 38104 03:04:22.383914 tst ping.py: using RAC 109 03:04:22.508799 tst ping.py: using CellId 38104 03:04:22.624180 tst ping.py: using BVCI 38105 03:04:22.730517 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:22.741357 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:22.751955 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:22.762686 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:22.773207 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:22.784225 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:22.795234 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:22.806041 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:04:22.923886 tst ping.py:19: start network... 03:04:23.132634 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:04:23.614296 run create_hlr_db(pid=800): Launched 03:04:23.733000 bus /gobi_6: Setting Powered False 03:04:24.795172 run create_hlr_db(pid=800): Terminated: ok {rc=0} 03:04:25.211859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=802): Launched 03:04:25.503096 run osmo-hlr_10.42.42.2(pid=803): Launched 03:04:25.615488 run osmo-stp_10.42.42.5: Starting osmo-stp 03:04:26.133961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=805): Launched 03:04:26.423525 run osmo-stp_10.42.42.5(pid=806): Launched 03:04:26.534733 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:04:27.037024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=808): Launched 03:04:27.148028 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:04:27.394002 run patchelf(pid=809): Launched 03:04:27.555745 run osmo-stp_10.42.42.5(pid=806): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=806)] 03:04:27.679101 run osmo-stp_10.42.42.5(pid=806): stdout: | (launched: 2022-12-14_03:04:26.370387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:27.803763 run osmo-stp_10.42.42.5(pid=806): stderr: | [0;m[38;5;43m20221214030426541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030426541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030426541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030426542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030426542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030426542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030426542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:27.928228 run osmo-stp_10.42.42.5(pid=806): stdout: | (launched: 2022-12-14_03:04:26.370387) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:28.047640 run osmo-stp_10.42.42.5(pid=806): stderr: | [0;m[38;5;43m20221214030426541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030426541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030426541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030426542 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030426542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030426542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030426542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:28.189427 run patchelf(pid=809): Terminating (SIGINT) 03:04:28.353822 run patchelf(pid=809): Terminated: ok {rc=0} 03:04:28.472599 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=806): Process ended prematurely: osmo-stp_10.42.42.5(pid=806) [trial-2398↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=806)] [trial-2398↪gprs:trx-lms-limenet-micro↪ping.py:22] 03:04:28.481536 tst ping.py:22: Test FAILED (6.3 sec) 03:04:28.508305 run osmo-hlr_10.42.42.2(pid=803): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=803)] 03:04:28.556008 run osmo-hlr_10.42.42.2(pid=803): stdout: | (launched: 2022-12-14_03:04:25.449214) 03:04:28.605306 run osmo-hlr_10.42.42.2(pid=803): stderr: | [0;m[1;31m20221214030425623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030425623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030425623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030425623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030425623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030425623 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030425635 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030425647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030425647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030425647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:04:28.654651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=802): Terminating (SIGTERM) 03:04:28.694704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=805): Terminating (SIGTERM) 03:04:28.734264 run pcap-recorder_any(filters='host 10.42.42.6')(pid=808): Terminating (SIGTERM) 03:04:28.774150 --- ParallelTerminationStrategy: PID 802 died... 03:04:28.793185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=802): Terminated: ok {rc=0} 03:04:28.836930 --- ParallelTerminationStrategy: PID 805 died... 03:04:28.855249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=805): Terminated: ok {rc=0} 03:04:28.898572 --- ParallelTerminationStrategy: PID 808 died... 03:04:28.917069 run pcap-recorder_any(filters='host 10.42.42.6')(pid=808): Terminated: ok {rc=0} 03:04:29.001909 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 03:04:30.088682 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:30.100180 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 03:04:30.145645 tst ping_idle_ping.py: using LAC 38105 03:04:30.262841 tst ping_idle_ping.py: using RAC 110 03:04:30.377692 tst ping_idle_ping.py: using CellId 38105 03:04:30.492450 tst ping_idle_ping.py: using BVCI 38106 03:04:30.598587 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:30.609410 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:30.619939 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:30.630492 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:30.640873 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:30.652397 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:30.663563 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 03:04:30.674585 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 03:04:30.793201 tst ping_idle_ping.py:24: start network... 03:04:31.036436 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:04:31.511663 run create_hlr_db(pid=810): Launched 03:04:31.665076 bus /gobi_6: Setting Powered False 03:04:32.723424 run create_hlr_db(pid=810): Terminated: ok {rc=0} 03:04:33.152061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=812): Launched 03:04:33.448581 run osmo-hlr_10.42.42.2(pid=813): Launched 03:04:33.560349 run osmo-stp_10.42.42.5: Starting osmo-stp 03:04:34.062731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=815): Launched 03:04:34.355731 run osmo-stp_10.42.42.5(pid=816): Launched 03:04:34.466854 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:04:34.971265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=818): Launched 03:04:35.082999 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:04:35.330262 run patchelf(pid=820): Launched 03:04:35.492775 run osmo-stp_10.42.42.5(pid=816): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=816)] 03:04:35.617394 run osmo-stp_10.42.42.5(pid=816): stdout: | (launched: 2022-12-14_03:04:34.301730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:35.742679 run osmo-stp_10.42.42.5(pid=816): stderr: | [0;m[38;5;43m20221214030434471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030434472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030434472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030434472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030434473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030434473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030434473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:35.868260 run osmo-stp_10.42.42.5(pid=816): stdout: | (launched: 2022-12-14_03:04:34.301730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:35.988889 run osmo-stp_10.42.42.5(pid=816): stderr: | [0;m[38;5;43m20221214030434471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030434472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030434472 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030434472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030434473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030434473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030434473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:36.131506 run patchelf(pid=820): Terminating (SIGINT) 03:04:36.297502 run patchelf(pid=820): Terminated: ok {rc=0} 03:04:36.416780 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=816): Process ended prematurely: osmo-stp_10.42.42.5(pid=816) [trial-2398↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=816)] [trial-2398↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 03:04:36.425742 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 03:04:36.452083 run osmo-hlr_10.42.42.2(pid=813): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=813)] 03:04:36.499696 run osmo-hlr_10.42.42.2(pid=813): stdout: | (launched: 2022-12-14_03:04:33.395167) 03:04:36.548624 run osmo-hlr_10.42.42.2(pid=813): stderr: | [0;m[1;31m20221214030433572 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030433572 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030433572 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030433572 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030433572 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030433572 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030433585 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030433594 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030433595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030433595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:04:36.598211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=812): Terminating (SIGTERM) 03:04:36.637994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=815): Terminating (SIGTERM) 03:04:36.677751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=818): Terminating (SIGTERM) 03:04:36.717616 --- ParallelTerminationStrategy: PID 812 died... 03:04:36.736732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=812): Terminated: ok {rc=0} 03:04:36.780427 --- ParallelTerminationStrategy: PID 815 died... 03:04:36.799148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=815): Terminated: ok {rc=0} 03:04:36.842812 --- ParallelTerminationStrategy: PID 818 died... 03:04:36.861527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=818): Terminated: ok {rc=0} 03:04:36.944913 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 03:04:38.242228 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:04:38.248590 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:04:38.277112 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:04:38.315699 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:04:38.400425 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:04:38.428670 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:04:38.466004 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:04:39.060940 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:04:39.108563 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:39.119632 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:04:39.165961 tst cs_paging_gprs_active.py: using LAC 38106 03:04:39.293691 tst cs_paging_gprs_active.py: using RAC 111 03:04:39.419976 tst cs_paging_gprs_active.py: using CellId 38106 03:04:39.544878 tst cs_paging_gprs_active.py: using BVCI 38107 03:04:39.661499 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:39.673448 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:39.684475 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:39.695609 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:39.707061 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:39.718520 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:39.730066 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:39.741480 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:39.753182 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:04:39.869666 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:04:39.987896 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:04:40.203466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:40.522790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=825): Launched 03:04:40.800670 run iperf3-srv_10.42.42.10(pid=826): Launched 03:04:40.921196 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:04:41.136478 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:41.456796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=827): Launched 03:04:41.733679 run iperf3-srv_10.42.42.10(pid=828): Launched 03:04:41.852918 tst cs_paging_gprs_active.py:38: start network... 03:04:42.066911 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:04:42.560658 run create_hlr_db(pid=831): Launched 03:04:42.681923 bus /gobi_6: Setting Powered False 03:04:43.745276 run create_hlr_db(pid=831): Terminated: ok {rc=0} 03:04:44.170021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=834): Launched 03:04:44.466426 run osmo-hlr_10.42.42.2(pid=835): Launched 03:04:44.580763 run osmo-stp_10.42.42.5: Starting osmo-stp 03:04:45.111767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=837): Launched 03:04:45.408287 run osmo-stp_10.42.42.5(pid=838): Launched 03:04:45.522259 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:04:46.086799 run pcap-recorder_any(filters='host 10.42.42.6')(pid=840): Launched 03:04:46.207312 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:04:46.479796 run patchelf(pid=841): Launched 03:04:46.668052 run osmo-stp_10.42.42.5(pid=838): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=838)] 03:04:46.809542 run osmo-stp_10.42.42.5(pid=838): stdout: | (launched: 2022-12-14_03:04:45.354193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:46.951577 run osmo-stp_10.42.42.5(pid=838): stderr: | [0;m[38;5;43m20221214030445523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030445524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030445524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030445524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030445525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030445525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030445525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:47.094312 run osmo-stp_10.42.42.5(pid=838): stdout: | (launched: 2022-12-14_03:04:45.354193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:47.229787 run osmo-stp_10.42.42.5(pid=838): stderr: | [0;m[38;5;43m20221214030445523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030445524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030445524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030445524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030445525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030445525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030445525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:47.387265 run patchelf(pid=841): Terminating (SIGINT) 03:04:47.568200 run patchelf(pid=841): Terminated: ok {rc=0} 03:04:47.699584 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=838): Process ended prematurely: osmo-stp_10.42.42.5(pid=838) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=838)] [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:04:47.709994 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 03:04:47.738434 run osmo-hlr_10.42.42.2(pid=835): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=835)] 03:04:47.789295 run osmo-hlr_10.42.42.2(pid=835): stdout: | (launched: 2022-12-14_03:04:44.412023) 03:04:47.841186 run osmo-hlr_10.42.42.2(pid=835): stderr: | [0;m[1;31m20221214030444590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030444590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030444590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030444590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030444590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030444590 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030444602 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030444613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030444613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030444613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:04:47.893648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=825): Terminating (SIGTERM) 03:04:47.935406 run iperf3-srv_10.42.42.10(pid=826): Terminating (SIGTERM) 03:04:47.977541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=827): Terminating (SIGTERM) 03:04:48.019582 run iperf3-srv_10.42.42.10(pid=828): Terminating (SIGTERM) 03:04:48.061987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=834): Terminating (SIGTERM) 03:04:48.105113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=837): Terminating (SIGTERM) 03:04:48.147247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=840): Terminating (SIGTERM) 03:04:48.189780 --- ParallelTerminationStrategy: PID 825 died... 03:04:48.210073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=825): Terminated: ok {rc=0} 03:04:48.256728 --- ParallelTerminationStrategy: PID 826 died... 03:04:48.276547 run iperf3-srv_10.42.42.10(pid=826): Terminated {rc=256} 03:04:48.322726 --- ParallelTerminationStrategy: PID 827 died... 03:04:48.342713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=827): Terminated: ok {rc=0} 03:04:48.388934 --- ParallelTerminationStrategy: PID 828 died... 03:04:48.408717 run iperf3-srv_10.42.42.10(pid=828): Terminated {rc=256} 03:04:48.454975 --- ParallelTerminationStrategy: PID 834 died... 03:04:48.475044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=834): Terminated: ok {rc=0} 03:04:48.521440 --- ParallelTerminationStrategy: PID 837 died... 03:04:48.541375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=837): Terminated: ok {rc=0} 03:04:48.587722 --- ParallelTerminationStrategy: PID 840 died... 03:04:48.607702 run pcap-recorder_any(filters='host 10.42.42.6')(pid=840): Terminated: ok {rc=0} 03:04:48.696833 bus /gobi_0: Setting Powered False 03:04:49.794276 bus /gobi_0: Setting Powered False 03:04:50.908280 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:04:52.052901 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:52.064527 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:04:52.110981 tst iperf3.py: using LAC 38107 03:04:52.240817 tst iperf3.py: using RAC 112 03:04:52.359830 tst iperf3.py: using CellId 38107 03:04:52.475695 tst iperf3.py: using BVCI 38108 03:04:52.583402 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:52.594604 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:52.605477 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:52.616338 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:52.627010 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:52.637723 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:52.648376 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:52.658973 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:04:52.669778 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:04:52.788158 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:04:53.002827 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:04:53.321666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=842): Launched 03:04:53.597764 run iperf3-srv_10.42.42.10(pid=844): Launched 03:04:53.717244 tst iperf3.py:8: start network... 03:04:53.931753 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:04:54.423924 run create_hlr_db(pid=845): Launched 03:04:54.546775 bus /gobi_6: Setting Powered False 03:04:55.609642 run create_hlr_db(pid=845): Terminated: ok {rc=0} 03:04:56.033641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=847): Launched 03:04:56.330499 run osmo-hlr_10.42.42.2(pid=848): Launched 03:04:56.445961 run osmo-stp_10.42.42.5: Starting osmo-stp 03:04:56.974068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=850): Launched 03:04:57.269260 run osmo-stp_10.42.42.5(pid=851): Launched 03:04:57.382028 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:04:57.893329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=853): Launched 03:04:58.005994 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:04:58.255445 run patchelf(pid=854): Launched 03:04:58.419695 run osmo-stp_10.42.42.5(pid=851): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=851)] 03:04:58.544926 run osmo-stp_10.42.42.5(pid=851): stdout: | (launched: 2022-12-14_03:04:57.215311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:58.671851 run osmo-stp_10.42.42.5(pid=851): stderr: | [0;m[38;5;43m20221214030457383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030457383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030457383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030457383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030457386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030457386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030457386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:58.798610 run osmo-stp_10.42.42.5(pid=851): stdout: | (launched: 2022-12-14_03:04:57.215311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:04:58.920018 run osmo-stp_10.42.42.5(pid=851): stderr: | [0;m[38;5;43m20221214030457383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030457383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030457383 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030457383 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030457386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030457386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030457386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:04:59.064143 run patchelf(pid=854): Terminating (SIGINT) 03:04:59.231343 run patchelf(pid=854): Terminated: ok {rc=0} 03:04:59.351691 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=851): Process ended prematurely: osmo-stp_10.42.42.5(pid=851) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=851)] [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 03:04:59.361109 tst iperf3.py:8: Test FAILED (7.3 sec) 03:04:59.388320 run osmo-hlr_10.42.42.2(pid=848): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=848)] 03:04:59.435698 run osmo-hlr_10.42.42.2(pid=848): stdout: | (launched: 2022-12-14_03:04:56.275923) 03:04:59.484562 run osmo-hlr_10.42.42.2(pid=848): stderr: | [0;m[1;31m20221214030456451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030456451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030456451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030456451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030456451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030456452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030456464 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030456474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030456474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030456474 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:04:59.533914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=842): Terminating (SIGTERM) 03:04:59.574114 run iperf3-srv_10.42.42.10(pid=844): Terminating (SIGTERM) 03:04:59.613695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=847): Terminating (SIGTERM) 03:04:59.653062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=850): Terminating (SIGTERM) 03:04:59.692388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=853): Terminating (SIGTERM) 03:04:59.731927 --- ParallelTerminationStrategy: PID 842 died... 03:04:59.750498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=842): Terminated: ok {rc=0} 03:04:59.795002 --- ParallelTerminationStrategy: PID 844 died... 03:04:59.813560 run iperf3-srv_10.42.42.10(pid=844): Terminated {rc=256} 03:04:59.856765 --- ParallelTerminationStrategy: PID 847 died... 03:04:59.875281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=847): Terminated: ok {rc=0} 03:04:59.918465 --- ParallelTerminationStrategy: PID 850 died... 03:04:59.936746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=850): Terminated: ok {rc=0} 03:04:59.980155 --- ParallelTerminationStrategy: PID 853 died... 03:04:59.998792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=853): Terminated: ok {rc=0} 03:05:00.080906 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:05:01.244236 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:01.256914 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:05:01.304813 tst iperf3m4.py: using LAC 38108 03:05:01.432908 tst iperf3m4.py: using RAC 113 03:05:01.565593 tst iperf3m4.py: using CellId 38108 03:05:01.696624 tst iperf3m4.py: using BVCI 38109 03:05:01.843377 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:01.858021 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:01.869763 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:01.884619 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:01.896337 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:01.907953 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:01.919654 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:01.931924 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:01.943767 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:05:02.090187 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:05:02.228886 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:05:02.349172 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:05:02.463921 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:05:02.662259 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:02.959372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=858): Launched 03:05:03.217644 run iperf3-srv_10.42.42.10(pid=859): Launched 03:05:03.329077 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:05:03.527200 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:03.825272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=860): Launched 03:05:04.082905 run iperf3-srv_10.42.42.10(pid=861): Launched 03:05:04.193917 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:05:04.391787 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:04.690415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=862): Launched 03:05:04.948756 run iperf3-srv_10.42.42.10(pid=863): Launched 03:05:05.060425 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:05:05.259103 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:05.556184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=864): Launched 03:05:05.814561 run iperf3-srv_10.42.42.10(pid=865): Launched 03:05:05.926372 tst iperf3m4.py:8: start network... 03:05:06.124812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:05:06.584842 run create_hlr_db(pid=866): Launched 03:05:06.709887 bus /gobi_6: Setting Powered False 03:05:07.769075 run create_hlr_db(pid=866): Terminated: ok {rc=0} 03:05:08.204752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=868): Launched 03:05:08.523352 run osmo-hlr_10.42.42.2(pid=869): Launched 03:05:08.645529 run osmo-stp_10.42.42.5: Starting osmo-stp 03:05:09.201484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=871): Launched 03:05:09.520409 run osmo-stp_10.42.42.5(pid=882): Launched 03:05:09.642806 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:05:10.195152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=888): Launched 03:05:10.318311 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:05:10.588883 run patchelf(pid=889): Launched 03:05:10.766594 run osmo-stp_10.42.42.5(pid=882): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=882)] 03:05:10.901645 run osmo-stp_10.42.42.5(pid=882): stdout: | (launched: 2022-12-14_03:05:09.462476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:11.038753 run osmo-stp_10.42.42.5(pid=882): stderr: | [0;m[38;5;43m20221214030509654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030509654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030509654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030509655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030509655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030509655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030509655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:11.175629 run osmo-stp_10.42.42.5(pid=882): stdout: | (launched: 2022-12-14_03:05:09.462476) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:11.307583 run osmo-stp_10.42.42.5(pid=882): stderr: | [0;m[38;5;43m20221214030509654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030509654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030509654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030509655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030509655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030509655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030509655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:11.463210 run patchelf(pid=889): Terminating (SIGINT) 03:05:11.643366 run patchelf(pid=889): Terminated: ok {rc=0} 03:05:11.773418 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=882): Process ended prematurely: osmo-stp_10.42.42.5(pid=882) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=882)] [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 03:05:11.783653 tst iperf3m4.py:8: Test FAILED (10.6 sec) 03:05:11.812189 run osmo-hlr_10.42.42.2(pid=869): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=869)] 03:05:11.862884 run osmo-hlr_10.42.42.2(pid=869): stdout: | (launched: 2022-12-14_03:05:08.465512) 03:05:11.915380 run osmo-hlr_10.42.42.2(pid=869): stderr: | [0;m[1;31m20221214030508662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030508662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030508662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030508662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030508662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030508662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030508674 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030508685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030508685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030508685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:05:11.967676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=858): Terminating (SIGTERM) 03:05:12.009570 run iperf3-srv_10.42.42.10(pid=859): Terminating (SIGTERM) 03:05:12.051457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=860): Terminating (SIGTERM) 03:05:12.093597 run iperf3-srv_10.42.42.10(pid=861): Terminating (SIGTERM) 03:05:12.135492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=862): Terminating (SIGTERM) 03:05:12.177677 run iperf3-srv_10.42.42.10(pid=863): Terminating (SIGTERM) 03:05:12.219898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=864): Terminating (SIGTERM) 03:05:12.261926 run iperf3-srv_10.42.42.10(pid=865): Terminating (SIGTERM) 03:05:12.304300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=868): Terminating (SIGTERM) 03:05:12.346449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=871): Terminating (SIGTERM) 03:05:12.388773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=888): Terminating (SIGTERM) 03:05:12.431142 --- ParallelTerminationStrategy: PID 858 died... 03:05:12.451393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=858): Terminated: ok {rc=0} 03:05:12.497936 --- ParallelTerminationStrategy: PID 859 died... 03:05:12.517639 run iperf3-srv_10.42.42.10(pid=859): Terminated {rc=256} 03:05:12.563798 --- ParallelTerminationStrategy: PID 860 died... 03:05:12.583630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=860): Terminated: ok {rc=0} 03:05:12.629783 --- ParallelTerminationStrategy: PID 861 died... 03:05:12.649527 run iperf3-srv_10.42.42.10(pid=861): Terminated {rc=256} 03:05:12.695685 --- ParallelTerminationStrategy: PID 862 died... 03:05:12.715529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=862): Terminated: ok {rc=0} 03:05:12.761857 --- ParallelTerminationStrategy: PID 863 died... 03:05:12.781701 run iperf3-srv_10.42.42.10(pid=863): Terminated {rc=256} 03:05:12.827880 --- ParallelTerminationStrategy: PID 864 died... 03:05:12.847634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=864): Terminated: ok {rc=0} 03:05:12.893977 --- ParallelTerminationStrategy: PID 865 died... 03:05:12.913816 run iperf3-srv_10.42.42.10(pid=865): Terminated {rc=256} 03:05:12.959956 --- ParallelTerminationStrategy: PID 868 died... 03:05:12.979764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=868): Terminated: ok {rc=0} 03:05:13.026176 --- ParallelTerminationStrategy: PID 871 died... 03:05:13.046045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=871): Terminated: ok {rc=0} 03:05:13.092288 --- ParallelTerminationStrategy: PID 888 died... 03:05:13.112304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=888): Terminated: ok {rc=0} 03:05:13.200891 bus /gobi_4: Setting Powered False 03:05:14.300102 bus /gobi_4: Setting Powered False 03:05:15.416067 bus /gobi_1: Setting Powered False 03:05:16.517842 bus /gobi_1: Setting Powered False 03:05:17.652425 bus /gobi_0: Setting Powered False 03:05:18.750618 bus /gobi_0: Setting Powered False 03:05:19.866720 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 03:05:20.968387 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:20.980168 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:05:21.026486 tst ping.py: using LAC 38109 03:05:21.147582 tst ping.py: using RAC 114 03:05:21.265402 tst ping.py: using CellId 38109 03:05:21.380942 tst ping.py: using BVCI 38110 03:05:21.486514 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:21.497512 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:21.508243 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:21.518925 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:21.529801 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:21.540599 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:21.551741 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:21.562650 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:05:21.676586 tst ping.py:19: start network... 03:05:21.871298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:05:22.322798 run create_hlr_db(pid=890): Launched 03:05:22.443608 bus /gobi_6: Setting Powered False 03:05:23.503177 run create_hlr_db(pid=890): Terminated: ok {rc=0} 03:05:23.932500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=892): Launched 03:05:24.225255 run osmo-hlr_10.42.42.2(pid=893): Launched 03:05:24.336530 run osmo-stp_10.42.42.5: Starting osmo-stp 03:05:24.857733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=895): Launched 03:05:25.148854 run osmo-stp_10.42.42.5(pid=896): Launched 03:05:25.259838 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:05:25.762955 run pcap-recorder_any(filters='host 10.42.42.6')(pid=898): Launched 03:05:25.874760 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:05:26.123011 run patchelf(pid=899): Launched 03:05:26.286330 run osmo-stp_10.42.42.5(pid=896): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=896)] 03:05:26.410944 run osmo-stp_10.42.42.5(pid=896): stdout: | (launched: 2022-12-14_03:05:25.095620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:26.536696 run osmo-stp_10.42.42.5(pid=896): stderr: | [0;m[38;5;43m20221214030525262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030525263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030525263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030525263 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030525265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030525266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030525266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:26.662875 run osmo-stp_10.42.42.5(pid=896): stdout: | (launched: 2022-12-14_03:05:25.095620) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:26.783291 run osmo-stp_10.42.42.5(pid=896): stderr: | [0;m[38;5;43m20221214030525262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030525263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030525263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030525263 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030525265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030525266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030525266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:26.926273 run patchelf(pid=899): Terminating (SIGINT) 03:05:27.093402 run patchelf(pid=899): Terminated: ok {rc=0} 03:05:27.213607 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=896): Process ended prematurely: osmo-stp_10.42.42.5(pid=896) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=896)] [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 03:05:27.222592 tst ping.py:22: Test FAILED (6.2 sec) 03:05:27.248926 run osmo-hlr_10.42.42.2(pid=893): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=893)] 03:05:27.296817 run osmo-hlr_10.42.42.2(pid=893): stdout: | (launched: 2022-12-14_03:05:24.171893) 03:05:27.346138 run osmo-hlr_10.42.42.2(pid=893): stderr: | [0;m[1;31m20221214030524347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030524347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030524347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030524347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030524347 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030524348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030524360 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030524370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030524370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030524370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:05:27.396156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=892): Terminating (SIGTERM) 03:05:27.436132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=895): Terminating (SIGTERM) 03:05:27.476124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=898): Terminating (SIGTERM) 03:05:27.516377 --- ParallelTerminationStrategy: PID 892 died... 03:05:27.535651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=892): Terminated: ok {rc=0} 03:05:27.579721 --- ParallelTerminationStrategy: PID 895 died... 03:05:27.598520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=895): Terminated: ok {rc=0} 03:05:27.642512 --- ParallelTerminationStrategy: PID 898 died... 03:05:27.661416 run pcap-recorder_any(filters='host 10.42.42.6')(pid=898): Terminated: ok {rc=0} 03:05:27.747217 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:05:28.835605 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:28.847723 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:05:28.898660 tst ping_idle_ping.py: using LAC 38110 03:05:29.014889 tst ping_idle_ping.py: using RAC 115 03:05:29.129427 tst ping_idle_ping.py: using CellId 38110 03:05:29.255914 tst ping_idle_ping.py: using BVCI 38111 03:05:29.373392 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:29.384811 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:29.396220 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:29.407735 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:29.419862 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:29.431965 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:29.444255 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:05:29.456247 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:05:29.571411 tst ping_idle_ping.py:24: start network... 03:05:29.767103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:05:30.222944 run create_hlr_db(pid=900): Launched 03:05:30.343456 bus /gobi_6: Setting Powered False 03:05:31.410735 run create_hlr_db(pid=900): Terminated: ok {rc=0} 03:05:31.904431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=902): Launched 03:05:32.282334 run osmo-hlr_10.42.42.2(pid=903): Launched 03:05:32.411097 run osmo-stp_10.42.42.5: Starting osmo-stp 03:05:32.953431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=905): Launched 03:05:33.267390 run osmo-stp_10.42.42.5(pid=906): Launched 03:05:33.386899 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:05:33.930254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=908): Launched 03:05:34.051162 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:05:34.317497 run patchelf(pid=909): Launched 03:05:34.492073 run osmo-stp_10.42.42.5(pid=906): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=906)] 03:05:34.625318 run osmo-stp_10.42.42.5(pid=906): stdout: | (launched: 2022-12-14_03:05:33.210044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:34.760053 run osmo-stp_10.42.42.5(pid=906): stderr: | [0;m[38;5;43m20221214030533400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030533401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030533401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030533401 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030533402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030533402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030533402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:34.894822 run osmo-stp_10.42.42.5(pid=906): stdout: | (launched: 2022-12-14_03:05:33.210044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:35.024085 run osmo-stp_10.42.42.5(pid=906): stderr: | [0;m[38;5;43m20221214030533400 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030533401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030533401 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030533401 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030533402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030533402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030533402 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:35.177669 run patchelf(pid=909): Terminating (SIGINT) 03:05:35.355722 run patchelf(pid=909): Terminated: ok {rc=0} 03:05:35.483657 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=906): Process ended prematurely: osmo-stp_10.42.42.5(pid=906) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=906)] [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 03:05:35.493222 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 03:05:35.521083 run osmo-hlr_10.42.42.2(pid=903): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=903)] 03:05:35.571515 run osmo-hlr_10.42.42.2(pid=903): stdout: | (launched: 2022-12-14_03:05:32.214378) 03:05:35.623195 run osmo-hlr_10.42.42.2(pid=903): stderr: | [0;m[1;31m20221214030532419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030532419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030532419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030532419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030532419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030532419 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030532431 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030532439 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030532440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030532440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:05:35.675252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=902): Terminating (SIGTERM) 03:05:35.717232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=905): Terminating (SIGTERM) 03:05:35.759529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=908): Terminating (SIGTERM) 03:05:35.801711 --- ParallelTerminationStrategy: PID 902 died... 03:05:35.821884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=902): Terminated: ok {rc=0} 03:05:35.868335 --- ParallelTerminationStrategy: PID 905 died... 03:05:35.887998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=905): Terminated: ok {rc=0} 03:05:35.934418 --- ParallelTerminationStrategy: PID 908 died... 03:05:35.954307 run pcap-recorder_any(filters='host 10.42.42.6')(pid=908): Terminated: ok {rc=0} 03:05:36.042314 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:05:37.342990 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:05:37.349536 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:05:37.378698 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:05:37.418897 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:05:37.506347 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:05:37.535451 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:05:37.574199 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:05:38.171584 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:05:38.223800 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:38.235143 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:05:38.301371 tst cs_paging_gprs_active.py: using LAC 38111 03:05:38.428258 tst cs_paging_gprs_active.py: using RAC 116 03:05:38.547542 tst cs_paging_gprs_active.py: using CellId 38111 03:05:38.664439 tst cs_paging_gprs_active.py: using BVCI 38112 03:05:38.772536 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:38.783718 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:38.794751 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:38.805660 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:38.816748 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:38.827809 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:38.839033 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:38.850044 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:38.861207 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:05:38.980705 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:05:39.096815 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:05:39.297872 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:39.598037 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=913): Launched 03:05:39.858743 run iperf3-srv_10.42.42.10(pid=914): Launched 03:05:39.971123 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:05:40.172086 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:40.472817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=915): Launched 03:05:40.734308 run iperf3-srv_10.42.42.10(pid=916): Launched 03:05:40.846780 tst cs_paging_gprs_active.py:38: start network... 03:05:41.047047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:05:41.511232 run create_hlr_db(pid=917): Launched 03:05:41.634157 bus /gobi_6: Setting Powered False 03:05:42.693581 run create_hlr_db(pid=917): Terminated: ok {rc=0} 03:05:43.130853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=919): Launched 03:05:43.453542 run osmo-hlr_10.42.42.2(pid=920): Launched 03:05:43.577800 run osmo-stp_10.42.42.5: Starting osmo-stp 03:05:44.132109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=922): Launched 03:05:44.453941 run osmo-stp_10.42.42.5(pid=923): Launched 03:05:44.577949 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:05:45.132735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=925): Launched 03:05:45.256331 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:05:45.527770 run patchelf(pid=926): Launched 03:05:45.706418 run osmo-stp_10.42.42.5(pid=923): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=923)] 03:05:45.850037 run osmo-stp_10.42.42.5(pid=923): stdout: | (launched: 2022-12-14_03:05:44.395397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:45.989142 run osmo-stp_10.42.42.5(pid=923): stderr: | [0;m[38;5;43m20221214030544586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030544586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030544586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030544587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030544587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030544587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030544587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:46.122189 run osmo-stp_10.42.42.5(pid=923): stdout: | (launched: 2022-12-14_03:05:44.395397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:46.249116 run osmo-stp_10.42.42.5(pid=923): stderr: | [0;m[38;5;43m20221214030544586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030544586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030544586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030544587 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030544587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030544587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030544587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:46.399122 run patchelf(pid=926): Terminating (SIGINT) 03:05:46.607523 run patchelf(pid=926): Terminated: ok {rc=0} 03:05:46.784179 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=923): Process ended prematurely: osmo-stp_10.42.42.5(pid=923) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=923)] [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:05:46.800316 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 03:05:46.836188 run osmo-hlr_10.42.42.2(pid=920): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=920)] 03:05:46.903559 run osmo-hlr_10.42.42.2(pid=920): stdout: | (launched: 2022-12-14_03:05:43.395156) 03:05:46.972424 run osmo-hlr_10.42.42.2(pid=920): stderr: | [0;m[1;31m20221214030543591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030543591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030543591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030543591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030543591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030543591 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030543604 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030543612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030543612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030543612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:05:47.039442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=913): Terminating (SIGTERM) 03:05:47.097131 run iperf3-srv_10.42.42.10(pid=914): Terminating (SIGTERM) 03:05:47.157845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=915): Terminating (SIGTERM) 03:05:47.205609 run iperf3-srv_10.42.42.10(pid=916): Terminating (SIGTERM) 03:05:47.253095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=919): Terminating (SIGTERM) 03:05:47.297463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=922): Terminating (SIGTERM) 03:05:47.339929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=925): Terminating (SIGTERM) 03:05:47.382613 --- ParallelTerminationStrategy: PID 913 died... 03:05:47.402902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=913): Terminated: ok {rc=0} 03:05:47.449306 --- ParallelTerminationStrategy: PID 914 died... 03:05:47.468942 run iperf3-srv_10.42.42.10(pid=914): Terminated {rc=256} 03:05:47.514978 --- ParallelTerminationStrategy: PID 915 died... 03:05:47.534816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=915): Terminated: ok {rc=0} 03:05:47.580794 --- ParallelTerminationStrategy: PID 916 died... 03:05:47.600501 run iperf3-srv_10.42.42.10(pid=916): Terminated {rc=256} 03:05:47.646460 --- ParallelTerminationStrategy: PID 919 died... 03:05:47.666369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=919): Terminated: ok {rc=0} 03:05:47.712446 --- ParallelTerminationStrategy: PID 922 died... 03:05:47.732243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=922): Terminated: ok {rc=0} 03:05:47.778361 --- ParallelTerminationStrategy: PID 925 died... 03:05:47.798230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=925): Terminated: ok {rc=0} 03:05:47.886390 bus /gobi_0: Setting Powered False 03:05:48.983211 bus /gobi_0: Setting Powered False 03:05:50.098335 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:05:51.247185 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:51.259409 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:05:51.328886 tst iperf3.py: using LAC 38112 03:05:51.454323 tst iperf3.py: using RAC 117 03:05:51.582197 tst iperf3.py: using CellId 38112 03:05:51.708217 tst iperf3.py: using BVCI 38113 03:05:51.825389 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:51.836823 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:51.848309 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:51.859466 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:51.871145 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:51.883106 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:51.894939 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:51.906495 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:05:51.918540 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:05:52.036688 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:05:52.237429 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:05:52.535933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=927): Launched 03:05:52.796761 run iperf3-srv_10.42.42.10(pid=928): Launched 03:05:52.908450 tst iperf3.py:8: start network... 03:05:53.108226 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:05:53.570723 run create_hlr_db(pid=929): Launched 03:05:53.693430 bus /gobi_6: Setting Powered False 03:05:54.755853 run create_hlr_db(pid=929): Terminated: ok {rc=0} 03:05:55.201655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=931): Launched 03:05:55.522637 run osmo-hlr_10.42.42.2(pid=932): Launched 03:05:55.645946 run osmo-stp_10.42.42.5: Starting osmo-stp 03:05:56.198305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=935): Launched 03:05:56.516793 run osmo-stp_10.42.42.5(pid=936): Launched 03:05:56.639221 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:05:57.189847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=938): Launched 03:05:57.312680 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:05:57.582905 run patchelf(pid=939): Launched 03:05:57.760343 run osmo-stp_10.42.42.5(pid=936): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=936)] 03:05:57.895561 run osmo-stp_10.42.42.5(pid=936): stdout: | (launched: 2022-12-14_03:05:56.459003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:58.032609 run osmo-stp_10.42.42.5(pid=936): stderr: | [0;m[38;5;43m20221214030556648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030556649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030556649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030556649 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030556650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030556650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030556650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:58.169682 run osmo-stp_10.42.42.5(pid=936): stdout: | (launched: 2022-12-14_03:05:56.459003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:05:58.302520 run osmo-stp_10.42.42.5(pid=936): stderr: | [0;m[38;5;43m20221214030556648 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030556649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030556649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030556649 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030556650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030556650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030556650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:05:58.457961 run patchelf(pid=939): Terminating (SIGINT) 03:05:58.638731 run patchelf(pid=939): Terminated: ok {rc=0} 03:05:58.769430 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=936): Process ended prematurely: osmo-stp_10.42.42.5(pid=936) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=936)] [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 03:05:58.779758 tst iperf3.py:8: Test FAILED (7.6 sec) 03:05:58.808354 run osmo-hlr_10.42.42.2(pid=932): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=932)] 03:05:58.858831 run osmo-hlr_10.42.42.2(pid=932): stdout: | (launched: 2022-12-14_03:05:55.464410) 03:05:58.910594 run osmo-hlr_10.42.42.2(pid=932): stderr: | [0;m[1;31m20221214030555662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030555662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030555662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030555662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030555662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030555662 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030555678 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030555686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030555686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030555686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:05:58.963352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=927): Terminating (SIGTERM) 03:05:59.005080 run iperf3-srv_10.42.42.10(pid=928): Terminating (SIGTERM) 03:05:59.047093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=931): Terminating (SIGTERM) 03:05:59.089790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=935): Terminating (SIGTERM) 03:05:59.131710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=938): Terminating (SIGTERM) 03:05:59.174471 --- ParallelTerminationStrategy: PID 927 died... 03:05:59.195281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=927): Terminated: ok {rc=0} 03:05:59.241935 --- ParallelTerminationStrategy: PID 928 died... 03:05:59.261759 run iperf3-srv_10.42.42.10(pid=928): Terminated {rc=256} 03:05:59.307937 --- ParallelTerminationStrategy: PID 931 died... 03:05:59.327958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=931): Terminated: ok {rc=0} 03:05:59.373866 --- ParallelTerminationStrategy: PID 935 died... 03:05:59.393737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=935): Terminated: ok {rc=0} 03:05:59.439836 --- ParallelTerminationStrategy: PID 938 died... 03:05:59.459597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=938): Terminated: ok {rc=0} 03:05:59.546638 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:06:00.694016 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:00.708732 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:06:00.776250 tst iperf3m4.py: using LAC 38113 03:06:00.927502 tst iperf3m4.py: using RAC 118 03:06:01.047639 tst iperf3m4.py: using CellId 38113 03:06:01.175872 tst iperf3m4.py: using BVCI 38114 03:06:01.295572 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:01.308012 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:01.320380 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:01.332720 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:01.346166 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:01.359470 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:01.372914 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:01.385882 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:01.399283 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:06:01.525248 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:06:01.671722 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:06:01.792437 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:06:01.926978 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:06:02.145577 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:02.469679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=940): Launched 03:06:02.747874 run iperf3-srv_10.42.42.10(pid=941): Launched 03:06:02.868570 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:06:03.084005 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:03.405211 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=942): Launched 03:06:03.683731 run iperf3-srv_10.42.42.10(pid=943): Launched 03:06:03.804443 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:06:04.019827 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:04.341147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=944): Launched 03:06:04.620119 run iperf3-srv_10.42.42.10(pid=945): Launched 03:06:04.740054 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:06:04.955743 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:05.277322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=946): Launched 03:06:05.555172 run iperf3-srv_10.42.42.10(pid=947): Launched 03:06:05.675824 tst iperf3m4.py:8: start network... 03:06:05.891347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:06:06.390183 run create_hlr_db(pid=948): Launched 03:06:06.511735 bus /gobi_6: Setting Powered False 03:06:07.572252 run create_hlr_db(pid=948): Terminated: ok {rc=0} 03:06:08.015979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=950): Launched 03:06:08.336593 run osmo-hlr_10.42.42.2(pid=951): Launched 03:06:08.459418 run osmo-stp_10.42.42.5: Starting osmo-stp 03:06:09.015574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=954): Launched 03:06:09.337063 run osmo-stp_10.42.42.5(pid=955): Launched 03:06:09.460026 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:06:10.013671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=958): Launched 03:06:10.135650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:06:10.406318 run patchelf(pid=959): Launched 03:06:10.584587 run osmo-stp_10.42.42.5(pid=955): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=955)] 03:06:10.719797 run osmo-stp_10.42.42.5(pid=955): stdout: | (launched: 2022-12-14_03:06:09.278548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:10.856481 run osmo-stp_10.42.42.5(pid=955): stderr: | [0;m[38;5;43m20221214030609471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030609471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030609471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030609472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030609472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030609472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030609472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:10.993391 run osmo-stp_10.42.42.5(pid=955): stdout: | (launched: 2022-12-14_03:06:09.278548) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:11.125130 run osmo-stp_10.42.42.5(pid=955): stderr: | [0;m[38;5;43m20221214030609471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030609471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030609471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030609472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030609472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030609472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030609472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:11.281768 run patchelf(pid=959): Terminating (SIGINT) 03:06:11.462317 run patchelf(pid=959): Terminated: ok {rc=0} 03:06:11.592686 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=955): Process ended prematurely: osmo-stp_10.42.42.5(pid=955) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=955)] [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:06:11.602971 tst iperf3m4.py:8: Test FAILED (10.9 sec) 03:06:11.631532 run osmo-hlr_10.42.42.2(pid=951): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=951)] 03:06:11.682231 run osmo-hlr_10.42.42.2(pid=951): stdout: | (launched: 2022-12-14_03:06:08.278098) 03:06:11.734346 run osmo-hlr_10.42.42.2(pid=951): stderr: | [0;m[1;31m20221214030608475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030608475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030608475 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030608476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030608476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030608476 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030608488 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030608497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030608497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030608497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:06:11.786876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=940): Terminating (SIGTERM) 03:06:11.828704 run iperf3-srv_10.42.42.10(pid=941): Terminating (SIGTERM) 03:06:11.871223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=942): Terminating (SIGTERM) 03:06:11.913462 run iperf3-srv_10.42.42.10(pid=943): Terminating (SIGTERM) 03:06:11.955845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=944): Terminating (SIGTERM) 03:06:11.997980 run iperf3-srv_10.42.42.10(pid=945): Terminating (SIGTERM) 03:06:12.039935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=946): Terminating (SIGTERM) 03:06:12.082605 run iperf3-srv_10.42.42.10(pid=947): Terminating (SIGTERM) 03:06:12.124509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=950): Terminating (SIGTERM) 03:06:12.166574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=954): Terminating (SIGTERM) 03:06:12.209105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=958): Terminating (SIGTERM) 03:06:12.251566 --- ParallelTerminationStrategy: PID 940 died... 03:06:12.271921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=940): Terminated: ok {rc=0} 03:06:12.318445 --- ParallelTerminationStrategy: PID 941 died... 03:06:12.338231 run iperf3-srv_10.42.42.10(pid=941): Terminated {rc=256} 03:06:12.384197 --- ParallelTerminationStrategy: PID 942 died... 03:06:12.403859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=942): Terminated: ok {rc=0} 03:06:12.449890 --- ParallelTerminationStrategy: PID 943 died... 03:06:12.469596 run iperf3-srv_10.42.42.10(pid=943): Terminated {rc=256} 03:06:12.515645 --- ParallelTerminationStrategy: PID 944 died... 03:06:12.535450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=944): Terminated: ok {rc=0} 03:06:12.581572 --- ParallelTerminationStrategy: PID 945 died... 03:06:12.601384 run iperf3-srv_10.42.42.10(pid=945): Terminated {rc=256} 03:06:12.647592 --- ParallelTerminationStrategy: PID 946 died... 03:06:12.667421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=946): Terminated: ok {rc=0} 03:06:12.713625 --- ParallelTerminationStrategy: PID 947 died... 03:06:12.733479 run iperf3-srv_10.42.42.10(pid=947): Terminated {rc=256} 03:06:12.779630 --- ParallelTerminationStrategy: PID 950 died... 03:06:12.799509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=950): Terminated: ok {rc=0} 03:06:12.845813 --- ParallelTerminationStrategy: PID 954 died... 03:06:12.865711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=954): Terminated: ok {rc=0} 03:06:12.912029 --- ParallelTerminationStrategy: PID 958 died... 03:06:12.931890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=958): Terminated: ok {rc=0} 03:06:13.019702 bus /gobi_4: Setting Powered False 03:06:14.118542 bus /gobi_4: Setting Powered False 03:06:15.235562 bus /gobi_1: Setting Powered False 03:06:16.334145 bus /gobi_1: Setting Powered False 03:06:17.454071 bus /gobi_0: Setting Powered False 03:06:18.552485 bus /gobi_0: Setting Powered False 03:06:19.667061 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:06:20.769995 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:20.781535 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:06:20.846217 tst ping.py: using LAC 38114 03:06:20.962708 tst ping.py: using RAC 119 03:06:21.077053 tst ping.py: using CellId 38114 03:06:21.200935 tst ping.py: using BVCI 38115 03:06:21.315749 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:21.327690 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:21.339125 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:21.350757 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:21.362689 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:21.374473 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:21.386323 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:21.398506 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:06:21.513640 tst ping.py:19: start network... 03:06:21.710181 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:06:22.163390 run create_hlr_db(pid=960): Launched 03:06:22.275188 bus /gobi_6: Setting Powered False 03:06:23.333798 run create_hlr_db(pid=960): Terminated: ok {rc=0} 03:06:23.765133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=962): Launched 03:06:24.080245 run osmo-hlr_10.42.42.2(pid=963): Launched 03:06:24.201300 run osmo-stp_10.42.42.5: Starting osmo-stp 03:06:24.749249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=965): Launched 03:06:25.063056 run osmo-stp_10.42.42.5(pid=966): Launched 03:06:25.183528 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:06:25.730335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=968): Launched 03:06:25.850859 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:06:26.116502 run patchelf(pid=969): Launched 03:06:26.292056 run osmo-stp_10.42.42.5(pid=966): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=966)] 03:06:26.425890 run osmo-stp_10.42.42.5(pid=966): stdout: | (launched: 2022-12-14_03:06:25.005812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:26.561196 run osmo-stp_10.42.42.5(pid=966): stderr: | [0;m[38;5;43m20221214030625195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030625195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030625195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030625196 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030625198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030625198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030625198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:26.696044 run osmo-stp_10.42.42.5(pid=966): stdout: | (launched: 2022-12-14_03:06:25.005812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:26.826016 run osmo-stp_10.42.42.5(pid=966): stderr: | [0;m[38;5;43m20221214030625195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030625195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030625195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030625196 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030625198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030625198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030625198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:26.979584 run patchelf(pid=969): Terminating (SIGINT) 03:06:27.157834 run patchelf(pid=969): Terminated: ok {rc=0} 03:06:27.286540 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=966): Process ended prematurely: osmo-stp_10.42.42.5(pid=966) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=966)] [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 03:06:27.296077 tst ping.py:22: Test FAILED (6.5 sec) 03:06:27.324238 run osmo-hlr_10.42.42.2(pid=963): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=963)] 03:06:27.374969 run osmo-hlr_10.42.42.2(pid=963): stdout: | (launched: 2022-12-14_03:06:24.022712) 03:06:27.427296 run osmo-hlr_10.42.42.2(pid=963): stderr: | [0;m[1;31m20221214030624222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030624222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030624222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030624222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030624222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030624222 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030624234 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030624242 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030624243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030624243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:06:27.479964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=962): Terminating (SIGTERM) 03:06:27.521944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=965): Terminating (SIGTERM) 03:06:27.564186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=968): Terminating (SIGTERM) 03:06:27.606785 --- ParallelTerminationStrategy: PID 962 died... 03:06:27.627365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=962): Terminated: ok {rc=0} 03:06:27.673865 --- ParallelTerminationStrategy: PID 965 died... 03:06:27.693898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=965): Terminated: ok {rc=0} 03:06:27.740171 --- ParallelTerminationStrategy: PID 968 died... 03:06:27.760427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=968): Terminated: ok {rc=0} 03:06:27.847647 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 03:06:28.935570 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:28.947732 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:06:29.013368 tst ping_idle_ping.py: using LAC 38115 03:06:29.128498 tst ping_idle_ping.py: using RAC 120 03:06:29.244128 tst ping_idle_ping.py: using CellId 38115 03:06:29.360846 tst ping_idle_ping.py: using BVCI 38116 03:06:29.467466 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:29.478461 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:29.489243 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:29.499921 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:29.510627 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:29.521434 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:29.532501 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:06:29.543344 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:06:29.660666 tst ping_idle_ping.py:24: start network... 03:06:29.873280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:06:30.364576 run create_hlr_db(pid=971): Launched 03:06:30.484688 bus /gobi_6: Setting Powered False 03:06:31.546761 run create_hlr_db(pid=971): Terminated: ok {rc=0} 03:06:32.002846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=973): Launched 03:06:32.353341 run osmo-hlr_10.42.42.2(pid=974): Launched 03:06:32.474468 run osmo-stp_10.42.42.5: Starting osmo-stp 03:06:33.018758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=976): Launched 03:06:33.335287 run osmo-stp_10.42.42.5(pid=977): Launched 03:06:33.456230 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:06:34.002179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=979): Launched 03:06:34.123151 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:06:34.391218 run patchelf(pid=980): Launched 03:06:34.567457 run osmo-stp_10.42.42.5(pid=977): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=977)] 03:06:34.701594 run osmo-stp_10.42.42.5(pid=977): stdout: | (launched: 2022-12-14_03:06:33.277460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:34.837105 run osmo-stp_10.42.42.5(pid=977): stderr: | [0;m[38;5;43m20221214030633471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030633471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030633471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030633472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030633472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030633472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030633472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:34.972479 run osmo-stp_10.42.42.5(pid=977): stdout: | (launched: 2022-12-14_03:06:33.277460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:35.103014 run osmo-stp_10.42.42.5(pid=977): stderr: | [0;m[38;5;43m20221214030633471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030633471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030633471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030633472 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030633472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030633472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030633472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:35.257407 run patchelf(pid=980): Terminating (SIGINT) 03:06:35.436076 run patchelf(pid=980): Terminated: ok {rc=0} 03:06:35.565039 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=977): Process ended prematurely: osmo-stp_10.42.42.5(pid=977) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=977)] [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 03:06:35.574596 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 03:06:35.602645 run osmo-hlr_10.42.42.2(pid=974): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=974)] 03:06:35.653567 run osmo-hlr_10.42.42.2(pid=974): stdout: | (launched: 2022-12-14_03:06:32.295731) 03:06:35.705612 run osmo-hlr_10.42.42.2(pid=974): stderr: | [0;m[1;31m20221214030632490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030632490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030632490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030632490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030632490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030632490 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030632503 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030632512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030632512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030632512 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:06:35.758223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=973): Terminating (SIGTERM) 03:06:35.799985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=976): Terminating (SIGTERM) 03:06:35.842099 run pcap-recorder_any(filters='host 10.42.42.6')(pid=979): Terminating (SIGTERM) 03:06:35.884461 --- ParallelTerminationStrategy: PID 973 died... 03:06:35.904838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=973): Terminated: ok {rc=0} 03:06:35.951088 --- ParallelTerminationStrategy: PID 976 died... 03:06:35.970882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=976): Terminated: ok {rc=0} 03:06:36.017114 --- ParallelTerminationStrategy: PID 979 died... 03:06:36.036921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=979): Terminated: ok {rc=0} 03:06:36.124779 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 03:06:37.421365 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:06:37.427818 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 03:06:37.456614 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 03:06:37.495085 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 03:06:37.580905 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 03:06:37.610466 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 03:06:37.648697 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 03:06:38.241307 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 03:06:38.289702 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:38.301142 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:06:38.366185 tst cs_paging_gprs_active.py: using LAC 38116 03:06:38.484365 tst cs_paging_gprs_active.py: using RAC 121 03:06:38.608226 tst cs_paging_gprs_active.py: using CellId 38116 03:06:38.729241 tst cs_paging_gprs_active.py: using BVCI 38117 03:06:38.839906 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:38.851125 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:38.862088 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:38.873055 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:38.884149 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:38.895254 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:38.906398 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:38.917416 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:38.928538 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:06:39.047998 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:06:39.163881 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:06:39.365896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:39.667295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=984): Launched 03:06:39.928220 run iperf3-srv_10.42.42.10(pid=985): Launched 03:06:40.041161 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:06:40.242211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:40.543618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=986): Launched 03:06:40.806134 run iperf3-srv_10.42.42.10(pid=988): Launched 03:06:40.918874 tst cs_paging_gprs_active.py:38: start network... 03:06:41.119765 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:06:41.584519 run create_hlr_db(pid=989): Launched 03:06:41.708327 bus /gobi_6: Setting Powered False 03:06:42.769177 run create_hlr_db(pid=989): Terminated: ok {rc=0} 03:06:43.209145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=994): Launched 03:06:43.531829 run osmo-hlr_10.42.42.2(pid=996): Launched 03:06:43.655916 run osmo-stp_10.42.42.5: Starting osmo-stp 03:06:44.210287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=998): Launched 03:06:44.532110 run osmo-stp_10.42.42.5(pid=999): Launched 03:06:44.655316 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:06:45.211211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1001): Launched 03:06:45.335310 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:06:45.614614 run patchelf(pid=1002): Launched 03:06:45.794232 run osmo-stp_10.42.42.5(pid=999): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=999)] 03:06:45.956042 run osmo-stp_10.42.42.5(pid=999): stdout: | (launched: 2022-12-14_03:06:44.473496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:46.098060 run osmo-stp_10.42.42.5(pid=999): stderr: | [0;m[38;5;43m20221214030644664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030644665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030644665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030644665 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030644666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030644666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030644666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:46.239490 run osmo-stp_10.42.42.5(pid=999): stdout: | (launched: 2022-12-14_03:06:44.473496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:46.376408 run osmo-stp_10.42.42.5(pid=999): stderr: | [0;m[38;5;43m20221214030644664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030644665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030644665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030644665 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030644666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030644666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030644666 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:46.537857 run patchelf(pid=1002): Terminating (SIGINT) 03:06:46.724279 run patchelf(pid=1002): Terminated: ok {rc=0} 03:06:46.859215 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=999): Process ended prematurely: osmo-stp_10.42.42.5(pid=999) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=999)] [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 03:06:46.870564 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 03:06:46.901634 run osmo-hlr_10.42.42.2(pid=996): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=996)] 03:06:46.955444 run osmo-hlr_10.42.42.2(pid=996): stdout: | (launched: 2022-12-14_03:06:43.473259) 03:06:47.010086 run osmo-hlr_10.42.42.2(pid=996): stderr: | [0;m[1;31m20221214030643670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030643670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030643670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030643670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030643670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030643670 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030643682 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030643690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030643691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030643691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:06:47.065322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=984): Terminating (SIGTERM) 03:06:47.108806 run iperf3-srv_10.42.42.10(pid=985): Terminating (SIGTERM) 03:06:47.155900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=986): Terminating (SIGTERM) 03:06:47.199198 run iperf3-srv_10.42.42.10(pid=988): Terminating (SIGTERM) 03:06:47.241987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=994): Terminating (SIGTERM) 03:06:47.285029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=998): Terminating (SIGTERM) 03:06:47.327818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1001): Terminating (SIGTERM) 03:06:47.370645 --- ParallelTerminationStrategy: PID 984 died... 03:06:47.391468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=984): Terminated: ok {rc=0} 03:06:47.438331 --- ParallelTerminationStrategy: PID 985 died... 03:06:47.458539 run iperf3-srv_10.42.42.10(pid=985): Terminated {rc=256} 03:06:47.505333 --- ParallelTerminationStrategy: PID 986 died... 03:06:47.525667 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=986): Terminated: ok {rc=0} 03:06:47.572369 --- ParallelTerminationStrategy: PID 988 died... 03:06:47.592716 run iperf3-srv_10.42.42.10(pid=988): Terminated {rc=256} 03:06:47.639467 --- ParallelTerminationStrategy: PID 994 died... 03:06:47.659866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=994): Terminated: ok {rc=0} 03:06:47.706708 --- ParallelTerminationStrategy: PID 998 died... 03:06:47.727040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=998): Terminated: ok {rc=0} 03:06:47.773889 --- ParallelTerminationStrategy: PID 1001 died... 03:06:47.794229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1001): Terminated: ok {rc=0} 03:06:47.883538 bus /gobi_0: Setting Powered False 03:06:48.980072 bus /gobi_0: Setting Powered False 03:06:50.096075 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 03:06:51.242566 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:51.254324 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:06:51.320117 tst iperf3.py: using LAC 38117 03:06:51.441102 tst iperf3.py: using RAC 122 03:06:51.558366 tst iperf3.py: using CellId 38117 03:06:51.674986 tst iperf3.py: using BVCI 38118 03:06:51.785446 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:51.796293 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:51.807039 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:51.817833 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:51.829345 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:51.840291 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:51.851471 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:51.862435 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:06:51.873752 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:06:51.992874 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:06:52.209904 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:06:52.531047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1003): Launched 03:06:52.810106 run iperf3-srv_10.42.42.10(pid=1004): Launched 03:06:52.930124 tst iperf3.py:8: start network... 03:06:53.146667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:06:53.645027 run create_hlr_db(pid=1005): Launched 03:06:53.767720 bus /gobi_6: Setting Powered False 03:06:54.830600 run create_hlr_db(pid=1005): Terminated: ok {rc=0} 03:06:55.277058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1007): Launched 03:06:55.597628 run osmo-hlr_10.42.42.2(pid=1008): Launched 03:06:55.721101 run osmo-stp_10.42.42.5: Starting osmo-stp 03:06:56.276544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1010): Launched 03:06:56.597365 run osmo-stp_10.42.42.5(pid=1011): Launched 03:06:56.720261 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:06:57.273643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1013): Launched 03:06:57.396234 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:06:57.667749 run patchelf(pid=1014): Launched 03:06:57.846498 run osmo-stp_10.42.42.5(pid=1011): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1011)] 03:06:57.982219 run osmo-stp_10.42.42.5(pid=1011): stdout: | (launched: 2022-12-14_03:06:56.538739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:58.119994 run osmo-stp_10.42.42.5(pid=1011): stderr: | [0;m[38;5;43m20221214030656732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030656732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030656732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030656733 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030656735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030656735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030656735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:58.258423 run osmo-stp_10.42.42.5(pid=1011): stdout: | (launched: 2022-12-14_03:06:56.538739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:06:58.391338 run osmo-stp_10.42.42.5(pid=1011): stderr: | [0;m[38;5;43m20221214030656732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030656732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030656732 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030656733 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030656735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030656735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030656735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:06:58.547974 run patchelf(pid=1014): Terminating (SIGINT) 03:06:58.729576 run patchelf(pid=1014): Terminated: ok {rc=0} 03:06:58.860350 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1011): Process ended prematurely: osmo-stp_10.42.42.5(pid=1011) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1011)] [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 03:06:58.870663 tst iperf3.py:8: Test FAILED (7.7 sec) 03:06:58.899107 run osmo-hlr_10.42.42.2(pid=1008): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1008)] 03:06:58.950274 run osmo-hlr_10.42.42.2(pid=1008): stdout: | (launched: 2022-12-14_03:06:55.539372) 03:06:59.002600 run osmo-hlr_10.42.42.2(pid=1008): stderr: | [0;m[1;31m20221214030655738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030655738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030655738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030655738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030655738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030655738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030655752 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030655762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030655762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030655762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:06:59.055556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1003): Terminating (SIGTERM) 03:06:59.097442 run iperf3-srv_10.42.42.10(pid=1004): Terminating (SIGTERM) 03:06:59.139734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1007): Terminating (SIGTERM) 03:06:59.182198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1010): Terminating (SIGTERM) 03:06:59.224427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1013): Terminating (SIGTERM) 03:06:59.267338 --- ParallelTerminationStrategy: PID 1003 died... 03:06:59.287838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1003): Terminated: ok {rc=0} 03:06:59.334576 --- ParallelTerminationStrategy: PID 1004 died... 03:06:59.354511 run iperf3-srv_10.42.42.10(pid=1004): Terminated {rc=256} 03:06:59.400724 --- ParallelTerminationStrategy: PID 1007 died... 03:06:59.420651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1007): Terminated: ok {rc=0} 03:06:59.466835 --- ParallelTerminationStrategy: PID 1010 died... 03:06:59.486710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1010): Terminated: ok {rc=0} 03:06:59.533229 --- ParallelTerminationStrategy: PID 1013 died... 03:06:59.553095 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1013): Terminated: ok {rc=0} 03:06:59.641735 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 03:07:00.790013 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:00.802391 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:07:00.870212 tst iperf3m4.py: using LAC 38118 03:07:01.023301 tst iperf3m4.py: using RAC 123 03:07:01.152223 tst iperf3m4.py: using CellId 38118 03:07:01.313619 tst iperf3m4.py: using BVCI 38119 03:07:01.428213 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:01.440065 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:01.451734 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:01.463343 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:01.475276 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:01.487447 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:01.499193 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:01.510866 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:01.523045 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:07:01.653067 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:07:01.779173 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:07:01.895804 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:07:02.011311 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:07:02.215379 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:07:02.538949 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1015): Launched 03:07:02.818988 run iperf3-srv_10.42.42.10(pid=1016): Launched 03:07:02.939807 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:07:03.155917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:07:03.478363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1017): Launched 03:07:03.757645 run iperf3-srv_10.42.42.10(pid=1018): Launched 03:07:03.878106 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:07:04.093715 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:07:04.397209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1019): Launched 03:07:04.658277 run iperf3-srv_10.42.42.10(pid=1020): Launched 03:07:04.771321 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:07:04.970936 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:07:05.271156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1021): Launched 03:07:05.531329 run iperf3-srv_10.42.42.10(pid=1022): Launched 03:07:05.643487 tst iperf3m4.py:8: start network... 03:07:05.842754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:07:06.306357 run create_hlr_db(pid=1023): Launched 03:07:06.429178 bus /gobi_6: Setting Powered False 03:07:07.489250 run create_hlr_db(pid=1023): Terminated: ok {rc=0} 03:07:07.907244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1025): Launched 03:07:08.206519 run osmo-hlr_10.42.42.2(pid=1026): Launched 03:07:08.319142 run osmo-stp_10.42.42.5: Starting osmo-stp 03:07:08.834215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1028): Launched 03:07:09.133261 run osmo-stp_10.42.42.5(pid=1029): Launched 03:07:09.246594 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:07:09.762891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1031): Launched 03:07:09.876801 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:07:10.130201 run patchelf(pid=1032): Launched 03:07:10.296661 run osmo-stp_10.42.42.5(pid=1029): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1029)] 03:07:10.423402 run osmo-stp_10.42.42.5(pid=1029): stdout: | (launched: 2022-12-14_03:07:09.077932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:10.551480 run osmo-stp_10.42.42.5(pid=1029): stderr: | [0;m[38;5;43m20221214030709249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030709249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030709249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030709250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030709250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030709250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030709250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:10.679476 run osmo-stp_10.42.42.5(pid=1029): stdout: | (launched: 2022-12-14_03:07:09.077932) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:10.802839 run osmo-stp_10.42.42.5(pid=1029): stderr: | [0;m[38;5;43m20221214030709249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030709249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030709249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030709250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030709250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030709250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030709250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:10.949114 run patchelf(pid=1032): Terminating (SIGINT) 03:07:11.118359 run patchelf(pid=1032): Terminated: ok {rc=0} 03:07:11.240338 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1029): Process ended prematurely: osmo-stp_10.42.42.5(pid=1029) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1029)] [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 03:07:11.249906 tst iperf3m4.py:8: Test FAILED (10.5 sec) 03:07:11.277337 run osmo-hlr_10.42.42.2(pid=1026): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1026)] 03:07:11.325165 run osmo-hlr_10.42.42.2(pid=1026): stdout: | (launched: 2022-12-14_03:07:08.151550) 03:07:11.374315 run osmo-hlr_10.42.42.2(pid=1026): stderr: | [0;m[1;31m20221214030708328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030708328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030708328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030708328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030708328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030708328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030708351 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030708360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030708360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030708360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:07:11.423825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1015): Terminating (SIGTERM) 03:07:11.463868 run iperf3-srv_10.42.42.10(pid=1016): Terminating (SIGTERM) 03:07:11.503668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1017): Terminating (SIGTERM) 03:07:11.543449 run iperf3-srv_10.42.42.10(pid=1018): Terminating (SIGTERM) 03:07:11.583533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1019): Terminating (SIGTERM) 03:07:11.623410 run iperf3-srv_10.42.42.10(pid=1020): Terminating (SIGTERM) 03:07:11.662946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1021): Terminating (SIGTERM) 03:07:11.702512 run iperf3-srv_10.42.42.10(pid=1022): Terminating (SIGTERM) 03:07:11.741847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1025): Terminating (SIGTERM) 03:07:11.781385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1028): Terminating (SIGTERM) 03:07:11.821373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1031): Terminating (SIGTERM) 03:07:11.862361 --- ParallelTerminationStrategy: PID 1015 died... 03:07:11.881534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1015): Terminated: ok {rc=0} 03:07:11.925629 --- ParallelTerminationStrategy: PID 1016 died... 03:07:11.944054 run iperf3-srv_10.42.42.10(pid=1016): Terminated {rc=256} 03:07:11.987791 --- ParallelTerminationStrategy: PID 1017 died... 03:07:12.006395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1017): Terminated: ok {rc=0} 03:07:12.050056 --- ParallelTerminationStrategy: PID 1018 died... 03:07:12.068534 run iperf3-srv_10.42.42.10(pid=1018): Terminated {rc=256} 03:07:12.112124 --- ParallelTerminationStrategy: PID 1019 died... 03:07:12.130712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1019): Terminated: ok {rc=0} 03:07:12.174161 --- ParallelTerminationStrategy: PID 1020 died... 03:07:12.192563 run iperf3-srv_10.42.42.10(pid=1020): Terminated {rc=256} 03:07:12.236111 --- ParallelTerminationStrategy: PID 1021 died... 03:07:12.254630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1021): Terminated: ok {rc=0} 03:07:12.298504 --- ParallelTerminationStrategy: PID 1022 died... 03:07:12.317038 run iperf3-srv_10.42.42.10(pid=1022): Terminated {rc=256} 03:07:12.360620 --- ParallelTerminationStrategy: PID 1025 died... 03:07:12.379230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1025): Terminated: ok {rc=0} 03:07:12.422809 --- ParallelTerminationStrategy: PID 1028 died... 03:07:12.441367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1028): Terminated: ok {rc=0} 03:07:12.484891 --- ParallelTerminationStrategy: PID 1031 died... 03:07:12.503916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1031): Terminated: ok {rc=0} 03:07:12.590171 bus /gobi_4: Setting Powered False 03:07:13.689284 bus /gobi_4: Setting Powered False 03:07:14.805591 bus /gobi_1: Setting Powered False 03:07:15.909962 bus /gobi_1: Setting Powered False 03:07:17.045374 bus /gobi_0: Setting Powered False 03:07:18.158676 bus /gobi_0: Setting Powered False 03:07:19.275867 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 03:07:20.378862 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:20.391179 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:07:20.460408 tst ping.py: using LAC 38119 03:07:20.585359 tst ping.py: using RAC 124 03:07:20.709215 tst ping.py: using CellId 38119 03:07:20.826782 tst ping.py: using BVCI 38120 03:07:20.935945 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:20.947156 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:20.957999 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:20.968937 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:20.980344 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:20.991888 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:21.003325 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:21.014670 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:07:21.133527 tst ping.py:19: start network... 03:07:21.346425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:07:21.833700 run create_hlr_db(pid=1035): Launched 03:07:21.954234 bus /gobi_6: Setting Powered False 03:07:23.017281 run create_hlr_db(pid=1035): Terminated: ok {rc=0} 03:07:23.457780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1037): Launched 03:07:23.771889 run osmo-hlr_10.42.42.2(pid=1038): Launched 03:07:23.891767 run osmo-stp_10.42.42.5: Starting osmo-stp 03:07:24.434566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1040): Launched 03:07:24.748704 run osmo-stp_10.42.42.5(pid=1041): Launched 03:07:24.871121 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:07:25.417013 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1043): Launched 03:07:25.537940 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:07:25.804384 run patchelf(pid=1044): Launched 03:07:25.980562 run osmo-stp_10.42.42.5(pid=1041): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1041)] 03:07:26.114048 run osmo-stp_10.42.42.5(pid=1041): stdout: | (launched: 2022-12-14_03:07:24.691402) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:26.249223 run osmo-stp_10.42.42.5(pid=1041): stderr: | [0;m[38;5;43m20221214030724883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030724883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030724883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030724883 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030724884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030724884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030724884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:26.384801 run osmo-stp_10.42.42.5(pid=1041): stdout: | (launched: 2022-12-14_03:07:24.691402) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:26.514534 run osmo-stp_10.42.42.5(pid=1041): stderr: | [0;m[38;5;43m20221214030724883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030724883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030724883 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030724883 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030724884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030724884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030724884 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:26.668077 run patchelf(pid=1044): Terminating (SIGINT) 03:07:26.846051 run patchelf(pid=1044): Terminated: ok {rc=0} 03:07:26.974996 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1041): Process ended prematurely: osmo-stp_10.42.42.5(pid=1041) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1041)] [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 03:07:26.984389 tst ping.py:22: Test FAILED (6.6 sec) 03:07:27.012391 run osmo-hlr_10.42.42.2(pid=1038): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1038)] 03:07:27.063238 run osmo-hlr_10.42.42.2(pid=1038): stdout: | (launched: 2022-12-14_03:07:23.714695) 03:07:27.115276 run osmo-hlr_10.42.42.2(pid=1038): stderr: | [0;m[1;31m20221214030723915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030723915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030723915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030723915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030723915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030723915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030723927 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030723935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030723936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030723936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:07:27.167840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1037): Terminating (SIGTERM) 03:07:27.209443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1040): Terminating (SIGTERM) 03:07:27.251329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1043): Terminating (SIGTERM) 03:07:27.293917 --- ParallelTerminationStrategy: PID 1037 died... 03:07:27.314521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1037): Terminated: ok {rc=0} 03:07:27.360999 --- ParallelTerminationStrategy: PID 1040 died... 03:07:27.380548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1040): Terminated: ok {rc=0} 03:07:27.426874 --- ParallelTerminationStrategy: PID 1043 died... 03:07:27.446616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1043): Terminated: ok {rc=0} 03:07:27.534704 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 03:07:28.621232 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:28.633356 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 03:07:28.701840 tst ping_idle_ping.py: using LAC 38120 03:07:28.829440 tst ping_idle_ping.py: using RAC 125 03:07:28.946086 tst ping_idle_ping.py: using CellId 38120 03:07:29.060615 tst ping_idle_ping.py: using BVCI 38121 03:07:29.167652 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:29.178768 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:29.189842 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:29.200720 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:29.212103 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:29.223434 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:29.235021 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 03:07:29.246375 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 03:07:29.361870 tst ping_idle_ping.py:24: start network... 03:07:29.559137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:07:30.018326 run create_hlr_db(pid=1045): Launched 03:07:30.139179 bus /gobi_6: Setting Powered False 03:07:31.197630 run create_hlr_db(pid=1045): Terminated: ok {rc=0} 03:07:31.626766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1047): Launched 03:07:31.956390 run osmo-hlr_10.42.42.2(pid=1048): Launched 03:07:32.114381 run osmo-stp_10.42.42.5: Starting osmo-stp 03:07:32.699198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1050): Launched 03:07:32.995009 run osmo-stp_10.42.42.5(pid=1051): Launched 03:07:33.107266 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:07:33.616408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1053): Launched 03:07:33.729959 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:07:33.979842 run patchelf(pid=1054): Launched 03:07:34.144763 run osmo-stp_10.42.42.5(pid=1051): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1051)] 03:07:34.269888 run osmo-stp_10.42.42.5(pid=1051): stdout: | (launched: 2022-12-14_03:07:32.939860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:34.396329 run osmo-stp_10.42.42.5(pid=1051): stderr: | [0;m[38;5;43m20221214030733110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030733110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030733111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030733111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030733113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030733114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030733114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:34.522682 run osmo-stp_10.42.42.5(pid=1051): stdout: | (launched: 2022-12-14_03:07:32.939860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:34.643690 run osmo-stp_10.42.42.5(pid=1051): stderr: | [0;m[38;5;43m20221214030733110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030733110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030733111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030733111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030733113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030733114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030733114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:34.787217 run patchelf(pid=1054): Terminating (SIGINT) 03:07:34.954191 run patchelf(pid=1054): Terminated: ok {rc=0} 03:07:35.075408 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1051): Process ended prematurely: osmo-stp_10.42.42.5(pid=1051) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1051)] [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 03:07:35.085171 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 03:07:35.113316 run osmo-hlr_10.42.42.2(pid=1048): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1048)] 03:07:35.160834 run osmo-hlr_10.42.42.2(pid=1048): stdout: | (launched: 2022-12-14_03:07:31.885988) 03:07:35.210148 run osmo-hlr_10.42.42.2(pid=1048): stderr: | [0;m[1;31m20221214030732256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030732256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030732256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030732256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030732256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030732256 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030732273 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030732281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030732281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030732281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:07:35.259621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1047): Terminating (SIGTERM) 03:07:35.300009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1050): Terminating (SIGTERM) 03:07:35.340171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1053): Terminating (SIGTERM) 03:07:35.380288 --- ParallelTerminationStrategy: PID 1047 died... 03:07:35.398943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1047): Terminated: ok {rc=0} 03:07:35.442988 --- ParallelTerminationStrategy: PID 1050 died... 03:07:35.461556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1050): Terminated: ok {rc=0} 03:07:35.505482 --- ParallelTerminationStrategy: PID 1053 died... 03:07:35.524120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1053): Terminated: ok {rc=0} 03:07:35.610402 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:07:36.916908 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:07:36.924370 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:07:36.955117 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 03:07:36.991377 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:07:37.045567 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:07:37.074987 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 03:07:37.110282 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:07:37.670160 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2398 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 03:07:37.675336 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:07:37.686973 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:07:37.755547 tst switch_tch_pdch.py: using LAC 38121 03:07:37.879211 tst switch_tch_pdch.py: using RAC 126 03:07:38.002704 tst switch_tch_pdch.py: using CellId 38121 03:07:38.126280 tst switch_tch_pdch.py: using BVCI 38122 03:07:38.240752 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:07:38.252408 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:07:38.264062 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:07:38.275960 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:07:38.287822 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:07:38.299622 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:07:38.311688 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:07:38.323689 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:07:38.445797 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:07:38.562300 tst switch_tch_pdch.py:51: start network... 03:07:38.758015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:07:39.213923 run create_hlr_db(pid=1059): Launched 03:07:39.335063 bus /gobi_6: Setting Powered False 03:07:40.394450 run create_hlr_db(pid=1059): Terminated: ok {rc=0} 03:07:40.826239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1061): Launched 03:07:41.142666 run osmo-hlr_10.42.42.2(pid=1062): Launched 03:07:41.262754 run osmo-stp_10.42.42.5: Starting osmo-stp 03:07:41.806574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1064): Launched 03:07:42.121720 run osmo-stp_10.42.42.5(pid=1065): Launched 03:07:42.242360 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:07:42.788634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1067): Launched 03:07:42.909943 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:07:43.176479 run patchelf(pid=1068): Launched 03:07:43.353522 run osmo-stp_10.42.42.5(pid=1065): ERR: Terminated: ERROR {rc=1} [trial-2398↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1065)] 03:07:43.487261 run osmo-stp_10.42.42.5(pid=1065): stdout: | (launched: 2022-12-14_03:07:42.063943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:43.622921 run osmo-stp_10.42.42.5(pid=1065): stderr: | [0;m[38;5;43m20221214030742256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030742256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030742256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030742257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030742257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030742257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030742257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:43.758376 run osmo-stp_10.42.42.5(pid=1065): stdout: | (launched: 2022-12-14_03:07:42.063943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:43.888224 run osmo-stp_10.42.42.5(pid=1065): stderr: | [0;m[38;5;43m20221214030742256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030742256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030742256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030742257 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030742257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030742257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030742257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:44.042156 run patchelf(pid=1068): Terminating (SIGINT) 03:07:44.220415 run patchelf(pid=1068): Terminated: ok {rc=0} 03:07:44.349469 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1065): Process ended prematurely: osmo-stp_10.42.42.5(pid=1065) [trial-2398↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1065)] [trial-2398↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 03:07:44.359150 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 03:07:44.387185 run osmo-hlr_10.42.42.2(pid=1062): ERR: Terminated: ERROR {rc=237} [trial-2398↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1062)] 03:07:44.438107 run osmo-hlr_10.42.42.2(pid=1062): stdout: | (launched: 2022-12-14_03:07:41.084893) 03:07:44.490300 run osmo-hlr_10.42.42.2(pid=1062): stderr: | [0;m[1;31m20221214030741282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030741282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030741282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030741282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030741282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030741282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030741295 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030741303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030741303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030741304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:07:44.542588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1061): Terminating (SIGTERM) 03:07:44.584050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1064): Terminating (SIGTERM) 03:07:44.625952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1067): Terminating (SIGTERM) 03:07:44.668137 --- ParallelTerminationStrategy: PID 1061 died... 03:07:44.688550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1061): Terminated: ok {rc=0} 03:07:44.734796 --- ParallelTerminationStrategy: PID 1064 died... 03:07:44.754720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1064): Terminated: ok {rc=0} 03:07:44.800649 --- ParallelTerminationStrategy: PID 1067 died... 03:07:44.820358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1067): Terminated: ok {rc=0} 03:07:44.907683 bus /gobi_0: Setting Powered False 03:07:46.017586 bus /gobi_0: Setting Powered False 03:07:47.145421 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 03:07:48.406973 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:07:48.413293 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 03:07:48.442434 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 03:07:48.477965 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 03:07:48.530962 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 03:07:48.559326 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 03:07:48.593276 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 03:07:49.153553 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2398 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 03:07:49.159544 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:07:49.171152 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 03:07:49.236885 tst switch_tch_pdch.py: using LAC 38122 03:07:49.360572 tst switch_tch_pdch.py: using RAC 127 03:07:49.482944 tst switch_tch_pdch.py: using CellId 38122 03:07:49.605301 tst switch_tch_pdch.py: using BVCI 38123 03:07:49.720170 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:07:49.731880 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:07:49.743252 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:07:49.754701 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:07:49.766475 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:07:49.778299 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:07:49.790287 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 03:07:49.802242 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:07:49.917141 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 03:07:50.036701 tst switch_tch_pdch.py:51: start network... 03:07:50.248897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:07:50.709580 run create_hlr_db(pid=1072): Launched 03:07:50.829355 bus /gobi_6: Setting Powered False 03:07:51.903799 run create_hlr_db(pid=1072): Terminated: ok {rc=0} 03:07:52.322376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1074): Launched 03:07:52.638491 run osmo-hlr_10.42.42.2(pid=1075): Launched 03:07:52.759281 run osmo-stp_10.42.42.5: Starting osmo-stp 03:07:53.274304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1077): Launched 03:07:53.589582 run osmo-stp_10.42.42.5(pid=1078): Launched 03:07:53.710221 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:07:54.227727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1080): Launched 03:07:54.344503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:07:54.592711 run patchelf(pid=1081): Launched 03:07:54.756301 run osmo-stp_10.42.42.5(pid=1078): ERR: Terminated: ERROR {rc=1} [trial-2398↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1078)] 03:07:54.880755 run osmo-stp_10.42.42.5(pid=1078): stdout: | (launched: 2022-12-14_03:07:53.532214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:55.006896 run osmo-stp_10.42.42.5(pid=1078): stderr: | [0;m[38;5;43m20221214030753722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030753722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030753722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030753723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030753725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030753725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030753725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:55.132784 run osmo-stp_10.42.42.5(pid=1078): stdout: | (launched: 2022-12-14_03:07:53.532214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:07:55.254054 run osmo-stp_10.42.42.5(pid=1078): stderr: | [0;m[38;5;43m20221214030753722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030753722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030753722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030753723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030753725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030753725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030753725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:07:55.397418 run patchelf(pid=1081): Terminating (SIGINT) 03:07:55.563400 run patchelf(pid=1081): Terminated: ok {rc=0} 03:07:55.683397 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1078): Process ended prematurely: osmo-stp_10.42.42.5(pid=1078) [trial-2398↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1078)] [trial-2398↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 03:07:55.692313 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 03:07:55.718799 run osmo-hlr_10.42.42.2(pid=1075): ERR: Terminated: ERROR {rc=237} [trial-2398↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1075)] 03:07:55.766117 run osmo-hlr_10.42.42.2(pid=1075): stdout: | (launched: 2022-12-14_03:07:52.581178) 03:07:55.815594 run osmo-hlr_10.42.42.2(pid=1075): stderr: | [0;m[1;31m20221214030752779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030752779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030752779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030752779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030752779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030752779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030752792 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030752801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030752801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030752801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:07:55.865335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1074): Terminating (SIGTERM) 03:07:55.904895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1077): Terminating (SIGTERM) 03:07:55.944540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1080): Terminating (SIGTERM) 03:07:55.984587 --- ParallelTerminationStrategy: PID 1074 died... 03:07:56.003746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1074): Terminated: ok {rc=0} 03:07:56.047552 --- ParallelTerminationStrategy: PID 1077 died... 03:07:56.066228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1077): Terminated: ok {rc=0} 03:07:56.109830 --- ParallelTerminationStrategy: PID 1080 died... 03:07:56.128418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1080): Terminated: ok {rc=0} 03:07:56.211417 bus /gobi_0: Setting Powered False 03:07:57.309881 bus /gobi_0: Setting Powered False 03:07:58.425515 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_sms:nanobts --------------------------------------------------------------------- 03:07:59.670951 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:07:59.675155 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 03:07:59.698995 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 03:07:59.705872 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 03:07:59.758500 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 03:07:59.782602 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 03:07:59.789468 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 03:08:00.327363 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 03:08:00.333047 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 03:08:00.344165 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 03:08:00.382238 tst mo_mt_sms.py: using LAC 38123 03:08:00.506282 tst mo_mt_sms.py: using RAC 128 03:08:00.629326 tst mo_mt_sms.py: using CellId 38123 03:08:00.754333 tst mo_mt_sms.py: using BVCI 38124 03:08:00.873533 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 03:08:00.995883 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 03:08:01.113268 tst mo_mt_sms.py:9: start nitb and bts... 03:08:01.378677 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:08:02.018856 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1085): Launched 03:08:02.367036 run osmo-nitb_10.42.42.2(pid=1086): Launched 03:08:02.542903 run osmo-nitb_10.42.42.2(pid=1086): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1086)] 03:08:02.675256 run osmo-nitb_10.42.42.2(pid=1086): stdout: | (launched: 2022-12-14_03:08:02.294183) 03:08:02.808683 run osmo-nitb_10.42.42.2(pid=1086): stderr: | (launched: 2022-12-14_03:08:02.342464) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:08:02.942285 run osmo-nitb_10.42.42.2(pid=1086): stdout: | (launched: 2022-12-14_03:08:02.294183) 03:08:03.070257 run osmo-nitb_10.42.42.2(pid=1086): stderr: | (launched: 2022-12-14_03:08:02.342464) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1086): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1086) [trial-2398↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1086)] 03:08:03.490527 tst osmo-nitb_10.42.42.2(pid=1086): stdout: | (launched: 2022-12-14_03:08:02.294183) 03:08:03.609056 tst osmo-nitb_10.42.42.2(pid=1086): stderr: | (launched: 2022-12-14_03:08:02.342464) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:08:03.747988 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=1086): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1086) [trial-2398↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1086)] [trial-2398↪nitb_sms:nanobts↪mo_mt_sms.py:11] 03:08:03.756655 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 03:08:03.763357 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1085): Terminating (SIGTERM) 03:08:03.971720 --- ParallelTerminationStrategy: PID 1085 died... 03:08:03.992337 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1085): Terminated: ok {rc=0} 03:08:04.079047 bus /sierra_3: Setting Powered False 03:08:05.179408 bus /sierra_3: Setting Powered False 03:08:06.296850 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 sms:nanobts+band-1900 --------------------------------------------------------------------- 03:08:07.479538 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:08:07.484403 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 03:08:07.507544 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 03:08:07.533450 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 03:08:07.585116 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 03:08:07.609374 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 03:08:07.636492 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 03:08:08.180673 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 03:08:08.185871 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:08.196221 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:08:08.232011 tst mo_mt_sms.py: using LAC 38124 03:08:08.347864 tst mo_mt_sms.py: using RAC 129 03:08:08.462647 tst mo_mt_sms.py: using CellId 38124 03:08:08.578917 tst mo_mt_sms.py: using BVCI 38125 03:08:08.686374 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:08.696886 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:08.707297 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:08.717631 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:08.728025 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:08.738408 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 03:08:08.853209 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 03:08:08.970518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:08:09.426249 run create_hlr_db(pid=1090): Launched 03:08:09.546357 bus /sierra_2: Setting Powered False 03:08:10.605679 run create_hlr_db(pid=1090): Terminated: ok {rc=0} 03:08:11.017326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1092): Launched 03:08:11.311612 run osmo-hlr_10.42.42.2(pid=1093): Launched 03:08:11.423653 run osmo-stp_10.42.42.5: Starting osmo-stp 03:08:11.947886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1095): Launched 03:08:12.241396 run osmo-stp_10.42.42.5(pid=1096): Launched 03:08:12.353273 run osmo-msc_10.42.42.6: Starting osmo-msc 03:08:12.884600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1098): Launched 03:08:13.179352 run osmo-msc_10.42.42.6(pid=1099): Launched 03:08:13.344360 run osmo-stp_10.42.42.5(pid=1096): ERR: Terminated: ERROR {rc=1} [trial-2398↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1096)] 03:08:13.468841 run osmo-stp_10.42.42.5(pid=1096): stdout: | (launched: 2022-12-14_03:08:12.187054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:13.593795 run osmo-stp_10.42.42.5(pid=1096): stderr: | [0;m[38;5;43m20221214030812357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030812358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030812358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030812358 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030812359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030812359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030812359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:13.716577 run osmo-stp_10.42.42.5(pid=1096): stdout: | (launched: 2022-12-14_03:08:12.187054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:13.834111 run osmo-stp_10.42.42.5(pid=1096): stderr: | [0;m[38;5;43m20221214030812357 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030812358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030812358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030812358 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030812359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030812359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030812359 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:13.974649 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=1096): Process ended prematurely: osmo-stp_10.42.42.5(pid=1096) [trial-2398↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1096)] [trial-2398↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 03:08:13.983116 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 03:08:14.009037 run osmo-hlr_10.42.42.2(pid=1093): ERR: Terminated: ERROR {rc=237} [trial-2398↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1093)] 03:08:14.056563 run osmo-hlr_10.42.42.2(pid=1093): stdout: | (launched: 2022-12-14_03:08:11.257306) 03:08:14.105920 run osmo-hlr_10.42.42.2(pid=1093): stderr: | [0;m[1;31m20221214030811434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030811434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030811434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030811434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030811434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030811434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030811447 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030811455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030811455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030811455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:08:14.174769 run osmo-msc_10.42.42.6(pid=1099): ERR: Terminated: ERROR {rc=2} [trial-2398↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1099)] 03:08:14.221739 run osmo-msc_10.42.42.6(pid=1099): stdout: | (launched: 2022-12-14_03:08:13.125539) 03:08:14.270490 run osmo-msc_10.42.42.6(pid=1099): stderr: | [0;m[38;5;43m20221214030813393 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030813394 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f56637f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030813394 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030813394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030813394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030813394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030813396 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030813396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030813396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030813396 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:08:14.319598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1092): Terminating (SIGTERM) 03:08:14.359483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1095): Terminating (SIGTERM) 03:08:14.399222 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1098): Terminating (SIGTERM) 03:08:14.439159 --- ParallelTerminationStrategy: PID 1092 died... 03:08:14.458463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1092): Terminated: ok {rc=0} 03:08:14.502451 --- ParallelTerminationStrategy: PID 1095 died... 03:08:14.521269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1095): Terminated: ok {rc=0} 03:08:14.564892 --- ParallelTerminationStrategy: PID 1098 died... 03:08:14.584024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1098): Terminated: ok {rc=0} 03:08:14.669533 bus /sierra_3: Setting Powered False 03:08:15.770563 bus /sierra_3: Setting Powered False 03:08:16.887340 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 03:08:18.110848 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:08:18.115610 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 03:08:18.138764 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 03:08:18.145511 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 03:08:18.181560 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 03:08:18.205610 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 03:08:18.212335 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 03:08:18.729569 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2398 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 03:08:18.734635 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 03:08:18.745593 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:08:18.782733 tst assert_extension.py: using LAC 38125 03:08:18.908940 tst assert_extension.py: using RAC 130 03:08:19.033717 tst assert_extension.py: using CellId 38125 03:08:19.158734 tst assert_extension.py: using BVCI 38126 03:08:19.273838 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 03:08:19.390561 tst assert_extension.py:10: start nitb and bts... 03:08:19.603745 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:08:20.246123 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1104): Launched 03:08:20.562385 run osmo-nitb_10.42.42.2(pid=1105): Launched 03:08:20.737482 run osmo-nitb_10.42.42.2(pid=1105): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1105)] 03:08:20.879580 run osmo-nitb_10.42.42.2(pid=1105): stdout: | (launched: 2022-12-14_03:08:20.504793) 03:08:21.022857 run osmo-nitb_10.42.42.2(pid=1105): stderr: | (launched: 2022-12-14_03:08:20.551885) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:08:21.165991 run osmo-nitb_10.42.42.2(pid=1105): stdout: | (launched: 2022-12-14_03:08:20.504793) 03:08:21.303926 run osmo-nitb_10.42.42.2(pid=1105): stderr: | (launched: 2022-12-14_03:08:20.551885) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1105): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1105) [trial-2398↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1105)] 03:08:21.681529 tst osmo-nitb_10.42.42.2(pid=1105): stdout: | (launched: 2022-12-14_03:08:20.504793) 03:08:21.808454 tst osmo-nitb_10.42.42.2(pid=1105): stderr: | (launched: 2022-12-14_03:08:20.551885) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:08:21.958505 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=1105): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1105) [trial-2398↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1105)] [trial-2398↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 03:08:21.967476 tst assert_extension.py:12: Test FAILED (3.2 sec) 03:08:21.974555 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1104): Terminating (SIGTERM) 03:08:22.185492 --- ParallelTerminationStrategy: PID 1104 died... 03:08:22.206874 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1104): Terminated: ok {rc=0} 03:08:22.295556 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 ussd:nanobts+band-1900 --------------------------------------------------------------------- 03:08:23.463144 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:08:23.468573 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 03:08:23.492601 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 03:08:23.521793 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 03:08:23.557643 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 03:08:23.582421 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 03:08:23.609502 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 03:08:24.138712 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2398 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 03:08:24.143926 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:24.154969 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:08:24.193327 tst assert_extension.py: using LAC 38126 03:08:24.318179 tst assert_extension.py: using RAC 131 03:08:24.444280 tst assert_extension.py: using CellId 38126 03:08:24.569602 tst assert_extension.py: using BVCI 38127 03:08:24.684122 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:24.695272 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:24.706319 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:24.717248 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:24.728470 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:08:24.739714 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 03:08:24.854676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:08:25.345567 run create_hlr_db(pid=1110): Launched 03:08:25.465426 bus /sierra_2: Setting Powered False 03:08:26.528019 run create_hlr_db(pid=1110): Terminated: ok {rc=0} 03:08:26.968728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1112): Launched 03:08:27.284837 run osmo-hlr_10.42.42.2(pid=1114): Launched 03:08:27.406734 run osmo-stp_10.42.42.5: Starting osmo-stp 03:08:27.952424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1116): Launched 03:08:28.268731 run osmo-stp_10.42.42.5(pid=1117): Launched 03:08:28.390524 run osmo-msc_10.42.42.6: Starting osmo-msc 03:08:28.961384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1120): Launched 03:08:29.276316 run osmo-msc_10.42.42.6(pid=1121): Launched 03:08:29.454526 run osmo-stp_10.42.42.5(pid=1117): ERR: Terminated: ERROR {rc=1} [trial-2398↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1117)] 03:08:29.589486 run osmo-stp_10.42.42.5(pid=1117): stdout: | (launched: 2022-12-14_03:08:28.211382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:29.724422 run osmo-stp_10.42.42.5(pid=1117): stderr: | [0;m[38;5;43m20221214030828404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030828404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030828404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030828405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030828405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030828405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030828405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:29.859832 run osmo-stp_10.42.42.5(pid=1117): stdout: | (launched: 2022-12-14_03:08:28.211382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:29.986242 run osmo-stp_10.42.42.5(pid=1117): stderr: | [0;m[38;5;43m20221214030828404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030828404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030828404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030828405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030828405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030828405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030828405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:30.137536 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=1117): Process ended prematurely: osmo-stp_10.42.42.5(pid=1117) [trial-2398↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1117)] [trial-2398↪ussd:nanobts+band-1900↪assert_extension.py:17] 03:08:30.146391 tst assert_extension.py:17: Test FAILED (6.0 sec) 03:08:30.173602 run osmo-hlr_10.42.42.2(pid=1114): ERR: Terminated: ERROR {rc=237} [trial-2398↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1114)] 03:08:30.224348 run osmo-hlr_10.42.42.2(pid=1114): stdout: | (launched: 2022-12-14_03:08:27.227211) 03:08:30.276774 run osmo-hlr_10.42.42.2(pid=1114): stderr: | [0;m[1;31m20221214030827427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030827427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030827427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030827427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030827427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030827427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030827439 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030827449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030827449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030827449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:08:30.349727 run osmo-msc_10.42.42.6(pid=1121): ERR: Terminated: ERROR {rc=2} [trial-2398↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1121)] 03:08:30.399498 run osmo-msc_10.42.42.6(pid=1121): stdout: | (launched: 2022-12-14_03:08:29.218959) 03:08:30.451441 run osmo-msc_10.42.42.6(pid=1121): stderr: | [0;m[38;5;43m20221214030829539 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030829539 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa56d88dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030829539 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030829539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030829540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030829540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030829541 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030829542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030829542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030829542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:08:30.503881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1112): Terminating (SIGTERM) 03:08:30.545487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1116): Terminating (SIGTERM) 03:08:30.587483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1120): Terminating (SIGTERM) 03:08:30.629788 --- ParallelTerminationStrategy: PID 1112 died... 03:08:30.650141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1112): Terminated: ok {rc=0} 03:08:30.696590 --- ParallelTerminationStrategy: PID 1116 died... 03:08:30.716861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1116): Terminated: ok {rc=0} 03:08:30.763114 --- ParallelTerminationStrategy: PID 1120 died... 03:08:30.782989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1120): Terminated: ok {rc=0} 03:08:30.883813 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:08:32.087672 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:08:32.102114 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:08:32.132085 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:08:32.168087 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:08:32.232337 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:08:32.270619 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:08:32.302775 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:08:32.836326 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:08:32.889849 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:32.901768 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:08:32.962598 tst mo_mt_call.py: using LAC 38127 03:08:33.089419 tst mo_mt_call.py: using RAC 132 03:08:33.216472 tst mo_mt_call.py: using CellId 38127 03:08:33.346142 tst mo_mt_call.py: using BVCI 38128 03:08:33.463866 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:33.475458 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:33.486868 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:33.498355 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:33.510193 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:33.521881 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:08:33.638733 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:08:33.757280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:08:34.220941 run create_hlr_db(pid=1130): Launched 03:08:34.345490 bus /sierra_2: Setting Powered False 03:08:35.405182 run create_hlr_db(pid=1130): Terminated: ok {rc=0} 03:08:35.822014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1132): Launched 03:08:36.120302 run osmo-hlr_10.42.42.2(pid=1133): Launched 03:08:36.234167 run osmo-stp_10.42.42.5: Starting osmo-stp 03:08:36.762657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1140): Launched 03:08:37.059514 run osmo-stp_10.42.42.5(pid=1141): Launched 03:08:37.172287 run osmo-msc_10.42.42.6: Starting osmo-msc 03:08:37.712829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1144): Launched 03:08:38.010561 run osmo-msc_10.42.42.6(pid=1145): Launched 03:08:38.177580 run osmo-stp_10.42.42.5(pid=1141): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1141)] 03:08:38.303968 run osmo-stp_10.42.42.5(pid=1141): stdout: | (launched: 2022-12-14_03:08:37.005296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:38.429708 run osmo-stp_10.42.42.5(pid=1141): stderr: | [0;m[38;5;43m20221214030837175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030837175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030837176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030837176 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030837176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030837177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030837177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:38.554147 run osmo-stp_10.42.42.5(pid=1141): stdout: | (launched: 2022-12-14_03:08:37.005296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:38.673076 run osmo-stp_10.42.42.5(pid=1141): stderr: | [0;m[38;5;43m20221214030837175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030837175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030837176 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030837176 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030837176 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030837177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030837177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:38.815004 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1141): Process ended prematurely: osmo-stp_10.42.42.5(pid=1141) [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1141)] [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:08:38.823809 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 03:08:38.850066 run osmo-hlr_10.42.42.2(pid=1133): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1133)] 03:08:38.897062 run osmo-hlr_10.42.42.2(pid=1133): stdout: | (launched: 2022-12-14_03:08:36.065658) 03:08:38.945913 run osmo-hlr_10.42.42.2(pid=1133): stderr: | [0;m[1;31m20221214030836239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030836239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030836239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030836239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030836239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030836239 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030836251 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030836261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030836261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030836261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:08:39.014072 run osmo-msc_10.42.42.6(pid=1145): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1145)] 03:08:39.061093 run osmo-msc_10.42.42.6(pid=1145): stdout: | (launched: 2022-12-14_03:08:37.955912) 03:08:39.109691 run osmo-msc_10.42.42.6(pid=1145): stderr: | [0;m[38;5;43m20221214030838223 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030838224 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7b1911bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030838224 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030838224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030838224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030838224 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030838226 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030838226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030838226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030838226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:08:39.158848 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1132): Terminating (SIGTERM) 03:08:39.197904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1140): Terminating (SIGTERM) 03:08:39.236853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1144): Terminating (SIGTERM) 03:08:39.276220 --- ParallelTerminationStrategy: PID 1132 died... 03:08:39.295005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1132): Terminated: ok {rc=0} 03:08:39.338485 --- ParallelTerminationStrategy: PID 1140 died... 03:08:39.356673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1140): Terminated: ok {rc=0} 03:08:39.400033 --- ParallelTerminationStrategy: PID 1144 died... 03:08:39.418530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1144): Terminated: ok {rc=0} 03:08:39.501702 bus /sierra_3: Setting Powered False 03:08:40.599133 bus /sierra_3: Setting Powered False 03:08:41.716103 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:08:42.860688 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:42.872417 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:08:42.932060 tst mo_mt_call_osmux.py: using LAC 38128 03:08:43.049048 tst mo_mt_call_osmux.py: using RAC 133 03:08:43.166062 tst mo_mt_call_osmux.py: using CellId 38128 03:08:43.283425 tst mo_mt_call_osmux.py: using BVCI 38129 03:08:43.393164 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:43.404213 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:43.415043 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:43.425885 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:43.436770 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:08:43.447735 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:08:43.563357 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:08:43.683746 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:08:44.180275 run create_hlr_db(pid=1147): Launched 03:08:44.303105 bus /sierra_2: Setting Powered False 03:08:45.366763 run create_hlr_db(pid=1147): Terminated: ok {rc=0} 03:08:45.812761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1149): Launched 03:08:46.170708 run osmo-hlr_10.42.42.2(pid=1150): Launched 03:08:46.361903 run osmo-stp_10.42.42.5: Starting osmo-stp 03:08:47.181171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1152): Launched 03:08:47.518827 run osmo-stp_10.42.42.5(pid=1153): Launched 03:08:47.642138 run osmo-msc_10.42.42.6: Starting osmo-msc 03:08:48.223823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1155): Launched 03:08:48.546246 run osmo-msc_10.42.42.6(pid=1156): Launched 03:08:48.725993 run osmo-stp_10.42.42.5(pid=1153): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1153)] 03:08:48.862071 run osmo-stp_10.42.42.5(pid=1153): stdout: | (launched: 2022-12-14_03:08:47.458690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:48.998586 run osmo-stp_10.42.42.5(pid=1153): stderr: | [0;m[38;5;43m20221214030847653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030847653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030847653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030847654 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030847654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030847654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030847654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:49.134736 run osmo-stp_10.42.42.5(pid=1153): stdout: | (launched: 2022-12-14_03:08:47.458690) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:49.263210 run osmo-stp_10.42.42.5(pid=1153): stderr: | [0;m[38;5;43m20221214030847653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030847653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030847653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030847654 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030847654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030847654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030847654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:08:49.417688 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1153): Process ended prematurely: osmo-stp_10.42.42.5(pid=1153) [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1153)] [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:08:49.427349 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 03:08:49.455107 run osmo-hlr_10.42.42.2(pid=1150): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1150)] 03:08:49.505938 run osmo-hlr_10.42.42.2(pid=1150): stdout: | (launched: 2022-12-14_03:08:46.093611) 03:08:49.558029 run osmo-hlr_10.42.42.2(pid=1150): stderr: | [0;m[1;31m20221214030846531 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030846532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030846532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030846532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030846532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030846532 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030846555 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030846571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030846571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030846571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:08:49.631231 run osmo-msc_10.42.42.6(pid=1156): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1156)] 03:08:49.681512 run osmo-msc_10.42.42.6(pid=1156): stdout: | (launched: 2022-12-14_03:08:48.487475) 03:08:49.733939 run osmo-msc_10.42.42.6(pid=1156): stderr: | [0;m[38;5;43m20221214030848809 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030848809 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb968700c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030848809 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030848809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030848809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030848810 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030848811 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030848811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030848812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030848812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:08:49.786329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1149): Terminating (SIGTERM) 03:08:49.828207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1152): Terminating (SIGTERM) 03:08:49.870344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1155): Terminating (SIGTERM) 03:08:49.912740 --- ParallelTerminationStrategy: PID 1149 died... 03:08:49.933286 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1149): Terminated: ok {rc=0} 03:08:49.979414 --- ParallelTerminationStrategy: PID 1152 died... 03:08:49.999372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1152): Terminated: ok {rc=0} 03:08:50.045495 --- ParallelTerminationStrategy: PID 1155 died... 03:08:50.065524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1155): Terminated: ok {rc=0} 03:08:50.153102 bus /sierra_3: Setting Powered False 03:08:51.251230 bus /sierra_3: Setting Powered False 03:08:52.369137 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:08:53.616527 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:08:53.624689 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:08:53.648834 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:08:53.677480 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:08:53.731439 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:08:53.756145 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:08:53.783682 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:08:54.330153 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:08:54.378062 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:08:54.389329 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:08:54.452176 tst mo_mt_call.py: using LAC 38129 03:08:54.572248 tst mo_mt_call.py: using RAC 134 03:08:54.689922 tst mo_mt_call.py: using CellId 38129 03:08:54.805091 tst mo_mt_call.py: using BVCI 38130 03:08:54.912649 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:08:54.923786 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:08:54.934614 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:08:54.945489 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:08:54.956635 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:08:54.967546 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:08:55.083342 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:08:55.200865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:08:55.665374 run create_hlr_db(pid=1161): Launched 03:08:55.788276 bus /sierra_2: Setting Powered False 03:08:56.848345 run create_hlr_db(pid=1161): Terminated: ok {rc=0} 03:08:57.265637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1163): Launched 03:08:57.563619 run osmo-hlr_10.42.42.2(pid=1164): Launched 03:08:57.678853 run osmo-stp_10.42.42.5: Starting osmo-stp 03:08:58.209465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1166): Launched 03:08:58.508662 run osmo-stp_10.42.42.5(pid=1167): Launched 03:08:58.622830 run osmo-msc_10.42.42.6: Starting osmo-msc 03:08:59.164573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1169): Launched 03:08:59.463948 run osmo-msc_10.42.42.6(pid=1170): Launched 03:08:59.631295 run osmo-stp_10.42.42.5(pid=1167): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1167)] 03:08:59.758972 run osmo-stp_10.42.42.5(pid=1167): stdout: | (launched: 2022-12-14_03:08:58.453654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:08:59.885608 run osmo-stp_10.42.42.5(pid=1167): stderr: | [0;m[38;5;43m20221214030858623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030858624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030858624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030858624 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030858625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030858625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030858625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:00.010133 run osmo-stp_10.42.42.5(pid=1167): stdout: | (launched: 2022-12-14_03:08:58.453654) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:00.129457 run osmo-stp_10.42.42.5(pid=1167): stderr: | [0;m[38;5;43m20221214030858623 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030858624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030858624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030858624 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030858625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030858625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030858625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:00.271722 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1167): Process ended prematurely: osmo-stp_10.42.42.5(pid=1167) [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1167)] [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:09:00.280514 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 03:09:00.306619 run osmo-hlr_10.42.42.2(pid=1164): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1164)] 03:09:00.353833 run osmo-hlr_10.42.42.2(pid=1164): stdout: | (launched: 2022-12-14_03:08:57.508835) 03:09:00.402850 run osmo-hlr_10.42.42.2(pid=1164): stderr: | [0;m[1;31m20221214030857683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030857683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030857683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030857683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030857683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030857683 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030857696 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030857706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030857706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030857706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:00.471347 run osmo-msc_10.42.42.6(pid=1170): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1170)] 03:09:00.518604 run osmo-msc_10.42.42.6(pid=1170): stdout: | (launched: 2022-12-14_03:08:59.409148) 03:09:00.567831 run osmo-msc_10.42.42.6(pid=1170): stderr: | [0;m[38;5;43m20221214030859679 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030859679 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f23b10d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030859679 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030859679 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030859680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030859680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030859682 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030859682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030859682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030859682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:00.617298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1163): Terminating (SIGTERM) 03:09:00.656860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1166): Terminating (SIGTERM) 03:09:00.696446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1169): Terminating (SIGTERM) 03:09:00.736383 --- ParallelTerminationStrategy: PID 1163 died... 03:09:00.755411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1163): Terminated: ok {rc=0} 03:09:00.799244 --- ParallelTerminationStrategy: PID 1166 died... 03:09:00.817932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1166): Terminated: ok {rc=0} 03:09:00.872407 --- ParallelTerminationStrategy: PID 1169 died... 03:09:00.897447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1169): Terminated: ok {rc=0} 03:09:00.983674 bus /sierra_3: Setting Powered False 03:09:02.108708 bus /sierra_3: Setting Powered False 03:09:03.282784 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:09:04.448902 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:04.461609 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:09:04.524028 tst mo_mt_call_osmux.py: using LAC 38130 03:09:04.644722 tst mo_mt_call_osmux.py: using RAC 135 03:09:04.763942 tst mo_mt_call_osmux.py: using CellId 38130 03:09:04.884510 tst mo_mt_call_osmux.py: using BVCI 38131 03:09:04.996478 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:05.008444 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:05.020220 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:05.032545 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:05.044527 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:09:05.056470 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:09:05.177129 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:09:05.297630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:09:05.800570 run create_hlr_db(pid=1446): Launched 03:09:05.959679 bus /sierra_2: Setting Powered False 03:09:07.020218 run create_hlr_db(pid=1446): Terminated: ok {rc=0} 03:09:07.455713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1448): Launched 03:09:07.782282 run osmo-hlr_10.42.42.2(pid=1449): Launched 03:09:08.023566 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:08.718819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1451): Launched 03:09:09.043457 run osmo-stp_10.42.42.5(pid=1452): Launched 03:09:09.284523 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:10.020533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1454): Launched 03:09:10.351902 run osmo-msc_10.42.42.6(pid=1455): Launched 03:09:10.713477 run osmo-stp_10.42.42.5(pid=1452): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1452)] 03:09:10.976759 run osmo-stp_10.42.42.5(pid=1452): stdout: | (launched: 2022-12-14_03:09:08.986882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:11.256317 run osmo-stp_10.42.42.5(pid=1452): stderr: | [0;m[38;5;43m20221214030909319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030909319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030909319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030909319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030909320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030909320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030909320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:11.432224 run osmo-stp_10.42.42.5(pid=1452): stdout: | (launched: 2022-12-14_03:09:08.986882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:11.558615 run osmo-stp_10.42.42.5(pid=1452): stderr: | [0;m[38;5;43m20221214030909319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030909319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030909319 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030909319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030909320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030909320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030909320 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:11.709645 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1452): Process ended prematurely: osmo-stp_10.42.42.5(pid=1452) [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1452)] [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:09:11.719635 tst mo_mt_call_osmux.py:8: Test FAILED (7.3 sec) 03:09:11.747526 run osmo-hlr_10.42.42.2(pid=1449): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1449)] 03:09:11.798456 run osmo-hlr_10.42.42.2(pid=1449): stdout: | (launched: 2022-12-14_03:09:07.722254) 03:09:11.850224 run osmo-hlr_10.42.42.2(pid=1449): stderr: | [0;m[1;31m20221214030908066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030908066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030908066 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030908067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030908067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030908067 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030908080 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030908093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030908093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030908093 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:11.924865 run osmo-msc_10.42.42.6(pid=1455): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1455)] 03:09:11.974902 run osmo-msc_10.42.42.6(pid=1455): stdout: | (launched: 2022-12-14_03:09:10.287567) 03:09:12.026393 run osmo-msc_10.42.42.6(pid=1455): stderr: | [0;m[38;5;43m20221214030910889 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030910889 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f62b1a92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030910890 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030910890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030910890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030910890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030910892 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030910892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030910892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030910892 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:12.078559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1448): Terminating (SIGTERM) 03:09:12.121380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1451): Terminating (SIGTERM) 03:09:12.165214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1454): Terminating (SIGTERM) 03:09:12.209157 --- ParallelTerminationStrategy: PID 1448 died... 03:09:12.228818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1448): Terminated: ok {rc=0} 03:09:12.275584 --- ParallelTerminationStrategy: PID 1451 died... 03:09:12.294974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1451): Terminated: ok {rc=0} 03:09:12.341258 --- ParallelTerminationStrategy: PID 1454 died... 03:09:12.361379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1454): Terminated: ok {rc=0} 03:09:12.451561 bus /sierra_3: Setting Powered False 03:09:13.551516 bus /sierra_3: Setting Powered False 03:09:14.670788 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:09:15.953529 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:09:15.975687 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:09:16.012191 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:09:16.061138 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:09:16.130003 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:09:16.167879 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:09:16.203696 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:09:16.774020 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:09:16.853335 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:16.868678 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:09:16.939885 tst mo_mt_call.py: using LAC 38131 03:09:17.068846 tst mo_mt_call.py: using RAC 136 03:09:17.232077 tst mo_mt_call.py: using CellId 38131 03:09:17.385105 tst mo_mt_call.py: using BVCI 38132 03:09:17.546100 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:17.558598 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:17.570915 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:17.583173 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:17.596158 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:17.609109 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:09:17.765629 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:09:17.937621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:09:18.443618 run create_hlr_db(pid=1460): Launched 03:09:18.608939 bus /sierra_2: Setting Powered False 03:09:19.671460 run create_hlr_db(pid=1460): Terminated: ok {rc=0} 03:09:20.111572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1462): Launched 03:09:20.438320 run osmo-hlr_10.42.42.2(pid=1463): Launched 03:09:20.682980 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:21.336723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1465): Launched 03:09:21.675919 run osmo-stp_10.42.42.5(pid=1466): Launched 03:09:21.923249 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:22.594653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1468): Launched 03:09:22.935217 run osmo-msc_10.42.42.6(pid=1469): Launched 03:09:23.292147 run osmo-stp_10.42.42.5(pid=1466): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1466)] 03:09:23.576646 run osmo-stp_10.42.42.5(pid=1466): stdout: | (launched: 2022-12-14_03:09:21.616764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:23.748810 run osmo-stp_10.42.42.5(pid=1466): stderr: | [0;m[38;5;43m20221214030921908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030921908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030921908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030921909 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030921909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030921909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030921909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:23.890954 run osmo-stp_10.42.42.5(pid=1466): stdout: | (launched: 2022-12-14_03:09:21.616764) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:24.020539 run osmo-stp_10.42.42.5(pid=1466): stderr: | [0;m[38;5;43m20221214030921908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030921908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030921908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030921909 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030921909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030921909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030921909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:24.175830 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1466): Process ended prematurely: osmo-stp_10.42.42.5(pid=1466) [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1466)] [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:09:24.185525 tst mo_mt_call.py:8: Test FAILED (7.4 sec) 03:09:24.213620 run osmo-hlr_10.42.42.2(pid=1463): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1463)] 03:09:24.265242 run osmo-hlr_10.42.42.2(pid=1463): stdout: | (launched: 2022-12-14_03:09:20.381699) 03:09:24.318149 run osmo-hlr_10.42.42.2(pid=1463): stderr: | [0;m[1;31m20221214030920724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030920724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030920724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030920724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030920724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030920724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030920747 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030920755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030920755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030920755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:24.391990 run osmo-msc_10.42.42.6(pid=1469): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1469)] 03:09:24.442451 run osmo-msc_10.42.42.6(pid=1469): stdout: | (launched: 2022-12-14_03:09:22.875979) 03:09:24.495606 run osmo-msc_10.42.42.6(pid=1469): stderr: | [0;m[38;5;43m20221214030923372 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030923372 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4b81f05c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030923372 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030923372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030923372 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030923377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030923379 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030923379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030923379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030923379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:24.548426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1462): Terminating (SIGTERM) 03:09:24.590420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1465): Terminating (SIGTERM) 03:09:24.632738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1468): Terminating (SIGTERM) 03:09:24.675719 --- ParallelTerminationStrategy: PID 1462 died... 03:09:24.696710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1462): Terminated: ok {rc=0} 03:09:24.743344 --- ParallelTerminationStrategy: PID 1465 died... 03:09:24.763211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1465): Terminated: ok {rc=0} 03:09:24.809587 --- ParallelTerminationStrategy: PID 1468 died... 03:09:24.829412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1468): Terminated: ok {rc=0} 03:09:24.917961 bus /sierra_3: Setting Powered False 03:09:26.014117 bus /sierra_3: Setting Powered False 03:09:27.126120 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:09:28.274885 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:28.287455 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:09:28.349607 tst mo_mt_call_osmux.py: using LAC 38132 03:09:28.478220 tst mo_mt_call_osmux.py: using RAC 137 03:09:28.607223 tst mo_mt_call_osmux.py: using CellId 38132 03:09:28.734622 tst mo_mt_call_osmux.py: using BVCI 38133 03:09:28.854404 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:28.866262 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:28.878009 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:28.890006 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:28.902170 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:09:28.914237 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:09:29.035429 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:09:29.153554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:09:29.622121 run create_hlr_db(pid=1472): Launched 03:09:29.750636 bus /sierra_2: Setting Powered False 03:09:30.815148 run create_hlr_db(pid=1472): Terminated: ok {rc=0} 03:09:31.301730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1474): Launched 03:09:31.620548 run osmo-hlr_10.42.42.2(pid=1475): Launched 03:09:31.860640 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:32.584477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1477): Launched 03:09:32.908607 run osmo-stp_10.42.42.5(pid=1478): Launched 03:09:33.032730 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:33.629051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1480): Launched 03:09:33.954865 run osmo-msc_10.42.42.6(pid=1481): Launched 03:09:34.136342 run osmo-stp_10.42.42.5(pid=1478): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1478)] 03:09:34.273879 run osmo-stp_10.42.42.5(pid=1478): stdout: | (launched: 2022-12-14_03:09:32.849696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:34.412510 run osmo-stp_10.42.42.5(pid=1478): stderr: | [0;m[38;5;43m20221214030933042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030933042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030933042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030933043 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030933043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030933043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030933043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:34.549578 run osmo-stp_10.42.42.5(pid=1478): stdout: | (launched: 2022-12-14_03:09:32.849696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:34.679743 run osmo-stp_10.42.42.5(pid=1478): stderr: | [0;m[38;5;43m20221214030933042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030933042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030933042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030933043 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030933043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030933043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030933043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:34.836104 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1478): Process ended prematurely: osmo-stp_10.42.42.5(pid=1478) [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1478)] [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:09:34.845754 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 03:09:34.873472 run osmo-hlr_10.42.42.2(pid=1475): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1475)] 03:09:34.924518 run osmo-hlr_10.42.42.2(pid=1475): stdout: | (launched: 2022-12-14_03:09:31.563672) 03:09:34.976518 run osmo-hlr_10.42.42.2(pid=1475): stderr: | [0;m[1;31m20221214030931904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030931904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030931904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030931904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030931904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030931904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030931931 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030931947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030931948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030931948 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:35.049886 run osmo-msc_10.42.42.6(pid=1481): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1481)] 03:09:35.100128 run osmo-msc_10.42.42.6(pid=1481): stdout: | (launched: 2022-12-14_03:09:33.895542) 03:09:35.152253 run osmo-msc_10.42.42.6(pid=1481): stderr: | [0;m[38;5;43m20221214030934217 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030934217 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3acc753c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030934217 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030934217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030934217 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030934218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030934219 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030934220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030934220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030934220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:35.205273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1474): Terminating (SIGTERM) 03:09:35.247096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1477): Terminating (SIGTERM) 03:09:35.289360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1480): Terminating (SIGTERM) 03:09:35.332442 --- ParallelTerminationStrategy: PID 1474 died... 03:09:35.352931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1474): Terminated: ok {rc=0} 03:09:35.399677 --- ParallelTerminationStrategy: PID 1477 died... 03:09:35.419612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1477): Terminated: ok {rc=0} 03:09:35.466083 --- ParallelTerminationStrategy: PID 1480 died... 03:09:35.485979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1480): Terminated: ok {rc=0} 03:09:35.574856 bus /sierra_3: Setting Powered False 03:09:36.673773 bus /sierra_3: Setting Powered False 03:09:37.789927 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:09:39.036328 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:09:39.044520 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:09:39.068850 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:09:39.096627 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:09:39.148660 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:09:39.172932 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:09:39.200512 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:09:39.750977 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:09:39.799119 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:39.810214 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:09:39.866949 tst mo_mt_call.py: using LAC 38133 03:09:39.982682 tst mo_mt_call.py: using RAC 138 03:09:40.099575 tst mo_mt_call.py: using CellId 38133 03:09:40.216725 tst mo_mt_call.py: using BVCI 38134 03:09:40.325500 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:40.336563 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:40.347563 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:40.358469 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:40.369540 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:40.380459 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:09:40.502506 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:09:40.622726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:09:41.124072 run create_hlr_db(pid=1486): Launched 03:09:41.247569 bus /sierra_2: Setting Powered False 03:09:42.311364 run create_hlr_db(pid=1486): Terminated: ok {rc=0} 03:09:42.743116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1488): Launched 03:09:43.044887 run osmo-hlr_10.42.42.2(pid=1489): Launched 03:09:43.162243 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:43.682744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1491): Launched 03:09:43.984724 run osmo-stp_10.42.42.5(pid=1492): Launched 03:09:44.100904 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:44.648748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1494): Launched 03:09:44.952191 run osmo-msc_10.42.42.6(pid=1495): Launched 03:09:45.121835 run osmo-stp_10.42.42.5(pid=1492): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1492)] 03:09:45.250534 run osmo-stp_10.42.42.5(pid=1492): stdout: | (launched: 2022-12-14_03:09:43.929392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:45.379356 run osmo-stp_10.42.42.5(pid=1492): stderr: | [0;m[38;5;43m20221214030944098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030944098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030944099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030944099 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030944099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030944099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030944099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:45.505438 run osmo-stp_10.42.42.5(pid=1492): stdout: | (launched: 2022-12-14_03:09:43.929392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:45.626054 run osmo-stp_10.42.42.5(pid=1492): stderr: | [0;m[38;5;43m20221214030944098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030944098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030944099 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030944099 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030944099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030944099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030944099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:45.770301 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1492): Process ended prematurely: osmo-stp_10.42.42.5(pid=1492) [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1492)] [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:09:45.779320 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 03:09:45.805692 run osmo-hlr_10.42.42.2(pid=1489): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1489)] 03:09:45.868146 run osmo-hlr_10.42.42.2(pid=1489): stdout: | (launched: 2022-12-14_03:09:42.989884) 03:09:45.929310 run osmo-hlr_10.42.42.2(pid=1489): stderr: | [0;m[1;31m20221214030943163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030943163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030943163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030943164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030943164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030943164 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030943178 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030943186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030943186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030943186 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:45.999905 run osmo-msc_10.42.42.6(pid=1495): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1495)] 03:09:46.049254 run osmo-msc_10.42.42.6(pid=1495): stdout: | (launched: 2022-12-14_03:09:44.895772) 03:09:46.099786 run osmo-msc_10.42.42.6(pid=1495): stderr: | [0;m[38;5;43m20221214030945166 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030945166 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f076bec3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030945166 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030945166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030945166 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030945167 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030945168 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030945169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030945169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030945169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:46.150593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1488): Terminating (SIGTERM) 03:09:46.192269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1491): Terminating (SIGTERM) 03:09:46.234835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1494): Terminating (SIGTERM) 03:09:46.276258 --- ParallelTerminationStrategy: PID 1488 died... 03:09:46.295573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1488): Terminated: ok {rc=0} 03:09:46.340783 --- ParallelTerminationStrategy: PID 1491 died... 03:09:46.360238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1491): Terminated: ok {rc=0} 03:09:46.405320 --- ParallelTerminationStrategy: PID 1494 died... 03:09:46.424634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1494): Terminated: ok {rc=0} 03:09:46.511489 bus /sierra_3: Setting Powered False 03:09:47.610320 bus /sierra_3: Setting Powered False 03:09:48.726930 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:09:49.870076 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:49.882113 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:09:49.941986 tst mo_mt_call_osmux.py: using LAC 38134 03:09:50.071938 tst mo_mt_call_osmux.py: using RAC 139 03:09:50.201393 tst mo_mt_call_osmux.py: using CellId 38134 03:09:50.331233 tst mo_mt_call_osmux.py: using BVCI 38135 03:09:50.449935 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:50.461865 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:50.473612 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:50.485213 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:50.497727 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:09:50.510115 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:09:50.630076 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:09:50.745488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:09:51.214609 run create_hlr_db(pid=1497): Launched 03:09:51.339585 bus /sierra_2: Setting Powered False 03:09:52.399583 run create_hlr_db(pid=1497): Terminated: ok {rc=0} 03:09:52.822088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1499): Launched 03:09:53.124383 run osmo-hlr_10.42.42.2(pid=1500): Launched 03:09:53.238998 run osmo-stp_10.42.42.5: Starting osmo-stp 03:09:53.763142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1502): Launched 03:09:54.064922 run osmo-stp_10.42.42.5(pid=1503): Launched 03:09:54.180915 run osmo-msc_10.42.42.6: Starting osmo-msc 03:09:54.728252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1505): Launched 03:09:55.030621 run osmo-msc_10.42.42.6(pid=1506): Launched 03:09:55.199963 run osmo-stp_10.42.42.5(pid=1503): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1503)] 03:09:55.328004 run osmo-stp_10.42.42.5(pid=1503): stdout: | (launched: 2022-12-14_03:09:54.009666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:55.456413 run osmo-stp_10.42.42.5(pid=1503): stderr: | [0;m[38;5;43m20221214030954181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030954181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030954181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030954182 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030954182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030954182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030954182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:55.582140 run osmo-stp_10.42.42.5(pid=1503): stdout: | (launched: 2022-12-14_03:09:54.009666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:09:55.702521 run osmo-stp_10.42.42.5(pid=1503): stderr: | [0;m[38;5;43m20221214030954181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214030954181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214030954181 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214030954182 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214030954182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214030954182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214030954182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:09:55.846916 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1503): Process ended prematurely: osmo-stp_10.42.42.5(pid=1503) [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1503)] [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:09:55.855931 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 03:09:55.882576 run osmo-hlr_10.42.42.2(pid=1500): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1500)] 03:09:55.930596 run osmo-hlr_10.42.42.2(pid=1500): stdout: | (launched: 2022-12-14_03:09:53.068892) 03:09:55.980076 run osmo-hlr_10.42.42.2(pid=1500): stderr: | [0;m[1;31m20221214030953243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214030953243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214030953243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214030953243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214030953243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214030953243 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214030953255 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214030953264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214030953264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214030953265 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:09:56.049166 run osmo-msc_10.42.42.6(pid=1506): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1506)] 03:09:56.096700 run osmo-msc_10.42.42.6(pid=1506): stdout: | (launched: 2022-12-14_03:09:54.974551) 03:09:56.146659 run osmo-msc_10.42.42.6(pid=1506): stderr: | [0;m[38;5;43m20221214030955245 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214030955245 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0511de9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214030955245 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214030955245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214030955245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214030955245 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214030955247 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214030955247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214030955248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214030955248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:09:56.196211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1499): Terminating (SIGTERM) 03:09:56.235879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1502): Terminating (SIGTERM) 03:09:56.275470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1505): Terminating (SIGTERM) 03:09:56.315416 --- ParallelTerminationStrategy: PID 1499 died... 03:09:56.334819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1499): Terminated: ok {rc=0} 03:09:56.379218 --- ParallelTerminationStrategy: PID 1502 died... 03:09:56.397998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1502): Terminated: ok {rc=0} 03:09:56.441804 --- ParallelTerminationStrategy: PID 1505 died... 03:09:56.460366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1505): Terminated: ok {rc=0} 03:09:56.545809 bus /sierra_3: Setting Powered False 03:09:57.644436 bus /sierra_3: Setting Powered False 03:09:58.761219 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:09:59.999378 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:10:00.006888 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:10:00.030286 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:10:00.056720 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:10:00.107528 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:10:00.131098 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:10:00.157527 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:10:00.713212 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:10:00.766195 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:00.778050 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:10:00.849194 tst mo_mt_call.py: using LAC 38135 03:10:00.986303 tst mo_mt_call.py: using RAC 140 03:10:01.115049 tst mo_mt_call.py: using CellId 38135 03:10:01.273343 tst mo_mt_call.py: using BVCI 38136 03:10:01.420877 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:01.432908 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:01.444795 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:01.456830 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:01.468756 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:01.480541 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:10:01.596672 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:10:01.738014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:10:02.263553 run create_hlr_db(pid=1518): Launched 03:10:02.429145 bus /sierra_2: Setting Powered False 03:10:03.493717 run create_hlr_db(pid=1518): Terminated: ok {rc=0} 03:10:03.925651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1520): Launched 03:10:04.228202 run osmo-hlr_10.42.42.2(pid=1521): Launched 03:10:04.342645 run osmo-stp_10.42.42.5: Starting osmo-stp 03:10:04.862447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1523): Launched 03:10:05.164902 run osmo-stp_10.42.42.5(pid=1524): Launched 03:10:05.280013 run osmo-msc_10.42.42.6: Starting osmo-msc 03:10:05.830986 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1526): Launched 03:10:06.133308 run osmo-msc_10.42.42.6(pid=1527): Launched 03:10:06.302101 run osmo-stp_10.42.42.5(pid=1524): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1524)] 03:10:06.429708 run osmo-stp_10.42.42.5(pid=1524): stdout: | (launched: 2022-12-14_03:10:05.108657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:06.557335 run osmo-stp_10.42.42.5(pid=1524): stderr: | [0;m[38;5;43m20221214031005279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031005280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031005280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031005280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031005281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031005281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031005281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:06.683518 run osmo-stp_10.42.42.5(pid=1524): stdout: | (launched: 2022-12-14_03:10:05.108657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:06.803811 run osmo-stp_10.42.42.5(pid=1524): stderr: | [0;m[38;5;43m20221214031005279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031005280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031005280 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031005280 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031005281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031005281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031005281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:06.947749 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1524): Process ended prematurely: osmo-stp_10.42.42.5(pid=1524) [trial-2398↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1524)] [trial-2398↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:10:06.956616 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:10:06.983179 run osmo-hlr_10.42.42.2(pid=1521): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1521)] 03:10:07.030884 run osmo-hlr_10.42.42.2(pid=1521): stdout: | (launched: 2022-12-14_03:10:04.172405) 03:10:07.080435 run osmo-hlr_10.42.42.2(pid=1521): stderr: | [0;m[1;31m20221214031004350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031004350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031004350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031004350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031004350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031004350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031004366 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031004374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031004374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031004374 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:10:07.149883 run osmo-msc_10.42.42.6(pid=1527): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1527)] 03:10:07.197785 run osmo-msc_10.42.42.6(pid=1527): stdout: | (launched: 2022-12-14_03:10:06.077686) 03:10:07.246975 run osmo-msc_10.42.42.6(pid=1527): stderr: | [0;m[38;5;43m20221214031006351 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031006351 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4b3f8cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031006352 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031006352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031006352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031006352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031006354 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031006354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031006354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031006354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:10:07.296834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1520): Terminating (SIGTERM) 03:10:07.336466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1523): Terminating (SIGTERM) 03:10:07.376039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1526): Terminating (SIGTERM) 03:10:07.415869 --- ParallelTerminationStrategy: PID 1520 died... 03:10:07.435000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1520): Terminated: ok {rc=0} 03:10:07.478780 --- ParallelTerminationStrategy: PID 1523 died... 03:10:07.497202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1523): Terminated: ok {rc=0} 03:10:07.541496 --- ParallelTerminationStrategy: PID 1526 died... 03:10:07.560188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1526): Terminated: ok {rc=0} 03:10:07.646124 bus /sierra_3: Setting Powered False 03:10:08.746123 bus /sierra_3: Setting Powered False 03:10:09.861991 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:10:11.003999 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:11.015944 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:10:11.075457 tst mo_mt_call_osmux.py: using LAC 38136 03:10:11.208535 tst mo_mt_call_osmux.py: using RAC 141 03:10:11.336485 tst mo_mt_call_osmux.py: using CellId 38136 03:10:11.462445 tst mo_mt_call_osmux.py: using BVCI 38137 03:10:11.580698 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:11.592534 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:11.604049 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:11.615541 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:11.627525 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:10:11.639539 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:10:11.758140 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:10:11.876919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:10:12.347716 run create_hlr_db(pid=1529): Launched 03:10:12.472764 bus /sierra_2: Setting Powered False 03:10:13.532097 run create_hlr_db(pid=1529): Terminated: ok {rc=0} 03:10:13.954401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1531): Launched 03:10:14.257463 run osmo-hlr_10.42.42.2(pid=1532): Launched 03:10:14.374091 run osmo-stp_10.42.42.5: Starting osmo-stp 03:10:14.899798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1534): Launched 03:10:15.203249 run osmo-stp_10.42.42.5(pid=1535): Launched 03:10:15.318794 run osmo-msc_10.42.42.6: Starting osmo-msc 03:10:15.876411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1537): Launched 03:10:16.214087 run osmo-msc_10.42.42.6(pid=1538): Launched 03:10:16.573985 run osmo-stp_10.42.42.5(pid=1535): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1535)] 03:10:16.853786 run osmo-stp_10.42.42.5(pid=1535): stdout: | (launched: 2022-12-14_03:10:15.147865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:16.998204 run osmo-stp_10.42.42.5(pid=1535): stderr: | [0;m[38;5;43m20221214031015318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031015318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031015318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031015319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031015319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031015319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031015319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:17.125823 run osmo-stp_10.42.42.5(pid=1535): stdout: | (launched: 2022-12-14_03:10:15.147865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:17.247860 run osmo-stp_10.42.42.5(pid=1535): stderr: | [0;m[38;5;43m20221214031015318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031015318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031015318 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031015319 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031015319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031015319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031015319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:17.394964 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1535): Process ended prematurely: osmo-stp_10.42.42.5(pid=1535) [trial-2398↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1535)] [trial-2398↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:10:17.404204 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 03:10:17.430960 run osmo-hlr_10.42.42.2(pid=1532): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1532)] 03:10:17.479164 run osmo-hlr_10.42.42.2(pid=1532): stdout: | (launched: 2022-12-14_03:10:14.201946) 03:10:17.528767 run osmo-hlr_10.42.42.2(pid=1532): stderr: | [0;m[1;31m20221214031014378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031014378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031014378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031014378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031014378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031014378 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031014389 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031014397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031014398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031014398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:10:17.597620 run osmo-msc_10.42.42.6(pid=1538): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1538)] 03:10:17.644784 run osmo-msc_10.42.42.6(pid=1538): stdout: | (launched: 2022-12-14_03:10:16.156303) 03:10:17.693893 run osmo-msc_10.42.42.6(pid=1538): stderr: | [0;m[38;5;43m20221214031016664 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031016664 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f312a5fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031016664 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031016664 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031016665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031016665 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031016667 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031016668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031016668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031016668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:10:17.743232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1531): Terminating (SIGTERM) 03:10:17.782899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1534): Terminating (SIGTERM) 03:10:17.822529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1537): Terminating (SIGTERM) 03:10:17.862295 --- ParallelTerminationStrategy: PID 1531 died... 03:10:17.881457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1531): Terminated: ok {rc=0} 03:10:17.925192 --- ParallelTerminationStrategy: PID 1534 died... 03:10:17.943684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1534): Terminated: ok {rc=0} 03:10:17.987051 --- ParallelTerminationStrategy: PID 1537 died... 03:10:18.005645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1537): Terminated: ok {rc=0} 03:10:18.091259 bus /sierra_3: Setting Powered False 03:10:19.190664 bus /sierra_3: Setting Powered False 03:10:20.304273 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 emergency:nanobts+band-1900 --------------------------------------------------------------------- 03:10:21.546179 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:10:21.552250 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 03:10:21.576553 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 03:10:21.604355 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 03:10:21.690042 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 03:10:21.714373 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 03:10:21.741748 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 03:10:22.327938 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2398 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 03:10:22.333258 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:22.344458 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:10:22.387919 tst emergency_mo_mt_call.py: using LAC 38137 03:10:22.504880 tst emergency_mo_mt_call.py: using RAC 142 03:10:22.620781 tst emergency_mo_mt_call.py: using CellId 38137 03:10:22.735982 tst emergency_mo_mt_call.py: using BVCI 38138 03:10:22.843676 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:22.854622 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:22.865456 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:22.876219 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:22.886967 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:22.897604 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:23.017170 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:23.133023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:10:23.593707 run create_hlr_db(pid=1543): Launched 03:10:23.714616 bus /sierra_2: Setting Powered False 03:10:24.774579 run create_hlr_db(pid=1543): Terminated: ok {rc=0} 03:10:25.211832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1545): Launched 03:10:25.533187 run osmo-hlr_10.42.42.2(pid=1546): Launched 03:10:25.655928 run osmo-stp_10.42.42.5: Starting osmo-stp 03:10:26.210271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1548): Launched 03:10:26.531473 run osmo-stp_10.42.42.5(pid=1549): Launched 03:10:26.663509 tst emergency_mo_mt_call.py: using MSISDN 8469 03:10:26.827301 run osmo-msc_10.42.42.6: Starting osmo-msc 03:10:27.402896 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1551): Launched 03:10:27.724718 run osmo-msc_10.42.42.6(pid=1552): Launched 03:10:27.902778 run osmo-stp_10.42.42.5(pid=1549): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1549)] 03:10:28.038369 run osmo-stp_10.42.42.5(pid=1549): stdout: | (launched: 2022-12-14_03:10:26.472646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:28.174882 run osmo-stp_10.42.42.5(pid=1549): stderr: | [0;m[38;5;43m20221214031026666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031026666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031026666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031026667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031026667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031026667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031026667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:28.310355 run osmo-stp_10.42.42.5(pid=1549): stdout: | (launched: 2022-12-14_03:10:26.472646) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:28.438986 run osmo-stp_10.42.42.5(pid=1549): stderr: | [0;m[38;5;43m20221214031026666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031026666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031026666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031026667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031026667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031026667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031026667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:28.591744 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1549): Process ended prematurely: osmo-stp_10.42.42.5(pid=1549) [trial-2398↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1549)] [trial-2398↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 03:10:28.600782 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 03:10:28.628127 run osmo-hlr_10.42.42.2(pid=1546): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1546)] 03:10:28.678988 run osmo-hlr_10.42.42.2(pid=1546): stdout: | (launched: 2022-12-14_03:10:25.474385) 03:10:28.731620 run osmo-hlr_10.42.42.2(pid=1546): stderr: | [0;m[1;31m20221214031025673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031025673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031025673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031025673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031025673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031025673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031025686 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031025694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031025694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031025694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:10:28.804434 run osmo-msc_10.42.42.6(pid=1552): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1552)] 03:10:28.854378 run osmo-msc_10.42.42.6(pid=1552): stdout: | (launched: 2022-12-14_03:10:27.666147) 03:10:28.907295 run osmo-msc_10.42.42.6(pid=1552): stderr: | [0;m[38;5;43m20221214031027990 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031027991 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb8ed333c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031027991 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031027991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031027991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031027991 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031027993 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031027993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031027993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031027994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:10:28.960232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1545): Terminating (SIGTERM) 03:10:29.002224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1548): Terminating (SIGTERM) 03:10:29.044411 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1551): Terminating (SIGTERM) 03:10:29.086891 --- ParallelTerminationStrategy: PID 1545 died... 03:10:29.107394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1545): Terminated: ok {rc=0} 03:10:29.154285 --- ParallelTerminationStrategy: PID 1548 died... 03:10:29.174261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1548): Terminated: ok {rc=0} 03:10:29.220783 --- ParallelTerminationStrategy: PID 1551 died... 03:10:29.241183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1551): Terminated: ok {rc=0} 03:10:29.330422 bus /sierra_3: Setting Powered False 03:10:30.428024 bus /sierra_3: Setting Powered False 03:10:31.540561 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 03:10:32.630243 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:32.642847 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:10:32.685127 tst emergency_preemptive_call.py: using LAC 38138 03:10:32.812325 tst emergency_preemptive_call.py: using RAC 143 03:10:32.952265 tst emergency_preemptive_call.py: using CellId 38138 03:10:33.081596 tst emergency_preemptive_call.py: using BVCI 38139 03:10:33.191694 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:33.202752 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:33.213570 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:33.224236 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:33.235016 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 03:10:33.246079 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:33.365855 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:33.483033 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:33.597638 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:33.715678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:10:34.213353 run create_hlr_db(pid=1554): Launched 03:10:34.337907 bus /sierra_2: Setting Powered False 03:10:35.402107 run create_hlr_db(pid=1554): Terminated: ok {rc=0} 03:10:35.829071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1556): Launched 03:10:36.126439 run osmo-hlr_10.42.42.2(pid=1557): Launched 03:10:36.239833 run osmo-stp_10.42.42.5: Starting osmo-stp 03:10:36.758094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1559): Launched 03:10:37.055847 run osmo-stp_10.42.42.5(pid=1560): Launched 03:10:37.181056 tst emergency_preemptive_call.py: using MSISDN 8470 03:10:37.334981 run osmo-msc_10.42.42.6: Starting osmo-msc 03:10:37.870327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1562): Launched 03:10:38.168510 run osmo-msc_10.42.42.6(pid=1563): Launched 03:10:38.336043 run osmo-stp_10.42.42.5(pid=1560): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1560)] 03:10:38.463307 run osmo-stp_10.42.42.5(pid=1560): stdout: | (launched: 2022-12-14_03:10:37.001244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:38.590145 run osmo-stp_10.42.42.5(pid=1560): stderr: | [0;m[38;5;43m20221214031037171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031037172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031037172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031037172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031037173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031037173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031037173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:38.714818 run osmo-stp_10.42.42.5(pid=1560): stdout: | (launched: 2022-12-14_03:10:37.001244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:38.833813 run osmo-stp_10.42.42.5(pid=1560): stderr: | [0;m[38;5;43m20221214031037171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031037172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031037172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031037172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031037173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031037173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031037173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:38.975671 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1560): Process ended prematurely: osmo-stp_10.42.42.5(pid=1560) [trial-2398↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1560)] [trial-2398↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 03:10:38.984208 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 03:10:39.010271 run osmo-hlr_10.42.42.2(pid=1557): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1557)] 03:10:39.057872 run osmo-hlr_10.42.42.2(pid=1557): stdout: | (launched: 2022-12-14_03:10:36.071757) 03:10:39.107471 run osmo-hlr_10.42.42.2(pid=1557): stderr: | [0;m[1;31m20221214031036247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031036247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031036247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031036247 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031036248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031036248 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031036260 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031036269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031036269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031036269 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:10:39.176561 run osmo-msc_10.42.42.6(pid=1563): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1563)] 03:10:39.223866 run osmo-msc_10.42.42.6(pid=1563): stdout: | (launched: 2022-12-14_03:10:38.113485) 03:10:39.273100 run osmo-msc_10.42.42.6(pid=1563): stderr: | [0;m[38;5;43m20221214031038384 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031038384 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1ee9ba0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031038384 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031038384 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031038385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031038385 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031038387 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031038387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031038387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031038387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:10:39.322445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1556): Terminating (SIGTERM) 03:10:39.361855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1559): Terminating (SIGTERM) 03:10:39.401709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1562): Terminating (SIGTERM) 03:10:39.442145 --- ParallelTerminationStrategy: PID 1556 died... 03:10:39.461272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1556): Terminated: ok {rc=0} 03:10:39.505233 --- ParallelTerminationStrategy: PID 1559 died... 03:10:39.524001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1559): Terminated: ok {rc=0} 03:10:39.567557 --- ParallelTerminationStrategy: PID 1562 died... 03:10:39.586356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1562): Terminated: ok {rc=0} 03:10:39.671816 bus /sierra_9: Setting Powered False 03:10:40.774029 bus /sierra_9: Setting Powered False 03:10:41.892346 bus /sierra_8: Setting Powered False 03:10:42.988706 bus /sierra_8: Setting Powered False 03:10:44.104169 bus /sierra_3: Setting Powered False 03:10:45.202497 bus /sierra_3: Setting Powered False 03:10:46.318262 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:nanobts+band-1900 --------------------------------------------------------------------- 03:10:47.593537 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:10:47.599876 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 03:10:47.623406 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 03:10:47.661287 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 03:10:47.745312 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 03:10:47.769556 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 03:10:47.808657 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 03:10:48.398209 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 03:10:48.447445 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:48.458065 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:10:48.494412 tst cs_paging_gprs_active.py: using LAC 38139 03:10:48.614557 tst cs_paging_gprs_active.py: using RAC 144 03:10:48.733796 tst cs_paging_gprs_active.py: using CellId 38139 03:10:48.857312 tst cs_paging_gprs_active.py: using BVCI 38140 03:10:48.969243 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:48.979975 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:48.990530 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:49.000891 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:49.011212 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:49.021624 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:49.032572 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:49.042905 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:10:49.053857 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:49.168405 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:10:49.288585 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:10:49.509731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:10:49.835905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1568): Launched 03:10:50.120863 run iperf3-srv_10.42.42.10(pid=1569): Launched 03:10:50.243324 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:10:50.463900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:10:50.790796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1570): Launched 03:10:51.076105 run iperf3-srv_10.42.42.10(pid=1571): Launched 03:10:51.198682 tst cs_paging_gprs_active.py:38: start network... 03:10:51.419243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:10:51.927517 run create_hlr_db(pid=1572): Launched 03:10:52.056385 bus /sierra_2: Setting Powered False 03:10:53.120372 run create_hlr_db(pid=1572): Terminated: ok {rc=0} 03:10:53.573319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1575): Launched 03:10:53.898915 run osmo-hlr_10.42.42.2(pid=1576): Launched 03:10:54.023262 run osmo-stp_10.42.42.5: Starting osmo-stp 03:10:54.588566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1578): Launched 03:10:54.914013 run osmo-stp_10.42.42.5(pid=1579): Launched 03:10:55.040779 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:10:55.604813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1581): Launched 03:10:55.730173 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:10:56.006221 run patchelf(pid=1582): Launched 03:10:56.188744 run osmo-stp_10.42.42.5(pid=1579): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1579)] 03:10:56.327349 run osmo-stp_10.42.42.5(pid=1579): stdout: | (launched: 2022-12-14_03:10:54.854583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:56.467503 run osmo-stp_10.42.42.5(pid=1579): stderr: | [0;m[38;5;43m20221214031055047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031055047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031055047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031055048 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031055048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031055048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031055048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:56.607064 run osmo-stp_10.42.42.5(pid=1579): stdout: | (launched: 2022-12-14_03:10:54.854583) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:10:56.741165 run osmo-stp_10.42.42.5(pid=1579): stderr: | [0;m[38;5;43m20221214031055047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031055047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031055047 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031055048 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031055048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031055048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031055048 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:10:56.900016 run patchelf(pid=1582): Terminating (SIGINT) 03:10:57.084556 run patchelf(pid=1582): Terminated: ok {rc=0} 03:10:57.217682 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1579): Process ended prematurely: osmo-stp_10.42.42.5(pid=1579) [trial-2398↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1579)] [trial-2398↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 03:10:57.227797 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 03:10:57.256096 run osmo-hlr_10.42.42.2(pid=1576): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1576)] 03:10:57.306749 run osmo-hlr_10.42.42.2(pid=1576): stdout: | (launched: 2022-12-14_03:10:53.839264) 03:10:57.358482 run osmo-hlr_10.42.42.2(pid=1576): stderr: | [0;m[1;31m20221214031054040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031054040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031054040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031054040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031054040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031054040 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031054051 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031054060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031054060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031054060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:10:57.411293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1568): Terminating (SIGTERM) 03:10:57.453022 run iperf3-srv_10.42.42.10(pid=1569): Terminating (SIGTERM) 03:10:57.494867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1570): Terminating (SIGTERM) 03:10:57.536732 run iperf3-srv_10.42.42.10(pid=1571): Terminating (SIGTERM) 03:10:57.578643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1575): Terminating (SIGTERM) 03:10:57.620521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1578): Terminating (SIGTERM) 03:10:57.662519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1581): Terminating (SIGTERM) 03:10:57.704721 --- ParallelTerminationStrategy: PID 1568 died... 03:10:57.725298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1568): Terminated: ok {rc=0} 03:10:57.771905 --- ParallelTerminationStrategy: PID 1569 died... 03:10:57.791800 run iperf3-srv_10.42.42.10(pid=1569): Terminated {rc=256} 03:10:57.838186 --- ParallelTerminationStrategy: PID 1570 died... 03:10:57.858143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1570): Terminated: ok {rc=0} 03:10:57.904443 --- ParallelTerminationStrategy: PID 1571 died... 03:10:57.924331 run iperf3-srv_10.42.42.10(pid=1571): Terminated {rc=256} 03:10:57.970402 --- ParallelTerminationStrategy: PID 1575 died... 03:10:57.990257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1575): Terminated: ok {rc=0} 03:10:58.036300 --- ParallelTerminationStrategy: PID 1578 died... 03:10:58.056164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1578): Terminated: ok {rc=0} 03:10:58.102420 --- ParallelTerminationStrategy: PID 1581 died... 03:10:58.122463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1581): Terminated: ok {rc=0} 03:10:58.211371 bus /gobi_0: Setting Powered False 03:10:59.310324 bus /gobi_0: Setting Powered False 03:11:00.426523 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 03:11:01.578148 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:01.591124 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:11:01.632329 tst iperf3.py: using LAC 38140 03:11:01.754558 tst iperf3.py: using RAC 145 03:11:01.885782 tst iperf3.py: using CellId 38140 03:11:02.046278 tst iperf3.py: using BVCI 38141 03:11:02.170957 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:02.183144 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:02.195207 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:02.207415 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:02.220753 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:02.233944 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:02.246964 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:02.259887 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:02.273245 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:02.396214 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:11:02.617488 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:02.945934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1583): Launched 03:11:03.229220 run iperf3-srv_10.42.42.10(pid=1584): Launched 03:11:03.353496 tst iperf3.py:8: start network... 03:11:03.574610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:11:04.080629 run create_hlr_db(pid=1585): Launched 03:11:04.205658 bus /gobi_6: Setting Powered False 03:11:05.266355 run create_hlr_db(pid=1585): Terminated: ok {rc=0} 03:11:05.699076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1587): Launched 03:11:06.001754 run osmo-hlr_10.42.42.2(pid=1588): Launched 03:11:06.117642 run osmo-stp_10.42.42.5: Starting osmo-stp 03:11:06.653977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1590): Launched 03:11:06.958357 run osmo-stp_10.42.42.5(pid=1591): Launched 03:11:07.073626 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:11:07.598447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1593): Launched 03:11:07.715888 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:11:07.972687 run patchelf(pid=1594): Launched 03:11:08.141926 run osmo-stp_10.42.42.5(pid=1591): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1591)] 03:11:08.270487 run osmo-stp_10.42.42.5(pid=1591): stdout: | (launched: 2022-12-14_03:11:06.903248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:08.400672 run osmo-stp_10.42.42.5(pid=1591): stderr: | [0;m[38;5;43m20221214031107072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031107072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031107072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031107073 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031107073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031107073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031107073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:08.530875 run osmo-stp_10.42.42.5(pid=1591): stdout: | (launched: 2022-12-14_03:11:06.903248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:08.655634 run osmo-stp_10.42.42.5(pid=1591): stderr: | [0;m[38;5;43m20221214031107072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031107072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031107072 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031107073 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031107073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031107073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031107073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:08.804401 run patchelf(pid=1594): Terminating (SIGINT) 03:11:08.976562 run patchelf(pid=1594): Terminated: ok {rc=0} 03:11:09.100635 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1591): Process ended prematurely: osmo-stp_10.42.42.5(pid=1591) [trial-2398↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1591)] [trial-2398↪gprs:nanobts+band-1900↪iperf3.py:8] 03:11:09.110327 tst iperf3.py:8: Test FAILED (7.6 sec) 03:11:09.137335 run osmo-hlr_10.42.42.2(pid=1588): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1588)] 03:11:09.184551 run osmo-hlr_10.42.42.2(pid=1588): stdout: | (launched: 2022-12-14_03:11:05.946385) 03:11:09.233548 run osmo-hlr_10.42.42.2(pid=1588): stderr: | [0;m[1;31m20221214031106121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031106121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031106121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031106121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031106121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031106121 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031106134 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031106144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031106144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031106144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:11:09.282951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1583): Terminating (SIGTERM) 03:11:09.322910 run iperf3-srv_10.42.42.10(pid=1584): Terminating (SIGTERM) 03:11:09.362583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1587): Terminating (SIGTERM) 03:11:09.402264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1590): Terminating (SIGTERM) 03:11:09.441951 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1593): Terminating (SIGTERM) 03:11:09.482138 --- ParallelTerminationStrategy: PID 1583 died... 03:11:09.501494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1583): Terminated: ok {rc=0} 03:11:09.545650 --- ParallelTerminationStrategy: PID 1584 died... 03:11:09.564399 run iperf3-srv_10.42.42.10(pid=1584): Terminated {rc=256} 03:11:09.608052 --- ParallelTerminationStrategy: PID 1587 died... 03:11:09.626705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1587): Terminated: ok {rc=0} 03:11:09.670144 --- ParallelTerminationStrategy: PID 1590 died... 03:11:09.688663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1590): Terminated: ok {rc=0} 03:11:09.732458 --- ParallelTerminationStrategy: PID 1593 died... 03:11:09.751140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1593): Terminated: ok {rc=0} 03:11:09.834346 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 03:11:10.985144 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:10.997372 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:11:11.038118 tst iperf3m4.py: using LAC 38141 03:11:11.167627 tst iperf3m4.py: using RAC 146 03:11:11.295029 tst iperf3m4.py: using CellId 38141 03:11:11.423523 tst iperf3m4.py: using BVCI 38142 03:11:11.543687 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:11.554908 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:11.566107 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:11.577231 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:11.588414 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:11.599711 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:11.611292 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:11.622797 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:11.634337 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:11.751673 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:11.874023 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:11.992349 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:12.107392 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:11:12.311483 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:12.617998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1595): Launched 03:11:12.885908 run iperf3-srv_10.42.42.10(pid=1596): Launched 03:11:13.001674 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:11:13.204239 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:13.509120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1597): Launched 03:11:13.775421 run iperf3-srv_10.42.42.10(pid=1598): Launched 03:11:13.889929 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:11:14.093534 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:14.398992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1599): Launched 03:11:14.665884 run iperf3-srv_10.42.42.10(pid=1600): Launched 03:11:14.781053 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:11:14.984608 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:15.291026 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1601): Launched 03:11:15.555838 run iperf3-srv_10.42.42.10(pid=1602): Launched 03:11:15.670205 tst iperf3m4.py:8: start network... 03:11:15.897754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:11:16.432354 run create_hlr_db(pid=1603): Launched 03:11:16.566104 bus /gobi_6: Setting Powered False 03:11:17.630670 run create_hlr_db(pid=1603): Terminated: ok {rc=0} 03:11:18.068188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1605): Launched 03:11:18.374646 run osmo-hlr_10.42.42.2(pid=1606): Launched 03:11:18.489956 run osmo-stp_10.42.42.5: Starting osmo-stp 03:11:19.018820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1608): Launched 03:11:19.323379 run osmo-stp_10.42.42.5(pid=1609): Launched 03:11:19.438824 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:11:19.963409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1611): Launched 03:11:20.079269 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:11:20.336780 run patchelf(pid=1612): Launched 03:11:20.508723 run osmo-stp_10.42.42.5(pid=1609): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1609)] 03:11:20.637647 run osmo-stp_10.42.42.5(pid=1609): stdout: | (launched: 2022-12-14_03:11:19.266773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:20.767802 run osmo-stp_10.42.42.5(pid=1609): stderr: | [0;m[38;5;43m20221214031119439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031119439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031119440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031119440 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031119441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031119441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031119441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:20.899213 run osmo-stp_10.42.42.5(pid=1609): stdout: | (launched: 2022-12-14_03:11:19.266773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:21.024124 run osmo-stp_10.42.42.5(pid=1609): stderr: | [0;m[38;5;43m20221214031119439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031119439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031119440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031119440 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031119441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031119441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031119441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:21.171973 run patchelf(pid=1612): Terminating (SIGINT) 03:11:21.344148 run patchelf(pid=1612): Terminated: ok {rc=0} 03:11:21.468069 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1609): Process ended prematurely: osmo-stp_10.42.42.5(pid=1609) [trial-2398↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1609)] [trial-2398↪gprs:nanobts+band-1900↪iperf3m4.py:8] 03:11:21.477738 tst iperf3m4.py:8: Test FAILED (10.5 sec) 03:11:21.504785 run osmo-hlr_10.42.42.2(pid=1606): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1606)] 03:11:21.552411 run osmo-hlr_10.42.42.2(pid=1606): stdout: | (launched: 2022-12-14_03:11:18.318176) 03:11:21.601574 run osmo-hlr_10.42.42.2(pid=1606): stderr: | [0;m[1;31m20221214031118496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031118496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031118496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031118496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031118496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031118496 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031118509 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031118518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031118519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031118519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:11:21.651349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1595): Terminating (SIGTERM) 03:11:21.691294 run iperf3-srv_10.42.42.10(pid=1596): Terminating (SIGTERM) 03:11:21.731113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1597): Terminating (SIGTERM) 03:11:21.770970 run iperf3-srv_10.42.42.10(pid=1598): Terminating (SIGTERM) 03:11:21.810691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1599): Terminating (SIGTERM) 03:11:21.850352 run iperf3-srv_10.42.42.10(pid=1600): Terminating (SIGTERM) 03:11:21.890522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1601): Terminating (SIGTERM) 03:11:21.930426 run iperf3-srv_10.42.42.10(pid=1602): Terminating (SIGTERM) 03:11:21.970189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1605): Terminating (SIGTERM) 03:11:22.010082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1608): Terminating (SIGTERM) 03:11:22.049952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1611): Terminating (SIGTERM) 03:11:22.089917 --- ParallelTerminationStrategy: PID 1595 died... 03:11:22.109410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1595): Terminated: ok {rc=0} 03:11:22.154002 --- ParallelTerminationStrategy: PID 1596 died... 03:11:22.172748 run iperf3-srv_10.42.42.10(pid=1596): Terminated {rc=256} 03:11:22.216720 --- ParallelTerminationStrategy: PID 1597 died... 03:11:22.235652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1597): Terminated: ok {rc=0} 03:11:22.279614 --- ParallelTerminationStrategy: PID 1598 died... 03:11:22.298410 run iperf3-srv_10.42.42.10(pid=1598): Terminated {rc=256} 03:11:22.342765 --- ParallelTerminationStrategy: PID 1599 died... 03:11:22.361531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1599): Terminated: ok {rc=0} 03:11:22.405616 --- ParallelTerminationStrategy: PID 1600 died... 03:11:22.424521 run iperf3-srv_10.42.42.10(pid=1600): Terminated {rc=256} 03:11:22.468467 --- ParallelTerminationStrategy: PID 1601 died... 03:11:22.487240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1601): Terminated: ok {rc=0} 03:11:22.531329 --- ParallelTerminationStrategy: PID 1602 died... 03:11:22.550186 run iperf3-srv_10.42.42.10(pid=1602): Terminated {rc=256} 03:11:22.594288 --- ParallelTerminationStrategy: PID 1605 died... 03:11:22.613105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1605): Terminated: ok {rc=0} 03:11:22.656873 --- ParallelTerminationStrategy: PID 1608 died... 03:11:22.676163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1608): Terminated: ok {rc=0} 03:11:22.720068 --- ParallelTerminationStrategy: PID 1611 died... 03:11:22.739015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1611): Terminated: ok {rc=0} 03:11:22.823608 bus /gobi_4: Setting Powered False 03:11:23.923497 bus /gobi_4: Setting Powered False 03:11:25.043486 bus /gobi_1: Setting Powered False 03:11:26.144792 bus /gobi_1: Setting Powered False 03:11:27.263384 bus /gobi_0: Setting Powered False 03:11:28.362203 bus /gobi_0: Setting Powered False 03:11:29.477604 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 03:11:30.579563 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:30.591538 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:11:30.635024 tst ping.py: using LAC 38142 03:11:30.760247 tst ping.py: using RAC 147 03:11:30.889001 tst ping.py: using CellId 38142 03:11:31.021629 tst ping.py: using BVCI 38143 03:11:31.171984 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:31.186789 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:31.200871 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:31.212539 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:31.224655 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:31.237362 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:31.250169 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:31.262805 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:31.382536 tst ping.py:19: start network... 03:11:31.588610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:11:32.066641 run create_hlr_db(pid=1613): Launched 03:11:32.226729 bus /gobi_6: Setting Powered False 03:11:33.289296 run create_hlr_db(pid=1613): Terminated: ok {rc=0} 03:11:33.716564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1615): Launched 03:11:34.015088 run osmo-hlr_10.42.42.2(pid=1616): Launched 03:11:34.130412 run osmo-stp_10.42.42.5: Starting osmo-stp 03:11:34.646863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1618): Launched 03:11:34.946629 run osmo-stp_10.42.42.5(pid=1619): Launched 03:11:35.060164 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:11:35.575832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1621): Launched 03:11:35.690916 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:11:35.943535 run patchelf(pid=1622): Launched 03:11:36.109866 run osmo-stp_10.42.42.5(pid=1619): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1619)] 03:11:36.236679 run osmo-stp_10.42.42.5(pid=1619): stdout: | (launched: 2022-12-14_03:11:34.891290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:36.364898 run osmo-stp_10.42.42.5(pid=1619): stderr: | [0;m[38;5;43m20221214031135064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031135064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031135064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031135065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031135065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031135065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031135065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:36.493194 run osmo-stp_10.42.42.5(pid=1619): stdout: | (launched: 2022-12-14_03:11:34.891290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:36.616183 run osmo-stp_10.42.42.5(pid=1619): stderr: | [0;m[38;5;43m20221214031135064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031135064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031135064 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031135065 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031135065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031135065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031135065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:36.762742 run patchelf(pid=1622): Terminating (SIGINT) 03:11:36.932859 run patchelf(pid=1622): Terminated: ok {rc=0} 03:11:37.055057 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1619): Process ended prematurely: osmo-stp_10.42.42.5(pid=1619) [trial-2398↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1619)] [trial-2398↪gprs:nanobts+band-1900↪ping.py:22] 03:11:37.063731 tst ping.py:22: Test FAILED (6.5 sec) 03:11:37.090467 run osmo-hlr_10.42.42.2(pid=1616): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1616)] 03:11:37.138445 run osmo-hlr_10.42.42.2(pid=1616): stdout: | (launched: 2022-12-14_03:11:33.960223) 03:11:37.187811 run osmo-hlr_10.42.42.2(pid=1616): stderr: | [0;m[1;31m20221214031134136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031134136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031134136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031134136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031134136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031134136 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031134148 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031134158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031134158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031134159 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:11:37.237518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1615): Terminating (SIGTERM) 03:11:37.277703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1618): Terminating (SIGTERM) 03:11:37.317722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1621): Terminating (SIGTERM) 03:11:37.357925 --- ParallelTerminationStrategy: PID 1615 died... 03:11:37.377385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1615): Terminated: ok {rc=0} 03:11:37.422438 --- ParallelTerminationStrategy: PID 1618 died... 03:11:37.441469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1618): Terminated: ok {rc=0} 03:11:37.485667 --- ParallelTerminationStrategy: PID 1621 died... 03:11:37.504436 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1621): Terminated: ok {rc=0} 03:11:37.588110 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 03:11:38.672791 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:38.684376 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 03:11:38.723900 tst ping_idle_ping.py: using LAC 38143 03:11:38.851931 tst ping_idle_ping.py: using RAC 148 03:11:38.978728 tst ping_idle_ping.py: using CellId 38143 03:11:39.106762 tst ping_idle_ping.py: using BVCI 38144 03:11:39.226390 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:39.237779 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:39.249002 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:39.260079 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:39.271559 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:39.283113 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:39.294747 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 03:11:39.306394 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 03:11:39.422537 tst ping_idle_ping.py:24: start network... 03:11:39.624432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:11:40.092294 run create_hlr_db(pid=1623): Launched 03:11:40.215911 bus /gobi_6: Setting Powered False 03:11:41.277104 run create_hlr_db(pid=1623): Terminated: ok {rc=0} 03:11:41.695721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1625): Launched 03:11:41.997200 run osmo-hlr_10.42.42.2(pid=1626): Launched 03:11:42.111620 run osmo-stp_10.42.42.5: Starting osmo-stp 03:11:42.643115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1628): Launched 03:11:42.942874 run osmo-stp_10.42.42.5(pid=1629): Launched 03:11:43.058138 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:11:43.575567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1631): Launched 03:11:43.689930 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:11:43.943654 run patchelf(pid=1632): Launched 03:11:44.111256 run osmo-stp_10.42.42.5(pid=1629): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1629)] 03:11:44.237928 run osmo-stp_10.42.42.5(pid=1629): stdout: | (launched: 2022-12-14_03:11:42.887372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:44.366432 run osmo-stp_10.42.42.5(pid=1629): stderr: | [0;m[38;5;43m20221214031143058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031143059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031143059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031143059 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031143061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031143062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031143062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:44.494946 run osmo-stp_10.42.42.5(pid=1629): stdout: | (launched: 2022-12-14_03:11:42.887372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:44.617889 run osmo-stp_10.42.42.5(pid=1629): stderr: | [0;m[38;5;43m20221214031143058 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031143059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031143059 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031143059 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031143061 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031143062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031143062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:44.763435 run patchelf(pid=1632): Terminating (SIGINT) 03:11:44.933487 run patchelf(pid=1632): Terminated: ok {rc=0} 03:11:45.056847 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1629): Process ended prematurely: osmo-stp_10.42.42.5(pid=1629) [trial-2398↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1629)] [trial-2398↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 03:11:45.065835 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 03:11:45.092789 run osmo-hlr_10.42.42.2(pid=1626): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1626)] 03:11:45.140413 run osmo-hlr_10.42.42.2(pid=1626): stdout: | (launched: 2022-12-14_03:11:41.941807) 03:11:45.189538 run osmo-hlr_10.42.42.2(pid=1626): stderr: | [0;m[1;31m20221214031142117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031142117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031142117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031142117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031142117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031142117 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031142130 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031142138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031142139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031142139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:11:45.239214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1625): Terminating (SIGTERM) 03:11:45.279127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1628): Terminating (SIGTERM) 03:11:45.318841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1631): Terminating (SIGTERM) 03:11:45.359128 --- ParallelTerminationStrategy: PID 1625 died... 03:11:45.377971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1625): Terminated: ok {rc=0} 03:11:45.421680 --- ParallelTerminationStrategy: PID 1628 died... 03:11:45.440146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1628): Terminated: ok {rc=0} 03:11:45.483882 --- ParallelTerminationStrategy: PID 1631 died... 03:11:45.502656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1631): Terminated: ok {rc=0} 03:11:45.587909 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 03:11:46.933014 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:11:46.942561 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:11:46.975962 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:11:47.022052 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:11:47.125716 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:11:47.160108 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:11:47.199046 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:11:47.780150 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:11:47.829353 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:47.840297 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:11:47.879934 tst cs_paging_gprs_active.py: using LAC 38144 03:11:48.000576 tst cs_paging_gprs_active.py: using RAC 149 03:11:48.121232 tst cs_paging_gprs_active.py: using CellId 38144 03:11:48.241284 tst cs_paging_gprs_active.py: using BVCI 38145 03:11:48.350851 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:48.361776 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:48.372471 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:48.383164 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:48.393778 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:48.404337 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:48.415170 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:48.425852 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:11:48.436772 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:11:48.558655 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:11:48.679043 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:11:48.883330 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:49.189824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1636): Launched 03:11:49.454931 run iperf3-srv_10.42.42.10(pid=1637): Launched 03:11:49.571137 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:11:49.774490 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:11:50.080348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1638): Launched 03:11:50.346329 run iperf3-srv_10.42.42.10(pid=1639): Launched 03:11:50.460637 tst cs_paging_gprs_active.py:38: start network... 03:11:50.664330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:11:51.138807 run create_hlr_db(pid=1640): Launched 03:11:51.263637 bus /gobi_6: Setting Powered False 03:11:52.324289 run create_hlr_db(pid=1640): Terminated: ok {rc=0} 03:11:52.770684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1642): Launched 03:11:53.098580 run osmo-hlr_10.42.42.2(pid=1643): Launched 03:11:53.226184 run osmo-stp_10.42.42.5: Starting osmo-stp 03:11:53.790038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1645): Launched 03:11:54.117284 run osmo-stp_10.42.42.5(pid=1646): Launched 03:11:54.243569 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:11:54.810019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1648): Launched 03:11:54.935549 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:11:55.213287 run patchelf(pid=1649): Launched 03:11:55.394947 run osmo-stp_10.42.42.5(pid=1646): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1646)] 03:11:55.533422 run osmo-stp_10.42.42.5(pid=1646): stdout: | (launched: 2022-12-14_03:11:54.057292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:55.672854 run osmo-stp_10.42.42.5(pid=1646): stderr: | [0;m[38;5;43m20221214031154249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031154249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031154250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031154250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031154251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031154251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031154251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:55.812132 run osmo-stp_10.42.42.5(pid=1646): stdout: | (launched: 2022-12-14_03:11:54.057292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:11:55.945915 run osmo-stp_10.42.42.5(pid=1646): stderr: | [0;m[38;5;43m20221214031154249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031154249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031154250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031154250 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031154251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031154251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031154251 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:11:56.104412 run patchelf(pid=1649): Terminating (SIGINT) 03:11:56.288530 run patchelf(pid=1649): Terminated: ok {rc=0} 03:11:56.422193 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1646): Process ended prematurely: osmo-stp_10.42.42.5(pid=1646) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1646)] [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:11:56.432331 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 03:11:56.461318 run osmo-hlr_10.42.42.2(pid=1643): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1643)] 03:11:56.512282 run osmo-hlr_10.42.42.2(pid=1643): stdout: | (launched: 2022-12-14_03:11:53.038744) 03:11:56.564548 run osmo-hlr_10.42.42.2(pid=1643): stderr: | [0;m[1;31m20221214031153236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031153236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031153236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031153236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031153236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031153236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031153248 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031153258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031153258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031153258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:11:56.617549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1636): Terminating (SIGTERM) 03:11:56.659399 run iperf3-srv_10.42.42.10(pid=1637): Terminating (SIGTERM) 03:11:56.702065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1638): Terminating (SIGTERM) 03:11:56.744260 run iperf3-srv_10.42.42.10(pid=1639): Terminating (SIGTERM) 03:11:56.786402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1642): Terminating (SIGTERM) 03:11:56.828451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1645): Terminating (SIGTERM) 03:11:56.870560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1648): Terminating (SIGTERM) 03:11:56.912875 --- ParallelTerminationStrategy: PID 1636 died... 03:11:56.933519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1636): Terminated: ok {rc=0} 03:11:56.980219 --- ParallelTerminationStrategy: PID 1637 died... 03:11:57.000779 run iperf3-srv_10.42.42.10(pid=1637): Terminated {rc=256} 03:11:57.047166 --- ParallelTerminationStrategy: PID 1638 died... 03:11:57.067226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1638): Terminated: ok {rc=0} 03:11:57.113976 --- ParallelTerminationStrategy: PID 1639 died... 03:11:57.134104 run iperf3-srv_10.42.42.10(pid=1639): Terminated {rc=256} 03:11:57.180429 --- ParallelTerminationStrategy: PID 1642 died... 03:11:57.200367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1642): Terminated: ok {rc=0} 03:11:57.247005 --- ParallelTerminationStrategy: PID 1645 died... 03:11:57.267148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1645): Terminated: ok {rc=0} 03:11:57.313617 --- ParallelTerminationStrategy: PID 1648 died... 03:11:57.333800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1648): Terminated: ok {rc=0} 03:11:57.423088 bus /gobi_0: Setting Powered False 03:11:58.522221 bus /gobi_0: Setting Powered False 03:11:59.634853 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:12:00.784245 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:00.796556 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:12:00.845314 tst iperf3.py: using LAC 38145 03:12:00.996632 tst iperf3.py: using RAC 150 03:12:01.118574 tst iperf3.py: using CellId 38145 03:12:01.238265 tst iperf3.py: using BVCI 38146 03:12:01.392168 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:01.405651 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:01.418184 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:01.430804 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:01.444253 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:01.457538 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:01.470531 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:01.483351 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:01.496157 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:01.624245 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:12:01.845776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:02.158838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1650): Launched 03:12:02.438830 run iperf3-srv_10.42.42.10(pid=1651): Launched 03:12:02.555132 tst iperf3.py:8: start network... 03:12:02.759590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:12:03.233538 run create_hlr_db(pid=1652): Launched 03:12:03.358472 bus /gobi_6: Setting Powered False 03:12:04.418950 run create_hlr_db(pid=1652): Terminated: ok {rc=0} 03:12:04.842132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1654): Launched 03:12:05.146941 run osmo-hlr_10.42.42.2(pid=1655): Launched 03:12:05.262485 run osmo-stp_10.42.42.5: Starting osmo-stp 03:12:05.786856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1657): Launched 03:12:06.091368 run osmo-stp_10.42.42.5(pid=1658): Launched 03:12:06.206979 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:12:06.732343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1660): Launched 03:12:06.847861 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:12:07.105105 run patchelf(pid=1661): Launched 03:12:07.274976 run osmo-stp_10.42.42.5(pid=1658): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1658)] 03:12:07.403710 run osmo-stp_10.42.42.5(pid=1658): stdout: | (launched: 2022-12-14_03:12:06.035275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:07.534044 run osmo-stp_10.42.42.5(pid=1658): stderr: | [0;m[38;5;43m20221214031206206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031206206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031206207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031206207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031206208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031206208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031206208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:07.664698 run osmo-stp_10.42.42.5(pid=1658): stdout: | (launched: 2022-12-14_03:12:06.035275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:07.789380 run osmo-stp_10.42.42.5(pid=1658): stderr: | [0;m[38;5;43m20221214031206206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031206206 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031206207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031206207 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031206208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031206208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031206208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:07.937449 run patchelf(pid=1661): Terminating (SIGINT) 03:12:08.109555 run patchelf(pid=1661): Terminated: ok {rc=0} 03:12:08.233783 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1658): Process ended prematurely: osmo-stp_10.42.42.5(pid=1658) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1658)] [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 03:12:08.243306 tst iperf3.py:8: Test FAILED (7.5 sec) 03:12:08.270543 run osmo-hlr_10.42.42.2(pid=1655): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1655)] 03:12:08.318255 run osmo-hlr_10.42.42.2(pid=1655): stdout: | (launched: 2022-12-14_03:12:05.090740) 03:12:08.367403 run osmo-hlr_10.42.42.2(pid=1655): stderr: | [0;m[1;31m20221214031205266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031205266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031205266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031205266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031205266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031205266 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031205297 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031205307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031205308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031205308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:12:08.417145 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1650): Terminating (SIGTERM) 03:12:08.456920 run iperf3-srv_10.42.42.10(pid=1651): Terminating (SIGTERM) 03:12:08.496594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1654): Terminating (SIGTERM) 03:12:08.536201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1657): Terminating (SIGTERM) 03:12:08.575610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1660): Terminating (SIGTERM) 03:12:08.615477 --- ParallelTerminationStrategy: PID 1650 died... 03:12:08.634753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1650): Terminated: ok {rc=0} 03:12:08.678883 --- ParallelTerminationStrategy: PID 1651 died... 03:12:08.697556 run iperf3-srv_10.42.42.10(pid=1651): Terminated {rc=256} 03:12:08.741264 --- ParallelTerminationStrategy: PID 1654 died... 03:12:08.759959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1654): Terminated: ok {rc=0} 03:12:08.803627 --- ParallelTerminationStrategy: PID 1657 died... 03:12:08.822347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1657): Terminated: ok {rc=0} 03:12:08.865858 --- ParallelTerminationStrategy: PID 1660 died... 03:12:08.884482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1660): Terminated: ok {rc=0} 03:12:08.969453 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:12:10.116242 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:10.128039 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:12:10.169034 tst iperf3m4.py: using LAC 38146 03:12:10.288399 tst iperf3m4.py: using RAC 151 03:12:10.409073 tst iperf3m4.py: using CellId 38146 03:12:10.528220 tst iperf3m4.py: using BVCI 38147 03:12:10.640410 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:10.651452 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:10.662206 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:10.673563 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:10.684141 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:10.694807 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:10.705682 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:10.716294 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:10.727227 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:10.848920 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:10.968326 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:11.089122 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:11.211430 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:12:11.433407 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:11.762724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1662): Launched 03:12:12.048002 run iperf3-srv_10.42.42.10(pid=1663): Launched 03:12:12.171279 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:12:12.392826 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:12.722465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1664): Launched 03:12:13.007304 run iperf3-srv_10.42.42.10(pid=1665): Launched 03:12:13.131733 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:12:13.353511 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:13.683523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1666): Launched 03:12:13.968821 run iperf3-srv_10.42.42.10(pid=1667): Launched 03:12:14.091594 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:12:14.312622 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:14.641706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1668): Launched 03:12:14.926659 run iperf3-srv_10.42.42.10(pid=1669): Launched 03:12:15.050891 tst iperf3m4.py:8: start network... 03:12:15.271378 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:12:15.779989 run create_hlr_db(pid=1670): Launched 03:12:15.919761 bus /gobi_6: Setting Powered False 03:12:16.992064 run create_hlr_db(pid=1670): Terminated: ok {rc=0} 03:12:17.458998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1672): Launched 03:12:17.788396 run osmo-hlr_10.42.42.2(pid=1673): Launched 03:12:17.913518 run osmo-stp_10.42.42.5: Starting osmo-stp 03:12:18.479495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1675): Launched 03:12:18.790717 run osmo-stp_10.42.42.5(pid=1676): Launched 03:12:18.906459 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:12:19.431776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1678): Launched 03:12:19.547896 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:12:19.805622 run patchelf(pid=1679): Launched 03:12:19.974976 run osmo-stp_10.42.42.5(pid=1676): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1676)] 03:12:20.103979 run osmo-stp_10.42.42.5(pid=1676): stdout: | (launched: 2022-12-14_03:12:18.734235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:20.234916 run osmo-stp_10.42.42.5(pid=1676): stderr: | [0;m[38;5;43m20221214031218904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031218904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031218904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031218905 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031218907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031218907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031218908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:20.366038 run osmo-stp_10.42.42.5(pid=1676): stdout: | (launched: 2022-12-14_03:12:18.734235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:20.490952 run osmo-stp_10.42.42.5(pid=1676): stderr: | [0;m[38;5;43m20221214031218904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031218904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031218904 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031218905 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031218907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031218907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031218908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:20.638842 run patchelf(pid=1679): Terminating (SIGINT) 03:12:20.811198 run patchelf(pid=1679): Terminated: ok {rc=0} 03:12:20.934813 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1676): Process ended prematurely: osmo-stp_10.42.42.5(pid=1676) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1676)] [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 03:12:20.944259 tst iperf3m4.py:8: Test FAILED (10.9 sec) 03:12:20.971754 run osmo-hlr_10.42.42.2(pid=1673): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1673)] 03:12:21.019621 run osmo-hlr_10.42.42.2(pid=1673): stdout: | (launched: 2022-12-14_03:12:17.728663) 03:12:21.068895 run osmo-hlr_10.42.42.2(pid=1673): stderr: | [0;m[1;31m20221214031217926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031217926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031217926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031217926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031217926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031217926 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031217939 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031217947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031217947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031217947 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:12:21.118762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1662): Terminating (SIGTERM) 03:12:21.158579 run iperf3-srv_10.42.42.10(pid=1663): Terminating (SIGTERM) 03:12:21.198227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1664): Terminating (SIGTERM) 03:12:21.238065 run iperf3-srv_10.42.42.10(pid=1665): Terminating (SIGTERM) 03:12:21.278141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1666): Terminating (SIGTERM) 03:12:21.318057 run iperf3-srv_10.42.42.10(pid=1667): Terminating (SIGTERM) 03:12:21.357859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1668): Terminating (SIGTERM) 03:12:21.397413 run iperf3-srv_10.42.42.10(pid=1669): Terminating (SIGTERM) 03:12:21.436783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1672): Terminating (SIGTERM) 03:12:21.476294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1675): Terminating (SIGTERM) 03:12:21.515909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1678): Terminating (SIGTERM) 03:12:21.555995 --- ParallelTerminationStrategy: PID 1662 died... 03:12:21.575517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1662): Terminated: ok {rc=0} 03:12:21.619715 --- ParallelTerminationStrategy: PID 1663 died... 03:12:21.638523 run iperf3-srv_10.42.42.10(pid=1663): Terminated {rc=256} 03:12:21.682280 --- ParallelTerminationStrategy: PID 1664 died... 03:12:21.701073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1664): Terminated: ok {rc=0} 03:12:21.744767 --- ParallelTerminationStrategy: PID 1665 died... 03:12:21.763612 run iperf3-srv_10.42.42.10(pid=1665): Terminated {rc=256} 03:12:21.808022 --- ParallelTerminationStrategy: PID 1666 died... 03:12:21.826952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1666): Terminated: ok {rc=0} 03:12:21.870945 --- ParallelTerminationStrategy: PID 1667 died... 03:12:21.889790 run iperf3-srv_10.42.42.10(pid=1667): Terminated {rc=256} 03:12:21.933823 --- ParallelTerminationStrategy: PID 1668 died... 03:12:21.952722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1668): Terminated: ok {rc=0} 03:12:21.996596 --- ParallelTerminationStrategy: PID 1669 died... 03:12:22.015528 run iperf3-srv_10.42.42.10(pid=1669): Terminated {rc=256} 03:12:22.059420 --- ParallelTerminationStrategy: PID 1672 died... 03:12:22.078292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1672): Terminated: ok {rc=0} 03:12:22.122137 --- ParallelTerminationStrategy: PID 1675 died... 03:12:22.141153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1675): Terminated: ok {rc=0} 03:12:22.184926 --- ParallelTerminationStrategy: PID 1678 died... 03:12:22.203752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1678): Terminated: ok {rc=0} 03:12:22.289163 bus /gobi_4: Setting Powered False 03:12:23.387601 bus /gobi_4: Setting Powered False 03:12:24.503003 bus /gobi_1: Setting Powered False 03:12:25.602072 bus /gobi_1: Setting Powered False 03:12:26.718724 bus /gobi_0: Setting Powered False 03:12:27.817197 bus /gobi_0: Setting Powered False 03:12:28.933447 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 03:12:30.036154 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.047855 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:12:30.088328 tst ping.py: using LAC 38147 03:12:30.207130 tst ping.py: using RAC 152 03:12:30.325413 tst ping.py: using CellId 38147 03:12:30.442070 tst ping.py: using BVCI 38148 03:12:30.549908 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.560873 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.571765 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.582588 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.593380 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.604086 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.615032 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:30.625852 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:30.739776 tst ping.py:19: start network... 03:12:30.974012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:12:31.497535 run create_hlr_db(pid=1680): Launched 03:12:31.652261 bus /gobi_6: Setting Powered False 03:12:32.712120 run create_hlr_db(pid=1680): Terminated: ok {rc=0} 03:12:33.149463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1682): Launched 03:12:33.471600 run osmo-hlr_10.42.42.2(pid=1683): Launched 03:12:33.594103 run osmo-stp_10.42.42.5: Starting osmo-stp 03:12:34.151066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1685): Launched 03:12:34.471834 run osmo-stp_10.42.42.5(pid=1686): Launched 03:12:34.595632 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:12:35.150044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1688): Launched 03:12:35.272683 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:12:35.545311 run patchelf(pid=1689): Launched 03:12:35.723750 run osmo-stp_10.42.42.5(pid=1686): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1686)] 03:12:35.859666 run osmo-stp_10.42.42.5(pid=1686): stdout: | (launched: 2022-12-14_03:12:34.413161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:35.997167 run osmo-stp_10.42.42.5(pid=1686): stderr: | [0;m[38;5;43m20221214031234605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031234605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031234605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031234606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031234607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031234607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031234607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:36.134737 run osmo-stp_10.42.42.5(pid=1686): stdout: | (launched: 2022-12-14_03:12:34.413161) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:36.266503 run osmo-stp_10.42.42.5(pid=1686): stderr: | [0;m[38;5;43m20221214031234605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031234605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031234605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031234606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031234607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031234607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031234607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:36.423112 run patchelf(pid=1689): Terminating (SIGINT) 03:12:36.604230 run patchelf(pid=1689): Terminated: ok {rc=0} 03:12:36.734482 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1686): Process ended prematurely: osmo-stp_10.42.42.5(pid=1686) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1686)] [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 03:12:36.743919 tst ping.py:22: Test FAILED (6.7 sec) 03:12:36.772342 run osmo-hlr_10.42.42.2(pid=1683): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1683)] 03:12:36.823500 run osmo-hlr_10.42.42.2(pid=1683): stdout: | (launched: 2022-12-14_03:12:33.412364) 03:12:36.876293 run osmo-hlr_10.42.42.2(pid=1683): stderr: | [0;m[1;31m20221214031233609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031233609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031233609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031233609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031233609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031233609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031233621 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031233629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031233630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031233630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:12:36.929388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1682): Terminating (SIGTERM) 03:12:36.971544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1685): Terminating (SIGTERM) 03:12:37.013871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1688): Terminating (SIGTERM) 03:12:37.056660 --- ParallelTerminationStrategy: PID 1682 died... 03:12:37.077466 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1682): Terminated: ok {rc=0} 03:12:37.124425 --- ParallelTerminationStrategy: PID 1685 died... 03:12:37.144543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1685): Terminated: ok {rc=0} 03:12:37.191431 --- ParallelTerminationStrategy: PID 1688 died... 03:12:37.211635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1688): Terminated: ok {rc=0} 03:12:37.300933 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:12:38.388210 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:38.400487 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:12:38.447841 tst ping_idle_ping.py: using LAC 38148 03:12:38.564836 tst ping_idle_ping.py: using RAC 153 03:12:38.683299 tst ping_idle_ping.py: using CellId 38148 03:12:38.810348 tst ping_idle_ping.py: using BVCI 38149 03:12:38.929342 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:38.940942 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:38.952448 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:38.964006 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:38.975866 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:38.987714 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:38.999809 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:12:39.011627 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:12:39.131748 tst ping_idle_ping.py:24: start network... 03:12:39.332554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:12:39.804928 run create_hlr_db(pid=1690): Launched 03:12:39.929582 bus /gobi_6: Setting Powered False 03:12:40.989864 run create_hlr_db(pid=1690): Terminated: ok {rc=0} 03:12:41.430720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1692): Launched 03:12:41.754604 run osmo-hlr_10.42.42.2(pid=1693): Launched 03:12:41.878559 run osmo-stp_10.42.42.5: Starting osmo-stp 03:12:42.437483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1695): Launched 03:12:42.758821 run osmo-stp_10.42.42.5(pid=1696): Launched 03:12:42.883052 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:12:43.439592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1698): Launched 03:12:43.564107 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:12:43.835737 run patchelf(pid=1699): Launched 03:12:44.014807 run osmo-stp_10.42.42.5(pid=1696): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1696)] 03:12:44.151633 run osmo-stp_10.42.42.5(pid=1696): stdout: | (launched: 2022-12-14_03:12:42.700370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:44.289749 run osmo-stp_10.42.42.5(pid=1696): stderr: | [0;m[38;5;43m20221214031242892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031242892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031242892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031242893 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031242893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031242893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031242893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:44.428410 run osmo-stp_10.42.42.5(pid=1696): stdout: | (launched: 2022-12-14_03:12:42.700370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:44.561375 run osmo-stp_10.42.42.5(pid=1696): stderr: | [0;m[38;5;43m20221214031242892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031242892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031242892 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031242893 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031242893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031242893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031242893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:44.718347 run patchelf(pid=1699): Terminating (SIGINT) 03:12:44.899882 run patchelf(pid=1699): Terminated: ok {rc=0} 03:12:45.031061 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1696): Process ended prematurely: osmo-stp_10.42.42.5(pid=1696) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1696)] [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 03:12:45.040715 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 03:12:45.068687 run osmo-hlr_10.42.42.2(pid=1693): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1693)] 03:12:45.119607 run osmo-hlr_10.42.42.2(pid=1693): stdout: | (launched: 2022-12-14_03:12:41.695678) 03:12:45.172221 run osmo-hlr_10.42.42.2(pid=1693): stderr: | [0;m[1;31m20221214031241894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031241894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031241894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031241894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031241894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031241894 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031241907 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031241916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031241916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031241916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:12:45.224988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1692): Terminating (SIGTERM) 03:12:45.266808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1695): Terminating (SIGTERM) 03:12:45.309156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1698): Terminating (SIGTERM) 03:12:45.351937 --- ParallelTerminationStrategy: PID 1692 died... 03:12:45.372481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1692): Terminated: ok {rc=0} 03:12:45.419617 --- ParallelTerminationStrategy: PID 1695 died... 03:12:45.440202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1695): Terminated: ok {rc=0} 03:12:45.487124 --- ParallelTerminationStrategy: PID 1698 died... 03:12:45.507342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1698): Terminated: ok {rc=0} 03:12:45.596013 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:12:46.896061 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:12:46.906019 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:12:46.933868 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:12:46.978156 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:12:47.070063 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:12:47.101099 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:12:47.151927 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:12:47.726006 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:12:47.781310 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:47.792874 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:12:47.852786 tst cs_paging_gprs_active.py: using LAC 38149 03:12:47.972589 tst cs_paging_gprs_active.py: using RAC 154 03:12:48.092258 tst cs_paging_gprs_active.py: using CellId 38149 03:12:48.210531 tst cs_paging_gprs_active.py: using BVCI 38150 03:12:48.322693 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:48.333907 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:48.344828 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:48.355554 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:48.366777 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:48.378087 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:48.389490 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:48.400670 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:12:48.412075 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:12:48.534076 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:12:48.652794 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:12:48.857036 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:49.165538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1703): Launched 03:12:49.430031 run iperf3-srv_10.42.42.10(pid=1704): Launched 03:12:49.546693 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:12:49.749486 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:12:50.054349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1705): Launched 03:12:50.319242 run iperf3-srv_10.42.42.10(pid=1706): Launched 03:12:50.433471 tst cs_paging_gprs_active.py:38: start network... 03:12:50.637252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:12:51.108381 run create_hlr_db(pid=1707): Launched 03:12:51.233786 bus /gobi_6: Setting Powered False 03:12:52.294701 run create_hlr_db(pid=1707): Terminated: ok {rc=0} 03:12:52.739243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1716): Launched 03:12:53.065673 run osmo-hlr_10.42.42.2(pid=1717): Launched 03:12:53.191010 run osmo-stp_10.42.42.5: Starting osmo-stp 03:12:53.756877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1719): Launched 03:12:54.081987 run osmo-stp_10.42.42.5(pid=1720): Launched 03:12:54.208313 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:12:54.772073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1722): Launched 03:12:54.896276 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:12:55.172151 run patchelf(pid=1723): Launched 03:12:55.353150 run osmo-stp_10.42.42.5(pid=1720): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1720)] 03:12:55.491226 run osmo-stp_10.42.42.5(pid=1720): stdout: | (launched: 2022-12-14_03:12:54.022535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:55.631166 run osmo-stp_10.42.42.5(pid=1720): stderr: | [0;m[38;5;43m20221214031254215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031254215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031254215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031254215 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031254216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031254216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031254216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:55.770721 run osmo-stp_10.42.42.5(pid=1720): stdout: | (launched: 2022-12-14_03:12:54.022535) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:12:55.904071 run osmo-stp_10.42.42.5(pid=1720): stderr: | [0;m[38;5;43m20221214031254215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031254215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031254215 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031254215 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031254216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031254216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031254216 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:12:56.062639 run patchelf(pid=1723): Terminating (SIGINT) 03:12:56.246062 run patchelf(pid=1723): Terminated: ok {rc=0} 03:12:56.378480 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1720): Process ended prematurely: osmo-stp_10.42.42.5(pid=1720) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1720)] [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:12:56.388564 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 03:12:56.417216 run osmo-hlr_10.42.42.2(pid=1717): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1717)] 03:12:56.468497 run osmo-hlr_10.42.42.2(pid=1717): stdout: | (launched: 2022-12-14_03:12:53.005891) 03:12:56.520811 run osmo-hlr_10.42.42.2(pid=1717): stderr: | [0;m[1;31m20221214031253206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031253206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031253206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031253206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031253206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031253206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031253218 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031253226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031253227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031253227 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:12:56.573466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1703): Terminating (SIGTERM) 03:12:56.615100 run iperf3-srv_10.42.42.10(pid=1704): Terminating (SIGTERM) 03:12:56.657086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1705): Terminating (SIGTERM) 03:12:56.699015 run iperf3-srv_10.42.42.10(pid=1706): Terminating (SIGTERM) 03:12:56.740863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1716): Terminating (SIGTERM) 03:12:56.782860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1719): Terminating (SIGTERM) 03:12:56.824816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1722): Terminating (SIGTERM) 03:12:56.867161 --- ParallelTerminationStrategy: PID 1703 died... 03:12:56.887650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1703): Terminated: ok {rc=0} 03:12:56.934221 --- ParallelTerminationStrategy: PID 1704 died... 03:12:56.954068 run iperf3-srv_10.42.42.10(pid=1704): Terminated {rc=256} 03:12:56.999869 --- ParallelTerminationStrategy: PID 1705 died... 03:12:57.019582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1705): Terminated: ok {rc=0} 03:12:57.065622 --- ParallelTerminationStrategy: PID 1706 died... 03:12:57.085362 run iperf3-srv_10.42.42.10(pid=1706): Terminated {rc=256} 03:12:57.131215 --- ParallelTerminationStrategy: PID 1716 died... 03:12:57.151129 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1716): Terminated: ok {rc=0} 03:12:57.197108 --- ParallelTerminationStrategy: PID 1719 died... 03:12:57.216791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1719): Terminated: ok {rc=0} 03:12:57.262858 --- ParallelTerminationStrategy: PID 1722 died... 03:12:57.282626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1722): Terminated: ok {rc=0} 03:12:57.369815 bus /gobi_0: Setting Powered False 03:12:58.468332 bus /gobi_0: Setting Powered False 03:12:59.583690 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:13:00.733266 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:00.745603 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:13:00.809903 tst iperf3.py: using LAC 38150 03:13:00.954754 tst iperf3.py: using RAC 155 03:13:01.096810 tst iperf3.py: using CellId 38150 03:13:01.219988 tst iperf3.py: using BVCI 38151 03:13:01.333693 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:01.345988 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:01.357965 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:01.369791 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:01.381679 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:01.393116 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:01.404527 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:01.416597 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:01.428128 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:01.546574 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:13:01.801446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:13:02.139700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1724): Launched 03:13:02.427792 run iperf3-srv_10.42.42.10(pid=1725): Launched 03:13:02.554056 tst iperf3.py:8: start network... 03:13:02.774656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:13:03.279270 run create_hlr_db(pid=1726): Launched 03:13:03.405154 bus /gobi_6: Setting Powered False 03:13:04.469934 run create_hlr_db(pid=1726): Terminated: ok {rc=0} 03:13:04.903028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1728): Launched 03:13:05.206224 run osmo-hlr_10.42.42.2(pid=1729): Launched 03:13:05.324353 run osmo-stp_10.42.42.5: Starting osmo-stp 03:13:05.862693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1731): Launched 03:13:06.166152 run osmo-stp_10.42.42.5(pid=1732): Launched 03:13:06.281448 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:13:06.805066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1734): Launched 03:13:06.920308 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:13:07.176796 run patchelf(pid=1735): Launched 03:13:07.345880 run osmo-stp_10.42.42.5(pid=1732): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1732)] 03:13:07.474036 run osmo-stp_10.42.42.5(pid=1732): stdout: | (launched: 2022-12-14_03:13:06.109981) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:07.604068 run osmo-stp_10.42.42.5(pid=1732): stderr: | [0;m[38;5;43m20221214031306281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031306281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031306281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031306282 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031306282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031306282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031306282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:07.734291 run osmo-stp_10.42.42.5(pid=1732): stdout: | (launched: 2022-12-14_03:13:06.109981) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:07.858730 run osmo-stp_10.42.42.5(pid=1732): stderr: | [0;m[38;5;43m20221214031306281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031306281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031306281 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031306282 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031306282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031306282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031306282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:08.006754 run patchelf(pid=1735): Terminating (SIGINT) 03:13:08.178404 run patchelf(pid=1735): Terminated: ok {rc=0} 03:13:08.302377 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1732): Process ended prematurely: osmo-stp_10.42.42.5(pid=1732) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1732)] [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 03:13:08.311765 tst iperf3.py:8: Test FAILED (7.6 sec) 03:13:08.338578 run osmo-hlr_10.42.42.2(pid=1729): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1729)] 03:13:08.385955 run osmo-hlr_10.42.42.2(pid=1729): stdout: | (launched: 2022-12-14_03:13:05.150618) 03:13:08.434787 run osmo-hlr_10.42.42.2(pid=1729): stderr: | [0;m[1;31m20221214031305328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031305328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031305328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031305328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031305328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031305328 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031305341 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031305349 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031305350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031305350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:13:08.484246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1724): Terminating (SIGTERM) 03:13:08.523864 run iperf3-srv_10.42.42.10(pid=1725): Terminating (SIGTERM) 03:13:08.563299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1728): Terminating (SIGTERM) 03:13:08.602860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1731): Terminating (SIGTERM) 03:13:08.642385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1734): Terminating (SIGTERM) 03:13:08.682281 --- ParallelTerminationStrategy: PID 1724 died... 03:13:08.701352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1724): Terminated: ok {rc=0} 03:13:08.745277 --- ParallelTerminationStrategy: PID 1725 died... 03:13:08.763755 run iperf3-srv_10.42.42.10(pid=1725): Terminated {rc=256} 03:13:08.807240 --- ParallelTerminationStrategy: PID 1728 died... 03:13:08.825741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1728): Terminated: ok {rc=0} 03:13:08.869179 --- ParallelTerminationStrategy: PID 1731 died... 03:13:08.887643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1731): Terminated: ok {rc=0} 03:13:08.931327 --- ParallelTerminationStrategy: PID 1734 died... 03:13:08.949853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1734): Terminated: ok {rc=0} 03:13:09.035410 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:13:10.182736 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:10.194409 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:13:10.255093 tst iperf3m4.py: using LAC 38151 03:13:10.375191 tst iperf3m4.py: using RAC 156 03:13:10.493891 tst iperf3m4.py: using CellId 38151 03:13:10.612303 tst iperf3m4.py: using BVCI 38152 03:13:10.723621 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:10.734646 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:10.745357 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:10.755972 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:10.766662 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:10.777435 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:10.788161 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:10.798819 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:10.809756 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:10.925858 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:11.048214 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:11.167901 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:11.289366 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:13:11.511039 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:13:11.838466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1736): Launched 03:13:12.123350 run iperf3-srv_10.42.42.10(pid=1737): Launched 03:13:12.246013 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:13:12.466757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:13:12.793954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1738): Launched 03:13:13.079978 run iperf3-srv_10.42.42.10(pid=1739): Launched 03:13:13.202615 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:13:13.422686 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:13:13.751050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1740): Launched 03:13:14.035370 run iperf3-srv_10.42.42.10(pid=1741): Launched 03:13:14.159112 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:13:14.379060 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:13:14.707401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1742): Launched 03:13:14.993062 run iperf3-srv_10.42.42.10(pid=1743): Launched 03:13:15.116722 tst iperf3m4.py:8: start network... 03:13:15.337360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:13:15.847502 run create_hlr_db(pid=1744): Launched 03:13:15.994152 bus /gobi_6: Setting Powered False 03:13:17.053783 run create_hlr_db(pid=1744): Terminated: ok {rc=0} 03:13:17.524647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1746): Launched 03:13:17.832796 run osmo-hlr_10.42.42.2(pid=1747): Launched 03:13:17.948593 run osmo-stp_10.42.42.5: Starting osmo-stp 03:13:18.488138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1749): Launched 03:13:18.791291 run osmo-stp_10.42.42.5(pid=1750): Launched 03:13:18.906985 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:13:19.430559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1752): Launched 03:13:19.546508 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:13:19.804810 run patchelf(pid=1753): Launched 03:13:19.974151 run osmo-stp_10.42.42.5(pid=1750): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1750)] 03:13:20.102779 run osmo-stp_10.42.42.5(pid=1750): stdout: | (launched: 2022-12-14_03:13:18.735240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:20.232768 run osmo-stp_10.42.42.5(pid=1750): stderr: | [0;m[38;5;43m20221214031318905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031318906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031318906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031318906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031318907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031318907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031318907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:20.362564 run osmo-stp_10.42.42.5(pid=1750): stdout: | (launched: 2022-12-14_03:13:18.735240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:20.487486 run osmo-stp_10.42.42.5(pid=1750): stderr: | [0;m[38;5;43m20221214031318905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031318906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031318906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031318906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031318907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031318907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031318907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:20.635229 run patchelf(pid=1753): Terminating (SIGINT) 03:13:20.806967 run patchelf(pid=1753): Terminated: ok {rc=0} 03:13:20.930505 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1750): Process ended prematurely: osmo-stp_10.42.42.5(pid=1750) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1750)] [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:13:20.940051 tst iperf3m4.py:8: Test FAILED (10.8 sec) 03:13:20.967497 run osmo-hlr_10.42.42.2(pid=1747): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1747)] 03:13:21.015318 run osmo-hlr_10.42.42.2(pid=1747): stdout: | (launched: 2022-12-14_03:13:17.776900) 03:13:21.064913 run osmo-hlr_10.42.42.2(pid=1747): stderr: | [0;m[1;31m20221214031317956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031317956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031317956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031317956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031317956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031317956 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031317968 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031317979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031317979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031317979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:13:21.114995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1736): Terminating (SIGTERM) 03:13:21.154936 run iperf3-srv_10.42.42.10(pid=1737): Terminating (SIGTERM) 03:13:21.194798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1738): Terminating (SIGTERM) 03:13:21.235375 run iperf3-srv_10.42.42.10(pid=1739): Terminating (SIGTERM) 03:13:21.275969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1740): Terminating (SIGTERM) 03:13:21.315848 run iperf3-srv_10.42.42.10(pid=1741): Terminating (SIGTERM) 03:13:21.355666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1742): Terminating (SIGTERM) 03:13:21.395464 run iperf3-srv_10.42.42.10(pid=1743): Terminating (SIGTERM) 03:13:21.435046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1746): Terminating (SIGTERM) 03:13:21.474848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1749): Terminating (SIGTERM) 03:13:21.514535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1752): Terminating (SIGTERM) 03:13:21.554481 --- ParallelTerminationStrategy: PID 1736 died... 03:13:21.573882 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1736): Terminated: ok {rc=0} 03:13:21.618394 --- ParallelTerminationStrategy: PID 1737 died... 03:13:21.637335 run iperf3-srv_10.42.42.10(pid=1737): Terminated {rc=256} 03:13:21.681278 --- ParallelTerminationStrategy: PID 1738 died... 03:13:21.700052 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1738): Terminated: ok {rc=0} 03:13:21.744666 --- ParallelTerminationStrategy: PID 1739 died... 03:13:21.763715 run iperf3-srv_10.42.42.10(pid=1739): Terminated {rc=256} 03:13:21.807610 --- ParallelTerminationStrategy: PID 1740 died... 03:13:21.826389 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1740): Terminated: ok {rc=0} 03:13:21.870339 --- ParallelTerminationStrategy: PID 1741 died... 03:13:21.889299 run iperf3-srv_10.42.42.10(pid=1741): Terminated {rc=256} 03:13:21.933107 --- ParallelTerminationStrategy: PID 1742 died... 03:13:21.951952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1742): Terminated: ok {rc=0} 03:13:21.995815 --- ParallelTerminationStrategy: PID 1743 died... 03:13:22.014560 run iperf3-srv_10.42.42.10(pid=1743): Terminated {rc=256} 03:13:22.058471 --- ParallelTerminationStrategy: PID 1746 died... 03:13:22.077115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1746): Terminated: ok {rc=0} 03:13:22.121058 --- ParallelTerminationStrategy: PID 1749 died... 03:13:22.139869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1749): Terminated: ok {rc=0} 03:13:22.183654 --- ParallelTerminationStrategy: PID 1752 died... 03:13:22.202524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1752): Terminated: ok {rc=0} 03:13:22.288450 bus /gobi_4: Setting Powered False 03:13:23.389212 bus /gobi_4: Setting Powered False 03:13:24.506505 bus /gobi_1: Setting Powered False 03:13:25.605423 bus /gobi_1: Setting Powered False 03:13:26.721967 bus /gobi_0: Setting Powered False 03:13:27.818823 bus /gobi_0: Setting Powered False 03:13:28.934707 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:13:30.037153 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:30.049498 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:13:30.111226 tst ping.py: using LAC 38152 03:13:30.237301 tst ping.py: using RAC 157 03:13:30.364050 tst ping.py: using CellId 38152 03:13:30.491767 tst ping.py: using BVCI 38153 03:13:30.608526 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:30.620165 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:30.631529 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:30.642899 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:30.654429 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:30.666158 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:30.677832 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:30.689574 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:30.806786 tst ping.py:19: start network... 03:13:31.018277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:13:31.492407 run create_hlr_db(pid=1754): Launched 03:13:31.651646 bus /gobi_6: Setting Powered False 03:13:32.711146 run create_hlr_db(pid=1754): Terminated: ok {rc=0} 03:13:33.151621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1756): Launched 03:13:33.474300 run osmo-hlr_10.42.42.2(pid=1757): Launched 03:13:33.599349 run osmo-stp_10.42.42.5: Starting osmo-stp 03:13:34.161474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1759): Launched 03:13:34.482067 run osmo-stp_10.42.42.5(pid=1760): Launched 03:13:34.604773 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:13:35.157910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1762): Launched 03:13:35.280897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:13:35.553057 run patchelf(pid=1763): Launched 03:13:35.730025 run osmo-stp_10.42.42.5(pid=1760): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1760)] 03:13:35.865606 run osmo-stp_10.42.42.5(pid=1760): stdout: | (launched: 2022-12-14_03:13:34.422942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:36.002771 run osmo-stp_10.42.42.5(pid=1760): stderr: | [0;m[38;5;43m20221214031334615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031334615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031334616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031334616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031334616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031334617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031334617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:36.140171 run osmo-stp_10.42.42.5(pid=1760): stdout: | (launched: 2022-12-14_03:13:34.422942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:36.271953 run osmo-stp_10.42.42.5(pid=1760): stderr: | [0;m[38;5;43m20221214031334615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031334615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031334616 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031334616 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031334616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031334617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031334617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:36.427744 run patchelf(pid=1763): Terminating (SIGINT) 03:13:36.608599 run patchelf(pid=1763): Terminated: ok {rc=0} 03:13:36.738597 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1760): Process ended prematurely: osmo-stp_10.42.42.5(pid=1760) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1760)] [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 03:13:36.748633 tst ping.py:22: Test FAILED (6.7 sec) 03:13:36.776552 run osmo-hlr_10.42.42.2(pid=1757): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1757)] 03:13:36.826865 run osmo-hlr_10.42.42.2(pid=1757): stdout: | (launched: 2022-12-14_03:13:33.414755) 03:13:36.878862 run osmo-hlr_10.42.42.2(pid=1757): stderr: | [0;m[1;31m20221214031333615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031333615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031333615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031333615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031333615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031333615 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031333627 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031333635 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031333636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031333636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:13:36.931535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1756): Terminating (SIGTERM) 03:13:36.972829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1759): Terminating (SIGTERM) 03:13:37.015346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1762): Terminating (SIGTERM) 03:13:37.057708 --- ParallelTerminationStrategy: PID 1756 died... 03:13:37.078180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1756): Terminated: ok {rc=0} 03:13:37.124682 --- ParallelTerminationStrategy: PID 1759 died... 03:13:37.144382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1759): Terminated: ok {rc=0} 03:13:37.190843 --- ParallelTerminationStrategy: PID 1762 died... 03:13:37.210706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1762): Terminated: ok {rc=0} 03:13:37.298475 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 03:13:38.386050 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:38.398265 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:13:38.461182 tst ping_idle_ping.py: using LAC 38153 03:13:38.588814 tst ping_idle_ping.py: using RAC 158 03:13:38.716789 tst ping_idle_ping.py: using CellId 38153 03:13:38.843503 tst ping_idle_ping.py: using BVCI 38154 03:13:38.962224 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:38.973753 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:38.984881 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:38.996196 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:39.007811 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:39.019642 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:39.031668 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:13:39.043381 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:13:39.161790 tst ping_idle_ping.py:24: start network... 03:13:39.362270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:13:39.826602 run create_hlr_db(pid=1764): Launched 03:13:39.950337 bus /gobi_6: Setting Powered False 03:13:41.010257 run create_hlr_db(pid=1764): Terminated: ok {rc=0} 03:13:41.448210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1766): Launched 03:13:41.769192 run osmo-hlr_10.42.42.2(pid=1767): Launched 03:13:41.893920 run osmo-stp_10.42.42.5: Starting osmo-stp 03:13:42.448405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1769): Launched 03:13:42.768258 run osmo-stp_10.42.42.5(pid=1770): Launched 03:13:42.890557 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:13:43.443319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1772): Launched 03:13:43.566834 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:13:43.837273 run patchelf(pid=1773): Launched 03:13:44.017413 run osmo-stp_10.42.42.5(pid=1770): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1770)] 03:13:44.153183 run osmo-stp_10.42.42.5(pid=1770): stdout: | (launched: 2022-12-14_03:13:42.709908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:44.291043 run osmo-stp_10.42.42.5(pid=1770): stderr: | [0;m[38;5;43m20221214031342901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031342901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031342901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031342902 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031342902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031342902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031342902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:44.428356 run osmo-stp_10.42.42.5(pid=1770): stdout: | (launched: 2022-12-14_03:13:42.709908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:44.560735 run osmo-stp_10.42.42.5(pid=1770): stderr: | [0;m[38;5;43m20221214031342901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031342901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031342901 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031342902 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031342902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031342902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031342902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:44.716728 run patchelf(pid=1773): Terminating (SIGINT) 03:13:44.897522 run patchelf(pid=1773): Terminated: ok {rc=0} 03:13:45.027633 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1770): Process ended prematurely: osmo-stp_10.42.42.5(pid=1770) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1770)] [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 03:13:45.037469 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 03:13:45.065494 run osmo-hlr_10.42.42.2(pid=1767): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1767)] 03:13:45.115918 run osmo-hlr_10.42.42.2(pid=1767): stdout: | (launched: 2022-12-14_03:13:41.710994) 03:13:45.168640 run osmo-hlr_10.42.42.2(pid=1767): stderr: | [0;m[1;31m20221214031341907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031341907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031341907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031341907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031341907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031341907 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031341920 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031341930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031341930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031341930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:13:45.221192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1766): Terminating (SIGTERM) 03:13:45.262944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1769): Terminating (SIGTERM) 03:13:45.305478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1772): Terminating (SIGTERM) 03:13:45.347730 --- ParallelTerminationStrategy: PID 1766 died... 03:13:45.368048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1766): Terminated: ok {rc=0} 03:13:45.414602 --- ParallelTerminationStrategy: PID 1769 died... 03:13:45.434503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1769): Terminated: ok {rc=0} 03:13:45.480787 --- ParallelTerminationStrategy: PID 1772 died... 03:13:45.501174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1772): Terminated: ok {rc=0} 03:13:45.588331 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 03:13:46.919181 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:13:46.938479 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:13:46.972720 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 03:13:47.017921 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:13:47.084596 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:13:47.115999 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 03:13:47.163495 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:13:47.706008 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2398 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 03:13:47.711753 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:13:47.724130 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:13:47.787806 tst switch_tch_pdch.py: using LAC 38154 03:13:47.914836 tst switch_tch_pdch.py: using RAC 159 03:13:48.042587 tst switch_tch_pdch.py: using CellId 38154 03:13:48.168362 tst switch_tch_pdch.py: using BVCI 38155 03:13:48.287057 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:13:48.299322 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:13:48.311322 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:13:48.323346 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:13:48.336307 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:13:48.349163 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:13:48.362040 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:13:48.374958 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:13:48.495053 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:13:48.616690 tst switch_tch_pdch.py:51: start network... 03:13:48.833535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:13:49.329671 run create_hlr_db(pid=1778): Launched 03:13:49.451498 bus /gobi_6: Setting Powered False 03:13:50.514884 run create_hlr_db(pid=1778): Terminated: ok {rc=0} 03:13:50.941244 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1781): Launched 03:13:51.238793 run osmo-hlr_10.42.42.2(pid=1782): Launched 03:13:51.352398 run osmo-stp_10.42.42.5: Starting osmo-stp 03:13:51.864639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1784): Launched 03:13:52.163476 run osmo-stp_10.42.42.5(pid=1785): Launched 03:13:52.277120 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:13:52.791180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1787): Launched 03:13:52.904412 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:13:53.155278 run patchelf(pid=1788): Launched 03:13:53.320701 run osmo-stp_10.42.42.5(pid=1785): ERR: Terminated: ERROR {rc=1} [trial-2398↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1785)] 03:13:53.446746 run osmo-stp_10.42.42.5(pid=1785): stdout: | (launched: 2022-12-14_03:13:52.108287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:53.573811 run osmo-stp_10.42.42.5(pid=1785): stderr: | [0;m[38;5;43m20221214031352278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031352278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031352278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031352279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031352279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031352279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031352279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:53.700912 run osmo-stp_10.42.42.5(pid=1785): stdout: | (launched: 2022-12-14_03:13:52.108287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:13:53.822989 run osmo-stp_10.42.42.5(pid=1785): stderr: | [0;m[38;5;43m20221214031352278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031352278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031352278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031352279 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031352279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031352279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031352279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:13:53.967744 run patchelf(pid=1788): Terminating (SIGINT) 03:13:54.136733 run patchelf(pid=1788): Terminated: ok {rc=0} 03:13:54.258195 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1785): Process ended prematurely: osmo-stp_10.42.42.5(pid=1785) [trial-2398↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1785)] [trial-2398↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 03:13:54.267154 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 03:13:54.293742 run osmo-hlr_10.42.42.2(pid=1782): ERR: Terminated: ERROR {rc=237} [trial-2398↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1782)] 03:13:54.340845 run osmo-hlr_10.42.42.2(pid=1782): stdout: | (launched: 2022-12-14_03:13:51.184284) 03:13:54.389866 run osmo-hlr_10.42.42.2(pid=1782): stderr: | [0;m[1;31m20221214031351366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031351366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031351366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031351366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031351366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031351366 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031351378 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031351386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031351386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031351386 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:13:54.439311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1781): Terminating (SIGTERM) 03:13:54.478853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1784): Terminating (SIGTERM) 03:13:54.518211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1787): Terminating (SIGTERM) 03:13:54.558015 --- ParallelTerminationStrategy: PID 1781 died... 03:13:54.576898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1781): Terminated: ok {rc=0} 03:13:54.620467 --- ParallelTerminationStrategy: PID 1784 died... 03:13:54.638987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1784): Terminated: ok {rc=0} 03:13:54.682138 --- ParallelTerminationStrategy: PID 1787 died... 03:13:54.700602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1787): Terminated: ok {rc=0} 03:13:54.783691 bus /gobi_0: Setting Powered False 03:13:55.881684 bus /gobi_0: Setting Powered False 03:13:56.997308 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 sms:nanobts+band-900 --------------------------------------------------------------------- 03:13:58.243274 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:13:58.248540 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 03:13:58.281260 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 03:13:58.309449 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 03:13:58.363328 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 03:13:58.397440 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 03:13:58.424603 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 03:13:58.969082 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 03:13:58.974503 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:13:58.985744 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 03:13:59.032463 tst mo_mt_sms.py: using LAC 38155 03:13:59.157408 tst mo_mt_sms.py: using RAC 160 03:13:59.274650 tst mo_mt_sms.py: using CellId 38155 03:13:59.393124 tst mo_mt_sms.py: using BVCI 38156 03:13:59.500700 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:13:59.511562 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:13:59.522162 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:13:59.532444 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:13:59.542841 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:13:59.553696 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 03:13:59.671700 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 03:13:59.787920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:00.249488 run create_hlr_db(pid=1794): Launched 03:14:00.371172 bus /gobi_6: Setting Powered False 03:14:01.430525 run create_hlr_db(pid=1794): Terminated: ok {rc=0} 03:14:01.856256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1796): Launched 03:14:02.178069 run osmo-hlr_10.42.42.2(pid=1797): Launched 03:14:02.303283 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:02.859005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1799): Launched 03:14:03.180342 run osmo-stp_10.42.42.5(pid=1800): Launched 03:14:03.302949 run osmo-msc_10.42.42.6: Starting osmo-msc 03:14:03.882516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1802): Launched 03:14:04.205708 run osmo-msc_10.42.42.6(pid=1803): Launched 03:14:04.384865 run osmo-stp_10.42.42.5(pid=1800): ERR: Terminated: ERROR {rc=1} [trial-2398↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1800)] 03:14:04.520652 run osmo-stp_10.42.42.5(pid=1800): stdout: | (launched: 2022-12-14_03:14:03.122054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:04.656683 run osmo-stp_10.42.42.5(pid=1800): stderr: | [0;m[38;5;43m20221214031403313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031403313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031403313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031403314 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031403314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031403314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031403314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:04.791828 run osmo-stp_10.42.42.5(pid=1800): stdout: | (launched: 2022-12-14_03:14:03.122054) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:04.920260 run osmo-stp_10.42.42.5(pid=1800): stderr: | [0;m[38;5;43m20221214031403313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031403313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031403313 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031403314 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031403314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031403314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031403314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:05.073500 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=1800): Process ended prematurely: osmo-stp_10.42.42.5(pid=1800) [trial-2398↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1800)] [trial-2398↪sms:nanobts+band-900↪mo_mt_sms.py:16] 03:14:05.082555 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 03:14:05.110059 run osmo-hlr_10.42.42.2(pid=1797): ERR: Terminated: ERROR {rc=237} [trial-2398↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1797)] 03:14:05.160717 run osmo-hlr_10.42.42.2(pid=1797): stdout: | (launched: 2022-12-14_03:14:02.117889) 03:14:05.212913 run osmo-hlr_10.42.42.2(pid=1797): stderr: | [0;m[1;31m20221214031402322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031402322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031402322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031402322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031402322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031402322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031402334 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031402342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031402342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031402342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:14:05.285289 run osmo-msc_10.42.42.6(pid=1803): ERR: Terminated: ERROR {rc=2} [trial-2398↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1803)] 03:14:05.335118 run osmo-msc_10.42.42.6(pid=1803): stdout: | (launched: 2022-12-14_03:14:04.146861) 03:14:05.387329 run osmo-msc_10.42.42.6(pid=1803): stderr: | [0;m[38;5;43m20221214031404469 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031404469 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efe4c488c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031404469 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031404469 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031404470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031404470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031404471 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031404472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031404472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031404472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:14:05.439791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1796): Terminating (SIGTERM) 03:14:05.481833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1799): Terminating (SIGTERM) 03:14:05.524328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1802): Terminating (SIGTERM) 03:14:05.566586 --- ParallelTerminationStrategy: PID 1796 died... 03:14:05.586929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1796): Terminated: ok {rc=0} 03:14:05.633280 --- ParallelTerminationStrategy: PID 1799 died... 03:14:05.653124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1799): Terminated: ok {rc=0} 03:14:05.699079 --- ParallelTerminationStrategy: PID 1802 died... 03:14:05.719011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1802): Terminated: ok {rc=0} 03:14:05.807049 bus /sierra_3: Setting Powered False 03:14:06.905326 bus /sierra_3: Setting Powered False 03:14:08.021797 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 03:14:09.256795 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:14:09.261865 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 03:14:09.294747 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 03:14:09.302130 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 03:14:09.338642 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 03:14:09.371491 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 03:14:09.378406 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 03:14:09.900364 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2398 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 03:14:09.905884 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 03:14:09.917296 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 03:14:09.964581 tst assert_extension.py: using LAC 38156 03:14:10.085191 tst assert_extension.py: using RAC 161 03:14:10.202280 tst assert_extension.py: using CellId 38156 03:14:10.320217 tst assert_extension.py: using BVCI 38157 03:14:10.429298 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 03:14:10.547033 tst assert_extension.py:10: start nitb and bts... 03:14:10.762824 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:14:11.415725 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1808): Launched 03:14:11.736913 run osmo-nitb_10.42.42.2(pid=1809): Launched 03:14:11.915563 run osmo-nitb_10.42.42.2(pid=1809): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1809)] 03:14:12.059453 run osmo-nitb_10.42.42.2(pid=1809): stdout: | (launched: 2022-12-14_03:14:11.678657) 03:14:12.204653 run osmo-nitb_10.42.42.2(pid=1809): stderr: | (launched: 2022-12-14_03:14:11.726430) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:14:12.349322 run osmo-nitb_10.42.42.2(pid=1809): stdout: | (launched: 2022-12-14_03:14:11.678657) 03:14:12.489491 run osmo-nitb_10.42.42.2(pid=1809): stderr: | (launched: 2022-12-14_03:14:11.726430) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1809): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1809) [trial-2398↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1809)] 03:14:12.858618 tst osmo-nitb_10.42.42.2(pid=1809): stdout: | (launched: 2022-12-14_03:14:11.678657) 03:14:12.988900 tst osmo-nitb_10.42.42.2(pid=1809): stderr: | (launched: 2022-12-14_03:14:11.726430) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:14:13.142122 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=1809): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1809) [trial-2398↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1809)] [trial-2398↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 03:14:13.151183 tst assert_extension.py:12: Test FAILED (3.2 sec) 03:14:13.158268 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1808): Terminating (SIGTERM) 03:14:13.370639 --- ParallelTerminationStrategy: PID 1808 died... 03:14:13.392510 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1808): Terminated: ok {rc=0} 03:14:13.482312 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 ussd:nanobts+band-900 --------------------------------------------------------------------- 03:14:14.658824 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:14:14.664098 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 03:14:14.695964 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 03:14:14.723140 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 03:14:14.757927 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 03:14:14.789484 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 03:14:14.815433 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 03:14:15.345287 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2398 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 03:14:15.350444 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:15.361348 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 03:14:15.406418 tst assert_extension.py: using LAC 38157 03:14:15.522946 tst assert_extension.py: using RAC 162 03:14:15.639886 tst assert_extension.py: using CellId 38157 03:14:15.758150 tst assert_extension.py: using BVCI 38158 03:14:15.869669 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:15.882486 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:15.895836 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:15.908164 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:15.919522 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:14:15.930863 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 03:14:16.048691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:16.523602 run create_hlr_db(pid=1813): Launched 03:14:16.680718 bus /sierra_2: Setting Powered False 03:14:17.741210 run create_hlr_db(pid=1813): Terminated: ok {rc=0} 03:14:18.158029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1816): Launched 03:14:18.458035 run osmo-hlr_10.42.42.2(pid=1817): Launched 03:14:18.574434 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:19.110265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1820): Launched 03:14:19.408244 run osmo-stp_10.42.42.5(pid=1821): Launched 03:14:19.522577 run osmo-msc_10.42.42.6: Starting osmo-msc 03:14:20.063544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1823): Launched 03:14:20.362215 run osmo-msc_10.42.42.6(pid=1824): Launched 03:14:20.528533 run osmo-stp_10.42.42.5(pid=1821): ERR: Terminated: ERROR {rc=1} [trial-2398↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1821)] 03:14:20.654759 run osmo-stp_10.42.42.5(pid=1821): stdout: | (launched: 2022-12-14_03:14:19.352853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:20.780770 run osmo-stp_10.42.42.5(pid=1821): stderr: | [0;m[38;5;43m20221214031419525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031419525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031419525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031419526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031419526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031419527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031419527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:20.904653 run osmo-stp_10.42.42.5(pid=1821): stdout: | (launched: 2022-12-14_03:14:19.352853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:21.022853 run osmo-stp_10.42.42.5(pid=1821): stderr: | [0;m[38;5;43m20221214031419525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031419525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031419525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031419526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031419526 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031419527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031419527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:21.164381 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=1821): Process ended prematurely: osmo-stp_10.42.42.5(pid=1821) [trial-2398↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1821)] [trial-2398↪ussd:nanobts+band-900↪assert_extension.py:17] 03:14:21.172533 tst assert_extension.py:17: Test FAILED (5.8 sec) 03:14:21.198374 run osmo-hlr_10.42.42.2(pid=1817): ERR: Terminated: ERROR {rc=237} [trial-2398↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1817)] 03:14:21.245669 run osmo-hlr_10.42.42.2(pid=1817): stdout: | (launched: 2022-12-14_03:14:18.402998) 03:14:21.294848 run osmo-hlr_10.42.42.2(pid=1817): stderr: | [0;m[1;31m20221214031418579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031418579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031418579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031418579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031418579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031418579 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031418591 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031418600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031418600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031418600 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:14:21.363553 run osmo-msc_10.42.42.6(pid=1824): ERR: Terminated: ERROR {rc=2} [trial-2398↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1824)] 03:14:21.410705 run osmo-msc_10.42.42.6(pid=1824): stdout: | (launched: 2022-12-14_03:14:20.306724) 03:14:21.459605 run osmo-msc_10.42.42.6(pid=1824): stderr: | [0;m[38;5;43m20221214031420577 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031420577 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff4cdc59c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031420577 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031420577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031420578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031420578 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031420580 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031420580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031420580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031420580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:14:21.508834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1816): Terminating (SIGTERM) 03:14:21.548121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1820): Terminating (SIGTERM) 03:14:21.587367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1823): Terminating (SIGTERM) 03:14:21.626805 --- ParallelTerminationStrategy: PID 1816 died... 03:14:21.645834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1816): Terminated: ok {rc=0} 03:14:21.689748 --- ParallelTerminationStrategy: PID 1820 died... 03:14:21.708078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1820): Terminated: ok {rc=0} 03:14:21.752012 --- ParallelTerminationStrategy: PID 1823 died... 03:14:21.770539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1823): Terminated: ok {rc=0} 03:14:21.855917 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 03:14:23.070458 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:14:23.078525 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 03:14:23.111615 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 03:14:23.145971 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 03:14:23.201333 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 03:14:23.234797 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 03:14:23.262622 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 03:14:23.812276 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 03:14:23.866347 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:23.878212 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:14:23.946592 tst mo_mt_call.py: using LAC 38158 03:14:24.074940 tst mo_mt_call.py: using RAC 163 03:14:24.205386 tst mo_mt_call.py: using CellId 38158 03:14:24.333665 tst mo_mt_call.py: using BVCI 38159 03:14:24.452872 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:24.464669 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:24.476591 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:24.488248 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:24.500213 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:24.512145 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:14:24.629538 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:14:24.748124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:25.219307 run create_hlr_db(pid=1829): Launched 03:14:25.344356 bus /sierra_2: Setting Powered False 03:14:26.405494 run create_hlr_db(pid=1829): Terminated: ok {rc=0} 03:14:26.850373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1831): Launched 03:14:27.177203 run osmo-hlr_10.42.42.2(pid=1832): Launched 03:14:27.303086 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:27.864167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1834): Launched 03:14:28.190460 run osmo-stp_10.42.42.5(pid=1835): Launched 03:14:28.316371 run osmo-msc_10.42.42.6: Starting osmo-msc 03:14:28.906458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1837): Launched 03:14:29.235205 run osmo-msc_10.42.42.6(pid=1838): Launched 03:14:29.417480 run osmo-stp_10.42.42.5(pid=1835): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1835)] 03:14:29.555603 run osmo-stp_10.42.42.5(pid=1835): stdout: | (launched: 2022-12-14_03:14:28.131288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:29.694646 run osmo-stp_10.42.42.5(pid=1835): stderr: | [0;m[38;5;43m20221214031428323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031428323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031428323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031428324 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031428324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031428324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031428324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:29.825919 run osmo-stp_10.42.42.5(pid=1835): stdout: | (launched: 2022-12-14_03:14:28.131288) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:29.947899 run osmo-stp_10.42.42.5(pid=1835): stderr: | [0;m[38;5;43m20221214031428323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031428323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031428323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031428324 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031428324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031428324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031428324 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:30.092531 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1835): Process ended prematurely: osmo-stp_10.42.42.5(pid=1835) [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1835)] [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 03:14:30.101717 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 03:14:30.128508 run osmo-hlr_10.42.42.2(pid=1832): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1832)] 03:14:30.176312 run osmo-hlr_10.42.42.2(pid=1832): stdout: | (launched: 2022-12-14_03:14:27.117952) 03:14:30.226139 run osmo-hlr_10.42.42.2(pid=1832): stderr: | [0;m[1;31m20221214031427317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031427317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031427317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031427317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031427317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031427317 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031427350 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031427360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031427360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031427360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:14:30.296096 run osmo-msc_10.42.42.6(pid=1838): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1838)] 03:14:30.343969 run osmo-msc_10.42.42.6(pid=1838): stdout: | (launched: 2022-12-14_03:14:29.175334) 03:14:30.393711 run osmo-msc_10.42.42.6(pid=1838): stderr: | [0;m[38;5;43m20221214031429494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031429494 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1acf301c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031429494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031429494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031429495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031429495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031429496 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031429497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031429497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031429497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:14:30.443409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1831): Terminating (SIGTERM) 03:14:30.483368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1834): Terminating (SIGTERM) 03:14:30.523470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1837): Terminating (SIGTERM) 03:14:30.564043 --- ParallelTerminationStrategy: PID 1831 died... 03:14:30.583683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1831): Terminated: ok {rc=0} 03:14:30.628437 --- ParallelTerminationStrategy: PID 1834 died... 03:14:30.647413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1834): Terminated: ok {rc=0} 03:14:30.691673 --- ParallelTerminationStrategy: PID 1837 died... 03:14:30.710632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1837): Terminated: ok {rc=0} 03:14:30.796607 bus /sierra_3: Setting Powered False 03:14:31.906906 bus /sierra_3: Setting Powered False 03:14:33.041623 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 03:14:34.188211 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:34.200062 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 03:14:34.266164 tst mo_mt_call_osmux.py: using LAC 38159 03:14:34.385746 tst mo_mt_call_osmux.py: using RAC 164 03:14:34.509106 tst mo_mt_call_osmux.py: using CellId 38159 03:14:34.628754 tst mo_mt_call_osmux.py: using BVCI 38160 03:14:34.738334 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:34.749451 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:34.760334 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:34.771142 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:34.782200 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 03:14:34.793099 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:14:34.913923 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 03:14:35.031152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:35.502875 run create_hlr_db(pid=1840): Launched 03:14:35.627768 bus /sierra_2: Setting Powered False 03:14:36.687875 run create_hlr_db(pid=1840): Terminated: ok {rc=0} 03:14:37.132826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1842): Launched 03:14:37.460784 run osmo-hlr_10.42.42.2(pid=1843): Launched 03:14:37.590380 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:38.158111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1845): Launched 03:14:38.486021 run osmo-stp_10.42.42.5(pid=1846): Launched 03:14:38.612224 run osmo-msc_10.42.42.6: Starting osmo-msc 03:14:39.202535 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1848): Launched 03:14:39.531548 run osmo-msc_10.42.42.6(pid=1849): Launched 03:14:39.714774 run osmo-stp_10.42.42.5(pid=1846): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1846)] 03:14:39.854427 run osmo-stp_10.42.42.5(pid=1846): stdout: | (launched: 2022-12-14_03:14:38.425589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:39.995690 run osmo-stp_10.42.42.5(pid=1846): stderr: | [0;m[38;5;43m20221214031438619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031438619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031438619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031438620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031438620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031438620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031438620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:40.133184 run osmo-stp_10.42.42.5(pid=1846): stdout: | (launched: 2022-12-14_03:14:38.425589) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:40.263833 run osmo-stp_10.42.42.5(pid=1846): stderr: | [0;m[38;5;43m20221214031438619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031438619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031438619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031438620 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031438620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031438620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031438620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:40.420882 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1846): Process ended prematurely: osmo-stp_10.42.42.5(pid=1846) [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1846)] [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 03:14:40.430897 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 03:14:40.459137 run osmo-hlr_10.42.42.2(pid=1843): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1843)] 03:14:40.510885 run osmo-hlr_10.42.42.2(pid=1843): stdout: | (launched: 2022-12-14_03:14:37.401391) 03:14:40.563459 run osmo-hlr_10.42.42.2(pid=1843): stderr: | [0;m[1;31m20221214031437602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031437602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031437602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031437602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031437602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031437602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031437615 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031437623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031437623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031437623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:14:40.636425 run osmo-msc_10.42.42.6(pid=1849): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1849)] 03:14:40.686629 run osmo-msc_10.42.42.6(pid=1849): stdout: | (launched: 2022-12-14_03:14:39.471019) 03:14:40.739021 run osmo-msc_10.42.42.6(pid=1849): stderr: | [0;m[38;5;43m20221214031439790 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031439791 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0837a64c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031439791 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031439791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031439791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031439791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031439793 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031439793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031439793 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031439794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:14:40.791622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1842): Terminating (SIGTERM) 03:14:40.833872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1845): Terminating (SIGTERM) 03:14:40.876008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1848): Terminating (SIGTERM) 03:14:40.918726 --- ParallelTerminationStrategy: PID 1842 died... 03:14:40.939448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1842): Terminated: ok {rc=0} 03:14:40.986660 --- ParallelTerminationStrategy: PID 1845 died... 03:14:41.006827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1845): Terminated: ok {rc=0} 03:14:41.053690 --- ParallelTerminationStrategy: PID 1848 died... 03:14:41.073849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1848): Terminated: ok {rc=0} 03:14:41.162751 bus /sierra_3: Setting Powered False 03:14:42.261404 bus /sierra_3: Setting Powered False 03:14:43.377239 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 03:14:44.632697 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:14:44.640878 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 03:14:44.674713 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 03:14:44.701889 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 03:14:44.755826 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 03:14:44.789627 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 03:14:44.817167 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 03:14:45.366717 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 03:14:45.419386 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:45.431110 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:14:45.499560 tst mo_mt_call.py: using LAC 38160 03:14:45.627814 tst mo_mt_call.py: using RAC 165 03:14:45.747654 tst mo_mt_call.py: using CellId 38160 03:14:45.887510 tst mo_mt_call.py: using BVCI 38161 03:14:46.029689 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:46.042203 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:46.054713 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:46.067113 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:46.080774 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:46.094358 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:14:46.224408 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:14:46.392097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:46.886093 run create_hlr_db(pid=1855): Launched 03:14:47.046678 bus /sierra_2: Setting Powered False 03:14:48.107671 run create_hlr_db(pid=1855): Terminated: ok {rc=0} 03:14:48.553232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1857): Launched 03:14:48.878963 run osmo-hlr_10.42.42.2(pid=1858): Launched 03:14:49.004762 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:49.568265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1860): Launched 03:14:49.896505 run osmo-stp_10.42.42.5(pid=1861): Launched 03:14:50.021466 run osmo-msc_10.42.42.6: Starting osmo-msc 03:14:50.613138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1863): Launched 03:14:50.939148 run osmo-msc_10.42.42.6(pid=1864): Launched 03:14:51.122366 run osmo-stp_10.42.42.5(pid=1861): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1861)] 03:14:51.259927 run osmo-stp_10.42.42.5(pid=1861): stdout: | (launched: 2022-12-14_03:14:49.836746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:51.398935 run osmo-stp_10.42.42.5(pid=1861): stderr: | [0;m[38;5;43m20221214031450030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031450030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031450030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031450031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031450031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031450031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031450031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:51.536779 run osmo-stp_10.42.42.5(pid=1861): stdout: | (launched: 2022-12-14_03:14:49.836746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:14:51.667522 run osmo-stp_10.42.42.5(pid=1861): stderr: | [0;m[38;5;43m20221214031450030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031450030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031450030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031450031 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031450031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031450031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031450031 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:14:51.823527 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1861): Process ended prematurely: osmo-stp_10.42.42.5(pid=1861) [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1861)] [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 03:14:51.833397 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 03:14:51.861303 run osmo-hlr_10.42.42.2(pid=1858): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1858)] 03:14:51.911895 run osmo-hlr_10.42.42.2(pid=1858): stdout: | (launched: 2022-12-14_03:14:48.819657) 03:14:51.964036 run osmo-hlr_10.42.42.2(pid=1858): stderr: | [0;m[1;31m20221214031449018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031449018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031449018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031449018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031449018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031449018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031449031 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031449039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031449039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031449039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:14:52.036273 run osmo-msc_10.42.42.6(pid=1864): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1864)] 03:14:52.085923 run osmo-msc_10.42.42.6(pid=1864): stdout: | (launched: 2022-12-14_03:14:50.879835) 03:14:52.137651 run osmo-msc_10.42.42.6(pid=1864): stderr: | [0;m[38;5;43m20221214031451198 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031451199 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f20d8a1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031451199 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031451199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031451199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031451199 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031451201 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031451201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031451201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031451202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:14:52.190221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1857): Terminating (SIGTERM) 03:14:52.231902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1860): Terminating (SIGTERM) 03:14:52.274348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1863): Terminating (SIGTERM) 03:14:52.317099 --- ParallelTerminationStrategy: PID 1857 died... 03:14:52.337811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1857): Terminated: ok {rc=0} 03:14:52.384649 --- ParallelTerminationStrategy: PID 1860 died... 03:14:52.404793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1860): Terminated: ok {rc=0} 03:14:52.451540 --- ParallelTerminationStrategy: PID 1863 died... 03:14:52.471669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1863): Terminated: ok {rc=0} 03:14:52.561735 bus /sierra_3: Setting Powered False 03:14:53.660871 bus /sierra_3: Setting Powered False 03:14:54.777157 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 03:14:55.926446 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:55.939043 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 03:14:56.012014 tst mo_mt_call_osmux.py: using LAC 38161 03:14:56.131687 tst mo_mt_call_osmux.py: using RAC 166 03:14:56.250858 tst mo_mt_call_osmux.py: using CellId 38161 03:14:56.370304 tst mo_mt_call_osmux.py: using BVCI 38162 03:14:56.479887 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:56.491629 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:56.502844 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:56.514040 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:56.525293 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 03:14:56.536374 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:14:56.655758 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 03:14:56.773133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:14:57.243546 run create_hlr_db(pid=1866): Launched 03:14:57.367683 bus /sierra_2: Setting Powered False 03:14:58.427753 run create_hlr_db(pid=1866): Terminated: ok {rc=0} 03:14:58.873560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1868): Launched 03:14:59.205399 run osmo-hlr_10.42.42.2(pid=1869): Launched 03:14:59.328472 run osmo-stp_10.42.42.5: Starting osmo-stp 03:14:59.884899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1871): Launched 03:15:00.207374 run osmo-stp_10.42.42.5(pid=1872): Launched 03:15:00.330715 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:00.957837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1874): Launched 03:15:01.301703 run osmo-msc_10.42.42.6(pid=1878): Launched 03:15:01.612909 run osmo-stp_10.42.42.5(pid=1872): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1872)] 03:15:01.882470 run osmo-stp_10.42.42.5(pid=1872): stdout: | (launched: 2022-12-14_03:15:00.148396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:02.048806 run osmo-stp_10.42.42.5(pid=1872): stderr: | [0;m[38;5;43m20221214031500339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031500339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031500340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031500340 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031500341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031500341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031500341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:02.232381 run osmo-stp_10.42.42.5(pid=1872): stdout: | (launched: 2022-12-14_03:15:00.148396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:02.402066 run osmo-stp_10.42.42.5(pid=1872): stderr: | [0;m[38;5;43m20221214031500339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031500339 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031500340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031500340 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031500341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031500341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031500341 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:02.560124 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1872): Process ended prematurely: osmo-stp_10.42.42.5(pid=1872) [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1872)] [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 03:15:02.569961 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 03:15:02.597850 run osmo-hlr_10.42.42.2(pid=1869): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1869)] 03:15:02.649632 run osmo-hlr_10.42.42.2(pid=1869): stdout: | (launched: 2022-12-14_03:14:59.146617) 03:15:02.702517 run osmo-hlr_10.42.42.2(pid=1869): stderr: | [0;m[1;31m20221214031459342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031459342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031459342 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031459343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031459343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031459343 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031459356 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031459364 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031459365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031459365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:15:02.775363 run osmo-msc_10.42.42.6(pid=1878): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1878)] 03:15:02.825149 run osmo-msc_10.42.42.6(pid=1878): stdout: | (launched: 2022-12-14_03:15:01.232205) 03:15:02.877481 run osmo-msc_10.42.42.6(pid=1878): stderr: | [0;m[38;5;43m20221214031501879 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031501880 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd311b12c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031501880 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031501880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031501881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031501884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031501890 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031501894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031501894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031501894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:15:02.929760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1868): Terminating (SIGTERM) 03:15:02.971986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1871): Terminating (SIGTERM) 03:15:03.014523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1874): Terminating (SIGTERM) 03:15:03.057564 --- ParallelTerminationStrategy: PID 1868 died... 03:15:03.078479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1868): Terminated: ok {rc=0} 03:15:03.125677 --- ParallelTerminationStrategy: PID 1871 died... 03:15:03.146125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1871): Terminated: ok {rc=0} 03:15:03.192924 --- ParallelTerminationStrategy: PID 1874 died... 03:15:03.213618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1874): Terminated: ok {rc=0} 03:15:03.303716 bus /sierra_3: Setting Powered False 03:15:04.402122 bus /sierra_3: Setting Powered False 03:15:05.518983 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 03:15:06.764351 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:15:06.771615 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 03:15:06.802721 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 03:15:06.829053 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 03:15:06.878162 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 03:15:06.909585 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 03:15:06.935466 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 03:15:07.489350 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 03:15:07.537509 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:07.548615 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:15:07.612816 tst mo_mt_call.py: using LAC 38162 03:15:07.729190 tst mo_mt_call.py: using RAC 167 03:15:07.845625 tst mo_mt_call.py: using CellId 38162 03:15:07.962090 tst mo_mt_call.py: using BVCI 38163 03:15:08.070521 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:08.081670 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:08.092487 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:08.103297 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:08.114335 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:08.125286 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:15:08.244856 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:15:08.362425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:08.828860 run create_hlr_db(pid=1883): Launched 03:15:08.952169 bus /sierra_2: Setting Powered False 03:15:10.012517 run create_hlr_db(pid=1883): Terminated: ok {rc=0} 03:15:10.451778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1885): Launched 03:15:10.775083 run osmo-hlr_10.42.42.2(pid=1886): Launched 03:15:10.898730 run osmo-stp_10.42.42.5: Starting osmo-stp 03:15:11.455280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1888): Launched 03:15:11.778193 run osmo-stp_10.42.42.5(pid=1889): Launched 03:15:11.901729 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:12.484146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1891): Launched 03:15:12.808315 run osmo-msc_10.42.42.6(pid=1892): Launched 03:15:12.988102 run osmo-stp_10.42.42.5(pid=1889): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1889)] 03:15:13.124451 run osmo-stp_10.42.42.5(pid=1889): stdout: | (launched: 2022-12-14_03:15:11.719793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:13.261481 run osmo-stp_10.42.42.5(pid=1889): stderr: | [0;m[38;5;43m20221214031511912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031511912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031511912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031511913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031511913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031511913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031511913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:13.397788 run osmo-stp_10.42.42.5(pid=1889): stdout: | (launched: 2022-12-14_03:15:11.719793) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:13.527113 run osmo-stp_10.42.42.5(pid=1889): stderr: | [0;m[38;5;43m20221214031511912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031511912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031511912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031511913 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031511913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031511913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031511913 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:13.681568 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1889): Process ended prematurely: osmo-stp_10.42.42.5(pid=1889) [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1889)] [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 03:15:13.691296 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 03:15:13.719122 run osmo-hlr_10.42.42.2(pid=1886): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1886)] 03:15:13.769586 run osmo-hlr_10.42.42.2(pid=1886): stdout: | (launched: 2022-12-14_03:15:10.716335) 03:15:13.821389 run osmo-hlr_10.42.42.2(pid=1886): stderr: | [0;m[1;31m20221214031510913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031510913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031510913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031510913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031510913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031510913 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031510925 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031510934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031510934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031510935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:15:13.893932 run osmo-msc_10.42.42.6(pid=1892): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1892)] 03:15:13.943497 run osmo-msc_10.42.42.6(pid=1892): stdout: | (launched: 2022-12-14_03:15:12.749694) 03:15:13.995573 run osmo-msc_10.42.42.6(pid=1892): stderr: | [0;m[38;5;43m20221214031513072 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031513073 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe5091adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031513073 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031513073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031513073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031513073 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031513075 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031513075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031513075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031513075 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:15:14.047855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1885): Terminating (SIGTERM) 03:15:14.089650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1888): Terminating (SIGTERM) 03:15:14.131652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1891): Terminating (SIGTERM) 03:15:14.174480 --- ParallelTerminationStrategy: PID 1885 died... 03:15:14.194754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1885): Terminated: ok {rc=0} 03:15:14.240734 --- ParallelTerminationStrategy: PID 1888 died... 03:15:14.260285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1888): Terminated: ok {rc=0} 03:15:14.306501 --- ParallelTerminationStrategy: PID 1891 died... 03:15:14.326254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1891): Terminated: ok {rc=0} 03:15:14.414001 bus /sierra_3: Setting Powered False 03:15:15.512468 bus /sierra_3: Setting Powered False 03:15:16.631788 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 03:15:17.777085 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:17.788822 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 03:15:17.854932 tst mo_mt_call_osmux.py: using LAC 38163 03:15:17.974889 tst mo_mt_call_osmux.py: using RAC 168 03:15:18.094742 tst mo_mt_call_osmux.py: using CellId 38163 03:15:18.214795 tst mo_mt_call_osmux.py: using BVCI 38164 03:15:18.325251 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:18.336362 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:18.347280 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:18.358196 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:18.369241 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 03:15:18.380088 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:15:18.493817 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 03:15:18.612747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:19.081122 run create_hlr_db(pid=1894): Launched 03:15:19.204086 bus /sierra_2: Setting Powered False 03:15:20.264885 run create_hlr_db(pid=1894): Terminated: ok {rc=0} 03:15:20.707414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1896): Launched 03:15:21.031335 run osmo-hlr_10.42.42.2(pid=1897): Launched 03:15:21.154951 run osmo-stp_10.42.42.5: Starting osmo-stp 03:15:21.712328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1899): Launched 03:15:22.035140 run osmo-stp_10.42.42.5(pid=1900): Launched 03:15:22.158431 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:22.743437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1902): Launched 03:15:23.066429 run osmo-msc_10.42.42.6(pid=1903): Launched 03:15:23.247457 run osmo-stp_10.42.42.5(pid=1900): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1900)] 03:15:23.384767 run osmo-stp_10.42.42.5(pid=1900): stdout: | (launched: 2022-12-14_03:15:21.976300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:23.522801 run osmo-stp_10.42.42.5(pid=1900): stderr: | [0;m[38;5;43m20221214031522168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031522168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031522168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031522169 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031522169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031522169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031522169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:23.659588 run osmo-stp_10.42.42.5(pid=1900): stdout: | (launched: 2022-12-14_03:15:21.976300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:23.788706 run osmo-stp_10.42.42.5(pid=1900): stderr: | [0;m[38;5;43m20221214031522168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031522168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031522168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031522169 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031522169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031522169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031522169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:23.943607 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1900): Process ended prematurely: osmo-stp_10.42.42.5(pid=1900) [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1900)] [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 03:15:23.953411 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 03:15:23.980930 run osmo-hlr_10.42.42.2(pid=1897): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1897)] 03:15:24.031934 run osmo-hlr_10.42.42.2(pid=1897): stdout: | (launched: 2022-12-14_03:15:20.972328) 03:15:24.084446 run osmo-hlr_10.42.42.2(pid=1897): stderr: | [0;m[1;31m20221214031521171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031521171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031521171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031521171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031521171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031521171 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031521183 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031521191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031521191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031521191 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:15:24.156911 run osmo-msc_10.42.42.6(pid=1903): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1903)] 03:15:24.206537 run osmo-msc_10.42.42.6(pid=1903): stdout: | (launched: 2022-12-14_03:15:23.007674) 03:15:24.259356 run osmo-msc_10.42.42.6(pid=1903): stderr: | [0;m[38;5;43m20221214031523330 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031523330 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4db81c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031523331 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031523331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031523331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031523331 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031523333 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031523333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031523333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031523333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:15:24.311472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1896): Terminating (SIGTERM) 03:15:24.353478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1899): Terminating (SIGTERM) 03:15:24.396317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1902): Terminating (SIGTERM) 03:15:24.438615 --- ParallelTerminationStrategy: PID 1896 died... 03:15:24.459006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1896): Terminated: ok {rc=0} 03:15:24.505524 --- ParallelTerminationStrategy: PID 1899 died... 03:15:24.525510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1899): Terminated: ok {rc=0} 03:15:24.572026 --- ParallelTerminationStrategy: PID 1902 died... 03:15:24.591855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1902): Terminated: ok {rc=0} 03:15:24.681324 bus /sierra_3: Setting Powered False 03:15:25.776355 bus /sierra_3: Setting Powered False 03:15:26.890344 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 03:15:28.134342 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:15:28.141689 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 03:15:28.173178 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 03:15:28.199460 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 03:15:28.249947 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 03:15:28.281760 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 03:15:28.307851 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 03:15:28.862612 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 03:15:28.915225 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:28.926888 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:15:28.993640 tst mo_mt_call.py: using LAC 38164 03:15:29.113387 tst mo_mt_call.py: using RAC 169 03:15:29.233828 tst mo_mt_call.py: using CellId 38164 03:15:29.351007 tst mo_mt_call.py: using BVCI 38165 03:15:29.459439 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:29.470579 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:29.481669 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:29.492314 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:29.503249 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:29.514098 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:15:29.634615 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:15:29.755292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:30.255308 run create_hlr_db(pid=1909): Launched 03:15:30.379028 bus /sierra_2: Setting Powered False 03:15:31.441612 run create_hlr_db(pid=1909): Terminated: ok {rc=0} 03:15:31.904039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1911): Launched 03:15:32.242820 run osmo-hlr_10.42.42.2(pid=1912): Launched 03:15:32.367365 run osmo-stp_10.42.42.5: Starting osmo-stp 03:15:32.923991 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1914): Launched 03:15:33.246732 run osmo-stp_10.42.42.5(pid=1915): Launched 03:15:33.370357 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:33.953724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1917): Launched 03:15:34.275801 run osmo-msc_10.42.42.6(pid=1918): Launched 03:15:34.455973 run osmo-stp_10.42.42.5(pid=1915): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1915)] 03:15:34.593450 run osmo-stp_10.42.42.5(pid=1915): stdout: | (launched: 2022-12-14_03:15:33.188166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:34.730089 run osmo-stp_10.42.42.5(pid=1915): stderr: | [0;m[38;5;43m20221214031533381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031533381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031533381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031533381 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031533382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031533382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031533382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:34.866709 run osmo-stp_10.42.42.5(pid=1915): stdout: | (launched: 2022-12-14_03:15:33.188166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:34.995540 run osmo-stp_10.42.42.5(pid=1915): stderr: | [0;m[38;5;43m20221214031533381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031533381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031533381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031533381 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031533382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031533382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031533382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:35.149559 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1915): Process ended prematurely: osmo-stp_10.42.42.5(pid=1915) [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1915)] [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 03:15:35.159114 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 03:15:35.186629 run osmo-hlr_10.42.42.2(pid=1912): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1912)] 03:15:35.236696 run osmo-hlr_10.42.42.2(pid=1912): stdout: | (launched: 2022-12-14_03:15:32.184194) 03:15:35.288487 run osmo-hlr_10.42.42.2(pid=1912): stderr: | [0;m[1;31m20221214031532381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031532381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031532381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031532381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031532381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031532381 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031532393 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031532401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031532401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031532401 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:15:35.360372 run osmo-msc_10.42.42.6(pid=1918): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1918)] 03:15:35.409602 run osmo-msc_10.42.42.6(pid=1918): stdout: | (launched: 2022-12-14_03:15:34.217246) 03:15:35.461278 run osmo-msc_10.42.42.6(pid=1918): stderr: | [0;m[38;5;43m20221214031534536 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031534536 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4b04ffdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031534536 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031534536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031534537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031534537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031534538 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031534539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031534539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031534539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:15:35.513382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1911): Terminating (SIGTERM) 03:15:35.554865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1914): Terminating (SIGTERM) 03:15:35.596833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1917): Terminating (SIGTERM) 03:15:35.638925 --- ParallelTerminationStrategy: PID 1911 died... 03:15:35.659164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1911): Terminated: ok {rc=0} 03:15:35.704918 --- ParallelTerminationStrategy: PID 1914 died... 03:15:35.724679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1914): Terminated: ok {rc=0} 03:15:35.770377 --- ParallelTerminationStrategy: PID 1917 died... 03:15:35.790070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1917): Terminated: ok {rc=0} 03:15:35.877197 bus /sierra_3: Setting Powered False 03:15:36.975903 bus /sierra_3: Setting Powered False 03:15:38.090962 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 03:15:39.238849 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:39.251475 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 03:15:39.320077 tst mo_mt_call_osmux.py: using LAC 38165 03:15:39.446458 tst mo_mt_call_osmux.py: using RAC 170 03:15:39.576344 tst mo_mt_call_osmux.py: using CellId 38165 03:15:39.694887 tst mo_mt_call_osmux.py: using BVCI 38166 03:15:39.805531 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:39.816666 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:39.827832 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:39.838733 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:39.849872 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 03:15:39.860654 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:15:39.979652 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 03:15:40.100607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:40.603850 run create_hlr_db(pid=1920): Launched 03:15:40.728115 bus /sierra_2: Setting Powered False 03:15:41.788160 run create_hlr_db(pid=1920): Terminated: ok {rc=0} 03:15:42.241646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1922): Launched 03:15:42.566275 run osmo-hlr_10.42.42.2(pid=1923): Launched 03:15:42.690259 run osmo-stp_10.42.42.5: Starting osmo-stp 03:15:43.249511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1925): Launched 03:15:43.573733 run osmo-stp_10.42.42.5(pid=1926): Launched 03:15:43.698151 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:44.284349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1928): Launched 03:15:44.608823 run osmo-msc_10.42.42.6(pid=1931): Launched 03:15:44.789981 run osmo-stp_10.42.42.5(pid=1926): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1926)] 03:15:44.927726 run osmo-stp_10.42.42.5(pid=1926): stdout: | (launched: 2022-12-14_03:15:43.514594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:45.065781 run osmo-stp_10.42.42.5(pid=1926): stderr: | [0;m[38;5;43m20221214031543705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031543705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031543705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031543705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031543706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031543706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031543706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:45.202912 run osmo-stp_10.42.42.5(pid=1926): stdout: | (launched: 2022-12-14_03:15:43.514594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:45.332669 run osmo-stp_10.42.42.5(pid=1926): stderr: | [0;m[38;5;43m20221214031543705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031543705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031543705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031543705 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031543706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031543706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031543706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:45.487817 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1926): Process ended prematurely: osmo-stp_10.42.42.5(pid=1926) [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1926)] [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 03:15:45.497588 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 03:15:45.525847 run osmo-hlr_10.42.42.2(pid=1923): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1923)] 03:15:45.576673 run osmo-hlr_10.42.42.2(pid=1923): stdout: | (launched: 2022-12-14_03:15:42.507392) 03:15:45.628764 run osmo-hlr_10.42.42.2(pid=1923): stderr: | [0;m[1;31m20221214031542703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031542703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031542703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031542703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031542703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031542703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031542716 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031542724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031542724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031542724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:15:45.701400 run osmo-msc_10.42.42.6(pid=1931): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1931)] 03:15:45.751227 run osmo-msc_10.42.42.6(pid=1931): stdout: | (launched: 2022-12-14_03:15:44.549653) 03:15:45.803704 run osmo-msc_10.42.42.6(pid=1931): stderr: | [0;m[38;5;43m20221214031544870 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031544870 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f11052edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031544871 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031544871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031544871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031544871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031544873 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031544874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031544874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031544874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:15:45.865097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1922): Terminating (SIGTERM) 03:15:45.912677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1925): Terminating (SIGTERM) 03:15:45.956836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1928): Terminating (SIGTERM) 03:15:46.002063 --- ParallelTerminationStrategy: PID 1922 died... 03:15:46.023260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1922): Terminated: ok {rc=0} 03:15:46.072031 --- ParallelTerminationStrategy: PID 1925 died... 03:15:46.092762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1925): Terminated: ok {rc=0} 03:15:46.140431 --- ParallelTerminationStrategy: PID 1928 died... 03:15:46.161347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1928): Terminated: ok {rc=0} 03:15:46.251879 bus /sierra_3: Setting Powered False 03:15:47.353441 bus /sierra_3: Setting Powered False 03:15:48.470918 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 03:15:49.721018 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:15:49.728729 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:15:49.761082 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 03:15:49.787727 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:15:49.838943 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:15:49.870046 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 03:15:49.895906 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:15:50.448405 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 03:15:50.496547 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:50.507807 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:15:50.573562 tst mo_mt_call.py: using LAC 38166 03:15:50.691459 tst mo_mt_call.py: using RAC 171 03:15:50.820138 tst mo_mt_call.py: using CellId 38166 03:15:50.951890 tst mo_mt_call.py: using BVCI 38167 03:15:51.062455 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:51.073589 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:51.084633 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:51.095799 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:51.106967 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:15:51.118128 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:15:51.238347 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:15:51.361701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:15:51.862615 run create_hlr_db(pid=1936): Launched 03:15:51.991632 bus /sierra_2: Setting Powered False 03:15:53.055176 run create_hlr_db(pid=1936): Terminated: ok {rc=0} 03:15:53.503266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1940): Launched 03:15:53.826605 run osmo-hlr_10.42.42.2(pid=1941): Launched 03:15:53.950812 run osmo-stp_10.42.42.5: Starting osmo-stp 03:15:54.507921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1943): Launched 03:15:54.830934 run osmo-stp_10.42.42.5(pid=1944): Launched 03:15:54.954058 run osmo-msc_10.42.42.6: Starting osmo-msc 03:15:55.537848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1946): Launched 03:15:55.859281 run osmo-msc_10.42.42.6(pid=1947): Launched 03:15:56.039501 run osmo-stp_10.42.42.5(pid=1944): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1944)] 03:15:56.175973 run osmo-stp_10.42.42.5(pid=1944): stdout: | (launched: 2022-12-14_03:15:54.772117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:56.313472 run osmo-stp_10.42.42.5(pid=1944): stderr: | [0;m[38;5;43m20221214031554966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031554966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031554966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031554966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031554967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031554967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031554967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:56.449631 run osmo-stp_10.42.42.5(pid=1944): stdout: | (launched: 2022-12-14_03:15:54.772117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:15:56.579308 run osmo-stp_10.42.42.5(pid=1944): stderr: | [0;m[38;5;43m20221214031554966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031554966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031554966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031554966 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031554967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031554967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031554967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:15:56.733927 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1944): Process ended prematurely: osmo-stp_10.42.42.5(pid=1944) [trial-2398↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1944)] [trial-2398↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 03:15:56.743445 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 03:15:56.771195 run osmo-hlr_10.42.42.2(pid=1941): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1941)] 03:15:56.821567 run osmo-hlr_10.42.42.2(pid=1941): stdout: | (launched: 2022-12-14_03:15:53.767638) 03:15:56.873847 run osmo-hlr_10.42.42.2(pid=1941): stderr: | [0;m[1;31m20221214031553964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031553964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031553964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031553964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031553964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031553964 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031553977 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031553986 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031553987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031553987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:15:56.946105 run osmo-msc_10.42.42.6(pid=1947): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1947)] 03:15:56.995846 run osmo-msc_10.42.42.6(pid=1947): stdout: | (launched: 2022-12-14_03:15:55.800783) 03:15:57.047708 run osmo-msc_10.42.42.6(pid=1947): stderr: | [0;m[38;5;43m20221214031556120 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031556121 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6c69b55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031556121 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031556121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031556121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031556121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031556123 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031556123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031556123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031556123 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:15:57.099570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1940): Terminating (SIGTERM) 03:15:57.141215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1943): Terminating (SIGTERM) 03:15:57.183336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1946): Terminating (SIGTERM) 03:15:57.225209 --- ParallelTerminationStrategy: PID 1940 died... 03:15:57.245453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1940): Terminated: ok {rc=0} 03:15:57.291506 --- ParallelTerminationStrategy: PID 1943 died... 03:15:57.311201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1943): Terminated: ok {rc=0} 03:15:57.357148 --- ParallelTerminationStrategy: PID 1946 died... 03:15:57.376782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1946): Terminated: ok {rc=0} 03:15:57.465207 bus /sierra_3: Setting Powered False 03:15:58.563282 bus /sierra_3: Setting Powered False 03:15:59.680041 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 03:16:00.827829 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:00.844659 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:16:00.914115 tst mo_mt_call_osmux.py: using LAC 38167 03:16:01.047248 tst mo_mt_call_osmux.py: using RAC 172 03:16:01.176230 tst mo_mt_call_osmux.py: using CellId 38167 03:16:01.304042 tst mo_mt_call_osmux.py: using BVCI 38168 03:16:01.455726 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:01.467437 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:01.479179 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:01.491005 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:01.503213 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 03:16:01.515123 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:16:01.632543 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:16:01.754223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:16:02.289343 run create_hlr_db(pid=1949): Launched 03:16:02.425691 bus /sierra_2: Setting Powered False 03:16:03.486499 run create_hlr_db(pid=1949): Terminated: ok {rc=0} 03:16:03.928019 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1951): Launched 03:16:04.251851 run osmo-hlr_10.42.42.2(pid=1952): Launched 03:16:04.375718 run osmo-stp_10.42.42.5: Starting osmo-stp 03:16:04.935202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1954): Launched 03:16:05.258256 run osmo-stp_10.42.42.5(pid=1955): Launched 03:16:05.382692 run osmo-msc_10.42.42.6: Starting osmo-msc 03:16:05.968353 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1957): Launched 03:16:06.291409 run osmo-msc_10.42.42.6(pid=1958): Launched 03:16:06.471627 run osmo-stp_10.42.42.5(pid=1955): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1955)] 03:16:06.608759 run osmo-stp_10.42.42.5(pid=1955): stdout: | (launched: 2022-12-14_03:16:05.199529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:06.746184 run osmo-stp_10.42.42.5(pid=1955): stderr: | [0;m[38;5;43m20221214031605390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031605391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031605391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031605391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031605392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031605392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031605392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:06.882547 run osmo-stp_10.42.42.5(pid=1955): stdout: | (launched: 2022-12-14_03:16:05.199529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:07.011899 run osmo-stp_10.42.42.5(pid=1955): stderr: | [0;m[38;5;43m20221214031605390 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031605391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031605391 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031605391 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031605392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031605392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031605392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:07.166820 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1955): Process ended prematurely: osmo-stp_10.42.42.5(pid=1955) [trial-2398↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1955)] [trial-2398↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 03:16:07.176308 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 03:16:07.204278 run osmo-hlr_10.42.42.2(pid=1952): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1952)] 03:16:07.255564 run osmo-hlr_10.42.42.2(pid=1952): stdout: | (launched: 2022-12-14_03:16:04.193330) 03:16:07.308019 run osmo-hlr_10.42.42.2(pid=1952): stderr: | [0;m[1;31m20221214031604393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031604393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031604393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031604393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031604393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031604393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031604406 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031604414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031604414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031604414 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:16:07.380863 run osmo-msc_10.42.42.6(pid=1958): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1958)] 03:16:07.430999 run osmo-msc_10.42.42.6(pid=1958): stdout: | (launched: 2022-12-14_03:16:06.232467) 03:16:07.483400 run osmo-msc_10.42.42.6(pid=1958): stderr: | [0;m[38;5;43m20221214031606552 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031606552 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8f138a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031606553 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031606553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031606553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031606553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031606556 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031606557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031606557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031606557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:16:07.536457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1951): Terminating (SIGTERM) 03:16:07.578557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1954): Terminating (SIGTERM) 03:16:07.620576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1957): Terminating (SIGTERM) 03:16:07.662987 --- ParallelTerminationStrategy: PID 1951 died... 03:16:07.683451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1951): Terminated: ok {rc=0} 03:16:07.730033 --- ParallelTerminationStrategy: PID 1954 died... 03:16:07.749952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1954): Terminated: ok {rc=0} 03:16:07.796170 --- ParallelTerminationStrategy: PID 1957 died... 03:16:07.816183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1957): Terminated: ok {rc=0} 03:16:07.904506 bus /sierra_3: Setting Powered False 03:16:09.003076 bus /sierra_3: Setting Powered False 03:16:10.118502 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 03:16:11.375114 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:16:11.382809 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 03:16:11.416187 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 03:16:11.443661 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 03:16:11.496487 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 03:16:11.528319 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 03:16:11.559049 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 03:16:12.106747 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 03:16:12.155007 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:12.166413 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:16:12.213784 tst mo_mt_call.py: using LAC 38168 03:16:12.330361 tst mo_mt_call.py: using RAC 173 03:16:12.448674 tst mo_mt_call.py: using CellId 38168 03:16:12.565338 tst mo_mt_call.py: using BVCI 38169 03:16:12.683776 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:12.695608 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:12.707268 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:12.719006 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:12.731314 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:12.743372 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:16:12.861804 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:16:12.985683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:16:13.487441 run create_hlr_db(pid=1963): Launched 03:16:13.611238 bus /sierra_2: Setting Powered False 03:16:14.675527 run create_hlr_db(pid=1963): Terminated: ok {rc=0} 03:16:15.106907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1966): Launched 03:16:15.409308 run osmo-hlr_10.42.42.2(pid=1967): Launched 03:16:15.524768 run osmo-stp_10.42.42.5: Starting osmo-stp 03:16:16.105712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1969): Launched 03:16:16.429017 run osmo-stp_10.42.42.5(pid=1970): Launched 03:16:16.722869 run osmo-msc_10.42.42.6: Starting osmo-msc 03:16:17.342723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1972): Launched 03:16:17.654547 run osmo-msc_10.42.42.6(pid=1973): Launched 03:16:17.825813 run osmo-stp_10.42.42.5(pid=1970): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1970)] 03:16:17.954790 run osmo-stp_10.42.42.5(pid=1970): stdout: | (launched: 2022-12-14_03:16:16.364027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:18.082963 run osmo-stp_10.42.42.5(pid=1970): stderr: | [0;m[38;5;43m20221214031616563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031616563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031616563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031616563 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031616564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031616564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031616564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:18.208808 run osmo-stp_10.42.42.5(pid=1970): stdout: | (launched: 2022-12-14_03:16:16.364027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:18.328686 run osmo-stp_10.42.42.5(pid=1970): stderr: | [0;m[38;5;43m20221214031616563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031616563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031616563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031616563 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031616564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031616564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031616564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:18.472331 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1970): Process ended prematurely: osmo-stp_10.42.42.5(pid=1970) [trial-2398↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1970)] [trial-2398↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 03:16:18.481276 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 03:16:18.507625 run osmo-hlr_10.42.42.2(pid=1967): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1967)] 03:16:18.555342 run osmo-hlr_10.42.42.2(pid=1967): stdout: | (launched: 2022-12-14_03:16:15.354201) 03:16:18.604690 run osmo-hlr_10.42.42.2(pid=1967): stderr: | [0;m[1;31m20221214031615529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031615529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031615529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031615529 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031615530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031615530 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031615542 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031615550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031615550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031615551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:16:18.673350 run osmo-msc_10.42.42.6(pid=1973): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1973)] 03:16:18.720477 run osmo-msc_10.42.42.6(pid=1973): stdout: | (launched: 2022-12-14_03:16:17.599550) 03:16:18.769295 run osmo-msc_10.42.42.6(pid=1973): stderr: | [0;m[38;5;43m20221214031617866 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031617866 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1be5638c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031617866 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031617866 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031617867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031617867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031617869 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031617869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031617869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031617869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:16:18.818750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1966): Terminating (SIGTERM) 03:16:18.858341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1969): Terminating (SIGTERM) 03:16:18.897845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1972): Terminating (SIGTERM) 03:16:18.937892 --- ParallelTerminationStrategy: PID 1966 died... 03:16:18.957061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1966): Terminated: ok {rc=0} 03:16:19.001606 --- ParallelTerminationStrategy: PID 1969 died... 03:16:19.020248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1969): Terminated: ok {rc=0} 03:16:19.064916 --- ParallelTerminationStrategy: PID 1972 died... 03:16:19.084061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1972): Terminated: ok {rc=0} 03:16:19.170973 bus /sierra_3: Setting Powered False 03:16:20.269984 bus /sierra_3: Setting Powered False 03:16:21.385663 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 03:16:22.535917 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:22.548602 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:16:22.601223 tst mo_mt_call_osmux.py: using LAC 38169 03:16:22.729866 tst mo_mt_call_osmux.py: using RAC 174 03:16:22.860124 tst mo_mt_call_osmux.py: using CellId 38169 03:16:22.986800 tst mo_mt_call_osmux.py: using BVCI 38170 03:16:23.104914 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:23.116908 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:23.128612 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:23.140351 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:23.152670 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 03:16:23.164999 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:16:23.282159 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 03:16:23.404323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:16:23.906000 run create_hlr_db(pid=1975): Launched 03:16:24.029804 bus /sierra_2: Setting Powered False 03:16:25.093867 run create_hlr_db(pid=1975): Terminated: ok {rc=0} 03:16:25.524517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1977): Launched 03:16:25.825687 run osmo-hlr_10.42.42.2(pid=1978): Launched 03:16:25.939710 run osmo-stp_10.42.42.5: Starting osmo-stp 03:16:26.456218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1980): Launched 03:16:26.757707 run osmo-stp_10.42.42.5(pid=1981): Launched 03:16:26.872309 run osmo-msc_10.42.42.6: Starting osmo-msc 03:16:27.418295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1983): Launched 03:16:27.719772 run osmo-msc_10.42.42.6(pid=1984): Launched 03:16:27.887796 run osmo-stp_10.42.42.5(pid=1981): ERR: Terminated: ERROR {rc=1} [trial-2398↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1981)] 03:16:28.015184 run osmo-stp_10.42.42.5(pid=1981): stdout: | (launched: 2022-12-14_03:16:26.702189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:28.142680 run osmo-stp_10.42.42.5(pid=1981): stderr: | [0;m[38;5;43m20221214031626870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031626871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031626871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031626871 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031626874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031626874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031626874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:28.267473 run osmo-stp_10.42.42.5(pid=1981): stdout: | (launched: 2022-12-14_03:16:26.702189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:28.386970 run osmo-stp_10.42.42.5(pid=1981): stderr: | [0;m[38;5;43m20221214031626870 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031626871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031626871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031626871 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031626874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031626874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031626874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:28.530808 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1981): Process ended prematurely: osmo-stp_10.42.42.5(pid=1981) [trial-2398↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1981)] [trial-2398↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 03:16:28.539671 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 03:16:28.565988 run osmo-hlr_10.42.42.2(pid=1978): ERR: Terminated: ERROR {rc=237} [trial-2398↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1978)] 03:16:28.613177 run osmo-hlr_10.42.42.2(pid=1978): stdout: | (launched: 2022-12-14_03:16:25.770298) 03:16:28.662411 run osmo-hlr_10.42.42.2(pid=1978): stderr: | [0;m[1;31m20221214031625947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031625947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031625947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031625947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031625947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031625948 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031625959 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031625968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031625968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031625968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:16:28.731146 run osmo-msc_10.42.42.6(pid=1984): ERR: Terminated: ERROR {rc=2} [trial-2398↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1984)] 03:16:28.778260 run osmo-msc_10.42.42.6(pid=1984): stdout: | (launched: 2022-12-14_03:16:27.664372) 03:16:28.826993 run osmo-msc_10.42.42.6(pid=1984): stderr: | [0;m[38;5;43m20221214031627936 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031627936 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc31f4ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031627936 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031627936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031627936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031627936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031627938 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031627939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031627939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031627939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:16:28.876149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1977): Terminating (SIGTERM) 03:16:28.915681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1980): Terminating (SIGTERM) 03:16:28.955160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1983): Terminating (SIGTERM) 03:16:28.994949 --- ParallelTerminationStrategy: PID 1977 died... 03:16:29.013993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1977): Terminated: ok {rc=0} 03:16:29.057702 --- ParallelTerminationStrategy: PID 1980 died... 03:16:29.076060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1980): Terminated: ok {rc=0} 03:16:29.119769 --- ParallelTerminationStrategy: PID 1983 died... 03:16:29.138322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1983): Terminated: ok {rc=0} 03:16:29.223613 bus /sierra_3: Setting Powered False 03:16:30.322780 bus /sierra_3: Setting Powered False 03:16:31.442763 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 emergency:nanobts+band-900 --------------------------------------------------------------------- 03:16:32.708783 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:16:32.714162 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 03:16:32.745273 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 03:16:32.771362 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 03:16:32.854213 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 03:16:32.885099 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 03:16:32.910684 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 03:16:33.498454 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2398 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 03:16:33.503999 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:33.515266 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 03:16:33.564110 tst emergency_mo_mt_call.py: using LAC 38170 03:16:33.691553 tst emergency_mo_mt_call.py: using RAC 175 03:16:33.810690 tst emergency_mo_mt_call.py: using CellId 38170 03:16:33.933248 tst emergency_mo_mt_call.py: using BVCI 38171 03:16:34.041064 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:34.051654 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:34.062171 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:34.072474 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:34.082844 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:34.093290 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:16:34.213171 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:16:34.331626 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:16:34.824905 run create_hlr_db(pid=1989): Launched 03:16:34.947285 bus /sierra_2: Setting Powered False 03:16:36.010242 run create_hlr_db(pid=1989): Terminated: ok {rc=0} 03:16:36.434384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1991): Launched 03:16:36.730296 run osmo-hlr_10.42.42.2(pid=1992): Launched 03:16:36.843990 run osmo-stp_10.42.42.5: Starting osmo-stp 03:16:37.354397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1994): Launched 03:16:37.649399 run osmo-stp_10.42.42.5(pid=1995): Launched 03:16:37.772675 tst emergency_mo_mt_call.py: using MSISDN 8471 03:16:37.926538 run osmo-msc_10.42.42.6: Starting osmo-msc 03:16:38.457708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1997): Launched 03:16:38.751966 run osmo-msc_10.42.42.6(pid=1998): Launched 03:16:38.917623 run osmo-stp_10.42.42.5(pid=1995): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1995)] 03:16:39.042754 run osmo-stp_10.42.42.5(pid=1995): stdout: | (launched: 2022-12-14_03:16:37.594834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:39.168247 run osmo-stp_10.42.42.5(pid=1995): stderr: | [0;m[38;5;43m20221214031637766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031637767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031637767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031637767 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031637768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031637768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031637768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:39.291282 run osmo-stp_10.42.42.5(pid=1995): stdout: | (launched: 2022-12-14_03:16:37.594834) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:39.409511 run osmo-stp_10.42.42.5(pid=1995): stderr: | [0;m[38;5;43m20221214031637766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031637767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031637767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031637767 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031637768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031637768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031637768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:39.549802 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1995): Process ended prematurely: osmo-stp_10.42.42.5(pid=1995) [trial-2398↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1995)] [trial-2398↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 03:16:39.558095 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 03:16:39.584027 run osmo-hlr_10.42.42.2(pid=1992): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1992)] 03:16:39.632052 run osmo-hlr_10.42.42.2(pid=1992): stdout: | (launched: 2022-12-14_03:16:36.675727) 03:16:39.681349 run osmo-hlr_10.42.42.2(pid=1992): stderr: | [0;m[1;31m20221214031636851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031636851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031636851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031636851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031636851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031636851 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031636863 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031636874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031636874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031636874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:16:39.750192 run osmo-msc_10.42.42.6(pid=1998): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1998)] 03:16:39.797595 run osmo-msc_10.42.42.6(pid=1998): stdout: | (launched: 2022-12-14_03:16:38.697539) 03:16:39.846641 run osmo-msc_10.42.42.6(pid=1998): stderr: | [0;m[38;5;43m20221214031638967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031638967 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f627fb9ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031638967 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031638967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031638967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031638968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031638969 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031638970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031638970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031638970 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:16:39.895875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1991): Terminating (SIGTERM) 03:16:39.935230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1994): Terminating (SIGTERM) 03:16:39.974784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1997): Terminating (SIGTERM) 03:16:40.014745 --- ParallelTerminationStrategy: PID 1991 died... 03:16:40.033815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1991): Terminated: ok {rc=0} 03:16:40.077421 --- ParallelTerminationStrategy: PID 1994 died... 03:16:40.095743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1994): Terminated: ok {rc=0} 03:16:40.139615 --- ParallelTerminationStrategy: PID 1997 died... 03:16:40.158104 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1997): Terminated: ok {rc=0} 03:16:40.240615 bus /sierra_3: Setting Powered False 03:16:41.338438 bus /sierra_3: Setting Powered False 03:16:42.452849 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 03:16:43.538353 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:43.550232 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 03:16:43.602080 tst emergency_preemptive_call.py: using LAC 38171 03:16:43.728045 tst emergency_preemptive_call.py: using RAC 176 03:16:43.853440 tst emergency_preemptive_call.py: using CellId 38171 03:16:43.984901 tst emergency_preemptive_call.py: using BVCI 38172 03:16:44.102327 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:44.113566 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:44.124316 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:44.135184 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:44.146420 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 03:16:44.157773 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:16:44.272693 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:16:44.391009 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:16:44.506648 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 03:16:44.624796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:16:45.119861 run create_hlr_db(pid=2000): Launched 03:16:45.241266 bus /sierra_2: Setting Powered False 03:16:46.306770 run create_hlr_db(pid=2000): Terminated: ok {rc=0} 03:16:46.777377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2002): Launched 03:16:47.111803 run osmo-hlr_10.42.42.2(pid=2003): Launched 03:16:47.270117 run osmo-stp_10.42.42.5: Starting osmo-stp 03:16:47.795528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2005): Launched 03:16:48.092100 run osmo-stp_10.42.42.5(pid=2006): Launched 03:16:48.215336 tst emergency_preemptive_call.py: using MSISDN 8472 03:16:48.365155 run osmo-msc_10.42.42.6: Starting osmo-msc 03:16:48.894734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2008): Launched 03:16:49.190493 run osmo-msc_10.42.42.6(pid=2009): Launched 03:16:49.355258 run osmo-stp_10.42.42.5(pid=2006): ERR: Terminated: ERROR {rc=1} [trial-2398↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2006)] 03:16:49.491263 run osmo-stp_10.42.42.5(pid=2006): stdout: | (launched: 2022-12-14_03:16:48.036795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:49.616172 run osmo-stp_10.42.42.5(pid=2006): stderr: | [0;m[38;5;43m20221214031648207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031648208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031648209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031648209 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031648211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031648211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031648211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:49.739477 run osmo-stp_10.42.42.5(pid=2006): stdout: | (launched: 2022-12-14_03:16:48.036795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:16:49.856588 run osmo-stp_10.42.42.5(pid=2006): stderr: | [0;m[38;5;43m20221214031648207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031648208 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031648209 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031648209 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031648211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031648211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031648211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:16:49.997337 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=2006): Process ended prematurely: osmo-stp_10.42.42.5(pid=2006) [trial-2398↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2006)] [trial-2398↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 03:16:50.005752 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 03:16:50.032085 run osmo-hlr_10.42.42.2(pid=2003): ERR: Terminated: ERROR {rc=237} [trial-2398↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2003)] 03:16:50.079661 run osmo-hlr_10.42.42.2(pid=2003): stdout: | (launched: 2022-12-14_03:16:47.045881) 03:16:50.129166 run osmo-hlr_10.42.42.2(pid=2003): stderr: | [0;m[1;31m20221214031647260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031647260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031647260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031647260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031647260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031647260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031647272 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031647282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031647282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031647282 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:16:50.197861 run osmo-msc_10.42.42.6(pid=2009): ERR: Terminated: ERROR {rc=2} [trial-2398↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2009)] 03:16:50.245184 run osmo-msc_10.42.42.6(pid=2009): stdout: | (launched: 2022-12-14_03:16:49.135750) 03:16:50.294125 run osmo-msc_10.42.42.6(pid=2009): stderr: | [0;m[38;5;43m20221214031649420 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214031649420 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f11b24a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214031649420 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214031649420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214031649421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214031649422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214031649423 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214031649424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214031649424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214031649424 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:16:50.343734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2002): Terminating (SIGTERM) 03:16:50.383148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2005): Terminating (SIGTERM) 03:16:50.422744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2008): Terminating (SIGTERM) 03:16:50.462572 --- ParallelTerminationStrategy: PID 2002 died... 03:16:50.481803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2002): Terminated: ok {rc=0} 03:16:50.525628 --- ParallelTerminationStrategy: PID 2005 died... 03:16:50.544124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2005): Terminated: ok {rc=0} 03:16:50.587915 --- ParallelTerminationStrategy: PID 2008 died... 03:16:50.606435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2008): Terminated: ok {rc=0} 03:16:50.691751 bus /sierra_9: Setting Powered False 03:16:51.791678 bus /sierra_9: Setting Powered False 03:16:52.907986 bus /sierra_8: Setting Powered False 03:16:54.007863 bus /sierra_8: Setting Powered False 03:16:55.123731 bus /sierra_3: Setting Powered False 03:16:56.221267 bus /sierra_3: Setting Powered False 03:16:57.337188 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:nanobts+band-900 --------------------------------------------------------------------- 03:16:58.616396 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:16:58.622076 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 03:16:58.654268 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 03:16:58.693638 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 03:16:58.781173 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 03:16:58.813703 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 03:16:58.852428 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 03:16:59.443766 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 03:16:59.497439 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:16:59.508390 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 03:16:59.556574 tst cs_paging_gprs_active.py: using LAC 38172 03:16:59.676836 tst cs_paging_gprs_active.py: using RAC 177 03:16:59.797442 tst cs_paging_gprs_active.py: using CellId 38172 03:16:59.924829 tst cs_paging_gprs_active.py: using BVCI 38173 03:17:00.044723 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:00.055969 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:00.066957 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:00.078188 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:00.089590 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:00.100528 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:00.111805 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:00.122784 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:00.134072 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:00.252392 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:00.375096 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:17:00.594751 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:00.945932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2014): Launched 03:17:01.260589 run iperf3-srv_10.42.42.10(pid=2018): Launched 03:17:01.422557 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:17:01.700515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:02.045713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2019): Launched 03:17:02.340716 run iperf3-srv_10.42.42.10(pid=2020): Launched 03:17:02.462617 tst cs_paging_gprs_active.py:38: start network... 03:17:02.681813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:17:03.183269 run create_hlr_db(pid=2021): Launched 03:17:03.307910 bus /sierra_2: Setting Powered False 03:17:04.371450 run create_hlr_db(pid=2021): Terminated: ok {rc=0} 03:17:04.821421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2023): Launched 03:17:05.143900 run osmo-hlr_10.42.42.2(pid=2024): Launched 03:17:05.268069 run osmo-stp_10.42.42.5: Starting osmo-stp 03:17:05.825501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2026): Launched 03:17:06.148747 run osmo-stp_10.42.42.5(pid=2027): Launched 03:17:06.272564 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:17:06.831723 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2029): Launched 03:17:06.955921 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:17:07.230255 run patchelf(pid=2030): Launched 03:17:07.411121 run osmo-stp_10.42.42.5(pid=2027): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2027)] 03:17:07.548000 run osmo-stp_10.42.42.5(pid=2027): stdout: | (launched: 2022-12-14_03:17:06.089878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:07.678716 run osmo-stp_10.42.42.5(pid=2027): stderr: | [0;m[38;5;43m20221214031706283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031706284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031706284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031706284 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031706285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031706285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031706285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:07.808613 run osmo-stp_10.42.42.5(pid=2027): stdout: | (launched: 2022-12-14_03:17:06.089878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:07.932657 run osmo-stp_10.42.42.5(pid=2027): stderr: | [0;m[38;5;43m20221214031706283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031706284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031706284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031706284 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031706285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031706285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031706285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:08.079218 run patchelf(pid=2030): Terminating (SIGINT) 03:17:08.250017 run patchelf(pid=2030): Terminated: ok {rc=0} 03:17:08.373284 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2027): Process ended prematurely: osmo-stp_10.42.42.5(pid=2027) [trial-2398↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2027)] [trial-2398↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 03:17:08.382867 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 03:17:08.410216 run osmo-hlr_10.42.42.2(pid=2024): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2024)] 03:17:08.458199 run osmo-hlr_10.42.42.2(pid=2024): stdout: | (launched: 2022-12-14_03:17:05.085229) 03:17:08.507584 run osmo-hlr_10.42.42.2(pid=2024): stderr: | [0;m[1;31m20221214031705281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031705281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031705281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031705281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031705282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031705282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031705295 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031705305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031705305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031705305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:17:08.558120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2014): Terminating (SIGTERM) 03:17:08.597879 run iperf3-srv_10.42.42.10(pid=2018): Terminating (SIGTERM) 03:17:08.637225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2019): Terminating (SIGTERM) 03:17:08.676859 run iperf3-srv_10.42.42.10(pid=2020): Terminating (SIGTERM) 03:17:08.716254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2023): Terminating (SIGTERM) 03:17:08.756016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2026): Terminating (SIGTERM) 03:17:08.795765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2029): Terminating (SIGTERM) 03:17:08.835775 --- ParallelTerminationStrategy: PID 2014 died... 03:17:08.855003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2014): Terminated: ok {rc=0} 03:17:08.899182 --- ParallelTerminationStrategy: PID 2018 died... 03:17:08.917982 run iperf3-srv_10.42.42.10(pid=2018): Terminated {rc=256} 03:17:08.961609 --- ParallelTerminationStrategy: PID 2019 died... 03:17:08.980571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2019): Terminated: ok {rc=0} 03:17:09.024205 --- ParallelTerminationStrategy: PID 2020 died... 03:17:09.042980 run iperf3-srv_10.42.42.10(pid=2020): Terminated {rc=256} 03:17:09.086535 --- ParallelTerminationStrategy: PID 2023 died... 03:17:09.105382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2023): Terminated: ok {rc=0} 03:17:09.149241 --- ParallelTerminationStrategy: PID 2026 died... 03:17:09.167913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2026): Terminated: ok {rc=0} 03:17:09.211955 --- ParallelTerminationStrategy: PID 2029 died... 03:17:09.231180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2029): Terminated: ok {rc=0} 03:17:09.317567 bus /gobi_0: Setting Powered False 03:17:10.417258 bus /gobi_0: Setting Powered False 03:17:11.531893 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 03:17:12.674194 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:12.685470 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 03:17:12.734393 tst iperf3.py: using LAC 38173 03:17:12.852776 tst iperf3.py: using RAC 178 03:17:12.982368 tst iperf3.py: using CellId 38173 03:17:13.111651 tst iperf3.py: using BVCI 38174 03:17:13.230727 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:13.242077 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:13.253139 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:13.263984 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:13.275556 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:13.287157 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:13.299347 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:13.310964 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:13.322825 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:13.441083 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:17:13.645555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:13.947428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2031): Launched 03:17:14.209455 run iperf3-srv_10.42.42.10(pid=2032): Launched 03:17:14.322136 tst iperf3.py:8: start network... 03:17:14.523237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:17:14.989870 run create_hlr_db(pid=2033): Launched 03:17:15.113909 bus /gobi_6: Setting Powered False 03:17:16.178254 run create_hlr_db(pid=2033): Terminated: ok {rc=0} 03:17:16.648215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2035): Launched 03:17:16.991131 run osmo-hlr_10.42.42.2(pid=2036): Launched 03:17:17.246299 run osmo-stp_10.42.42.5: Starting osmo-stp 03:17:17.776618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2038): Launched 03:17:18.077691 run osmo-stp_10.42.42.5(pid=2039): Launched 03:17:18.191688 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:17:18.710221 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2041): Launched 03:17:18.825476 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:17:19.079258 run patchelf(pid=2042): Launched 03:17:19.246367 run osmo-stp_10.42.42.5(pid=2039): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2039)] 03:17:19.373417 run osmo-stp_10.42.42.5(pid=2039): stdout: | (launched: 2022-12-14_03:17:18.022364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:19.501645 run osmo-stp_10.42.42.5(pid=2039): stderr: | [0;m[38;5;43m20221214031718194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031718195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031718195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031718195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031718196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031718196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031718196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:19.630630 run osmo-stp_10.42.42.5(pid=2039): stdout: | (launched: 2022-12-14_03:17:18.022364) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:19.754354 run osmo-stp_10.42.42.5(pid=2039): stderr: | [0;m[38;5;43m20221214031718194 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031718195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031718195 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031718195 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031718196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031718196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031718196 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:19.900240 run patchelf(pid=2042): Terminating (SIGINT) 03:17:20.070478 run patchelf(pid=2042): Terminated: ok {rc=0} 03:17:20.193117 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2039): Process ended prematurely: osmo-stp_10.42.42.5(pid=2039) [trial-2398↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2039)] [trial-2398↪gprs:nanobts+band-900↪iperf3.py:8] 03:17:20.202510 tst iperf3.py:8: Test FAILED (7.6 sec) 03:17:20.229434 run osmo-hlr_10.42.42.2(pid=2036): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2036)] 03:17:20.276441 run osmo-hlr_10.42.42.2(pid=2036): stdout: | (launched: 2022-12-14_03:17:16.929642) 03:17:20.325192 run osmo-hlr_10.42.42.2(pid=2036): stderr: | [0;m[1;31m20221214031717189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031717189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031717189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031717189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031717189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031717189 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031717203 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031717215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031717215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031717215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:17:20.375005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2031): Terminating (SIGTERM) 03:17:20.414610 run iperf3-srv_10.42.42.10(pid=2032): Terminating (SIGTERM) 03:17:20.453884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2035): Terminating (SIGTERM) 03:17:20.493155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2038): Terminating (SIGTERM) 03:17:20.532430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2041): Terminating (SIGTERM) 03:17:20.572067 --- ParallelTerminationStrategy: PID 2031 died... 03:17:20.591045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2031): Terminated: ok {rc=0} 03:17:20.634614 --- ParallelTerminationStrategy: PID 2032 died... 03:17:20.653191 run iperf3-srv_10.42.42.10(pid=2032): Terminated {rc=256} 03:17:20.696437 --- ParallelTerminationStrategy: PID 2035 died... 03:17:20.715001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2035): Terminated: ok {rc=0} 03:17:20.758333 --- ParallelTerminationStrategy: PID 2038 died... 03:17:20.776983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2038): Terminated: ok {rc=0} 03:17:20.821264 --- ParallelTerminationStrategy: PID 2041 died... 03:17:20.839681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2041): Terminated: ok {rc=0} 03:17:20.924669 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 03:17:22.075376 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:22.087173 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 03:17:22.136433 tst iperf3m4.py: using LAC 38174 03:17:22.255930 tst iperf3m4.py: using RAC 179 03:17:22.375537 tst iperf3m4.py: using CellId 38174 03:17:22.493787 tst iperf3m4.py: using BVCI 38175 03:17:22.604202 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:22.614846 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:22.625215 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:22.635497 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:22.645927 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:22.656530 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:22.667090 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:22.677304 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:22.687666 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:22.807824 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:22.929955 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:23.051602 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:23.171841 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:17:23.392260 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:23.718800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2043): Launched 03:17:24.002535 run iperf3-srv_10.42.42.10(pid=2044): Launched 03:17:24.124889 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:17:24.344862 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:24.671961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2045): Launched 03:17:24.954727 run iperf3-srv_10.42.42.10(pid=2046): Launched 03:17:25.076924 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:17:25.295694 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:25.621450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2047): Launched 03:17:25.903305 run iperf3-srv_10.42.42.10(pid=2048): Launched 03:17:26.024820 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:17:26.243471 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:17:26.568741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2049): Launched 03:17:26.851504 run iperf3-srv_10.42.42.10(pid=2050): Launched 03:17:26.973772 tst iperf3m4.py:8: start network... 03:17:27.192764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:17:27.698975 run create_hlr_db(pid=2051): Launched 03:17:27.823712 bus /gobi_6: Setting Powered False 03:17:28.887552 run create_hlr_db(pid=2051): Terminated: ok {rc=0} 03:17:29.320938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2053): Launched 03:17:29.624514 run osmo-hlr_10.42.42.2(pid=2054): Launched 03:17:29.741310 run osmo-stp_10.42.42.5: Starting osmo-stp 03:17:30.267938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2056): Launched 03:17:30.571559 run osmo-stp_10.42.42.5(pid=2057): Launched 03:17:30.686996 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:17:31.275516 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2059): Launched 03:17:31.405901 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:17:31.671155 run patchelf(pid=2060): Launched 03:17:31.852744 run osmo-stp_10.42.42.5(pid=2057): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2057)] 03:17:31.982932 run osmo-stp_10.42.42.5(pid=2057): stdout: | (launched: 2022-12-14_03:17:30.515862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:32.114490 run osmo-stp_10.42.42.5(pid=2057): stderr: | [0;m[38;5;43m20221214031730686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031730686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031730686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031730687 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031730687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031730687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031730687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:32.245884 run osmo-stp_10.42.42.5(pid=2057): stdout: | (launched: 2022-12-14_03:17:30.515862) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:32.389951 run osmo-stp_10.42.42.5(pid=2057): stderr: | [0;m[38;5;43m20221214031730686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031730686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031730686 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031730687 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031730687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031730687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031730687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:32.549709 run patchelf(pid=2060): Terminating (SIGINT) 03:17:32.735728 run patchelf(pid=2060): Terminated: ok {rc=0} 03:17:32.869254 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2057): Process ended prematurely: osmo-stp_10.42.42.5(pid=2057) [trial-2398↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2057)] [trial-2398↪gprs:nanobts+band-900↪iperf3m4.py:8] 03:17:32.879886 tst iperf3m4.py:8: Test FAILED (10.8 sec) 03:17:32.909232 run osmo-hlr_10.42.42.2(pid=2054): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2054)] 03:17:32.961986 run osmo-hlr_10.42.42.2(pid=2054): stdout: | (launched: 2022-12-14_03:17:29.568767) 03:17:33.014835 run osmo-hlr_10.42.42.2(pid=2054): stderr: | [0;m[1;31m20221214031729748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031729748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031729748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031729748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031729748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031729748 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031729760 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031729770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031729771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031729771 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:17:33.068242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2043): Terminating (SIGTERM) 03:17:33.110166 run iperf3-srv_10.42.42.10(pid=2044): Terminating (SIGTERM) 03:17:33.152918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2045): Terminating (SIGTERM) 03:17:33.195605 run iperf3-srv_10.42.42.10(pid=2046): Terminating (SIGTERM) 03:17:33.238221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2047): Terminating (SIGTERM) 03:17:33.281003 run iperf3-srv_10.42.42.10(pid=2048): Terminating (SIGTERM) 03:17:33.323616 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2049): Terminating (SIGTERM) 03:17:33.366550 run iperf3-srv_10.42.42.10(pid=2050): Terminating (SIGTERM) 03:17:33.409221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2053): Terminating (SIGTERM) 03:17:33.451949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2056): Terminating (SIGTERM) 03:17:33.494966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2059): Terminating (SIGTERM) 03:17:33.538103 --- ParallelTerminationStrategy: PID 2043 died... 03:17:33.559071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2043): Terminated: ok {rc=0} 03:17:33.606606 --- ParallelTerminationStrategy: PID 2044 died... 03:17:33.627215 run iperf3-srv_10.42.42.10(pid=2044): Terminated {rc=256} 03:17:33.674201 --- ParallelTerminationStrategy: PID 2045 died... 03:17:33.694644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2045): Terminated: ok {rc=0} 03:17:33.741471 --- ParallelTerminationStrategy: PID 2046 died... 03:17:33.761994 run iperf3-srv_10.42.42.10(pid=2046): Terminated {rc=256} 03:17:33.808799 --- ParallelTerminationStrategy: PID 2047 died... 03:17:33.829625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2047): Terminated: ok {rc=0} 03:17:33.876401 --- ParallelTerminationStrategy: PID 2048 died... 03:17:33.896681 run iperf3-srv_10.42.42.10(pid=2048): Terminated {rc=256} 03:17:33.943590 --- ParallelTerminationStrategy: PID 2049 died... 03:17:33.963962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2049): Terminated: ok {rc=0} 03:17:34.011281 --- ParallelTerminationStrategy: PID 2050 died... 03:17:34.031683 run iperf3-srv_10.42.42.10(pid=2050): Terminated {rc=256} 03:17:34.078492 --- ParallelTerminationStrategy: PID 2053 died... 03:17:34.099077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2053): Terminated: ok {rc=0} 03:17:34.145995 --- ParallelTerminationStrategy: PID 2056 died... 03:17:34.166566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2056): Terminated: ok {rc=0} 03:17:34.213594 --- ParallelTerminationStrategy: PID 2059 died... 03:17:34.233983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2059): Terminated: ok {rc=0} 03:17:34.322975 bus /gobi_4: Setting Powered False 03:17:35.421480 bus /gobi_4: Setting Powered False 03:17:36.538628 bus /gobi_1: Setting Powered False 03:17:37.636394 bus /gobi_1: Setting Powered False 03:17:38.752070 bus /gobi_0: Setting Powered False 03:17:39.846179 bus /gobi_0: Setting Powered False 03:17:40.959687 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-900 ping.py ---------------------------------------------- 03:17:42.060127 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:42.071434 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 03:17:42.118540 tst ping.py: using LAC 38175 03:17:42.236803 tst ping.py: using RAC 180 03:17:42.353793 tst ping.py: using CellId 38175 03:17:42.473355 tst ping.py: using BVCI 38176 03:17:42.581133 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:42.591869 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:42.602622 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:42.613194 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:42.623747 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:42.634388 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:42.645327 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:42.656005 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:42.776141 tst ping.py:19: start network... 03:17:42.991504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:17:43.484839 run create_hlr_db(pid=2061): Launched 03:17:43.607762 bus /gobi_6: Setting Powered False 03:17:44.671715 run create_hlr_db(pid=2061): Terminated: ok {rc=0} 03:17:45.096863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2067): Launched 03:17:45.393055 run osmo-hlr_10.42.42.2(pid=2070): Launched 03:17:45.505805 run osmo-stp_10.42.42.5: Starting osmo-stp 03:17:46.069123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2075): Launched 03:17:46.402534 run osmo-stp_10.42.42.5(pid=2076): Launched 03:17:46.610480 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:17:47.238329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2080): Launched 03:17:47.360733 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:17:47.614360 run patchelf(pid=2081): Launched 03:17:47.779127 run osmo-stp_10.42.42.5(pid=2076): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2076)] 03:17:47.905468 run osmo-stp_10.42.42.5(pid=2076): stdout: | (launched: 2022-12-14_03:17:46.341434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:48.033327 run osmo-stp_10.42.42.5(pid=2076): stderr: | [0;m[38;5;43m20221214031746702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031746702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031746702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031746702 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031746703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031746703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031746703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:48.159946 run osmo-stp_10.42.42.5(pid=2076): stdout: | (launched: 2022-12-14_03:17:46.341434) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:48.281311 run osmo-stp_10.42.42.5(pid=2076): stderr: | [0;m[38;5;43m20221214031746702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031746702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031746702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031746702 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031746703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031746703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031746703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:48.425527 run patchelf(pid=2081): Terminating (SIGINT) 03:17:48.593299 run patchelf(pid=2081): Terminated: ok {rc=0} 03:17:48.714393 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2076): Process ended prematurely: osmo-stp_10.42.42.5(pid=2076) [trial-2398↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2076)] [trial-2398↪gprs:nanobts+band-900↪ping.py:22] 03:17:48.723182 tst ping.py:22: Test FAILED (6.7 sec) 03:17:48.749889 run osmo-hlr_10.42.42.2(pid=2070): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2070)] 03:17:48.797326 run osmo-hlr_10.42.42.2(pid=2070): stdout: | (launched: 2022-12-14_03:17:45.338601) 03:17:48.846506 run osmo-hlr_10.42.42.2(pid=2070): stderr: | [0;m[1;31m20221214031745512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031745512 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031745513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031745513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031745513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031745513 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031745525 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031745534 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031745536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031745536 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:17:48.896258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2067): Terminating (SIGTERM) 03:17:48.935798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2075): Terminating (SIGTERM) 03:17:48.975151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2080): Terminating (SIGTERM) 03:17:49.014859 --- ParallelTerminationStrategy: PID 2067 died... 03:17:49.033930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2067): Terminated: ok {rc=0} 03:17:49.077558 --- ParallelTerminationStrategy: PID 2075 died... 03:17:49.095950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2075): Terminated: ok {rc=0} 03:17:49.139821 --- ParallelTerminationStrategy: PID 2080 died... 03:17:49.158430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2080): Terminated: ok {rc=0} 03:17:49.243360 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 03:17:50.331304 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:50.342673 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 03:17:50.390548 tst ping_idle_ping.py: using LAC 38176 03:17:50.517809 tst ping_idle_ping.py: using RAC 181 03:17:50.645788 tst ping_idle_ping.py: using CellId 38176 03:17:50.774713 tst ping_idle_ping.py: using BVCI 38177 03:17:50.893586 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:50.904539 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:50.915470 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:50.926647 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:50.937877 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:50.948871 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:50.960183 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 03:17:50.971415 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 03:17:51.088613 tst ping_idle_ping.py:24: start network... 03:17:51.294651 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:17:51.794554 run create_hlr_db(pid=2084): Launched 03:17:51.916443 bus /gobi_6: Setting Powered False 03:17:52.980653 run create_hlr_db(pid=2084): Terminated: ok {rc=0} 03:17:53.425966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2086): Launched 03:17:53.748696 run osmo-hlr_10.42.42.2(pid=2087): Launched 03:17:53.874652 run osmo-stp_10.42.42.5: Starting osmo-stp 03:17:54.407919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2089): Launched 03:17:54.729277 run osmo-stp_10.42.42.5(pid=2090): Launched 03:17:54.851846 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:17:55.408166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2092): Launched 03:17:55.530592 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:17:55.802084 run patchelf(pid=2093): Launched 03:17:55.980489 run osmo-stp_10.42.42.5(pid=2090): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2090)] 03:17:56.116716 run osmo-stp_10.42.42.5(pid=2090): stdout: | (launched: 2022-12-14_03:17:54.671228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:56.253898 run osmo-stp_10.42.42.5(pid=2090): stderr: | [0;m[38;5;43m20221214031754864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031754864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031754864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031754865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031754865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031754865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031754865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:56.390982 run osmo-stp_10.42.42.5(pid=2090): stdout: | (launched: 2022-12-14_03:17:54.671228) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:17:56.523374 run osmo-stp_10.42.42.5(pid=2090): stderr: | [0;m[38;5;43m20221214031754864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031754864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031754864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031754865 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031754865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031754865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031754865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:17:56.679869 run patchelf(pid=2093): Terminating (SIGINT) 03:17:56.861987 run patchelf(pid=2093): Terminated: ok {rc=0} 03:17:56.992062 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2090): Process ended prematurely: osmo-stp_10.42.42.5(pid=2090) [trial-2398↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2090)] [trial-2398↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 03:17:57.001555 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 03:17:57.029698 run osmo-hlr_10.42.42.2(pid=2087): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2087)] 03:17:57.080147 run osmo-hlr_10.42.42.2(pid=2087): stdout: | (launched: 2022-12-14_03:17:53.690513) 03:17:57.132523 run osmo-hlr_10.42.42.2(pid=2087): stderr: | [0;m[1;31m20221214031753891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031753891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031753891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031753891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031753891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031753891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031753903 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031753911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031753911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031753911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:17:57.185688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2086): Terminating (SIGTERM) 03:17:57.227715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2089): Terminating (SIGTERM) 03:17:57.269943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2092): Terminating (SIGTERM) 03:17:57.312332 --- ParallelTerminationStrategy: PID 2086 died... 03:17:57.332854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2086): Terminated: ok {rc=0} 03:17:57.379560 --- ParallelTerminationStrategy: PID 2089 died... 03:17:57.399513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2089): Terminated: ok {rc=0} 03:17:57.446081 --- ParallelTerminationStrategy: PID 2092 died... 03:17:57.465996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2092): Terminated: ok {rc=0} 03:17:57.554220 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 03:17:58.858105 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:17:58.865056 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 03:17:58.897406 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 03:17:58.936421 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 03:17:59.029642 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 03:17:59.063242 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 03:17:59.102166 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 03:17:59.696009 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 03:17:59.745845 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:17:59.756623 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:17:59.807460 tst cs_paging_gprs_active.py: using LAC 38177 03:17:59.937371 tst cs_paging_gprs_active.py: using RAC 182 03:18:00.063414 tst cs_paging_gprs_active.py: using CellId 38177 03:18:00.191079 tst cs_paging_gprs_active.py: using BVCI 38178 03:18:00.309423 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:00.320689 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:00.331811 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:00.342866 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:00.354166 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:00.365587 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:00.377011 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:00.388227 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:00.399626 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:00.516005 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:00.632824 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:18:00.835656 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:01.173723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2098): Launched 03:18:01.466221 run iperf3-srv_10.42.42.10(pid=2099): Launched 03:18:01.587463 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:18:01.798243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:02.158636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2100): Launched 03:18:02.456536 run iperf3-srv_10.42.42.10(pid=2101): Launched 03:18:02.578237 tst cs_paging_gprs_active.py:38: start network... 03:18:02.794278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:18:03.278645 run create_hlr_db(pid=2102): Launched 03:18:03.403953 bus /gobi_6: Setting Powered False 03:18:04.469094 run create_hlr_db(pid=2102): Terminated: ok {rc=0} 03:18:04.906898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2104): Launched 03:18:05.230019 run osmo-hlr_10.42.42.2(pid=2105): Launched 03:18:05.355567 run osmo-stp_10.42.42.5: Starting osmo-stp 03:18:05.894401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2107): Launched 03:18:06.218205 run osmo-stp_10.42.42.5(pid=2108): Launched 03:18:06.335997 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:18:06.863998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2110): Launched 03:18:06.979642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:18:07.238102 run patchelf(pid=2111): Launched 03:18:07.406935 run osmo-stp_10.42.42.5(pid=2108): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2108)] 03:18:07.535302 run osmo-stp_10.42.42.5(pid=2108): stdout: | (launched: 2022-12-14_03:18:06.162194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:07.677408 run osmo-stp_10.42.42.5(pid=2108): stderr: | [0;m[38;5;43m20221214031806332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031806333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031806333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031806333 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031806334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031806334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031806334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:07.816304 run osmo-stp_10.42.42.5(pid=2108): stdout: | (launched: 2022-12-14_03:18:06.162194) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:07.950194 run osmo-stp_10.42.42.5(pid=2108): stderr: | [0;m[38;5;43m20221214031806332 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031806333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031806333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031806333 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031806334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031806334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031806334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:08.108785 run patchelf(pid=2111): Terminating (SIGINT) 03:18:08.291887 run patchelf(pid=2111): Terminated: ok {rc=0} 03:18:08.424896 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2108): Process ended prematurely: osmo-stp_10.42.42.5(pid=2108) [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2108)] [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 03:18:08.434997 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 03:18:08.463394 run osmo-hlr_10.42.42.2(pid=2105): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2105)] 03:18:08.513836 run osmo-hlr_10.42.42.2(pid=2105): stdout: | (launched: 2022-12-14_03:18:05.170606) 03:18:08.566013 run osmo-hlr_10.42.42.2(pid=2105): stderr: | [0;m[1;31m20221214031805370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031805370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031805370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031805370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031805370 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031805371 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031805385 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031805393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031805393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031805393 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:18:08.618660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2098): Terminating (SIGTERM) 03:18:08.660245 run iperf3-srv_10.42.42.10(pid=2099): Terminating (SIGTERM) 03:18:08.702916 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2100): Terminating (SIGTERM) 03:18:08.744908 run iperf3-srv_10.42.42.10(pid=2101): Terminating (SIGTERM) 03:18:08.787022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2104): Terminating (SIGTERM) 03:18:08.828648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2107): Terminating (SIGTERM) 03:18:08.870262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2110): Terminating (SIGTERM) 03:18:08.912354 --- ParallelTerminationStrategy: PID 2098 died... 03:18:08.932555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2098): Terminated: ok {rc=0} 03:18:08.979059 --- ParallelTerminationStrategy: PID 2099 died... 03:18:08.998883 run iperf3-srv_10.42.42.10(pid=2099): Terminated {rc=256} 03:18:09.045518 --- ParallelTerminationStrategy: PID 2100 died... 03:18:09.065409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2100): Terminated: ok {rc=0} 03:18:09.111763 --- ParallelTerminationStrategy: PID 2101 died... 03:18:09.131566 run iperf3-srv_10.42.42.10(pid=2101): Terminated {rc=256} 03:18:09.177699 --- ParallelTerminationStrategy: PID 2104 died... 03:18:09.197603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2104): Terminated: ok {rc=0} 03:18:09.243859 --- ParallelTerminationStrategy: PID 2107 died... 03:18:09.263695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2107): Terminated: ok {rc=0} 03:18:09.309838 --- ParallelTerminationStrategy: PID 2110 died... 03:18:09.329765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2110): Terminated: ok {rc=0} 03:18:09.417922 bus /gobi_0: Setting Powered False 03:18:10.517005 bus /gobi_0: Setting Powered False 03:18:11.631540 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 03:18:12.777193 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:12.788483 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:18:12.839159 tst iperf3.py: using LAC 38178 03:18:12.959706 tst iperf3.py: using RAC 183 03:18:13.079894 tst iperf3.py: using CellId 38178 03:18:13.215071 tst iperf3.py: using BVCI 38179 03:18:13.335241 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:13.347061 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:13.358373 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:13.369742 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:13.381504 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:13.393094 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:13.404794 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:13.416350 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:13.428490 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:13.546578 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:18:13.750762 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:14.057852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2113): Launched 03:18:14.322344 run iperf3-srv_10.42.42.10(pid=2114): Launched 03:18:14.435872 tst iperf3.py:8: start network... 03:18:14.638828 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:18:15.108890 run create_hlr_db(pid=2115): Launched 03:18:15.232713 bus /gobi_6: Setting Powered False 03:18:16.323158 run create_hlr_db(pid=2115): Terminated: ok {rc=0} 03:18:16.802345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2117): Launched 03:18:17.150098 run osmo-hlr_10.42.42.2(pid=2118): Launched 03:18:17.283420 run osmo-stp_10.42.42.5: Starting osmo-stp 03:18:17.828936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2120): Launched 03:18:18.131865 run osmo-stp_10.42.42.5(pid=2121): Launched 03:18:18.246206 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:18:18.764764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2123): Launched 03:18:18.879821 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:18:19.134771 run patchelf(pid=2124): Launched 03:18:19.302808 run osmo-stp_10.42.42.5(pid=2121): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2121)] 03:18:19.430510 run osmo-stp_10.42.42.5(pid=2121): stdout: | (launched: 2022-12-14_03:18:18.075724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:19.559610 run osmo-stp_10.42.42.5(pid=2121): stderr: | [0;m[38;5;43m20221214031818248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031818248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031818248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031818249 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031818249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031818249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031818249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:19.688936 run osmo-stp_10.42.42.5(pid=2121): stdout: | (launched: 2022-12-14_03:18:18.075724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:19.812791 run osmo-stp_10.42.42.5(pid=2121): stderr: | [0;m[38;5;43m20221214031818248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031818248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031818248 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031818249 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031818249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031818249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031818249 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:19.959622 run patchelf(pid=2124): Terminating (SIGINT) 03:18:20.131663 run patchelf(pid=2124): Terminated: ok {rc=0} 03:18:20.255417 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2121): Process ended prematurely: osmo-stp_10.42.42.5(pid=2121) [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2121)] [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 03:18:20.264834 tst iperf3.py:8: Test FAILED (7.5 sec) 03:18:20.291991 run osmo-hlr_10.42.42.2(pid=2118): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2118)] 03:18:20.338999 run osmo-hlr_10.42.42.2(pid=2118): stdout: | (launched: 2022-12-14_03:18:17.079946) 03:18:20.387847 run osmo-hlr_10.42.42.2(pid=2118): stderr: | [0;m[1;31m20221214031817296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031817296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031817296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031817296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031817296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031817296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031817309 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031817317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031817318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031817318 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:18:20.437127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2113): Terminating (SIGTERM) 03:18:20.476542 run iperf3-srv_10.42.42.10(pid=2114): Terminating (SIGTERM) 03:18:20.515846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2117): Terminating (SIGTERM) 03:18:20.555119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2120): Terminating (SIGTERM) 03:18:20.594407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2123): Terminating (SIGTERM) 03:18:20.634003 --- ParallelTerminationStrategy: PID 2113 died... 03:18:20.652804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2113): Terminated: ok {rc=0} 03:18:20.696574 --- ParallelTerminationStrategy: PID 2114 died... 03:18:20.715146 run iperf3-srv_10.42.42.10(pid=2114): Terminated {rc=256} 03:18:20.758622 --- ParallelTerminationStrategy: PID 2117 died... 03:18:20.777241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2117): Terminated: ok {rc=0} 03:18:20.820677 --- ParallelTerminationStrategy: PID 2120 died... 03:18:20.839248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2120): Terminated: ok {rc=0} 03:18:20.882928 --- ParallelTerminationStrategy: PID 2123 died... 03:18:20.901485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2123): Terminated: ok {rc=0} 03:18:20.986309 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 03:18:22.133900 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:22.145595 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:18:22.193314 tst iperf3m4.py: using LAC 38179 03:18:22.313476 tst iperf3m4.py: using RAC 184 03:18:22.431608 tst iperf3m4.py: using CellId 38179 03:18:22.551339 tst iperf3m4.py: using BVCI 38180 03:18:22.662335 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:22.673237 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:22.683855 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:22.694479 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:22.705038 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:22.715583 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:22.726487 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:22.737016 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:22.747660 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:22.861741 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:22.985156 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:23.102983 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:23.226145 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:18:23.447589 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:23.779285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2126): Launched 03:18:24.058151 run iperf3-srv_10.42.42.10(pid=2127): Launched 03:18:24.173353 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:18:24.375347 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:24.678490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2129): Launched 03:18:24.942645 run iperf3-srv_10.42.42.10(pid=2130): Launched 03:18:25.055481 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:18:25.258267 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:25.562374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2131): Launched 03:18:25.825710 run iperf3-srv_10.42.42.10(pid=2132): Launched 03:18:25.939053 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:18:26.141019 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:18:26.455326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2133): Launched 03:18:26.741482 run iperf3-srv_10.42.42.10(pid=2134): Launched 03:18:26.863429 tst iperf3m4.py:8: start network... 03:18:27.082833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:18:27.586135 run create_hlr_db(pid=2135): Launched 03:18:27.713685 bus /gobi_6: Setting Powered False 03:18:28.774034 run create_hlr_db(pid=2135): Terminated: ok {rc=0} 03:18:29.216776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2137): Launched 03:18:29.521948 run osmo-hlr_10.42.42.2(pid=2138): Launched 03:18:29.637402 run osmo-stp_10.42.42.5: Starting osmo-stp 03:18:30.176178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2140): Launched 03:18:30.479410 run osmo-stp_10.42.42.5(pid=2141): Launched 03:18:30.595006 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:18:31.178957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2144): Launched 03:18:31.306290 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:18:31.602860 run patchelf(pid=2145): Launched 03:18:31.797190 run osmo-stp_10.42.42.5(pid=2141): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2141)] 03:18:31.969539 run osmo-stp_10.42.42.5(pid=2141): stdout: | (launched: 2022-12-14_03:18:30.423642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:32.114241 run osmo-stp_10.42.42.5(pid=2141): stderr: | [0;m[38;5;43m20221214031830595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031830595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031830596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031830596 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031830598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031830598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031830598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:32.262574 run osmo-stp_10.42.42.5(pid=2141): stdout: | (launched: 2022-12-14_03:18:30.423642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:32.396209 run osmo-stp_10.42.42.5(pid=2141): stderr: | [0;m[38;5;43m20221214031830595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031830595 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031830596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031830596 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031830598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031830598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031830598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:32.556798 run patchelf(pid=2145): Terminating (SIGINT) 03:18:32.727401 run patchelf(pid=2145): Terminated: ok {rc=0} 03:18:32.849682 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2141): Process ended prematurely: osmo-stp_10.42.42.5(pid=2141) [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2141)] [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 03:18:32.859085 tst iperf3m4.py:8: Test FAILED (10.8 sec) 03:18:32.886431 run osmo-hlr_10.42.42.2(pid=2138): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2138)] 03:18:32.933751 run osmo-hlr_10.42.42.2(pid=2138): stdout: | (launched: 2022-12-14_03:18:29.466566) 03:18:32.982648 run osmo-hlr_10.42.42.2(pid=2138): stderr: | [0;m[1;31m20221214031829648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031829648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031829648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031829648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031829648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031829648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031829661 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031829670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031829670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031829670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:18:33.031765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2126): Terminating (SIGTERM) 03:18:33.071486 run iperf3-srv_10.42.42.10(pid=2127): Terminating (SIGTERM) 03:18:33.111078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2129): Terminating (SIGTERM) 03:18:33.150558 run iperf3-srv_10.42.42.10(pid=2130): Terminating (SIGTERM) 03:18:33.189887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2131): Terminating (SIGTERM) 03:18:33.229495 run iperf3-srv_10.42.42.10(pid=2132): Terminating (SIGTERM) 03:18:33.268798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2133): Terminating (SIGTERM) 03:18:33.308301 run iperf3-srv_10.42.42.10(pid=2134): Terminating (SIGTERM) 03:18:33.347692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2137): Terminating (SIGTERM) 03:18:33.387277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2140): Terminating (SIGTERM) 03:18:33.426826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2144): Terminating (SIGTERM) 03:18:33.466639 --- ParallelTerminationStrategy: PID 2126 died... 03:18:33.485754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2126): Terminated: ok {rc=0} 03:18:33.529560 --- ParallelTerminationStrategy: PID 2127 died... 03:18:33.547941 run iperf3-srv_10.42.42.10(pid=2127): Terminated {rc=256} 03:18:33.591447 --- ParallelTerminationStrategy: PID 2129 died... 03:18:33.610023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2129): Terminated: ok {rc=0} 03:18:33.653303 --- ParallelTerminationStrategy: PID 2130 died... 03:18:33.671679 run iperf3-srv_10.42.42.10(pid=2130): Terminated {rc=256} 03:18:33.714957 --- ParallelTerminationStrategy: PID 2131 died... 03:18:33.733331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2131): Terminated: ok {rc=0} 03:18:33.777319 --- ParallelTerminationStrategy: PID 2132 died... 03:18:33.795739 run iperf3-srv_10.42.42.10(pid=2132): Terminated {rc=256} 03:18:33.839169 --- ParallelTerminationStrategy: PID 2133 died... 03:18:33.857727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2133): Terminated: ok {rc=0} 03:18:33.901309 --- ParallelTerminationStrategy: PID 2134 died... 03:18:33.919699 run iperf3-srv_10.42.42.10(pid=2134): Terminated {rc=256} 03:18:33.963278 --- ParallelTerminationStrategy: PID 2137 died... 03:18:33.981738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2137): Terminated: ok {rc=0} 03:18:34.025149 --- ParallelTerminationStrategy: PID 2140 died... 03:18:34.043604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2140): Terminated: ok {rc=0} 03:18:34.086991 --- ParallelTerminationStrategy: PID 2144 died... 03:18:34.105606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2144): Terminated: ok {rc=0} 03:18:34.190749 bus /gobi_4: Setting Powered False 03:18:35.291427 bus /gobi_4: Setting Powered False 03:18:36.403511 bus /gobi_1: Setting Powered False 03:18:37.499431 bus /gobi_1: Setting Powered False 03:18:38.610674 bus /gobi_0: Setting Powered False 03:18:39.709379 bus /gobi_0: Setting Powered False 03:18:40.826875 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 03:18:41.928145 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:41.940143 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:18:41.993960 tst ping.py: using LAC 38180 03:18:42.120465 tst ping.py: using RAC 185 03:18:42.238867 tst ping.py: using CellId 38180 03:18:42.356772 tst ping.py: using BVCI 38181 03:18:42.472342 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:42.483762 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:42.495096 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:42.506314 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:42.517736 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:42.529327 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:42.542697 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:42.555638 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:42.675948 tst ping.py:19: start network... 03:18:42.890715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:18:43.385052 run create_hlr_db(pid=2146): Launched 03:18:43.506801 bus /gobi_6: Setting Powered False 03:18:44.570595 run create_hlr_db(pid=2146): Terminated: ok {rc=0} 03:18:45.019249 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2148): Launched 03:18:45.323590 run osmo-hlr_10.42.42.2(pid=2149): Launched 03:18:45.436162 run osmo-stp_10.42.42.5: Starting osmo-stp 03:18:46.005243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2151): Launched 03:18:46.324655 run osmo-stp_10.42.42.5(pid=2152): Launched 03:18:46.451543 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:18:47.191174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2154): Launched 03:18:47.319121 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:18:47.572414 run patchelf(pid=2155): Launched 03:18:47.738235 run osmo-stp_10.42.42.5(pid=2152): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2152)] 03:18:47.864309 run osmo-stp_10.42.42.5(pid=2152): stdout: | (launched: 2022-12-14_03:18:46.262155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:47.991880 run osmo-stp_10.42.42.5(pid=2152): stderr: | [0;m[38;5;43m20221214031846617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031846618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031846619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031846621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031846627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031846627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031846628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:48.119595 run osmo-stp_10.42.42.5(pid=2152): stdout: | (launched: 2022-12-14_03:18:46.262155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:48.241968 run osmo-stp_10.42.42.5(pid=2152): stderr: | [0;m[38;5;43m20221214031846617 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031846618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031846619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031846621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031846627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031846627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031846628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:48.387931 run patchelf(pid=2155): Terminating (SIGINT) 03:18:48.556228 run patchelf(pid=2155): Terminated: ok {rc=0} 03:18:48.677919 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2152): Process ended prematurely: osmo-stp_10.42.42.5(pid=2152) [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2152)] [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 03:18:48.686745 tst ping.py:22: Test FAILED (6.8 sec) 03:18:48.713461 run osmo-hlr_10.42.42.2(pid=2149): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2149)] 03:18:48.761146 run osmo-hlr_10.42.42.2(pid=2149): stdout: | (launched: 2022-12-14_03:18:45.268739) 03:18:48.810360 run osmo-hlr_10.42.42.2(pid=2149): stderr: | [0;m[1;31m20221214031845442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031845442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031845442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031845442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031845442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031845442 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031845458 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031845472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031845472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031845472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:18:48.860047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2148): Terminating (SIGTERM) 03:18:48.899579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2151): Terminating (SIGTERM) 03:18:48.939133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2154): Terminating (SIGTERM) 03:18:48.978985 --- ParallelTerminationStrategy: PID 2148 died... 03:18:48.998202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2148): Terminated: ok {rc=0} 03:18:49.042177 --- ParallelTerminationStrategy: PID 2151 died... 03:18:49.060579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2151): Terminated: ok {rc=0} 03:18:49.104473 --- ParallelTerminationStrategy: PID 2154 died... 03:18:49.123096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2154): Terminated: ok {rc=0} 03:18:49.208581 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 03:18:50.296714 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:50.308350 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 03:18:50.357989 tst ping_idle_ping.py: using LAC 38181 03:18:50.476484 tst ping_idle_ping.py: using RAC 186 03:18:50.597410 tst ping_idle_ping.py: using CellId 38181 03:18:50.714875 tst ping_idle_ping.py: using BVCI 38182 03:18:50.824918 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:50.835951 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:50.846683 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:50.857315 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:50.868337 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:50.879438 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:50.890842 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 03:18:50.902064 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 03:18:51.025941 tst ping_idle_ping.py:24: start network... 03:18:51.241861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:18:51.718421 run create_hlr_db(pid=2156): Launched 03:18:51.840068 bus /gobi_6: Setting Powered False 03:18:52.900680 run create_hlr_db(pid=2156): Terminated: ok {rc=0} 03:18:53.315782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2158): Launched 03:18:53.616054 run osmo-hlr_10.42.42.2(pid=2159): Launched 03:18:53.729075 run osmo-stp_10.42.42.5: Starting osmo-stp 03:18:54.258678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2161): Launched 03:18:54.581102 run osmo-stp_10.42.42.5(pid=2162): Launched 03:18:54.708728 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:18:55.266116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2164): Launched 03:18:55.388697 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:18:55.661268 run patchelf(pid=2165): Launched 03:18:55.841212 run osmo-stp_10.42.42.5(pid=2162): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2162)] 03:18:55.977658 run osmo-stp_10.42.42.5(pid=2162): stdout: | (launched: 2022-12-14_03:18:54.522701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:56.115207 run osmo-stp_10.42.42.5(pid=2162): stderr: | [0;m[38;5;43m20221214031854715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031854715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031854715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031854716 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031854718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031854718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031854718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:56.253745 run osmo-stp_10.42.42.5(pid=2162): stdout: | (launched: 2022-12-14_03:18:54.522701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:18:56.385786 run osmo-stp_10.42.42.5(pid=2162): stderr: | [0;m[38;5;43m20221214031854715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031854715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031854715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031854716 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031854718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031854718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031854718 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:18:56.543034 run patchelf(pid=2165): Terminating (SIGINT) 03:18:56.725988 run patchelf(pid=2165): Terminated: ok {rc=0} 03:18:56.857154 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2162): Process ended prematurely: osmo-stp_10.42.42.5(pid=2162) [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2162)] [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 03:18:56.866773 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 03:18:56.894981 run osmo-hlr_10.42.42.2(pid=2159): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2159)] 03:18:56.945988 run osmo-hlr_10.42.42.2(pid=2159): stdout: | (launched: 2022-12-14_03:18:53.557441) 03:18:56.998116 run osmo-hlr_10.42.42.2(pid=2159): stderr: | [0;m[1;31m20221214031853737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031853737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031853737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031853737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031853737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031853737 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031853750 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031853759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031853759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031853759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:18:57.050661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2158): Terminating (SIGTERM) 03:18:57.092411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2161): Terminating (SIGTERM) 03:18:57.134535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2164): Terminating (SIGTERM) 03:18:57.177112 --- ParallelTerminationStrategy: PID 2158 died... 03:18:57.197541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2158): Terminated: ok {rc=0} 03:18:57.244043 --- ParallelTerminationStrategy: PID 2161 died... 03:18:57.264093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2161): Terminated: ok {rc=0} 03:18:57.310473 --- ParallelTerminationStrategy: PID 2164 died... 03:18:57.330366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2164): Terminated: ok {rc=0} 03:18:57.418819 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 03:18:58.722807 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:18:58.730595 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 03:18:58.762980 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 03:18:58.802895 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 03:18:58.890411 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 03:18:58.923034 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 03:18:58.962175 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 03:18:59.557306 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 03:18:59.610429 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:18:59.621952 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:18:59.692063 tst cs_paging_gprs_active.py: using LAC 38182 03:18:59.812116 tst cs_paging_gprs_active.py: using RAC 187 03:18:59.932400 tst cs_paging_gprs_active.py: using CellId 38182 03:19:00.052742 tst cs_paging_gprs_active.py: using BVCI 38183 03:19:00.164764 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:00.175637 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:00.186426 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:00.196932 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:00.207792 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:00.218453 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:00.229164 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:00.239631 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:00.250402 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:00.370545 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:00.490900 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:19:00.714808 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:01.070377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2169): Launched 03:19:01.375133 run iperf3-srv_10.42.42.10(pid=2170): Launched 03:19:01.511946 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:19:01.736060 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:02.104459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2171): Launched 03:19:02.399879 run iperf3-srv_10.42.42.10(pid=2172): Launched 03:19:02.523324 tst cs_paging_gprs_active.py:38: start network... 03:19:02.743081 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:19:03.249217 run create_hlr_db(pid=2174): Launched 03:19:03.373858 bus /gobi_6: Setting Powered False 03:19:04.438130 run create_hlr_db(pid=2174): Terminated: ok {rc=0} 03:19:04.885738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2176): Launched 03:19:05.211996 run osmo-hlr_10.42.42.2(pid=2177): Launched 03:19:05.336745 run osmo-stp_10.42.42.5: Starting osmo-stp 03:19:05.897310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2179): Launched 03:19:06.223289 run osmo-stp_10.42.42.5(pid=2180): Launched 03:19:06.347186 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:19:06.912498 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2182): Launched 03:19:07.037494 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:19:07.313709 run patchelf(pid=2183): Launched 03:19:07.494864 run osmo-stp_10.42.42.5(pid=2180): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2180)] 03:19:07.634080 run osmo-stp_10.42.42.5(pid=2180): stdout: | (launched: 2022-12-14_03:19:06.164060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:07.773312 run osmo-stp_10.42.42.5(pid=2180): stderr: | [0;m[38;5;43m20221214031906360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031906360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031906360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031906361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031906363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031906363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031906363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:07.912668 run osmo-stp_10.42.42.5(pid=2180): stdout: | (launched: 2022-12-14_03:19:06.164060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:08.047326 run osmo-stp_10.42.42.5(pid=2180): stderr: | [0;m[38;5;43m20221214031906360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031906360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031906360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031906361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031906363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031906363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031906363 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:08.205982 run patchelf(pid=2183): Terminating (SIGINT) 03:19:08.391118 run patchelf(pid=2183): Terminated: ok {rc=0} 03:19:08.524454 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2180): Process ended prematurely: osmo-stp_10.42.42.5(pid=2180) [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2180)] [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 03:19:08.534755 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 03:19:08.563179 run osmo-hlr_10.42.42.2(pid=2177): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2177)] 03:19:08.614103 run osmo-hlr_10.42.42.2(pid=2177): stdout: | (launched: 2022-12-14_03:19:05.152541) 03:19:08.667440 run osmo-hlr_10.42.42.2(pid=2177): stderr: | [0;m[1;31m20221214031905354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031905354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031905354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031905354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031905354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031905354 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031905367 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031905375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031905375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031905375 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:19:08.720301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2169): Terminating (SIGTERM) 03:19:08.762250 run iperf3-srv_10.42.42.10(pid=2170): Terminating (SIGTERM) 03:19:08.804161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2171): Terminating (SIGTERM) 03:19:08.846319 run iperf3-srv_10.42.42.10(pid=2172): Terminating (SIGTERM) 03:19:08.888186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2176): Terminating (SIGTERM) 03:19:08.930189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2179): Terminating (SIGTERM) 03:19:08.972396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2182): Terminating (SIGTERM) 03:19:09.015322 --- ParallelTerminationStrategy: PID 2169 died... 03:19:09.035727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2169): Terminated: ok {rc=0} 03:19:09.082121 --- ParallelTerminationStrategy: PID 2170 died... 03:19:09.101955 run iperf3-srv_10.42.42.10(pid=2170): Terminated {rc=256} 03:19:09.148174 --- ParallelTerminationStrategy: PID 2171 died... 03:19:09.168085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2171): Terminated: ok {rc=0} 03:19:09.214311 --- ParallelTerminationStrategy: PID 2172 died... 03:19:09.234105 run iperf3-srv_10.42.42.10(pid=2172): Terminated {rc=256} 03:19:09.280117 --- ParallelTerminationStrategy: PID 2176 died... 03:19:09.299984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2176): Terminated: ok {rc=0} 03:19:09.346131 --- ParallelTerminationStrategy: PID 2179 died... 03:19:09.366203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2179): Terminated: ok {rc=0} 03:19:09.412363 --- ParallelTerminationStrategy: PID 2182 died... 03:19:09.432216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2182): Terminated: ok {rc=0} 03:19:09.520161 bus /gobi_0: Setting Powered False 03:19:10.618801 bus /gobi_0: Setting Powered False 03:19:11.730983 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 03:19:12.880355 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:12.892362 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:19:12.962954 tst iperf3.py: using LAC 38183 03:19:13.098010 tst iperf3.py: using RAC 188 03:19:13.224546 tst iperf3.py: using CellId 38183 03:19:13.350556 tst iperf3.py: using BVCI 38184 03:19:13.469472 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:13.480707 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:13.491861 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:13.503030 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:13.514365 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:13.525917 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:13.537494 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:13.548686 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:13.560188 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:13.676927 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:19:13.897968 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:14.226593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2184): Launched 03:19:14.510453 run iperf3-srv_10.42.42.10(pid=2185): Launched 03:19:14.634320 tst iperf3.py:8: start network... 03:19:14.854471 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:19:15.361489 run create_hlr_db(pid=2186): Launched 03:19:15.486272 bus /gobi_6: Setting Powered False 03:19:16.553125 run create_hlr_db(pid=2186): Terminated: ok {rc=0} 03:19:17.023097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2188): Launched 03:19:17.365867 run osmo-hlr_10.42.42.2(pid=2189): Launched 03:19:17.495957 run osmo-stp_10.42.42.5: Starting osmo-stp 03:19:18.067304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2191): Launched 03:19:18.392156 run osmo-stp_10.42.42.5(pid=2192): Launched 03:19:18.520693 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:19:19.083599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2194): Launched 03:19:19.208158 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:19:19.482937 run patchelf(pid=2195): Launched 03:19:19.664663 run osmo-stp_10.42.42.5(pid=2192): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2192)] 03:19:19.801947 run osmo-stp_10.42.42.5(pid=2192): stdout: | (launched: 2022-12-14_03:19:18.332884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:19.941333 run osmo-stp_10.42.42.5(pid=2192): stderr: | [0;m[38;5;43m20221214031918526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031918526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031918526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031918526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031918527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031918527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031918527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:20.080283 run osmo-stp_10.42.42.5(pid=2192): stdout: | (launched: 2022-12-14_03:19:18.332884) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:20.213436 run osmo-stp_10.42.42.5(pid=2192): stderr: | [0;m[38;5;43m20221214031918526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031918526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031918526 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031918526 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031918527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031918527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031918527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:20.372442 run patchelf(pid=2195): Terminating (SIGINT) 03:19:20.555849 run patchelf(pid=2195): Terminated: ok {rc=0} 03:19:20.689907 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2192): Process ended prematurely: osmo-stp_10.42.42.5(pid=2192) [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2192)] [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 03:19:20.699974 tst iperf3.py:8: Test FAILED (7.9 sec) 03:19:20.728380 run osmo-hlr_10.42.42.2(pid=2189): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2189)] 03:19:20.778668 run osmo-hlr_10.42.42.2(pid=2189): stdout: | (launched: 2022-12-14_03:19:17.306264) 03:19:20.830480 run osmo-hlr_10.42.42.2(pid=2189): stderr: | [0;m[1;31m20221214031917505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031917505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031917505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031917505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031917505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031917505 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031917517 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031917525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031917525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031917525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:19:20.882219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2184): Terminating (SIGTERM) 03:19:20.924295 run iperf3-srv_10.42.42.10(pid=2185): Terminating (SIGTERM) 03:19:20.966324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2188): Terminating (SIGTERM) 03:19:21.008265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2191): Terminating (SIGTERM) 03:19:21.051170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2194): Terminating (SIGTERM) 03:19:21.093569 --- ParallelTerminationStrategy: PID 2184 died... 03:19:21.113924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2184): Terminated: ok {rc=0} 03:19:21.160486 --- ParallelTerminationStrategy: PID 2185 died... 03:19:21.180164 run iperf3-srv_10.42.42.10(pid=2185): Terminated {rc=256} 03:19:21.226183 --- ParallelTerminationStrategy: PID 2188 died... 03:19:21.245968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2188): Terminated: ok {rc=0} 03:19:21.292031 --- ParallelTerminationStrategy: PID 2191 died... 03:19:21.311970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2191): Terminated: ok {rc=0} 03:19:21.358158 --- ParallelTerminationStrategy: PID 2194 died... 03:19:21.378047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2194): Terminated: ok {rc=0} 03:19:21.466834 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 03:19:22.616917 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:22.629402 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:19:22.696633 tst iperf3m4.py: using LAC 38184 03:19:22.824479 tst iperf3m4.py: using RAC 189 03:19:22.952452 tst iperf3m4.py: using CellId 38184 03:19:23.077811 tst iperf3m4.py: using BVCI 38185 03:19:23.189204 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:23.200236 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:23.211130 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:23.222003 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:23.232772 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:23.246648 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:23.257659 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:23.268319 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:23.279142 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:23.399680 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:23.522661 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:23.643871 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:23.762154 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:19:23.965486 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:24.292277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2196): Launched 03:19:24.566359 run iperf3-srv_10.42.42.10(pid=2197): Launched 03:19:24.680679 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:19:24.898765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:25.226655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2199): Launched 03:19:25.510936 run iperf3-srv_10.42.42.10(pid=2200): Launched 03:19:25.634338 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:19:25.854559 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:26.181515 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2201): Launched 03:19:26.453637 run iperf3-srv_10.42.42.10(pid=2202): Launched 03:19:26.567647 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:19:26.790676 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:19:27.118479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2203): Launched 03:19:27.406546 run iperf3-srv_10.42.42.10(pid=2204): Launched 03:19:27.520716 tst iperf3m4.py:8: start network... 03:19:27.726203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:19:28.198685 run create_hlr_db(pid=2205): Launched 03:19:28.322616 bus /gobi_6: Setting Powered False 03:19:29.383327 run create_hlr_db(pid=2205): Terminated: ok {rc=0} 03:19:29.804320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2207): Launched 03:19:30.107400 run osmo-hlr_10.42.42.2(pid=2208): Launched 03:19:30.221961 run osmo-stp_10.42.42.5: Starting osmo-stp 03:19:30.760836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2210): Launched 03:19:31.119168 run osmo-stp_10.42.42.5(pid=2211): Launched 03:19:31.259486 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:19:32.017063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2213): Launched 03:19:32.155550 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:19:32.435715 run patchelf(pid=2214): Launched 03:19:32.617275 run osmo-stp_10.42.42.5(pid=2211): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2211)] 03:19:32.756082 run osmo-stp_10.42.42.5(pid=2211): stdout: | (launched: 2022-12-14_03:19:31.055506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:32.895448 run osmo-stp_10.42.42.5(pid=2211): stderr: | [0;m[38;5;43m20221214031931412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031931412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031931412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031931425 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031931426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031931426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031931426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:33.037244 run osmo-stp_10.42.42.5(pid=2211): stdout: | (launched: 2022-12-14_03:19:31.055506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:33.161522 run osmo-stp_10.42.42.5(pid=2211): stderr: | [0;m[38;5;43m20221214031931412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031931412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031931412 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031931425 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031931426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031931426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031931426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:33.307957 run patchelf(pid=2214): Terminating (SIGINT) 03:19:33.492389 run patchelf(pid=2214): Terminated: ok {rc=0} 03:19:33.626318 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2211): Process ended prematurely: osmo-stp_10.42.42.5(pid=2211) [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2211)] [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 03:19:33.636601 tst iperf3m4.py:8: Test FAILED (11.1 sec) 03:19:33.665295 run osmo-hlr_10.42.42.2(pid=2208): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2208)] 03:19:33.717365 run osmo-hlr_10.42.42.2(pid=2208): stdout: | (launched: 2022-12-14_03:19:30.051756) 03:19:33.769406 run osmo-hlr_10.42.42.2(pid=2208): stderr: | [0;m[1;31m20221214031930231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031930231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031930231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031930231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031930231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031930231 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031930243 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031930252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031930252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031930252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:19:33.821764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2196): Terminating (SIGTERM) 03:19:33.863464 run iperf3-srv_10.42.42.10(pid=2197): Terminating (SIGTERM) 03:19:33.905360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2199): Terminating (SIGTERM) 03:19:33.947076 run iperf3-srv_10.42.42.10(pid=2200): Terminating (SIGTERM) 03:19:33.988777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2201): Terminating (SIGTERM) 03:19:34.030662 run iperf3-srv_10.42.42.10(pid=2202): Terminating (SIGTERM) 03:19:34.073020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2203): Terminating (SIGTERM) 03:19:34.115492 run iperf3-srv_10.42.42.10(pid=2204): Terminating (SIGTERM) 03:19:34.157112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2207): Terminating (SIGTERM) 03:19:34.198838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2210): Terminating (SIGTERM) 03:19:34.240467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2213): Terminating (SIGTERM) 03:19:34.282496 --- ParallelTerminationStrategy: PID 2196 died... 03:19:34.302539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2196): Terminated: ok {rc=0} 03:19:34.349059 --- ParallelTerminationStrategy: PID 2197 died... 03:19:34.369039 run iperf3-srv_10.42.42.10(pid=2197): Terminated {rc=256} 03:19:34.415797 --- ParallelTerminationStrategy: PID 2199 died... 03:19:34.435615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2199): Terminated: ok {rc=0} 03:19:34.481954 --- ParallelTerminationStrategy: PID 2200 died... 03:19:34.501743 run iperf3-srv_10.42.42.10(pid=2200): Terminated {rc=256} 03:19:34.547906 --- ParallelTerminationStrategy: PID 2201 died... 03:19:34.567691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2201): Terminated: ok {rc=0} 03:19:34.613941 --- ParallelTerminationStrategy: PID 2202 died... 03:19:34.634210 run iperf3-srv_10.42.42.10(pid=2202): Terminated {rc=256} 03:19:34.680465 --- ParallelTerminationStrategy: PID 2203 died... 03:19:34.700646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2203): Terminated: ok {rc=0} 03:19:34.746874 --- ParallelTerminationStrategy: PID 2204 died... 03:19:34.767156 run iperf3-srv_10.42.42.10(pid=2204): Terminated {rc=256} 03:19:34.813533 --- ParallelTerminationStrategy: PID 2207 died... 03:19:34.833548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2207): Terminated: ok {rc=0} 03:19:34.879774 --- ParallelTerminationStrategy: PID 2210 died... 03:19:34.899647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2210): Terminated: ok {rc=0} 03:19:34.945706 --- ParallelTerminationStrategy: PID 2213 died... 03:19:34.965668 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2213): Terminated: ok {rc=0} 03:19:35.052936 bus /gobi_4: Setting Powered False 03:19:36.151629 bus /gobi_4: Setting Powered False 03:19:37.267856 bus /gobi_1: Setting Powered False 03:19:38.365820 bus /gobi_1: Setting Powered False 03:19:39.483346 bus /gobi_0: Setting Powered False 03:19:40.580217 bus /gobi_0: Setting Powered False 03:19:41.695799 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 03:19:42.798948 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:42.810463 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:19:42.874575 tst ping.py: using LAC 38185 03:19:42.990383 tst ping.py: using RAC 190 03:19:43.106713 tst ping.py: using CellId 38185 03:19:43.221851 tst ping.py: using BVCI 38186 03:19:43.328583 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:43.339603 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:43.350406 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:43.361550 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:43.372021 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:43.382698 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:43.393610 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:43.404214 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:43.518878 tst ping.py:19: start network... 03:19:43.718442 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:19:44.216149 run create_hlr_db(pid=2216): Launched 03:19:44.338505 bus /gobi_6: Setting Powered False 03:19:45.401920 run create_hlr_db(pid=2216): Terminated: ok {rc=0} 03:19:45.857815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2218): Launched 03:19:46.208071 run osmo-hlr_10.42.42.2(pid=2219): Launched 03:19:46.435721 run osmo-stp_10.42.42.5: Starting osmo-stp 03:19:47.057676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2221): Launched 03:19:47.390070 run osmo-stp_10.42.42.5(pid=2222): Launched 03:19:47.532806 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:19:48.091873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2224): Launched 03:19:48.215584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:19:48.486894 run patchelf(pid=2225): Launched 03:19:48.666813 run osmo-stp_10.42.42.5(pid=2222): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2222)] 03:19:48.802491 run osmo-stp_10.42.42.5(pid=2222): stdout: | (launched: 2022-12-14_03:19:47.326704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:48.940381 run osmo-stp_10.42.42.5(pid=2222): stderr: | [0;m[38;5;43m20221214031947540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031947541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031947541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031947541 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031947542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031947542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031947542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:49.077693 run osmo-stp_10.42.42.5(pid=2222): stdout: | (launched: 2022-12-14_03:19:47.326704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:49.209770 run osmo-stp_10.42.42.5(pid=2222): stderr: | [0;m[38;5;43m20221214031947540 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031947541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031947541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031947541 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031947542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031947542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031947542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:49.366706 run patchelf(pid=2225): Terminating (SIGINT) 03:19:49.548274 run patchelf(pid=2225): Terminated: ok {rc=0} 03:19:49.680310 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2222): Process ended prematurely: osmo-stp_10.42.42.5(pid=2222) [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2222)] [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 03:19:49.690055 tst ping.py:22: Test FAILED (6.9 sec) 03:19:49.718483 run osmo-hlr_10.42.42.2(pid=2219): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2219)] 03:19:49.769314 run osmo-hlr_10.42.42.2(pid=2219): stdout: | (launched: 2022-12-14_03:19:46.144338) 03:19:49.822059 run osmo-hlr_10.42.42.2(pid=2219): stderr: | [0;m[1;31m20221214031946353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031946353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031946353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031946353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031946353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031946353 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031946368 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031946387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031946387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031946387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:19:49.874756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2218): Terminating (SIGTERM) 03:19:49.916663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2221): Terminating (SIGTERM) 03:19:49.959036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2224): Terminating (SIGTERM) 03:19:50.001791 --- ParallelTerminationStrategy: PID 2218 died... 03:19:50.022345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2218): Terminated: ok {rc=0} 03:19:50.069943 --- ParallelTerminationStrategy: PID 2221 died... 03:19:50.090189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2221): Terminated: ok {rc=0} 03:19:50.136912 --- ParallelTerminationStrategy: PID 2224 died... 03:19:50.157038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2224): Terminated: ok {rc=0} 03:19:50.245699 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 03:19:51.333435 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:51.346055 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 03:19:51.415913 tst ping_idle_ping.py: using LAC 38186 03:19:51.544046 tst ping_idle_ping.py: using RAC 191 03:19:51.671792 tst ping_idle_ping.py: using CellId 38186 03:19:51.798697 tst ping_idle_ping.py: using BVCI 38187 03:19:51.917200 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:51.928510 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:51.939735 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:51.950971 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:51.962582 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:51.973767 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:51.985063 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 03:19:51.996301 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 03:19:52.115714 tst ping_idle_ping.py:24: start network... 03:19:52.329702 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:19:52.814299 run create_hlr_db(pid=2228): Launched 03:19:52.937398 bus /gobi_6: Setting Powered False 03:19:54.001412 run create_hlr_db(pid=2228): Terminated: ok {rc=0} 03:19:54.430530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2231): Launched 03:19:54.746228 run osmo-hlr_10.42.42.2(pid=2232): Launched 03:19:54.869163 run osmo-stp_10.42.42.5: Starting osmo-stp 03:19:55.422457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2234): Launched 03:19:55.721630 run osmo-stp_10.42.42.5(pid=2235): Launched 03:19:55.834534 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:19:56.371716 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2237): Launched 03:19:56.496036 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:19:56.769215 run patchelf(pid=2238): Launched 03:19:56.949789 run osmo-stp_10.42.42.5(pid=2235): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2235)] 03:19:57.086117 run osmo-stp_10.42.42.5(pid=2235): stdout: | (launched: 2022-12-14_03:19:55.666072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:57.223882 run osmo-stp_10.42.42.5(pid=2235): stderr: | [0;m[38;5;43m20221214031955841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031955841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031955841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031955842 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031955842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031955842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031955842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:57.362335 run osmo-stp_10.42.42.5(pid=2235): stdout: | (launched: 2022-12-14_03:19:55.666072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:19:57.495854 run osmo-stp_10.42.42.5(pid=2235): stderr: | [0;m[38;5;43m20221214031955841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214031955841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214031955841 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214031955842 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214031955842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214031955842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214031955842 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:19:57.653407 run patchelf(pid=2238): Terminating (SIGINT) 03:19:57.836182 run patchelf(pid=2238): Terminated: ok {rc=0} 03:19:57.967581 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2235): Process ended prematurely: osmo-stp_10.42.42.5(pid=2235) [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2235)] [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 03:19:57.977182 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 03:19:58.005328 run osmo-hlr_10.42.42.2(pid=2232): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2232)] 03:19:58.056502 run osmo-hlr_10.42.42.2(pid=2232): stdout: | (launched: 2022-12-14_03:19:54.687223) 03:19:58.109552 run osmo-hlr_10.42.42.2(pid=2232): stderr: | [0;m[1;31m20221214031954883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214031954883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214031954883 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214031954884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214031954884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214031954884 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214031954895 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214031954904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214031954904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214031954904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:19:58.162267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2231): Terminating (SIGTERM) 03:19:58.203921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2234): Terminating (SIGTERM) 03:19:58.246273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2237): Terminating (SIGTERM) 03:19:58.288730 --- ParallelTerminationStrategy: PID 2231 died... 03:19:58.309264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2231): Terminated: ok {rc=0} 03:19:58.356013 --- ParallelTerminationStrategy: PID 2234 died... 03:19:58.375974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2234): Terminated: ok {rc=0} 03:19:58.422493 --- ParallelTerminationStrategy: PID 2237 died... 03:19:58.442758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2237): Terminated: ok {rc=0} 03:19:58.531490 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 03:19:59.845206 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:19:59.853286 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 03:19:59.884751 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 03:19:59.929371 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 03:20:00.015976 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 03:20:00.047232 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 03:20:00.084942 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 03:20:00.684032 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 03:20:00.732431 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:00.743840 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:20:00.792464 tst cs_paging_gprs_active.py: using LAC 38187 03:20:00.934592 tst cs_paging_gprs_active.py: using RAC 192 03:20:01.079332 tst cs_paging_gprs_active.py: using CellId 38187 03:20:01.240902 tst cs_paging_gprs_active.py: using BVCI 38188 03:20:01.357364 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:01.369155 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:01.380590 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:01.392253 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:01.403984 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:01.415748 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:01.429877 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:01.441792 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:01.454122 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:01.575077 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:01.699786 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 03:20:01.972422 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:02.336022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2245): Launched 03:20:02.626330 run iperf3-srv_10.42.42.10(pid=2246): Launched 03:20:02.747157 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 03:20:02.964239 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:03.285996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2247): Launched 03:20:03.565585 run iperf3-srv_10.42.42.10(pid=2248): Launched 03:20:03.686287 tst cs_paging_gprs_active.py:38: start network... 03:20:03.902288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:20:04.402168 run create_hlr_db(pid=2249): Launched 03:20:04.525218 bus /gobi_6: Setting Powered False 03:20:05.590001 run create_hlr_db(pid=2249): Terminated: ok {rc=0} 03:20:06.038185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2251): Launched 03:20:06.359287 run osmo-hlr_10.42.42.2(pid=2252): Launched 03:20:06.483805 run osmo-stp_10.42.42.5: Starting osmo-stp 03:20:07.028808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2254): Launched 03:20:07.344156 run osmo-stp_10.42.42.5(pid=2255): Launched 03:20:07.469009 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:20:08.027938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2257): Launched 03:20:08.151010 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:20:08.423453 run patchelf(pid=2258): Launched 03:20:08.601806 run osmo-stp_10.42.42.5(pid=2255): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2255)] 03:20:08.739120 run osmo-stp_10.42.42.5(pid=2255): stdout: | (launched: 2022-12-14_03:20:07.286059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:08.876886 run osmo-stp_10.42.42.5(pid=2255): stderr: | [0;m[38;5;43m20221214032007475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032007475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032007475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032007476 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032007476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032007476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032007476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:09.015211 run osmo-stp_10.42.42.5(pid=2255): stdout: | (launched: 2022-12-14_03:20:07.286059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:09.148486 run osmo-stp_10.42.42.5(pid=2255): stderr: | [0;m[38;5;43m20221214032007475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032007475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032007475 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032007476 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032007476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032007476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032007476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:09.305108 run patchelf(pid=2258): Terminating (SIGINT) 03:20:09.487123 run patchelf(pid=2258): Terminated: ok {rc=0} 03:20:09.619053 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2255): Process ended prematurely: osmo-stp_10.42.42.5(pid=2255) [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2255)] [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 03:20:09.629229 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 03:20:09.657869 run osmo-hlr_10.42.42.2(pid=2252): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2252)] 03:20:09.709067 run osmo-hlr_10.42.42.2(pid=2252): stdout: | (launched: 2022-12-14_03:20:06.301114) 03:20:09.761794 run osmo-hlr_10.42.42.2(pid=2252): stderr: | [0;m[1;31m20221214032006502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032006502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032006502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032006502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032006502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032006502 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032006514 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032006524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032006524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032006524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:20:09.814537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2245): Terminating (SIGTERM) 03:20:09.856548 run iperf3-srv_10.42.42.10(pid=2246): Terminating (SIGTERM) 03:20:09.899243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2247): Terminating (SIGTERM) 03:20:09.942131 run iperf3-srv_10.42.42.10(pid=2248): Terminating (SIGTERM) 03:20:09.984352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2251): Terminating (SIGTERM) 03:20:10.026909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2254): Terminating (SIGTERM) 03:20:10.069271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2257): Terminating (SIGTERM) 03:20:10.111940 --- ParallelTerminationStrategy: PID 2245 died... 03:20:10.132340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2245): Terminated: ok {rc=0} 03:20:10.178904 --- ParallelTerminationStrategy: PID 2246 died... 03:20:10.198726 run iperf3-srv_10.42.42.10(pid=2246): Terminated {rc=256} 03:20:10.245603 --- ParallelTerminationStrategy: PID 2247 died... 03:20:10.265488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2247): Terminated: ok {rc=0} 03:20:10.311955 --- ParallelTerminationStrategy: PID 2248 died... 03:20:10.331697 run iperf3-srv_10.42.42.10(pid=2248): Terminated {rc=256} 03:20:10.378007 --- ParallelTerminationStrategy: PID 2251 died... 03:20:10.397946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2251): Terminated: ok {rc=0} 03:20:10.444299 --- ParallelTerminationStrategy: PID 2254 died... 03:20:10.464240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2254): Terminated: ok {rc=0} 03:20:10.510366 --- ParallelTerminationStrategy: PID 2257 died... 03:20:10.530294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2257): Terminated: ok {rc=0} 03:20:10.619866 bus /gobi_0: Setting Powered False 03:20:11.720870 bus /gobi_0: Setting Powered False 03:20:12.840777 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 03:20:13.990595 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:14.003027 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:20:14.053274 tst iperf3.py: using LAC 38188 03:20:14.180220 tst iperf3.py: using RAC 193 03:20:14.307906 tst iperf3.py: using CellId 38188 03:20:14.426607 tst iperf3.py: using BVCI 38189 03:20:14.536385 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:14.547790 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:14.559114 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:14.570351 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:14.581610 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:14.592552 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:14.603718 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:14.614636 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:14.625947 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:14.746938 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 03:20:14.946451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:15.244427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2259): Launched 03:20:15.503216 run iperf3-srv_10.42.42.10(pid=2260): Launched 03:20:15.614607 tst iperf3.py:8: start network... 03:20:15.813274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:20:16.305607 run create_hlr_db(pid=2261): Launched 03:20:16.459918 bus /gobi_6: Setting Powered False 03:20:17.518426 run create_hlr_db(pid=2261): Terminated: ok {rc=0} 03:20:17.954887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2263): Launched 03:20:18.276385 run osmo-hlr_10.42.42.2(pid=2264): Launched 03:20:18.399116 run osmo-stp_10.42.42.5: Starting osmo-stp 03:20:18.951934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2266): Launched 03:20:19.272720 run osmo-stp_10.42.42.5(pid=2267): Launched 03:20:19.396155 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:20:19.951190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2269): Launched 03:20:20.074767 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:20:20.346576 run patchelf(pid=2270): Launched 03:20:20.524877 run osmo-stp_10.42.42.5(pid=2267): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2267)] 03:20:20.661693 run osmo-stp_10.42.42.5(pid=2267): stdout: | (launched: 2022-12-14_03:20:19.214421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:20.799503 run osmo-stp_10.42.42.5(pid=2267): stderr: | [0;m[38;5;43m20221214032019405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032019405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032019405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032019405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032019406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032019406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032019406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:20.937689 run osmo-stp_10.42.42.5(pid=2267): stdout: | (launched: 2022-12-14_03:20:19.214421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:21.070104 run osmo-stp_10.42.42.5(pid=2267): stderr: | [0;m[38;5;43m20221214032019405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032019405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032019405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032019405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032019406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032019406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032019406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:21.227254 run patchelf(pid=2270): Terminating (SIGINT) 03:20:21.408656 run patchelf(pid=2270): Terminated: ok {rc=0} 03:20:21.539826 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2267): Process ended prematurely: osmo-stp_10.42.42.5(pid=2267) [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2267)] [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 03:20:21.550066 tst iperf3.py:8: Test FAILED (7.6 sec) 03:20:21.578560 run osmo-hlr_10.42.42.2(pid=2264): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2264)] 03:20:21.630123 run osmo-hlr_10.42.42.2(pid=2264): stdout: | (launched: 2022-12-14_03:20:18.218364) 03:20:21.683068 run osmo-hlr_10.42.42.2(pid=2264): stderr: | [0;m[1;31m20221214032018417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032018417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032018417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032018417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032018417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032018417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032018433 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032018443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032018443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032018443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:20:21.736113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2259): Terminating (SIGTERM) 03:20:21.778303 run iperf3-srv_10.42.42.10(pid=2260): Terminating (SIGTERM) 03:20:21.820495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2263): Terminating (SIGTERM) 03:20:21.863198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2266): Terminating (SIGTERM) 03:20:21.905556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2269): Terminating (SIGTERM) 03:20:21.947920 --- ParallelTerminationStrategy: PID 2259 died... 03:20:21.968221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2259): Terminated: ok {rc=0} 03:20:22.014969 --- ParallelTerminationStrategy: PID 2260 died... 03:20:22.034682 run iperf3-srv_10.42.42.10(pid=2260): Terminated {rc=256} 03:20:22.081162 --- ParallelTerminationStrategy: PID 2263 died... 03:20:22.101080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2263): Terminated: ok {rc=0} 03:20:22.147766 --- ParallelTerminationStrategy: PID 2266 died... 03:20:22.167607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2266): Terminated: ok {rc=0} 03:20:22.214077 --- ParallelTerminationStrategy: PID 2269 died... 03:20:22.233970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2269): Terminated: ok {rc=0} 03:20:22.322417 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 03:20:23.471806 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:23.484150 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:20:23.536356 tst iperf3m4.py: using LAC 38189 03:20:23.655321 tst iperf3m4.py: using RAC 194 03:20:23.773934 tst iperf3m4.py: using CellId 38189 03:20:23.891004 tst iperf3m4.py: using BVCI 38190 03:20:24.001513 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:24.012784 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:24.024021 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:24.035135 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:24.046172 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:24.057166 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:24.068236 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:24.079261 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:24.090470 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:24.211767 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:24.330287 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:24.447629 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:24.567897 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 03:20:24.786942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:25.108936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2271): Launched 03:20:25.388490 run iperf3-srv_10.42.42.10(pid=2272): Launched 03:20:25.509264 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 03:20:25.725652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:26.046829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2273): Launched 03:20:26.326022 run iperf3-srv_10.42.42.10(pid=2274): Launched 03:20:26.446114 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 03:20:26.662398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:26.984001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2275): Launched 03:20:27.262214 run iperf3-srv_10.42.42.10(pid=2276): Launched 03:20:27.382182 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 03:20:27.597785 run iperf3-srv_10.42.42.10: Starting iperf3-srv 03:20:27.919822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2277): Launched 03:20:28.198005 run iperf3-srv_10.42.42.10(pid=2278): Launched 03:20:28.319353 tst iperf3m4.py:8: start network... 03:20:28.535250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:20:29.031831 run create_hlr_db(pid=2279): Launched 03:20:29.153651 bus /gobi_6: Setting Powered False 03:20:30.216885 run create_hlr_db(pid=2279): Terminated: ok {rc=0} 03:20:30.642691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2281): Launched 03:20:30.961961 run osmo-hlr_10.42.42.2(pid=2282): Launched 03:20:31.079486 run osmo-stp_10.42.42.5: Starting osmo-stp 03:20:31.824758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2284): Launched 03:20:32.169734 run osmo-stp_10.42.42.5(pid=2285): Launched 03:20:32.337850 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:20:32.897132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2287): Launched 03:20:33.019236 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:20:33.290168 run patchelf(pid=2288): Launched 03:20:33.468612 run osmo-stp_10.42.42.5(pid=2285): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2285)] 03:20:33.604362 run osmo-stp_10.42.42.5(pid=2285): stdout: | (launched: 2022-12-14_03:20:32.106945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:33.741873 run osmo-stp_10.42.42.5(pid=2285): stderr: | [0;m[38;5;43m20221214032032328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032032328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032032329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032032329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032032329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032032330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032032330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:33.879475 run osmo-stp_10.42.42.5(pid=2285): stdout: | (launched: 2022-12-14_03:20:32.106945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:34.011272 run osmo-stp_10.42.42.5(pid=2285): stderr: | [0;m[38;5;43m20221214032032328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032032328 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032032329 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032032329 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032032329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032032330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032032330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:34.167469 run patchelf(pid=2288): Terminating (SIGINT) 03:20:34.348378 run patchelf(pid=2288): Terminated: ok {rc=0} 03:20:34.479177 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2285): Process ended prematurely: osmo-stp_10.42.42.5(pid=2285) [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2285)] [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 03:20:34.489328 tst iperf3m4.py:8: Test FAILED (11.1 sec) 03:20:34.517731 run osmo-hlr_10.42.42.2(pid=2282): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2282)] 03:20:34.568026 run osmo-hlr_10.42.42.2(pid=2282): stdout: | (launched: 2022-12-14_03:20:30.893215) 03:20:34.620357 run osmo-hlr_10.42.42.2(pid=2282): stderr: | [0;m[1;31m20221214032031212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032031212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032031212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032031212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032031212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032031212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032031227 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032031240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032031240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032031240 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:20:34.672774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2271): Terminating (SIGTERM) 03:20:34.714415 run iperf3-srv_10.42.42.10(pid=2272): Terminating (SIGTERM) 03:20:34.756099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2273): Terminating (SIGTERM) 03:20:34.797879 run iperf3-srv_10.42.42.10(pid=2274): Terminating (SIGTERM) 03:20:34.839573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2275): Terminating (SIGTERM) 03:20:34.881498 run iperf3-srv_10.42.42.10(pid=2276): Terminating (SIGTERM) 03:20:34.923055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2277): Terminating (SIGTERM) 03:20:34.964829 run iperf3-srv_10.42.42.10(pid=2278): Terminating (SIGTERM) 03:20:35.006416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2281): Terminating (SIGTERM) 03:20:35.048077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2284): Terminating (SIGTERM) 03:20:35.089821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2287): Terminating (SIGTERM) 03:20:35.131962 --- ParallelTerminationStrategy: PID 2271 died... 03:20:35.151687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2271): Terminated: ok {rc=0} 03:20:35.197670 --- ParallelTerminationStrategy: PID 2272 died... 03:20:35.217498 run iperf3-srv_10.42.42.10(pid=2272): Terminated {rc=256} 03:20:35.263137 --- ParallelTerminationStrategy: PID 2273 died... 03:20:35.282837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2273): Terminated: ok {rc=0} 03:20:35.328683 --- ParallelTerminationStrategy: PID 2274 died... 03:20:35.348595 run iperf3-srv_10.42.42.10(pid=2274): Terminated {rc=256} 03:20:35.394533 --- ParallelTerminationStrategy: PID 2275 died... 03:20:35.414170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2275): Terminated: ok {rc=0} 03:20:35.459888 --- ParallelTerminationStrategy: PID 2276 died... 03:20:35.479521 run iperf3-srv_10.42.42.10(pid=2276): Terminated {rc=256} 03:20:35.525210 --- ParallelTerminationStrategy: PID 2277 died... 03:20:35.544649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2277): Terminated: ok {rc=0} 03:20:35.590544 --- ParallelTerminationStrategy: PID 2278 died... 03:20:35.610141 run iperf3-srv_10.42.42.10(pid=2278): Terminated {rc=256} 03:20:35.656056 --- ParallelTerminationStrategy: PID 2281 died... 03:20:35.675733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2281): Terminated: ok {rc=0} 03:20:35.721752 --- ParallelTerminationStrategy: PID 2284 died... 03:20:35.741517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2284): Terminated: ok {rc=0} 03:20:35.787370 --- ParallelTerminationStrategy: PID 2287 died... 03:20:35.807116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2287): Terminated: ok {rc=0} 03:20:35.895222 bus /gobi_4: Setting Powered False 03:20:36.993702 bus /gobi_4: Setting Powered False 03:20:38.108558 bus /gobi_1: Setting Powered False 03:20:39.206615 bus /gobi_1: Setting Powered False 03:20:40.321449 bus /gobi_0: Setting Powered False 03:20:41.418429 bus /gobi_0: Setting Powered False 03:20:42.535962 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 03:20:43.638031 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:43.650048 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:20:43.699195 tst ping.py: using LAC 38190 03:20:43.823352 tst ping.py: using RAC 195 03:20:43.945843 tst ping.py: using CellId 38190 03:20:44.069390 tst ping.py: using BVCI 38191 03:20:44.183990 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:44.195808 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:44.207468 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:44.219079 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:44.230909 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:44.242856 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:44.254919 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:44.266789 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:44.381559 tst ping.py:19: start network... 03:20:44.578468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:20:45.033529 run create_hlr_db(pid=2289): Launched 03:20:45.154558 bus /gobi_6: Setting Powered False 03:20:46.213726 run create_hlr_db(pid=2289): Terminated: ok {rc=0} 03:20:46.698184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2291): Launched 03:20:47.088070 run osmo-hlr_10.42.42.2(pid=2292): Launched 03:20:47.364086 run osmo-stp_10.42.42.5: Starting osmo-stp 03:20:47.909123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2294): Launched 03:20:48.225373 run osmo-stp_10.42.42.5(pid=2295): Launched 03:20:48.346684 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:20:48.893158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2297): Launched 03:20:49.009906 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:20:49.257659 run patchelf(pid=2298): Launched 03:20:49.421465 run osmo-stp_10.42.42.5(pid=2295): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2295)] 03:20:49.546008 run osmo-stp_10.42.42.5(pid=2295): stdout: | (launched: 2022-12-14_03:20:48.167963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:49.672403 run osmo-stp_10.42.42.5(pid=2295): stderr: | [0;m[38;5;43m20221214032048360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032048360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032048361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032048361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032048361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032048361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032048362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:49.798462 run osmo-stp_10.42.42.5(pid=2295): stdout: | (launched: 2022-12-14_03:20:48.167963) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:49.919784 run osmo-stp_10.42.42.5(pid=2295): stderr: | [0;m[38;5;43m20221214032048360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032048360 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032048361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032048361 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032048361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032048361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032048362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:50.062835 run patchelf(pid=2298): Terminating (SIGINT) 03:20:50.229526 run patchelf(pid=2298): Terminated: ok {rc=0} 03:20:50.349688 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2295): Process ended prematurely: osmo-stp_10.42.42.5(pid=2295) [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2295)] [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 03:20:50.358525 tst ping.py:22: Test FAILED (6.7 sec) 03:20:50.385268 run osmo-hlr_10.42.42.2(pid=2292): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2292)] 03:20:50.432857 run osmo-hlr_10.42.42.2(pid=2292): stdout: | (launched: 2022-12-14_03:20:47.024732) 03:20:50.482178 run osmo-hlr_10.42.42.2(pid=2292): stderr: | [0;m[1;31m20221214032047276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032047276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032047276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032047276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032047276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032047277 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032047288 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032047296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032047296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032047297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:20:50.532072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2291): Terminating (SIGTERM) 03:20:50.571877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2294): Terminating (SIGTERM) 03:20:50.611691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2297): Terminating (SIGTERM) 03:20:50.651811 --- ParallelTerminationStrategy: PID 2291 died... 03:20:50.670949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2291): Terminated: ok {rc=0} 03:20:50.715046 --- ParallelTerminationStrategy: PID 2294 died... 03:20:50.733710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2294): Terminated: ok {rc=0} 03:20:50.777552 --- ParallelTerminationStrategy: PID 2297 died... 03:20:50.796123 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2297): Terminated: ok {rc=0} 03:20:50.878942 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 03:20:51.965896 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:51.978485 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 03:20:52.030856 tst ping_idle_ping.py: using LAC 38191 03:20:52.156534 tst ping_idle_ping.py: using RAC 196 03:20:52.280279 tst ping_idle_ping.py: using CellId 38191 03:20:52.406191 tst ping_idle_ping.py: using BVCI 38192 03:20:52.523615 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:52.535512 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:52.547139 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:52.558832 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:52.570757 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:52.582745 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:52.594776 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 03:20:52.606710 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 03:20:52.721221 tst ping_idle_ping.py:24: start network... 03:20:52.918714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:20:53.377810 run create_hlr_db(pid=2299): Launched 03:20:53.499642 bus /gobi_6: Setting Powered False 03:20:54.558653 run create_hlr_db(pid=2299): Terminated: ok {rc=0} 03:20:54.970694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2301): Launched 03:20:55.265247 run osmo-hlr_10.42.42.2(pid=2302): Launched 03:20:55.378388 run osmo-stp_10.42.42.5: Starting osmo-stp 03:20:55.905015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2304): Launched 03:20:56.199405 run osmo-stp_10.42.42.5(pid=2305): Launched 03:20:56.311589 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:20:56.819016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2307): Launched 03:20:56.931132 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:20:57.179164 run patchelf(pid=2308): Launched 03:20:57.342767 run osmo-stp_10.42.42.5(pid=2305): ERR: Terminated: ERROR {rc=1} [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2305)] 03:20:57.467905 run osmo-stp_10.42.42.5(pid=2305): stdout: | (launched: 2022-12-14_03:20:56.145430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:57.594349 run osmo-stp_10.42.42.5(pid=2305): stderr: | [0;m[38;5;43m20221214032056315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032056315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032056315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032056316 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032056316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032056316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032056316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:57.720334 run osmo-stp_10.42.42.5(pid=2305): stdout: | (launched: 2022-12-14_03:20:56.145430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:20:57.841217 run osmo-stp_10.42.42.5(pid=2305): stderr: | [0;m[38;5;43m20221214032056315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032056315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032056315 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032056316 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032056316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032056316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032056316 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:20:57.984123 run patchelf(pid=2308): Terminating (SIGINT) 03:20:58.150837 run patchelf(pid=2308): Terminated: ok {rc=0} 03:20:58.270970 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2305): Process ended prematurely: osmo-stp_10.42.42.5(pid=2305) [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2305)] [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 03:20:58.279882 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 03:20:58.306234 run osmo-hlr_10.42.42.2(pid=2302): ERR: Terminated: ERROR {rc=237} [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2302)] 03:20:58.353505 run osmo-hlr_10.42.42.2(pid=2302): stdout: | (launched: 2022-12-14_03:20:55.211260) 03:20:58.402738 run osmo-hlr_10.42.42.2(pid=2302): stderr: | [0;m[1;31m20221214032055389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032055389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032055389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032055389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032055389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032055389 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032055402 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032055411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032055411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032055411 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:20:58.452347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2301): Terminating (SIGTERM) 03:20:58.492140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2304): Terminating (SIGTERM) 03:20:58.531755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2307): Terminating (SIGTERM) 03:20:58.572188 --- ParallelTerminationStrategy: PID 2301 died... 03:20:58.591192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2301): Terminated: ok {rc=0} 03:20:58.634814 --- ParallelTerminationStrategy: PID 2304 died... 03:20:58.653267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2304): Terminated: ok {rc=0} 03:20:58.696580 --- ParallelTerminationStrategy: PID 2307 died... 03:20:58.715006 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2307): Terminated: ok {rc=0} 03:20:58.800036 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 03:21:00.112501 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:21:00.120314 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 03:21:00.152034 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 03:21:00.185457 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 03:21:00.236693 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 03:21:00.267848 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 03:21:00.301899 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 03:21:00.863858 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2398 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 03:21:00.870949 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:21:00.885186 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 03:21:00.967775 tst switch_tch_pdch.py: using LAC 38192 03:21:01.095767 tst switch_tch_pdch.py: using RAC 197 03:21:01.223733 tst switch_tch_pdch.py: using CellId 38192 03:21:01.349225 tst switch_tch_pdch.py: using BVCI 38193 03:21:01.485371 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:21:01.498306 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:21:01.510915 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:21:01.523800 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:21:01.537350 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:21:01.551533 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:21:01.565021 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 03:21:01.579680 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:21:01.705209 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 03:21:01.826536 tst switch_tch_pdch.py:51: start network... 03:21:02.045327 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:02.539224 run create_hlr_db(pid=2312): Launched 03:21:02.660883 bus /gobi_6: Setting Powered False 03:21:03.724109 run create_hlr_db(pid=2312): Terminated: ok {rc=0} 03:21:04.145376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2314): Launched 03:21:04.438189 run osmo-hlr_10.42.42.2(pid=2315): Launched 03:21:04.548830 run osmo-stp_10.42.42.5: Starting osmo-stp 03:21:05.055549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2317): Launched 03:21:05.349602 run osmo-stp_10.42.42.5(pid=2318): Launched 03:21:05.462075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 03:21:05.969020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2320): Launched 03:21:06.081325 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 03:21:06.330135 run patchelf(pid=2321): Launched 03:21:06.493179 run osmo-stp_10.42.42.5(pid=2318): ERR: Terminated: ERROR {rc=1} [trial-2398↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2318)] 03:21:06.617759 run osmo-stp_10.42.42.5(pid=2318): stdout: | (launched: 2022-12-14_03:21:05.295629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:06.743989 run osmo-stp_10.42.42.5(pid=2318): stderr: | [0;m[38;5;43m20221214032105464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032105464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032105464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032105465 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032105465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032105465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032105465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:06.869968 run osmo-stp_10.42.42.5(pid=2318): stdout: | (launched: 2022-12-14_03:21:05.295629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:06.991048 run osmo-stp_10.42.42.5(pid=2318): stderr: | [0;m[38;5;43m20221214032105464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032105464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032105464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032105465 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032105465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032105465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032105465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:07.134445 run patchelf(pid=2321): Terminating (SIGINT) 03:21:07.300898 run patchelf(pid=2321): Terminated: ok {rc=0} 03:21:07.420919 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2318): Process ended prematurely: osmo-stp_10.42.42.5(pid=2318) [trial-2398↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2318)] [trial-2398↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 03:21:07.429868 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 03:21:07.456511 run osmo-hlr_10.42.42.2(pid=2315): ERR: Terminated: ERROR {rc=237} [trial-2398↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2315)] 03:21:07.503897 run osmo-hlr_10.42.42.2(pid=2315): stdout: | (launched: 2022-12-14_03:21:04.384583) 03:21:07.552649 run osmo-hlr_10.42.42.2(pid=2315): stderr: | [0;m[1;31m20221214032104560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032104560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032104560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032104560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032104560 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032104561 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032104573 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032104581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032104582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032104582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:07.601642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2314): Terminating (SIGTERM) 03:21:07.641378 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2317): Terminating (SIGTERM) 03:21:07.681024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2320): Terminating (SIGTERM) 03:21:07.720780 --- ParallelTerminationStrategy: PID 2314 died... 03:21:07.739656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2314): Terminated: ok {rc=0} 03:21:07.783057 --- ParallelTerminationStrategy: PID 2317 died... 03:21:07.801368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2317): Terminated: ok {rc=0} 03:21:07.844653 --- ParallelTerminationStrategy: PID 2320 died... 03:21:07.863033 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2320): Terminated: ok {rc=0} 03:21:07.948020 bus /gobi_0: Setting Powered False 03:21:09.047215 bus /gobi_0: Setting Powered False 03:21:10.160254 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2398 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 nitb_smpp --------------------------------------------------------------------- 03:21:11.414899 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:21:11.417858 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 03:21:11.438678 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 03:21:11.445749 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 03:21:11.481980 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 03:21:11.502908 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 03:21:11.509647 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 03:21:12.028627 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2398 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 03:21:12.034597 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 03:21:12.053707 tst esme_connect_policy_acceptall.py: using MSISDN 8473 03:21:12.186028 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:21:12.747564 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2326): Launched 03:21:13.048021 run osmo-nitb_10.42.42.2(pid=2327): Launched 03:21:13.214661 run osmo-nitb_10.42.42.2(pid=2327): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2327)] 03:21:13.349236 run osmo-nitb_10.42.42.2(pid=2327): stdout: | (launched: 2022-12-14_03:21:12.992849) 03:21:13.485769 run osmo-nitb_10.42.42.2(pid=2327): stderr: | (launched: 2022-12-14_03:21:13.037845) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:13.621989 run osmo-nitb_10.42.42.2(pid=2327): stdout: | (launched: 2022-12-14_03:21:12.992849) 03:21:13.752688 run osmo-nitb_10.42.42.2(pid=2327): stderr: | (launched: 2022-12-14_03:21:13.037845) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2327): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2327) [trial-2398↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2327)] 03:21:14.161696 tst osmo-nitb_10.42.42.2(pid=2327): stdout: | (launched: 2022-12-14_03:21:12.992849) 03:21:14.283089 tst osmo-nitb_10.42.42.2(pid=2327): stderr: | (launched: 2022-12-14_03:21:13.037845) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:14.426440 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=2327): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2327) [trial-2398↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2327)] [trial-2398↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 03:21:14.434765 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 03:21:14.441217 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2326): Terminating (SIGTERM) 03:21:14.649803 --- ParallelTerminationStrategy: PID 2326 died... 03:21:14.670660 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2326): Terminated: ok {rc=0} ---------------------------------------------- trial-2398 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 03:21:14.718906 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 03:21:14.740677 tst esme_connect_policy_closed.py: using MSISDN 8474 03:21:14.861899 tst esme_connect_policy_closed.py: using MSISDN 8475 03:21:14.972000 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:21:15.534231 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2328): Launched 03:21:15.839641 run osmo-nitb_10.42.42.2(pid=2329): Launched 03:21:16.052892 run osmo-nitb_10.42.42.2(pid=2329): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2329)] 03:21:16.191214 run osmo-nitb_10.42.42.2(pid=2329): stdout: | (launched: 2022-12-14_03:21:15.780404) 03:21:16.331552 run osmo-nitb_10.42.42.2(pid=2329): stderr: | (launched: 2022-12-14_03:21:15.825426) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:16.472425 run osmo-nitb_10.42.42.2(pid=2329): stdout: | (launched: 2022-12-14_03:21:15.780404) 03:21:16.607370 run osmo-nitb_10.42.42.2(pid=2329): stderr: | (launched: 2022-12-14_03:21:15.825426) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:16.768076 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=2329): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2329) [trial-2398↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2329)] [trial-2398↪nitb_smpp↪esme_connect_policy_closed.py:24] 03:21:16.778031 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 03:21:16.786007 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2328): Terminating (SIGTERM) 03:21:17.001015 --- ParallelTerminationStrategy: PID 2328 died... 03:21:17.022208 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2328): Terminated: ok {rc=0} ---------------------------------------------- trial-2398 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 03:21:17.079391 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 03:21:17.092179 tst nitb_smpp: Using 1 x bts (candidates: 1) 03:21:17.138531 tst esme_ms_sms_storeforward.py: using LAC 38193 03:21:17.276080 tst esme_ms_sms_storeforward.py: using RAC 198 03:21:17.404439 tst esme_ms_sms_storeforward.py: using CellId 38193 03:21:17.530546 tst esme_ms_sms_storeforward.py: using BVCI 38194 03:21:17.649625 tst nitb_smpp: Using 1 x modem (candidates: 1) 03:21:17.774664 tst esme_ms_sms_storeforward.py: using MSISDN 8476 03:21:17.884143 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 03:21:18.103904 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:21:18.767567 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2330): Launched 03:21:19.092809 run osmo-nitb_10.42.42.2(pid=2331): Launched 03:21:19.269451 run osmo-nitb_10.42.42.2(pid=2331): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2331)] 03:21:19.404113 run osmo-nitb_10.42.42.2(pid=2331): stdout: | (launched: 2022-12-14_03:21:19.034140) 03:21:19.539998 run osmo-nitb_10.42.42.2(pid=2331): stderr: | (launched: 2022-12-14_03:21:19.082707) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:19.676541 run osmo-nitb_10.42.42.2(pid=2331): stdout: | (launched: 2022-12-14_03:21:19.034140) 03:21:19.806472 run osmo-nitb_10.42.42.2(pid=2331): stderr: | (launched: 2022-12-14_03:21:19.082707) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:19.962038 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=2331): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2331) [trial-2398↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2331)] [trial-2398↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 03:21:19.970886 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 03:21:19.977877 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2330): Terminating (SIGTERM) 03:21:20.188909 --- ParallelTerminationStrategy: PID 2330 died... 03:21:20.210321 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2330): Terminated: ok {rc=0} 03:21:20.299312 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 03:21:21.387376 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 03:21:21.399025 tst nitb_smpp: Using 1 x bts (candidates: 1) 03:21:21.434229 tst esme_ms_sms_transaction.py: using LAC 38194 03:21:21.553903 tst esme_ms_sms_transaction.py: using RAC 199 03:21:21.676060 tst esme_ms_sms_transaction.py: using CellId 38194 03:21:21.796568 tst esme_ms_sms_transaction.py: using BVCI 38195 03:21:21.907791 tst nitb_smpp: Using 1 x modem (candidates: 1) 03:21:22.034624 tst esme_ms_sms_transaction.py: using MSISDN 8477 03:21:22.143937 tst esme_ms_sms_transaction.py:18: start nitb and bts... 03:21:22.346293 run osmo-nitb_10.42.42.2: Starting osmo-nitb 03:21:22.959522 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2332): Launched 03:21:23.260434 run osmo-nitb_10.42.42.2(pid=2333): Launched 03:21:23.427148 run osmo-nitb_10.42.42.2(pid=2333): ERR: Terminated: ERROR {rc=2} [trial-2398↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2333)] 03:21:23.562695 run osmo-nitb_10.42.42.2(pid=2333): stdout: | (launched: 2022-12-14_03:21:23.205702) 03:21:23.699412 run osmo-nitb_10.42.42.2(pid=2333): stderr: | (launched: 2022-12-14_03:21:23.250533) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:23.835746 run osmo-nitb_10.42.42.2(pid=2333): stdout: | (launched: 2022-12-14_03:21:23.205702) 03:21:23.966805 run osmo-nitb_10.42.42.2(pid=2333): stderr: | (launched: 2022-12-14_03:21:23.250533) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f6a18b36268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2333): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2333) [trial-2398↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2333)] 03:21:24.373612 tst osmo-nitb_10.42.42.2(pid=2333): stdout: | (launched: 2022-12-14_03:21:23.205702) 03:21:24.494969 tst osmo-nitb_10.42.42.2(pid=2333): stderr: | (launched: 2022-12-14_03:21:23.250533) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 03:21:24.638752 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=2333): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2333) [trial-2398↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2333)] [trial-2398↪nitb_smpp↪esme_ms_sms_transaction.py:21] 03:21:24.647019 tst esme_ms_sms_transaction.py:21: Test FAILED (3.3 sec) 03:21:24.653426 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2332): Terminating (SIGTERM) 03:21:24.861644 --- ParallelTerminationStrategy: PID 2332 died... 03:21:24.882503 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2332): Terminated: ok {rc=0} 03:21:24.970303 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 smpp --------------------------------------------------------------------- 03:21:26.135729 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:21:26.138909 tst smpp: Verifying 1 x bts (candidates: 11) 03:21:26.159401 tst smpp: Verifying 6 x ip_address (candidates: 9) 03:21:26.185953 tst smpp: Verifying 1 x modem (candidates: 12) 03:21:26.221772 tst smpp: Reserving 1 x bts (candidates: 11) 03:21:26.241787 tst smpp: Reserving 6 x ip_address (candidates: 9) 03:21:26.267474 tst smpp: Reserving 1 x modem (candidates: 12) 03:21:26.795596 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2398 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 03:21:26.801137 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:26.811955 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:26.822846 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:26.833628 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:26.854537 tst esme_connect_policy_acceptall.py: using MSISDN 8478 03:21:26.974355 run osmo-stp_10.42.42.4: Starting osmo-stp 03:21:27.525587 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2337): Launched 03:21:27.849793 run osmo-stp_10.42.42.4(pid=2338): Launched 03:21:27.973824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:28.480882 run create_hlr_db(pid=2339): Launched 03:21:28.606483 bus /sierra_2: Setting Powered False 03:21:29.670935 run create_hlr_db(pid=2339): Terminated: ok {rc=0} 03:21:30.105867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2341): Launched 03:21:30.409199 run osmo-hlr_10.42.42.2(pid=2342): Launched 03:21:30.525292 run osmo-msc_10.42.42.5: Starting osmo-msc 03:21:31.098606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2344): Launched 03:21:31.421354 run osmo-msc_10.42.42.5(pid=2345): Launched 03:21:31.662053 run osmo-hlr_10.42.42.2(pid=2342): ERR: Terminated: ERROR {rc=237} [trial-2398↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2342)] 03:21:31.944254 run osmo-hlr_10.42.42.2(pid=2342): stdout: | (launched: 2022-12-14_03:21:30.353621) 03:21:32.175880 run osmo-hlr_10.42.42.2(pid=2342): stderr: | [0;m[1;31m20221214032130526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032130526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032130526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032130526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032130526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032130526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032130538 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032130547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032130547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032130547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:32.382266 run osmo-hlr_10.42.42.2(pid=2342): stdout: | (launched: 2022-12-14_03:21:30.353621) 03:21:32.503639 run osmo-hlr_10.42.42.2(pid=2342): stderr: | [0;m[1;31m20221214032130526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032130526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032130526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032130526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032130526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032130526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032130538 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032130547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032130547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032130547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:32.649294 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=2342): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2342) [trial-2398↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2342)] [trial-2398↪smpp↪esme_connect_policy_acceptall.py:23] 03:21:32.657528 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.9 sec) 03:21:32.683491 run osmo-msc_10.42.42.5(pid=2345): ERR: Terminated: ERROR {rc=9} [trial-2398↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=2345)] 03:21:32.731149 run osmo-msc_10.42.42.5(pid=2345): stdout: | (launched: 2022-12-14_03:21:31.362844) 03:21:32.781200 run osmo-msc_10.42.42.5(pid=2345): stderr: | [0;m[38;5;43m20221214032131943 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221214032131943 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221214032131943 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221214032131943 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221214032131943 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221214032131943 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221214032131943 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221214032131943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214032131943 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 03:21:32.831185 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2337): Terminating (SIGTERM) 03:21:32.871025 run osmo-stp_10.42.42.4(pid=2338): Terminating (SIGTERM) 03:21:32.910796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2341): Terminating (SIGTERM) 03:21:32.952042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2344): Terminating (SIGTERM) 03:21:32.993583 --- ParallelTerminationStrategy: PID 2337 died... 03:21:33.012761 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2337): Terminated: ok {rc=0} 03:21:33.057030 --- ParallelTerminationStrategy: PID 2338 died... 03:21:33.075562 run osmo-stp_10.42.42.4(pid=2338): Terminated: ok {rc=0} 03:21:33.119519 --- ParallelTerminationStrategy: PID 2341 died... 03:21:33.138133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2341): Terminated: ok {rc=0} 03:21:33.182254 --- ParallelTerminationStrategy: PID 2344 died... 03:21:33.200871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2344): Terminated: ok {rc=0} ---------------------------------------------- trial-2398 smpp esme_connect_policy_closed.py ---------------------------------------------- 03:21:33.249523 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:33.260529 tst smpp: Using 1 x bts (candidates: 1) 03:21:33.295861 tst esme_connect_policy_closed.py: using LAC 38195 03:21:33.428931 tst esme_connect_policy_closed.py: using RAC 200 03:21:33.559102 tst esme_connect_policy_closed.py: using CellId 38195 03:21:33.688449 tst esme_connect_policy_closed.py: using BVCI 38196 03:21:33.808907 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:33.820013 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:33.831138 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:33.851374 tst esme_connect_policy_closed.py: using MSISDN 8479 03:21:33.985045 tst esme_connect_policy_closed.py: using MSISDN 8480 03:21:34.106098 run osmo-stp_10.42.42.4: Starting osmo-stp 03:21:34.665156 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2348): Launched 03:21:34.993746 run osmo-stp_10.42.42.4(pid=2349): Launched 03:21:35.119704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:35.628563 run create_hlr_db(pid=2350): Launched 03:21:36.812706 run create_hlr_db(pid=2350): Terminated: ok {rc=0} 03:21:37.158181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2352): Launched 03:21:37.486321 run osmo-hlr_10.42.42.2(pid=2353): Launched 03:21:37.605149 run osmo-msc_10.42.42.5: Starting osmo-msc 03:21:38.162086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2355): Launched 03:21:38.468625 run osmo-msc_10.42.42.5(pid=2356): Launched 03:21:38.640287 run osmo-hlr_10.42.42.2(pid=2353): ERR: Terminated: ERROR {rc=237} [trial-2398↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2353)] 03:21:38.771568 run osmo-hlr_10.42.42.2(pid=2353): stdout: | (launched: 2022-12-14_03:21:37.426507) 03:21:38.902127 run osmo-hlr_10.42.42.2(pid=2353): stderr: | [0;m[1;31m20221214032137600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032137600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032137600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032137600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032137600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032137600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032137615 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032137623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032137623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032137623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:39.029447 run osmo-hlr_10.42.42.2(pid=2353): stdout: | (launched: 2022-12-14_03:21:37.426507) 03:21:39.150802 run osmo-hlr_10.42.42.2(pid=2353): stderr: | [0;m[1;31m20221214032137600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032137600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032137600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032137600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032137600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032137600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032137615 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032137623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032137623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032137623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:39.296290 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=2353): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2353) [trial-2398↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2353)] [trial-2398↪smpp↪esme_connect_policy_closed.py:31] 03:21:39.304678 tst esme_connect_policy_closed.py:31: Test FAILED (6.0 sec) 03:21:39.330538 run osmo-msc_10.42.42.5(pid=2356): ERR: Terminated: ERROR {rc=9} [trial-2398↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=2356)] 03:21:39.378744 run osmo-msc_10.42.42.5(pid=2356): stdout: | (launched: 2022-12-14_03:21:38.412321) 03:21:39.428238 run osmo-msc_10.42.42.5(pid=2356): stderr: | [0;m[38;5;43m20221214032138728 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221214032138728 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221214032138728 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221214032138728 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221214032138728 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221214032138729 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221214032138729 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221214032138729 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214032138729 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 03:21:39.477699 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2348): Terminating (SIGTERM) 03:21:39.517481 run osmo-stp_10.42.42.4(pid=2349): Terminating (SIGTERM) 03:21:39.557320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2352): Terminating (SIGTERM) 03:21:39.598778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2355): Terminating (SIGTERM) 03:21:39.639622 --- ParallelTerminationStrategy: PID 2348 died... 03:21:39.658991 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=2348): Terminated: ok {rc=0} 03:21:39.703368 --- ParallelTerminationStrategy: PID 2349 died... 03:21:39.722038 run osmo-stp_10.42.42.4(pid=2349): Terminated: ok {rc=0} 03:21:39.765882 --- ParallelTerminationStrategy: PID 2352 died... 03:21:39.784605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2352): Terminated: ok {rc=0} 03:21:39.828502 --- ParallelTerminationStrategy: PID 2355 died... 03:21:39.847166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2355): Terminated: ok {rc=0} ---------------------------------------------- trial-2398 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 03:21:39.895886 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:39.907171 tst smpp: Using 1 x bts (candidates: 1) 03:21:39.941388 tst esme_ms_sms_storeforward.py: using LAC 38196 03:21:40.071899 tst esme_ms_sms_storeforward.py: using RAC 201 03:21:40.202806 tst esme_ms_sms_storeforward.py: using CellId 38196 03:21:40.334019 tst esme_ms_sms_storeforward.py: using BVCI 38197 03:21:40.455648 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:40.466485 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:40.477141 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:40.487850 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:40.498918 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:40.509903 tst smpp: Using 1 x modem (candidates: 1) 03:21:40.639293 tst esme_ms_sms_storeforward.py: using MSISDN 8481 03:21:40.759510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:41.270321 run create_hlr_db(pid=2359): Launched 03:21:42.454138 run create_hlr_db(pid=2359): Terminated: ok {rc=0} 03:21:42.801588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2361): Launched 03:21:43.129659 run osmo-hlr_10.42.42.2(pid=2362): Launched 03:21:43.255527 run osmo-stp_10.42.42.5: Starting osmo-stp 03:21:43.821633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2364): Launched 03:21:44.149988 run osmo-stp_10.42.42.5(pid=2365): Launched 03:21:44.276122 run osmo-msc_10.42.42.6: Starting osmo-msc 03:21:44.871548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2367): Launched 03:21:45.199480 run osmo-msc_10.42.42.6(pid=2368): Launched 03:21:45.383171 run osmo-stp_10.42.42.5(pid=2365): ERR: Terminated: ERROR {rc=1} [trial-2398↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2365)] 03:21:45.522143 run osmo-stp_10.42.42.5(pid=2365): stdout: | (launched: 2022-12-14_03:21:44.090489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:45.661489 run osmo-stp_10.42.42.5(pid=2365): stderr: | [0;m[38;5;43m20221214032144284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032144284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032144284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032144285 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032144285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032144285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032144285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:45.799595 run osmo-stp_10.42.42.5(pid=2365): stdout: | (launched: 2022-12-14_03:21:44.090489) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:45.950475 run osmo-stp_10.42.42.5(pid=2365): stderr: | [0;m[38;5;43m20221214032144284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032144284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032144284 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032144285 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032144285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032144285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032144285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:46.110141 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=2365): Process ended prematurely: osmo-stp_10.42.42.5(pid=2365) [trial-2398↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2365)] [trial-2398↪smpp↪esme_ms_sms_storeforward.py:30] 03:21:46.119755 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.2 sec) 03:21:46.147929 run osmo-hlr_10.42.42.2(pid=2362): ERR: Terminated: ERROR {rc=237} [trial-2398↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2362)] 03:21:46.202280 run osmo-hlr_10.42.42.2(pid=2362): stdout: | (launched: 2022-12-14_03:21:43.070129) 03:21:46.256043 run osmo-hlr_10.42.42.2(pid=2362): stderr: | [0;m[1;31m20221214032143267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032143267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032143267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032143267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032143267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032143267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032143294 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032143304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032143305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032143305 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:46.331020 run osmo-msc_10.42.42.6(pid=2368): ERR: Terminated: ERROR {rc=2} [trial-2398↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2368)] 03:21:46.383105 run osmo-msc_10.42.42.6(pid=2368): stdout: | (launched: 2022-12-14_03:21:45.139655) 03:21:46.437287 run osmo-msc_10.42.42.6(pid=2368): stderr: | [0;m[38;5;43m20221214032145458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032145458 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f628dbcfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032145458 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032145458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032145459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032145459 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032145461 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032145461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032145461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032145461 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:21:46.491684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2361): Terminating (SIGTERM) 03:21:46.534973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2364): Terminating (SIGTERM) 03:21:46.580429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2367): Terminating (SIGTERM) 03:21:46.624794 --- ParallelTerminationStrategy: PID 2361 died... 03:21:46.646526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2361): Terminated: ok {rc=0} 03:21:46.695077 --- ParallelTerminationStrategy: PID 2364 died... 03:21:46.715983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2364): Terminated: ok {rc=0} 03:21:46.764430 --- ParallelTerminationStrategy: PID 2367 died... 03:21:46.785556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2367): Terminated: ok {rc=0} 03:21:46.876493 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 smpp esme_ms_sms_transaction.py ---------------------------------------------- 03:21:47.964451 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:47.975654 tst smpp: Using 1 x bts (candidates: 1) 03:21:48.010689 tst esme_ms_sms_transaction.py: using LAC 38197 03:21:48.132754 tst esme_ms_sms_transaction.py: using RAC 202 03:21:48.256607 tst esme_ms_sms_transaction.py: using CellId 38197 03:21:48.382721 tst esme_ms_sms_transaction.py: using BVCI 38198 03:21:48.494876 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:48.505582 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:48.515904 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:48.526389 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:48.536735 tst smpp: Using 1 x ip_address (candidates: 6) 03:21:48.547378 tst smpp: Using 1 x modem (candidates: 1) 03:21:48.673489 tst esme_ms_sms_transaction.py: using MSISDN 8482 03:21:48.794878 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:49.302160 run create_hlr_db(pid=2370): Launched 03:21:49.426966 bus /sierra_2: Setting Powered False 03:21:50.491302 run create_hlr_db(pid=2370): Terminated: ok {rc=0} 03:21:50.948245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2372): Launched 03:21:51.276855 run osmo-hlr_10.42.42.2(pid=2373): Launched 03:21:51.402497 run osmo-stp_10.42.42.5: Starting osmo-stp 03:21:51.969054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2375): Launched 03:21:52.294728 run osmo-stp_10.42.42.5(pid=2376): Launched 03:21:52.419309 run osmo-msc_10.42.42.6: Starting osmo-msc 03:21:53.010319 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2378): Launched 03:21:53.337178 run osmo-msc_10.42.42.6(pid=2379): Launched 03:21:53.519991 run osmo-stp_10.42.42.5(pid=2376): ERR: Terminated: ERROR {rc=1} [trial-2398↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2376)] 03:21:53.657971 run osmo-stp_10.42.42.5(pid=2376): stdout: | (launched: 2022-12-14_03:21:52.235473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:53.796538 run osmo-stp_10.42.42.5(pid=2376): stderr: | [0;m[38;5;43m20221214032152428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032152428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032152428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032152429 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032152431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032152431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032152431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:53.934782 run osmo-stp_10.42.42.5(pid=2376): stdout: | (launched: 2022-12-14_03:21:52.235473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:21:54.065269 run osmo-stp_10.42.42.5(pid=2376): stderr: | [0;m[38;5;43m20221214032152428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032152428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032152428 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032152429 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032152431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032152431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032152431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:21:54.221466 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=2376): Process ended prematurely: osmo-stp_10.42.42.5(pid=2376) [trial-2398↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2376)] [trial-2398↪smpp↪esme_ms_sms_transaction.py:28] 03:21:54.230404 tst esme_ms_sms_transaction.py:28: Test FAILED (6.3 sec) 03:21:54.257595 run osmo-hlr_10.42.42.2(pid=2373): ERR: Terminated: ERROR {rc=237} [trial-2398↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2373)] 03:21:54.308052 run osmo-hlr_10.42.42.2(pid=2373): stdout: | (launched: 2022-12-14_03:21:51.217171) 03:21:54.360430 run osmo-hlr_10.42.42.2(pid=2373): stderr: | [0;m[1;31m20221214032151416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032151416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032151416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032151416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032151416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032151416 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032151427 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032151436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032151436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032151436 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:21:54.433156 run osmo-msc_10.42.42.6(pid=2379): ERR: Terminated: ERROR {rc=2} [trial-2398↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2379)] 03:21:54.482915 run osmo-msc_10.42.42.6(pid=2379): stdout: | (launched: 2022-12-14_03:21:53.277737) 03:21:54.535488 run osmo-msc_10.42.42.6(pid=2379): stderr: | [0;m[38;5;43m20221214032153602 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032153602 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f66fd70dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032153602 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032153602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032153602 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032153603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032153605 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032153605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032153605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032153605 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:21:54.587808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2372): Terminating (SIGTERM) 03:21:54.629643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2375): Terminating (SIGTERM) 03:21:54.671734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2378): Terminating (SIGTERM) 03:21:54.715052 --- ParallelTerminationStrategy: PID 2372 died... 03:21:54.735317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2372): Terminated: ok {rc=0} 03:21:54.781664 --- ParallelTerminationStrategy: PID 2375 died... 03:21:54.801398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2375): Terminated: ok {rc=0} 03:21:54.847434 --- ParallelTerminationStrategy: PID 2378 died... 03:21:54.867293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2378): Terminated: ok {rc=0} 03:21:54.955549 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 encryption --------------------------------------------------------------------- 03:21:56.154150 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:21:56.158217 tst encryption: Verifying 1 x bts (candidates: 11) 03:21:56.180410 tst encryption: Verifying 6 x ip_address (candidates: 9) 03:21:56.207752 tst encryption: Verifying 1 x modem (candidates: 12) 03:21:56.241050 tst encryption: Reserving 1 x bts (candidates: 11) 03:21:56.261886 tst encryption: Reserving 6 x ip_address (candidates: 9) 03:21:56.288064 tst encryption: Reserving 1 x modem (candidates: 12) 03:21:56.819451 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2398 encryption register_a5_0_authopt.py ---------------------------------------------- 03:21:56.871074 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:56.881666 tst encryption: Using 1 x bts (candidates: 1) 03:21:56.915257 tst register_a5_0_authopt.py: using LAC 38198 03:21:57.036212 tst register_a5_0_authopt.py: using RAC 203 03:21:57.157623 tst register_a5_0_authopt.py: using CellId 38198 03:21:57.309516 tst register_a5_0_authopt.py: using BVCI 38199 03:21:57.422547 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:57.433019 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:57.443282 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:57.453551 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:57.463917 tst encryption: Using 1 x ip_address (candidates: 6) 03:21:57.474163 tst encryption: Using 1 x modem (candidates: 1) 03:21:57.593610 tst register_a5_0_authopt.py:8: start network... 03:21:57.802329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:21:58.283387 run create_hlr_db(pid=2384): Launched 03:21:58.409918 bus /sierra_2: Setting Powered False 03:21:59.472625 run create_hlr_db(pid=2384): Terminated: ok {rc=0} 03:21:59.926110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2386): Launched 03:22:00.257703 run osmo-hlr_10.42.42.2(pid=2387): Launched 03:22:00.384610 run osmo-stp_10.42.42.5: Starting osmo-stp 03:22:00.991104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2389): Launched 03:22:01.365658 run osmo-stp_10.42.42.5(pid=2390): Launched 03:22:01.606540 run osmo-msc_10.42.42.6: Starting osmo-msc 03:22:02.336754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2392): Launched 03:22:02.647064 run osmo-msc_10.42.42.6(pid=2393): Launched 03:22:02.819439 run osmo-stp_10.42.42.5(pid=2390): ERR: Terminated: ERROR {rc=1} [trial-2398↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2390)] 03:22:02.949890 run osmo-stp_10.42.42.5(pid=2390): stdout: | (launched: 2022-12-14_03:22:01.295358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:03.079987 run osmo-stp_10.42.42.5(pid=2390): stderr: | [0;m[38;5;43m20221214032201632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032201637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032201637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032201638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032201638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032201638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032201638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:03.208815 run osmo-stp_10.42.42.5(pid=2390): stdout: | (launched: 2022-12-14_03:22:01.295358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:03.331845 run osmo-stp_10.42.42.5(pid=2390): stderr: | [0;m[38;5;43m20221214032201632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032201637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032201637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032201638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032201638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032201638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032201638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:03.479282 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2390): Process ended prematurely: osmo-stp_10.42.42.5(pid=2390) [trial-2398↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2390)] [trial-2398↪encryption↪register_a5_0_authopt.py:8] 03:22:03.488226 tst register_a5_0_authopt.py:8: Test FAILED (6.7 sec) 03:22:03.514496 run osmo-hlr_10.42.42.2(pid=2387): ERR: Terminated: ERROR {rc=237} [trial-2398↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2387)] 03:22:03.562558 run osmo-hlr_10.42.42.2(pid=2387): stdout: | (launched: 2022-12-14_03:22:00.197467) 03:22:03.611941 run osmo-hlr_10.42.42.2(pid=2387): stderr: | [0;m[1;31m20221214032200398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032200398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032200398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032200398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032200398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032200398 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032200409 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032200418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032200418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032200418 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:22:03.681170 run osmo-msc_10.42.42.6(pid=2393): ERR: Terminated: ERROR {rc=2} [trial-2398↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2393)] 03:22:03.728546 run osmo-msc_10.42.42.6(pid=2393): stdout: | (launched: 2022-12-14_03:22:02.590442) 03:22:03.777920 run osmo-msc_10.42.42.6(pid=2393): stderr: | [0;m[38;5;43m20221214032202862 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032202862 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5d783c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032202862 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032202862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032202863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032202863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032202864 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032202865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032202865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032202865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:22:03.827566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2386): Terminating (SIGTERM) 03:22:03.867816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2389): Terminating (SIGTERM) 03:22:03.908847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2392): Terminating (SIGTERM) 03:22:03.949550 --- ParallelTerminationStrategy: PID 2386 died... 03:22:03.968754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2386): Terminated: ok {rc=0} 03:22:04.013244 --- ParallelTerminationStrategy: PID 2389 died... 03:22:04.032187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2389): Terminated: ok {rc=0} 03:22:04.076209 --- ParallelTerminationStrategy: PID 2392 died... 03:22:04.095178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2392): Terminated: ok {rc=0} 03:22:04.182856 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 encryption register_a5_0_authreq.py ---------------------------------------------- 03:22:05.331803 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:05.343115 tst encryption: Using 1 x bts (candidates: 1) 03:22:05.378731 tst register_a5_0_authreq.py: using LAC 38199 03:22:05.509712 tst register_a5_0_authreq.py: using RAC 204 03:22:05.639774 tst register_a5_0_authreq.py: using CellId 38199 03:22:05.770238 tst register_a5_0_authreq.py: using BVCI 38200 03:22:05.892189 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:05.903309 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:05.914408 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:05.925196 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:05.936333 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:05.947442 tst encryption: Using 1 x modem (candidates: 1) 03:22:06.067617 tst register_a5_0_authreq.py:8: start network... 03:22:06.275569 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:22:06.751993 run create_hlr_db(pid=2395): Launched 03:22:06.878833 bus /sierra_2: Setting Powered False 03:22:07.940629 run create_hlr_db(pid=2395): Terminated: ok {rc=0} 03:22:08.370979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2397): Launched 03:22:08.679863 run osmo-hlr_10.42.42.2(pid=2398): Launched 03:22:08.797801 run osmo-stp_10.42.42.5: Starting osmo-stp 03:22:09.351113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2400): Launched 03:22:09.658182 run osmo-stp_10.42.42.5(pid=2401): Launched 03:22:09.775650 run osmo-msc_10.42.42.6: Starting osmo-msc 03:22:10.332530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2403): Launched 03:22:10.642295 run osmo-msc_10.42.42.6(pid=2404): Launched 03:22:10.814576 run osmo-stp_10.42.42.5(pid=2401): ERR: Terminated: ERROR {rc=1} [trial-2398↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2401)] 03:22:10.944732 run osmo-stp_10.42.42.5(pid=2401): stdout: | (launched: 2022-12-14_03:22:09.601913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:11.075547 run osmo-stp_10.42.42.5(pid=2401): stderr: | [0;m[38;5;43m20221214032209772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032209772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032209773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032209773 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032209775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032209775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032209776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:11.204411 run osmo-stp_10.42.42.5(pid=2401): stdout: | (launched: 2022-12-14_03:22:09.601913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:11.326941 run osmo-stp_10.42.42.5(pid=2401): stderr: | [0;m[38;5;43m20221214032209772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032209772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032209773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032209773 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032209775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032209775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032209776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:11.473864 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2401): Process ended prematurely: osmo-stp_10.42.42.5(pid=2401) [trial-2398↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2401)] [trial-2398↪encryption↪register_a5_0_authreq.py:8] 03:22:11.482712 tst register_a5_0_authreq.py:8: Test FAILED (6.2 sec) 03:22:11.508680 run osmo-hlr_10.42.42.2(pid=2398): ERR: Terminated: ERROR {rc=237} [trial-2398↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2398)] 03:22:11.556311 run osmo-hlr_10.42.42.2(pid=2398): stdout: | (launched: 2022-12-14_03:22:08.623108) 03:22:11.605243 run osmo-hlr_10.42.42.2(pid=2398): stderr: | [0;m[1;31m20221214032208800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032208800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032208800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032208800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032208800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032208800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032208812 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032208820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032208820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032208820 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:22:11.674277 run osmo-msc_10.42.42.6(pid=2404): ERR: Terminated: ERROR {rc=2} [trial-2398↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2404)] 03:22:11.721633 run osmo-msc_10.42.42.6(pid=2404): stdout: | (launched: 2022-12-14_03:22:10.585198) 03:22:11.770299 run osmo-msc_10.42.42.6(pid=2404): stderr: | [0;m[38;5;43m20221214032210858 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032210859 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5648740c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032210859 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032210859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032210859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032210859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032210861 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032210861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032210862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032210862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:22:11.819314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2397): Terminating (SIGTERM) 03:22:11.858985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2400): Terminating (SIGTERM) 03:22:11.898789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2403): Terminating (SIGTERM) 03:22:11.938761 --- ParallelTerminationStrategy: PID 2397 died... 03:22:11.958378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2397): Terminated: ok {rc=0} 03:22:12.002836 --- ParallelTerminationStrategy: PID 2400 died... 03:22:12.021648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2400): Terminated: ok {rc=0} 03:22:12.065749 --- ParallelTerminationStrategy: PID 2403 died... 03:22:12.084414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2403): Terminated: ok {rc=0} 03:22:12.169977 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 encryption register_a5_1_authreq.py ---------------------------------------------- 03:22:13.322611 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:13.334566 tst encryption: Using 1 x bts (candidates: 1) 03:22:13.374790 tst register_a5_1_authreq.py: using LAC 38200 03:22:13.505593 tst register_a5_1_authreq.py: using RAC 205 03:22:13.636613 tst register_a5_1_authreq.py: using CellId 38200 03:22:13.766002 tst register_a5_1_authreq.py: using BVCI 38201 03:22:13.888843 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:13.899876 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:13.910708 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:13.921537 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:13.932846 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:13.944214 tst encryption: Using 1 x modem (candidates: 1) 03:22:14.065174 tst register_a5_1_authreq.py:8: start network... 03:22:14.290676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:22:14.805740 run create_hlr_db(pid=2406): Launched 03:22:14.932442 bus /sierra_2: Setting Powered False 03:22:16.010818 run create_hlr_db(pid=2406): Terminated: ok {rc=0} 03:22:16.482676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2408): Launched 03:22:16.828326 run osmo-hlr_10.42.42.2(pid=2409): Launched 03:22:17.079186 run osmo-stp_10.42.42.5: Starting osmo-stp 03:22:17.652084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2411): Launched 03:22:17.984102 run osmo-stp_10.42.42.5(pid=2412): Launched 03:22:18.111529 run osmo-msc_10.42.42.6: Starting osmo-msc 03:22:18.709684 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2414): Launched 03:22:19.041099 run osmo-msc_10.42.42.6(pid=2415): Launched 03:22:19.226999 run osmo-stp_10.42.42.5(pid=2412): ERR: Terminated: ERROR {rc=1} [trial-2398↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2412)] 03:22:19.367521 run osmo-stp_10.42.42.5(pid=2412): stdout: | (launched: 2022-12-14_03:22:17.923662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:19.508332 run osmo-stp_10.42.42.5(pid=2412): stderr: | [0;m[38;5;43m20221214032218117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032218117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032218118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032218118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032218120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032218120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032218120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:19.647328 run osmo-stp_10.42.42.5(pid=2412): stdout: | (launched: 2022-12-14_03:22:17.923662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:19.780278 run osmo-stp_10.42.42.5(pid=2412): stderr: | [0;m[38;5;43m20221214032218117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032218117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032218118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032218118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032218120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032218120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032218120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:19.938911 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2412): Process ended prematurely: osmo-stp_10.42.42.5(pid=2412) [trial-2398↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2412)] [trial-2398↪encryption↪register_a5_1_authreq.py:8] 03:22:19.948544 tst register_a5_1_authreq.py:8: Test FAILED (6.7 sec) 03:22:19.976379 run osmo-hlr_10.42.42.2(pid=2409): ERR: Terminated: ERROR {rc=237} [trial-2398↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2409)] 03:22:20.028034 run osmo-hlr_10.42.42.2(pid=2409): stdout: | (launched: 2022-12-14_03:22:16.766131) 03:22:20.080650 run osmo-hlr_10.42.42.2(pid=2409): stderr: | [0;m[1;31m20221214032217018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032217018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032217018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032217018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032217018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032217018 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032217042 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032217050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032217050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032217050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:22:20.153239 run osmo-msc_10.42.42.6(pid=2415): ERR: Terminated: ERROR {rc=2} [trial-2398↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2415)] 03:22:20.203238 run osmo-msc_10.42.42.6(pid=2415): stdout: | (launched: 2022-12-14_03:22:18.980573) 03:22:20.255776 run osmo-msc_10.42.42.6(pid=2415): stderr: | [0;m[38;5;43m20221214032219301 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032219301 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f442be1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032219301 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032219301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032219301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032219301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032219303 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032219303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032219304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032219304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:22:20.308214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2408): Terminating (SIGTERM) 03:22:20.350396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2411): Terminating (SIGTERM) 03:22:20.392854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2414): Terminating (SIGTERM) 03:22:20.435241 --- ParallelTerminationStrategy: PID 2408 died... 03:22:20.455709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2408): Terminated: ok {rc=0} 03:22:20.502270 --- ParallelTerminationStrategy: PID 2411 died... 03:22:20.522347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2411): Terminated: ok {rc=0} 03:22:20.568820 --- ParallelTerminationStrategy: PID 2414 died... 03:22:20.589198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2414): Terminated: ok {rc=0} 03:22:20.677018 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2398 encryption register_a5_3_authreq.py ---------------------------------------------- 03:22:21.829516 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:21.841316 tst encryption: Using 1 x bts (candidates: 1) 03:22:21.878533 tst register_a5_3_authreq.py: using LAC 38201 03:22:22.009464 tst register_a5_3_authreq.py: using RAC 206 03:22:22.141580 tst register_a5_3_authreq.py: using CellId 38201 03:22:22.264419 tst register_a5_3_authreq.py: using BVCI 38202 03:22:22.378734 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:22.389244 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:22.399447 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:22.409863 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:22.420632 tst encryption: Using 1 x ip_address (candidates: 6) 03:22:22.432333 tst encryption: Using 1 x modem (candidates: 1) 03:22:22.564051 tst register_a5_3_authreq.py:8: start network... 03:22:22.789903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:22:23.302940 run create_hlr_db(pid=2417): Launched 03:22:23.430976 bus /sierra_2: Setting Powered False 03:22:24.496882 run create_hlr_db(pid=2417): Terminated: ok {rc=0} 03:22:24.937789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2419): Launched 03:22:25.246511 run osmo-hlr_10.42.42.2(pid=2420): Launched 03:22:25.364629 run osmo-stp_10.42.42.5: Starting osmo-stp 03:22:25.912453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2422): Launched 03:22:26.222665 run osmo-stp_10.42.42.5(pid=2423): Launched 03:22:26.340688 run osmo-msc_10.42.42.6: Starting osmo-msc 03:22:26.897156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2425): Launched 03:22:27.209816 run osmo-msc_10.42.42.6(pid=2426): Launched 03:22:27.382585 run osmo-stp_10.42.42.5(pid=2423): ERR: Terminated: ERROR {rc=1} [trial-2398↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2423)] 03:22:27.514227 run osmo-stp_10.42.42.5(pid=2423): stdout: | (launched: 2022-12-14_03:22:26.166030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:27.643927 run osmo-stp_10.42.42.5(pid=2423): stderr: | [0;m[38;5;43m20221214032226336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032226337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032226337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032226337 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032226338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032226338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032226338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:27.771994 run osmo-stp_10.42.42.5(pid=2423): stdout: | (launched: 2022-12-14_03:22:26.166030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:22:27.894552 run osmo-stp_10.42.42.5(pid=2423): stderr: | [0;m[38;5;43m20221214032226336 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032226337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032226337 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032226337 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032226338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032226338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032226338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:22:28.041472 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2423): Process ended prematurely: osmo-stp_10.42.42.5(pid=2423) [trial-2398↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2423)] [trial-2398↪encryption↪register_a5_3_authreq.py:8] 03:22:28.050285 tst register_a5_3_authreq.py:8: Test FAILED (6.3 sec) 03:22:28.076546 run osmo-hlr_10.42.42.2(pid=2420): ERR: Terminated: ERROR {rc=237} [trial-2398↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2420)] 03:22:28.124210 run osmo-hlr_10.42.42.2(pid=2420): stdout: | (launched: 2022-12-14_03:22:25.189801) 03:22:28.173490 run osmo-hlr_10.42.42.2(pid=2420): stderr: | [0;m[1;31m20221214032225365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032225365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032225365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032225365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032225365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032225365 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032225377 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032225385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032225385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032225385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:22:28.241964 run osmo-msc_10.42.42.6(pid=2426): ERR: Terminated: ERROR {rc=2} [trial-2398↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2426)] 03:22:28.289189 run osmo-msc_10.42.42.6(pid=2426): stdout: | (launched: 2022-12-14_03:22:27.149305) 03:22:28.338274 run osmo-msc_10.42.42.6(pid=2426): stderr: | [0;m[38;5;43m20221214032227420 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032227420 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f083f6e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032227420 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032227420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032227421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032227421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032227422 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032227423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032227423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032227423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:22:28.387669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2419): Terminating (SIGTERM) 03:22:28.427018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2422): Terminating (SIGTERM) 03:22:28.466510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2425): Terminating (SIGTERM) 03:22:28.506088 --- ParallelTerminationStrategy: PID 2419 died... 03:22:28.525074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2419): Terminated: ok {rc=0} 03:22:28.568861 --- ParallelTerminationStrategy: PID 2422 died... 03:22:28.587412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2422): Terminated: ok {rc=0} 03:22:28.630932 --- ParallelTerminationStrategy: PID 2425 died... 03:22:28.649385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2425): Terminated: ok {rc=0} 03:22:28.732396 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 03:22:29.935239 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:22:29.940123 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 03:22:29.958134 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 03:22:29.984878 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 03:22:30.016862 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 03:22:30.036457 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 03:22:30.063449 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 03:22:30.575000 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2398 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 03:22:30.581530 tst handover.py:11: TEST_CONFIG: {} 03:22:30.787561 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:22:30.803469 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:22:30.826289 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:22:30.895249 tst handover.py: using MSISDN 8483 03:22:31.025135 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8483', subscriber_id=0} 03:22:31.146410 run srsepc_10.42.42.118: Starting srsepc 03:22:33.086586 run rm-remote-dir(pid=2431): Launched 03:22:33.218892 bus /sierra_2: Setting Powered False 03:22:34.288863 run rm-remote-dir(pid=2431): Terminated: ok {rc=0} 03:22:34.747498 run mk-remote-dir(pid=2432): Launched 03:22:35.928902 run mk-remote-dir(pid=2432): Terminated: ok {rc=0} 03:22:36.219778 run scp-inst-to-remote(pid=2433): Launched 03:22:38.400438 run scp-inst-to-remote(pid=2433): Terminated: ok {rc=0} 03:22:38.754090 run rm-remote-dir(pid=2435): Launched 03:22:39.946558 run rm-remote-dir(pid=2435): Terminated: ok {rc=0} 03:22:40.309686 run mk-remote-dir(pid=2436): Launched 03:22:41.502934 run mk-remote-dir(pid=2436): Terminated: ok {rc=0} 03:22:41.812561 run scp-cfg-to-remote(pid=2437): Launched 03:22:43.002197 run scp-cfg-to-remote(pid=2437): Terminated: ok {rc=0} 03:22:43.309217 run scp-db-to-remote(pid=2439): Launched 03:22:44.500135 run scp-db-to-remote(pid=2439): Terminated: ok {rc=0} 03:22:44.642532 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:22:44.976534 run patchelf(pid=2441): Launched 03:22:46.170717 run patchelf(pid=2441): Terminated: ok {rc=0} 03:22:46.316795 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:22:46.688889 run setcap-netadm(pid=2442): Launched 03:22:47.912865 run setcap-netadm(pid=2442): Terminated: ok {rc=0} 03:22:48.262808 run srsepc(pid=2443): Launched 03:22:48.386939 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:22:49.586148 run rm-remote-dir(pid=2444): Launched 03:22:49.775808 run srsepc(pid=2443): ERR: Terminated: ERROR {rc=127} [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2443)] 03:22:49.921272 run srsepc(pid=2443): stdout: | (launched: 2022-12-14_03:22:48.202077) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:22:50.066929 run srsepc(pid=2443): stderr: | (launched: 2022-12-14_03:22:48.251829) | Connection to 10.42.42.116 closed. 03:22:50.212919 run srsepc(pid=2443): stdout: | (launched: 2022-12-14_03:22:48.202077) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:22:50.353596 run srsepc(pid=2443): stderr: | (launched: 2022-12-14_03:22:48.251829) | Connection to 10.42.42.116 closed. 03:22:50.519290 run rm-remote-dir(pid=2444): Terminating (SIGINT) 03:22:50.712257 run rm-remote-dir(pid=2444): Terminated: ok {rc=0} 03:22:50.852002 tst handover.py:37: ERR: Error: srsepc(pid=2443): Process ended prematurely: srsepc(pid=2443) [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2443)] [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 03:22:50.862879 tst handover.py:37: Test FAILED (20.3 sec) 03:22:50.944540 run scp-back-log(pid=2445): Launched 03:22:52.023673 run scp-back-log(pid=2445): ERR: Terminated: ERROR {rc=1} [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2445)] 03:22:52.088170 run scp-back-log(pid=2445): stdout: | (launched: 2022-12-14_03:22:50.912734) 03:22:52.155017 run scp-back-log(pid=2445): stderr: | (launched: 2022-12-14_03:22:50.933711) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:22:52.229375 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2445): launch_sync(): local process exited with status 1 [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2445)]') ---------------------------------------------- trial-2398 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 03:22:52.277499 tst iperf3_bidir.py:13: Number of physical ue: 1 03:22:52.501895 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:22:52.545476 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 03:22:52.768542 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:22:52.785266 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:22:52.818155 tst iperf3_bidir.py: using MSISDN 8484 03:22:52.932842 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8484', subscriber_id=0} 03:22:53.040513 run srsepc_10.42.42.118: Starting srsepc 03:22:53.672854 run rm-remote-dir(pid=2447): Launched 03:22:54.854774 run rm-remote-dir(pid=2447): Terminated: ok {rc=0} 03:22:55.192309 run mk-remote-dir(pid=2448): Launched 03:22:56.373360 run mk-remote-dir(pid=2448): Terminated: ok {rc=0} 03:22:56.661483 run scp-inst-to-remote(pid=2449): Launched 03:22:58.842811 run scp-inst-to-remote(pid=2449): Terminated: ok {rc=0} 03:22:59.177787 run rm-remote-dir(pid=2451): Launched 03:23:00.359136 run rm-remote-dir(pid=2451): Terminated: ok {rc=0} 03:23:00.697168 run mk-remote-dir(pid=2452): Launched 03:23:01.896754 run mk-remote-dir(pid=2452): Terminated: ok {rc=0} 03:23:02.238673 run scp-cfg-to-remote(pid=2453): Launched 03:23:03.447311 run scp-cfg-to-remote(pid=2453): Terminated: ok {rc=0} 03:23:03.753398 run scp-db-to-remote(pid=2455): Launched 03:23:04.943136 run scp-db-to-remote(pid=2455): Terminated: ok {rc=0} 03:23:05.084568 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:23:05.416872 run patchelf(pid=2457): Launched 03:23:06.606665 run patchelf(pid=2457): Terminated: ok {rc=0} 03:23:06.748734 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:23:07.090675 run setcap-netadm(pid=2458): Launched 03:23:08.279569 run setcap-netadm(pid=2458): Terminated: ok {rc=0} 03:23:08.627637 run srsepc(pid=2459): Launched 03:23:08.750951 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:23:09.950601 run rm-remote-dir(pid=2460): Launched 03:23:10.140207 run srsepc(pid=2459): ERR: Terminated: ERROR {rc=127} [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2459)] 03:23:10.285039 run srsepc(pid=2459): stdout: | (launched: 2022-12-14_03:23:08.567515) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:10.431162 run srsepc(pid=2459): stderr: | (launched: 2022-12-14_03:23:08.616802) | Connection to 10.42.42.116 closed. 03:23:10.576541 run srsepc(pid=2459): stdout: | (launched: 2022-12-14_03:23:08.567515) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:10.716095 run srsepc(pid=2459): stderr: | (launched: 2022-12-14_03:23:08.616802) | Connection to 10.42.42.116 closed. 03:23:10.882144 run rm-remote-dir(pid=2460): Terminating (SIGINT) 03:23:11.074544 run rm-remote-dir(pid=2460): Terminated: ok {rc=0} 03:23:11.213673 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=2459): Process ended prematurely: srsepc(pid=2459) [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2459)] [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 03:23:11.224344 tst iperf3_bidir.py:42: Test FAILED (18.9 sec) 03:23:11.306303 run scp-back-log(pid=2461): Launched 03:23:12.386892 run scp-back-log(pid=2461): ERR: Terminated: ERROR {rc=1} [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2461)] 03:23:12.452094 run scp-back-log(pid=2461): stdout: | (launched: 2022-12-14_03:23:11.274352) 03:23:12.518011 run scp-back-log(pid=2461): stderr: | (launched: 2022-12-14_03:23:11.295217) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:23:12.592150 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2461): launch_sync(): local process exited with status 1 [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2461)]') ---------------------------------------------- trial-2398 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 03:23:12.640328 tst iperf3_dl.py:13: Number of physical ue: 1 03:23:12.865441 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:23:12.909191 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 03:23:13.130885 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:23:13.147156 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:23:13.178856 tst iperf3_dl.py: using MSISDN 8485 03:23:13.300180 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8485', subscriber_id=0} 03:23:13.417106 run srsepc_10.42.42.118: Starting srsepc 03:23:14.094185 run rm-remote-dir(pid=2463): Launched 03:23:15.286783 run rm-remote-dir(pid=2463): Terminated: ok {rc=0} 03:23:15.647796 run mk-remote-dir(pid=2464): Launched 03:23:16.839630 run mk-remote-dir(pid=2464): Terminated: ok {rc=0} 03:23:17.156435 run scp-inst-to-remote(pid=2465): Launched 03:23:19.352140 run scp-inst-to-remote(pid=2465): Terminated: ok {rc=0} 03:23:19.710954 run rm-remote-dir(pid=2467): Launched 03:23:20.902939 run rm-remote-dir(pid=2467): Terminated: ok {rc=0} 03:23:21.264266 run mk-remote-dir(pid=2468): Launched 03:23:22.457400 run mk-remote-dir(pid=2468): Terminated: ok {rc=0} 03:23:22.766579 run scp-cfg-to-remote(pid=2469): Launched 03:23:23.956016 run scp-cfg-to-remote(pid=2469): Terminated: ok {rc=0} 03:23:24.261622 run scp-db-to-remote(pid=2471): Launched 03:23:25.452575 run scp-db-to-remote(pid=2471): Terminated: ok {rc=0} 03:23:25.594068 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:23:25.927395 run patchelf(pid=2473): Launched 03:23:27.116811 run patchelf(pid=2473): Terminated: ok {rc=0} 03:23:27.258870 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:23:27.592668 run setcap-netadm(pid=2474): Launched 03:23:28.782110 run setcap-netadm(pid=2474): Terminated: ok {rc=0} 03:23:29.130685 run srsepc(pid=2475): Launched 03:23:29.253604 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:23:30.444583 run rm-remote-dir(pid=2476): Launched 03:23:30.633594 run srsepc(pid=2475): ERR: Terminated: ERROR {rc=127} [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2475)] 03:23:30.778449 run srsepc(pid=2475): stdout: | (launched: 2022-12-14_03:23:29.070673) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:30.956849 run srsepc(pid=2475): stderr: | (launched: 2022-12-14_03:23:29.119772) | Connection to 10.42.42.116 closed. 03:23:31.104707 run srsepc(pid=2475): stdout: | (launched: 2022-12-14_03:23:29.070673) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:31.247032 run srsepc(pid=2475): stderr: | (launched: 2022-12-14_03:23:29.119772) | Connection to 10.42.42.116 closed. 03:23:31.415754 run rm-remote-dir(pid=2476): Terminating (SIGINT) 03:23:31.610764 run rm-remote-dir(pid=2476): Terminated: ok {rc=0} 03:23:31.752919 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=2475): Process ended prematurely: srsepc(pid=2475) [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2475)] [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 03:23:31.764371 tst iperf3_dl.py:42: Test FAILED (19.1 sec) 03:23:31.852576 run scp-back-log(pid=2477): Launched 03:23:32.972087 run scp-back-log(pid=2477): ERR: Terminated: ERROR {rc=1} [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2477)] 03:23:33.036112 run scp-back-log(pid=2477): stdout: | (launched: 2022-12-14_03:23:31.815637) 03:23:33.101585 run scp-back-log(pid=2477): stderr: | (launched: 2022-12-14_03:23:31.836742) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:23:33.175244 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2477): launch_sync(): local process exited with status 1 [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2477)]') ---------------------------------------------- trial-2398 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 03:23:33.222862 tst iperf3_ul.py:13: Number of physical ue: 1 03:23:33.445824 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:23:33.492501 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 03:23:33.699035 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:23:33.714756 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:23:33.745822 tst iperf3_ul.py: using MSISDN 8486 03:23:33.857984 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8486', subscriber_id=0} 03:23:33.966489 run srsepc_10.42.42.118: Starting srsepc 03:23:34.598729 run rm-remote-dir(pid=2479): Launched 03:23:35.779802 run rm-remote-dir(pid=2479): Terminated: ok {rc=0} 03:23:36.117288 run mk-remote-dir(pid=2480): Launched 03:23:37.297862 run mk-remote-dir(pid=2480): Terminated: ok {rc=0} 03:23:37.585649 run scp-inst-to-remote(pid=2481): Launched 03:23:39.770296 run scp-inst-to-remote(pid=2481): Terminated: ok {rc=0} 03:23:40.129646 run rm-remote-dir(pid=2483): Launched 03:23:41.322015 run rm-remote-dir(pid=2483): Terminated: ok {rc=0} 03:23:41.683468 run mk-remote-dir(pid=2484): Launched 03:23:42.875703 run mk-remote-dir(pid=2484): Terminated: ok {rc=0} 03:23:43.183791 run scp-cfg-to-remote(pid=2485): Launched 03:23:44.373476 run scp-cfg-to-remote(pid=2485): Terminated: ok {rc=0} 03:23:44.678997 run scp-db-to-remote(pid=2487): Launched 03:23:45.884571 run scp-db-to-remote(pid=2487): Terminated: ok {rc=0} 03:23:46.029312 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:23:46.371975 run patchelf(pid=2489): Launched 03:23:47.614872 run patchelf(pid=2489): Terminated: ok {rc=0} 03:23:47.757162 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:23:48.090253 run setcap-netadm(pid=2490): Launched 03:23:49.279301 run setcap-netadm(pid=2490): Terminated: ok {rc=0} 03:23:49.628364 run srsepc(pid=2491): Launched 03:23:49.751868 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:23:50.882520 run rm-remote-dir(pid=2492): Launched 03:23:51.062406 run srsepc(pid=2491): ERR: Terminated: ERROR {rc=127} [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2491)] 03:23:51.199379 run srsepc(pid=2491): stdout: | (launched: 2022-12-14_03:23:49.567799) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:51.335456 run srsepc(pid=2491): stderr: | (launched: 2022-12-14_03:23:49.617388) | Connection to 10.42.42.116 closed. 03:23:51.471512 run srsepc(pid=2491): stdout: | (launched: 2022-12-14_03:23:49.567799) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:23:51.601866 run srsepc(pid=2491): stderr: | (launched: 2022-12-14_03:23:49.617388) | Connection to 10.42.42.116 closed. 03:23:51.756793 run rm-remote-dir(pid=2492): Terminating (SIGINT) 03:23:51.937190 run rm-remote-dir(pid=2492): Terminated: ok {rc=0} 03:23:52.067800 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=2491): Process ended prematurely: srsepc(pid=2491) [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2491)] [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 03:23:52.077799 tst iperf3_ul.py:42: Test FAILED (18.8 sec) 03:23:52.154480 run scp-back-log(pid=2493): Launched 03:23:53.232887 run scp-back-log(pid=2493): ERR: Terminated: ERROR {rc=1} [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2493)] 03:23:53.293900 run scp-back-log(pid=2493): stdout: | (launched: 2022-12-14_03:23:52.124254) 03:23:53.356316 run scp-back-log(pid=2493): stderr: | (launched: 2022-12-14_03:23:52.144035) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:23:53.426594 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2493): launch_sync(): local process exited with status 1 [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2493)]') ---------------------------------------------- trial-2398 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 03:23:53.472515 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:23:53.489061 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:23:53.511458 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:23:53.560931 tst ping.py: using MSISDN 8487 03:23:53.677117 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8487', subscriber_id=0} 03:23:53.785870 run srsepc_10.42.42.118: Starting srsepc 03:23:54.421994 run rm-remote-dir(pid=2495): Launched 03:23:55.603658 run rm-remote-dir(pid=2495): Terminated: ok {rc=0} 03:23:55.941415 run mk-remote-dir(pid=2496): Launched 03:23:57.122620 run mk-remote-dir(pid=2496): Terminated: ok {rc=0} 03:23:57.409885 run scp-inst-to-remote(pid=2497): Launched 03:23:59.594073 run scp-inst-to-remote(pid=2497): Terminated: ok {rc=0} 03:23:59.953528 run rm-remote-dir(pid=2499): Launched 03:24:01.155106 run rm-remote-dir(pid=2499): Terminated: ok {rc=0} 03:24:01.627057 run mk-remote-dir(pid=2531): Launched 03:24:02.934368 run mk-remote-dir(pid=2531): Terminated: ok {rc=0} 03:24:03.306414 run scp-cfg-to-remote(pid=2667): Launched 03:24:04.622368 run scp-cfg-to-remote(pid=2667): Terminated: ok {rc=0} 03:24:04.922321 run scp-db-to-remote(pid=2776): Launched 03:24:06.165456 run scp-db-to-remote(pid=2776): Terminated: ok {rc=0} 03:24:06.299200 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:24:06.625172 run patchelf(pid=2780): Launched 03:24:07.862320 run patchelf(pid=2780): Terminated: ok {rc=0} 03:24:07.998154 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:24:08.317427 run setcap-netadm(pid=2781): Launched 03:24:09.555604 run setcap-netadm(pid=2781): Terminated: ok {rc=0} 03:24:09.895138 run srsepc(pid=2782): Launched 03:24:10.069656 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:24:11.293041 run rm-remote-dir(pid=2783): Launched 03:24:11.590201 run srsepc(pid=2782): ERR: Terminated: ERROR {rc=127} [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2782)] 03:24:11.745585 run srsepc(pid=2782): stdout: | (launched: 2022-12-14_03:24:09.836750) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:11.884939 run srsepc(pid=2782): stderr: | (launched: 2022-12-14_03:24:09.883829) | Connection to 10.42.42.116 closed. 03:24:12.026644 run srsepc(pid=2782): stdout: | (launched: 2022-12-14_03:24:09.836750) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:12.161916 run srsepc(pid=2782): stderr: | (launched: 2022-12-14_03:24:09.883829) | Connection to 10.42.42.116 closed. 03:24:12.320399 run rm-remote-dir(pid=2783): Terminating (SIGINT) 03:24:12.508281 run rm-remote-dir(pid=2783): Terminated: ok {rc=0} 03:24:12.645516 tst ping.py:16: ERR: Error: srsepc(pid=2782): Process ended prematurely: srsepc(pid=2782) [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2782)] [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 03:24:12.656748 tst ping.py:16: Test FAILED (19.2 sec) 03:24:12.745159 run scp-back-log(pid=2784): Launched 03:24:13.826426 run scp-back-log(pid=2784): ERR: Terminated: ERROR {rc=1} [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2784)] 03:24:13.889592 run scp-back-log(pid=2784): stdout: | (launched: 2022-12-14_03:24:12.706099) 03:24:13.956323 run scp-back-log(pid=2784): stderr: | (launched: 2022-12-14_03:24:12.726581) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:24:14.028550 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2784): launch_sync(): local process exited with status 1 [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2784)]') ---------------------------------------------- trial-2398 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 03:24:14.076858 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:24:14.094760 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:24:14.119218 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:24:14.171499 tst rrc_idle_mo_ping.py: using MSISDN 8488 03:24:14.289751 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8488', subscriber_id=0} 03:24:14.402368 run srsepc_10.42.42.118: Starting srsepc 03:24:15.058182 run rm-remote-dir(pid=2786): Launched 03:24:16.336063 run rm-remote-dir(pid=2786): Terminated: ok {rc=0} 03:24:16.814466 run mk-remote-dir(pid=2787): Launched 03:24:18.149235 run mk-remote-dir(pid=2787): Terminated: ok {rc=0} 03:24:18.448765 run scp-inst-to-remote(pid=2788): Launched 03:24:20.695458 run scp-inst-to-remote(pid=2788): Terminated: ok {rc=0} 03:24:21.045354 run rm-remote-dir(pid=2790): Launched 03:24:22.288271 run rm-remote-dir(pid=2790): Terminated: ok {rc=0} 03:24:22.644546 run mk-remote-dir(pid=2791): Launched 03:24:23.887274 run mk-remote-dir(pid=2791): Terminated: ok {rc=0} 03:24:24.175406 run scp-cfg-to-remote(pid=2792): Launched 03:24:25.354193 run scp-cfg-to-remote(pid=2792): Terminated: ok {rc=0} 03:24:25.640216 run scp-db-to-remote(pid=2794): Launched 03:24:26.819766 run scp-db-to-remote(pid=2794): Terminated: ok {rc=0} 03:24:26.951863 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:24:27.263467 run patchelf(pid=2796): Launched 03:24:28.442699 run patchelf(pid=2796): Terminated: ok {rc=0} 03:24:28.574925 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:24:28.885421 run setcap-netadm(pid=2797): Launched 03:24:30.063550 run setcap-netadm(pid=2797): Terminated: ok {rc=0} 03:24:30.388367 run srsepc(pid=2798): Launched 03:24:30.507068 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:24:31.664704 run rm-remote-dir(pid=2799): Launched 03:24:31.946317 run srsepc(pid=2798): ERR: Terminated: ERROR {rc=127} [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2798)] 03:24:32.104759 run srsepc(pid=2798): stdout: | (launched: 2022-12-14_03:24:30.332034) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:32.244292 run srsepc(pid=2798): stderr: | (launched: 2022-12-14_03:24:30.377857) | Connection to 10.42.42.116 closed. 03:24:32.381853 run srsepc(pid=2798): stdout: | (launched: 2022-12-14_03:24:30.332034) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:32.513320 run srsepc(pid=2798): stderr: | (launched: 2022-12-14_03:24:30.377857) | Connection to 10.42.42.116 closed. 03:24:32.668682 run rm-remote-dir(pid=2799): Terminating (SIGINT) 03:24:32.850387 run rm-remote-dir(pid=2799): Terminated: ok {rc=0} 03:24:32.981684 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=2798): Process ended prematurely: srsepc(pid=2798) [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2798)] [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 03:24:32.991828 tst rrc_idle_mo_ping.py:16: Test FAILED (18.9 sec) 03:24:33.070084 run scp-back-log(pid=2800): Launched 03:24:34.147427 run scp-back-log(pid=2800): ERR: Terminated: ERROR {rc=1} [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2800)] 03:24:34.209090 run scp-back-log(pid=2800): stdout: | (launched: 2022-12-14_03:24:33.038872) 03:24:34.271720 run scp-back-log(pid=2800): stderr: | (launched: 2022-12-14_03:24:33.058870) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:24:34.342185 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2800): launch_sync(): local process exited with status 1 [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2800)]') ---------------------------------------------- trial-2398 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 03:24:34.388448 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 03:24:34.405234 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 03:24:34.427862 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 03:24:34.478650 tst rrc_idle_mt_ping.py: using MSISDN 8489 03:24:34.593898 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8489', subscriber_id=0} 03:24:34.702378 run srsepc_10.42.42.118: Starting srsepc 03:24:35.338470 run rm-remote-dir(pid=2802): Launched 03:24:36.521199 run rm-remote-dir(pid=2802): Terminated: ok {rc=0} 03:24:36.860274 run mk-remote-dir(pid=2803): Launched 03:24:38.042496 run mk-remote-dir(pid=2803): Terminated: ok {rc=0} 03:24:38.331343 run scp-inst-to-remote(pid=2804): Launched 03:24:40.517830 run scp-inst-to-remote(pid=2804): Terminated: ok {rc=0} 03:24:40.879697 run rm-remote-dir(pid=2806): Launched 03:24:42.072671 run rm-remote-dir(pid=2806): Terminated: ok {rc=0} 03:24:42.435296 run mk-remote-dir(pid=2807): Launched 03:24:43.630047 run mk-remote-dir(pid=2807): Terminated: ok {rc=0} 03:24:43.939348 run scp-cfg-to-remote(pid=2808): Launched 03:24:45.130063 run scp-cfg-to-remote(pid=2808): Terminated: ok {rc=0} 03:24:45.437517 run scp-db-to-remote(pid=2810): Launched 03:24:46.626136 run scp-db-to-remote(pid=2810): Terminated: ok {rc=0} 03:24:46.771805 run srsepc_10.42.42.118: Setting RPATH for srsepc 03:24:47.111638 run patchelf(pid=2812): Launched 03:24:48.321624 run patchelf(pid=2812): Terminated: ok {rc=0} 03:24:48.459185 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 03:24:48.773345 run setcap-netadm(pid=2813): Launched 03:24:49.952566 run setcap-netadm(pid=2813): Terminated: ok {rc=0} 03:24:50.281039 run srsepc(pid=2814): Launched 03:24:50.398829 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 03:24:51.520823 run rm-remote-dir(pid=2815): Launched 03:24:51.700318 run srsepc(pid=2814): ERR: Terminated: ERROR {rc=127} [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2814)] 03:24:51.838069 run srsepc(pid=2814): stdout: | (launched: 2022-12-14_03:24:50.224157) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:51.974765 run srsepc(pid=2814): stderr: | (launched: 2022-12-14_03:24:50.270548) | Connection to 10.42.42.116 closed. 03:24:52.111031 run srsepc(pid=2814): stdout: | (launched: 2022-12-14_03:24:50.224157) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 03:24:52.241751 run srsepc(pid=2814): stderr: | (launched: 2022-12-14_03:24:50.270548) | Connection to 10.42.42.116 closed. 03:24:52.396626 run rm-remote-dir(pid=2815): Terminating (SIGINT) 03:24:52.577308 run rm-remote-dir(pid=2815): Terminated: ok {rc=0} 03:24:52.707841 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=2814): Process ended prematurely: srsepc(pid=2814) [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2814)] [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 03:24:52.718121 tst rrc_idle_mt_ping.py:16: Test FAILED (18.3 sec) 03:24:52.795695 run scp-back-log(pid=2816): Launched 03:24:53.874473 run scp-back-log(pid=2816): ERR: Terminated: ERROR {rc=1} [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2816)] 03:24:53.939411 run scp-back-log(pid=2816): stdout: | (launched: 2022-12-14_03:24:52.765382) 03:24:54.005510 run scp-back-log(pid=2816): stderr: | (launched: 2022-12-14_03:24:52.785322) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 03:24:54.079731 tst srsepc_10.42.42.118: Error('scp-back-log(pid=2816): launch_sync(): local process exited with status 1 [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=2816)]') --------------------------------------------------------------------- trial-2398 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 03:24:54.213128 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:24:54.218171 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 03:24:54.258649 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 03:24:54.285682 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 03:24:54.337761 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 03:24:54.380552 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 03:24:54.406775 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 03:24:54.954081 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 03:24:54.959414 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:24:54.970186 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 03:24:55.007204 tst handover.py: using LAC 38202 03:24:55.130401 tst handover.py: using RAC 207 03:24:55.255190 tst handover.py: using CellId 38202 03:24:55.384658 tst handover.py: using BVCI 38203 03:24:55.505771 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 03:24:55.540421 tst handover.py: using LAC 38203 03:24:55.667974 tst handover.py: using RAC 208 03:24:55.789961 tst handover.py: using CellId 38203 03:24:55.918347 tst handover.py: using BVCI 38204 03:24:56.037616 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:24:56.049245 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:24:56.060245 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:24:56.071554 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:24:56.083122 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 03:24:56.094636 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 03:24:56.213987 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 03:24:56.332618 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:24:56.840867 run create_hlr_db(pid=2823): Launched 03:24:58.024457 run create_hlr_db(pid=2823): Terminated: ok {rc=0} 03:24:58.346277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2825): Launched 03:24:58.653222 run osmo-hlr_10.42.42.2(pid=2826): Launched 03:24:58.769845 run osmo-stp_10.42.42.5: Starting osmo-stp 03:24:59.297585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2828): Launched 03:24:59.602453 run osmo-stp_10.42.42.5(pid=2829): Launched 03:24:59.718616 run osmo-msc_10.42.42.6: Starting osmo-msc 03:25:00.269668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2831): Launched 03:25:00.574122 run osmo-msc_10.42.42.6(pid=2832): Launched 03:25:00.745172 run osmo-stp_10.42.42.5(pid=2829): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2829)] 03:25:00.954395 run osmo-stp_10.42.42.5(pid=2829): stdout: | (launched: 2022-12-14_03:24:59.546000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:01.103953 run osmo-stp_10.42.42.5(pid=2829): stderr: | [0;m[38;5;43m20221214032459717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032459717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032459718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032459718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032459719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032459719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032459719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:01.248723 run osmo-stp_10.42.42.5(pid=2829): stdout: | (launched: 2022-12-14_03:24:59.546000) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:01.399353 run osmo-stp_10.42.42.5(pid=2829): stderr: | [0;m[38;5;43m20221214032459717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032459717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032459718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032459718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032459719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032459719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032459719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:01.561562 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2829): Process ended prematurely: osmo-stp_10.42.42.5(pid=2829) [trial-2398↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2829)] [trial-2398↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 03:25:01.571657 tst handover.py:18: Test FAILED (6.6 sec) 03:25:01.600717 run osmo-hlr_10.42.42.2(pid=2826): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2826)] 03:25:01.655919 run osmo-hlr_10.42.42.2(pid=2826): stdout: | (launched: 2022-12-14_03:24:58.597123) 03:25:01.715885 run osmo-hlr_10.42.42.2(pid=2826): stderr: | [0;m[1;31m20221214032458778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032458778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032458778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032458778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032458778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032458778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032458790 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032458798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032458799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032458799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:25:01.800081 run osmo-msc_10.42.42.6(pid=2832): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2832)] 03:25:01.857880 run osmo-msc_10.42.42.6(pid=2832): stdout: | (launched: 2022-12-14_03:25:00.518298) 03:25:01.915019 run osmo-msc_10.42.42.6(pid=2832): stderr: | [0;m[38;5;43m20221214032500789 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032500790 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1ef131ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032500790 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032500790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032500790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032500790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032500792 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032500792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032500792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032500792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:25:01.973660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2825): Terminating (SIGTERM) 03:25:02.021671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2828): Terminating (SIGTERM) 03:25:02.071404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2831): Terminating (SIGTERM) 03:25:02.122024 --- ParallelTerminationStrategy: PID 2825 died... 03:25:02.145702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2825): Terminated: ok {rc=0} 03:25:02.197890 --- ParallelTerminationStrategy: PID 2828 died... 03:25:02.220648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2828): Terminated: ok {rc=0} 03:25:02.276093 --- ParallelTerminationStrategy: PID 2831 died... 03:25:02.299726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2831): Terminated: ok {rc=0} 03:25:02.399640 bus /sierra_3: Setting Powered False 03:25:03.501220 bus /sierra_3: Setting Powered False 03:25:04.616636 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 03:25:05.859263 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:25:05.864306 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 03:25:05.903316 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 03:25:05.929632 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 03:25:05.981732 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 03:25:06.022854 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 03:25:06.053493 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 03:25:06.598922 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 03:25:06.604244 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:25:06.615187 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 03:25:06.657800 tst handover.py: using LAC 38204 03:25:06.778203 tst handover.py: using RAC 209 03:25:06.899806 tst handover.py: using CellId 38204 03:25:07.018729 tst handover.py: using BVCI 38205 03:25:07.131617 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 03:25:07.164058 tst handover.py: using LAC 38205 03:25:07.285226 tst handover.py: using RAC 210 03:25:07.404272 tst handover.py: using CellId 38205 03:25:07.523625 tst handover.py: using BVCI 38206 03:25:07.635139 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:25:07.645951 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:25:07.656497 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:25:07.667076 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:25:07.678247 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:25:07.689378 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 03:25:07.809961 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 03:25:07.927667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:25:08.374678 run create_hlr_db(pid=2840): Launched 03:25:08.499750 bus /sierra_2: Setting Powered False 03:25:09.560761 run create_hlr_db(pid=2840): Terminated: ok {rc=0} 03:25:09.978928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2842): Launched 03:25:10.307513 run osmo-hlr_10.42.42.2(pid=2843): Launched 03:25:10.433404 run osmo-stp_10.42.42.5: Starting osmo-stp 03:25:10.971399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2845): Launched 03:25:11.281688 run osmo-stp_10.42.42.5(pid=2846): Launched 03:25:11.398935 run osmo-msc_10.42.42.6: Starting osmo-msc 03:25:11.926024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2848): Launched 03:25:12.232337 run osmo-msc_10.42.42.6(pid=2849): Launched 03:25:12.403823 run osmo-stp_10.42.42.5(pid=2846): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2846)] 03:25:12.532891 run osmo-stp_10.42.42.5(pid=2846): stdout: | (launched: 2022-12-14_03:25:11.225708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:12.661930 run osmo-stp_10.42.42.5(pid=2846): stderr: | [0;m[38;5;43m20221214032511398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032511398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032511398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032511399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032511400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032511400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032511400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:12.789178 run osmo-stp_10.42.42.5(pid=2846): stdout: | (launched: 2022-12-14_03:25:11.225708) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:12.910918 run osmo-stp_10.42.42.5(pid=2846): stderr: | [0;m[38;5;43m20221214032511398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032511398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032511398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032511399 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032511400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032511400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032511400 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:13.056133 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2846): Process ended prematurely: osmo-stp_10.42.42.5(pid=2846) [trial-2398↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2846)] [trial-2398↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 03:25:13.064596 tst handover.py:18: Test FAILED (6.5 sec) 03:25:13.090600 run osmo-hlr_10.42.42.2(pid=2843): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2843)] 03:25:13.138713 run osmo-hlr_10.42.42.2(pid=2843): stdout: | (launched: 2022-12-14_03:25:10.248176) 03:25:13.188345 run osmo-hlr_10.42.42.2(pid=2843): stderr: | [0;m[1;31m20221214032510448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032510448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032510448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032510448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032510448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032510448 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032510460 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032510468 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032510469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032510469 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:25:13.257319 run osmo-msc_10.42.42.6(pid=2849): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2849)] 03:25:13.304859 run osmo-msc_10.42.42.6(pid=2849): stdout: | (launched: 2022-12-14_03:25:12.176364) 03:25:13.354103 run osmo-msc_10.42.42.6(pid=2849): stderr: | [0;m[38;5;43m20221214032512446 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032512447 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7efe7759dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032512447 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032512447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032512447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032512447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032512449 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032512449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032512450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032512450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:25:13.404251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2842): Terminating (SIGTERM) 03:25:13.443966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2845): Terminating (SIGTERM) 03:25:13.483423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2848): Terminating (SIGTERM) 03:25:13.523236 --- ParallelTerminationStrategy: PID 2842 died... 03:25:13.542677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2842): Terminated: ok {rc=0} 03:25:13.586528 --- ParallelTerminationStrategy: PID 2845 died... 03:25:13.605088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2845): Terminated: ok {rc=0} 03:25:13.648644 --- ParallelTerminationStrategy: PID 2848 died... 03:25:13.667429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2848): Terminated: ok {rc=0} 03:25:13.752644 bus /sierra_3: Setting Powered False 03:25:14.851435 bus /sierra_3: Setting Powered False 03:25:15.962790 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 03:25:17.204449 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:25:17.210473 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 03:25:17.271604 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 03:25:17.299866 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 03:25:17.354291 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 03:25:17.408142 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 03:25:17.434843 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 03:25:17.982689 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 03:25:17.988138 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:17.999168 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:25:18.036393 tst handover.py: using LAC 38206 03:25:18.156051 tst handover.py: using RAC 211 03:25:18.277151 tst handover.py: using CellId 38206 03:25:18.397117 tst handover.py: using BVCI 38207 03:25:18.509433 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:25:18.560627 tst handover.py: using LAC 38207 03:25:18.679875 tst handover.py: using RAC 212 03:25:18.798068 tst handover.py: using CellId 38207 03:25:18.918378 tst handover.py: using BVCI 38208 03:25:19.030686 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:19.041720 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:19.052477 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:19.063211 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:19.074076 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:25:19.084786 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:25:19.200475 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:25:19.321686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:25:19.802409 run create_hlr_db(pid=2855): Launched 03:25:19.930407 bus /sierra_2: Setting Powered False 03:25:20.994976 run create_hlr_db(pid=2855): Terminated: ok {rc=0} 03:25:21.406235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2857): Launched 03:25:21.714709 run osmo-hlr_10.42.42.2(pid=2858): Launched 03:25:21.830849 run osmo-stp_10.42.42.5: Starting osmo-stp 03:25:22.329968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2860): Launched 03:25:22.634785 run osmo-stp_10.42.42.5(pid=2861): Launched 03:25:22.751799 run osmo-msc_10.42.42.6: Starting osmo-msc 03:25:23.279866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2863): Launched 03:25:23.587187 run osmo-msc_10.42.42.6(pid=2864): Launched 03:25:23.757703 run osmo-stp_10.42.42.5(pid=2861): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2861)] 03:25:23.886719 run osmo-stp_10.42.42.5(pid=2861): stdout: | (launched: 2022-12-14_03:25:22.578579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:24.015124 run osmo-stp_10.42.42.5(pid=2861): stderr: | [0;m[38;5;43m20221214032522749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032522749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032522750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032522750 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032522752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032522753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032522753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:24.142612 run osmo-stp_10.42.42.5(pid=2861): stdout: | (launched: 2022-12-14_03:25:22.578579) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:24.263606 run osmo-stp_10.42.42.5(pid=2861): stderr: | [0;m[38;5;43m20221214032522749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032522749 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032522750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032522750 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032522752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032522753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032522753 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:24.408061 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2861): Process ended prematurely: osmo-stp_10.42.42.5(pid=2861) [trial-2398↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2861)] [trial-2398↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 03:25:24.416374 tst handover.py:18: Test FAILED (6.4 sec) 03:25:24.442211 run osmo-hlr_10.42.42.2(pid=2858): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2858)] 03:25:24.489671 run osmo-hlr_10.42.42.2(pid=2858): stdout: | (launched: 2022-12-14_03:25:21.658388) 03:25:24.538880 run osmo-hlr_10.42.42.2(pid=2858): stderr: | [0;m[1;31m20221214032521835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032521835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032521835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032521835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032521835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032521835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032521847 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032521855 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032521856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032521856 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:25:24.607663 run osmo-msc_10.42.42.6(pid=2864): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2864)] 03:25:24.654918 run osmo-msc_10.42.42.6(pid=2864): stdout: | (launched: 2022-12-14_03:25:23.530437) 03:25:24.704004 run osmo-msc_10.42.42.6(pid=2864): stderr: | [0;m[38;5;43m20221214032523803 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032523803 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8a25affc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032523803 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032523803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032523803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032523803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032523805 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032523805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032523806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032523806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:25:24.753361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2857): Terminating (SIGTERM) 03:25:24.792898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2860): Terminating (SIGTERM) 03:25:24.832565 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2863): Terminating (SIGTERM) 03:25:24.872446 --- ParallelTerminationStrategy: PID 2857 died... 03:25:24.891454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2857): Terminated: ok {rc=0} 03:25:24.934900 --- ParallelTerminationStrategy: PID 2860 died... 03:25:24.953340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2860): Terminated: ok {rc=0} 03:25:24.996724 --- ParallelTerminationStrategy: PID 2863 died... 03:25:25.015196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2863): Terminated: ok {rc=0} 03:25:25.100256 bus /sierra_3: Setting Powered False 03:25:26.200027 bus /sierra_3: Setting Powered False 03:25:27.315812 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 03:25:28.580444 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:25:28.586194 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 03:25:28.637431 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:25:28.664310 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:25:28.716845 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 03:25:28.767799 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:25:28.794836 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:25:29.348052 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 03:25:29.353812 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:29.365780 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:25:29.404007 tst handover.py: using LAC 38208 03:25:29.532601 tst handover.py: using RAC 213 03:25:29.654340 tst handover.py: using CellId 38208 03:25:29.774380 tst handover.py: using BVCI 38209 03:25:29.886600 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:25:29.933566 tst handover.py: using LAC 38209 03:25:30.053317 tst handover.py: using RAC 214 03:25:30.171433 tst handover.py: using CellId 38209 03:25:30.291328 tst handover.py: using BVCI 38210 03:25:30.413647 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:30.425343 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:30.436678 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:30.448263 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:30.460120 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:25:30.472094 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:25:30.589837 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:25:30.710295 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:25:31.229463 run create_hlr_db(pid=2869): Launched 03:25:31.380626 bus /sierra_2: Setting Powered False 03:25:32.443406 run create_hlr_db(pid=2869): Terminated: ok {rc=0} 03:25:32.855562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2871): Launched 03:25:33.162218 run osmo-hlr_10.42.42.2(pid=2872): Launched 03:25:33.279021 run osmo-stp_10.42.42.5: Starting osmo-stp 03:25:33.779478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2874): Launched 03:25:34.085246 run osmo-stp_10.42.42.5(pid=2875): Launched 03:25:34.201671 run osmo-msc_10.42.42.6: Starting osmo-msc 03:25:34.731592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2877): Launched 03:25:35.038685 run osmo-msc_10.42.42.6(pid=2878): Launched 03:25:35.212117 run osmo-stp_10.42.42.5(pid=2875): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2875)] 03:25:35.342054 run osmo-stp_10.42.42.5(pid=2875): stdout: | (launched: 2022-12-14_03:25:34.029092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:35.471369 run osmo-stp_10.42.42.5(pid=2875): stderr: | [0;m[38;5;43m20221214032534201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032534201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032534201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032534202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032534204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032534204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032534204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:35.599609 run osmo-stp_10.42.42.5(pid=2875): stdout: | (launched: 2022-12-14_03:25:34.029092) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:35.720676 run osmo-stp_10.42.42.5(pid=2875): stderr: | [0;m[38;5;43m20221214032534201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032534201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032534201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032534202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032534204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032534204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032534204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:35.866134 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2875): Process ended prematurely: osmo-stp_10.42.42.5(pid=2875) [trial-2398↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2875)] [trial-2398↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 03:25:35.874431 tst handover.py:18: Test FAILED (6.5 sec) 03:25:35.900357 run osmo-hlr_10.42.42.2(pid=2872): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2872)] 03:25:35.947604 run osmo-hlr_10.42.42.2(pid=2872): stdout: | (launched: 2022-12-14_03:25:33.105956) 03:25:35.996720 run osmo-hlr_10.42.42.2(pid=2872): stderr: | [0;m[1;31m20221214032533281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032533281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032533281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032533281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032533281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032533281 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032533293 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032533301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032533301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032533301 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:25:36.065283 run osmo-msc_10.42.42.6(pid=2878): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2878)] 03:25:36.112457 run osmo-msc_10.42.42.6(pid=2878): stdout: | (launched: 2022-12-14_03:25:34.982252) 03:25:36.161581 run osmo-msc_10.42.42.6(pid=2878): stderr: | [0;m[38;5;43m20221214032535253 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032535253 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff9dfd8dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032535253 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032535253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032535254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032535254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032535255 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032535256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032535256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032535256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:25:36.210820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2871): Terminating (SIGTERM) 03:25:36.250303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2874): Terminating (SIGTERM) 03:25:36.289807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2877): Terminating (SIGTERM) 03:25:36.329559 --- ParallelTerminationStrategy: PID 2871 died... 03:25:36.348457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2871): Terminated: ok {rc=0} 03:25:36.392066 --- ParallelTerminationStrategy: PID 2874 died... 03:25:36.410533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2874): Terminated: ok {rc=0} 03:25:36.454384 --- ParallelTerminationStrategy: PID 2877 died... 03:25:36.472853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2877): Terminated: ok {rc=0} 03:25:36.558838 bus /sierra_3: Setting Powered False 03:25:37.658526 bus /sierra_3: Setting Powered False 03:25:38.774767 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 03:25:40.029573 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:25:40.034546 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 03:25:40.087644 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 03:25:40.113847 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 03:25:40.164350 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 03:25:40.218011 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 03:25:40.243898 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 03:25:40.797125 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 03:25:40.803257 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:25:40.814760 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:25:40.855304 tst handover.py: using LAC 38210 03:25:40.976508 tst handover.py: using RAC 215 03:25:41.094948 tst handover.py: using CellId 38210 03:25:41.214536 tst handover.py: using BVCI 38211 03:25:41.326653 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:25:41.376862 tst handover.py: using LAC 38211 03:25:41.497537 tst handover.py: using RAC 216 03:25:41.617466 tst handover.py: using CellId 38211 03:25:41.735728 tst handover.py: using BVCI 38212 03:25:41.846792 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:25:41.857763 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:25:41.868433 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:25:41.879247 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:25:41.890589 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:25:41.901869 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:25:42.023672 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:25:42.142496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:25:42.590023 run create_hlr_db(pid=2883): Launched 03:25:42.716002 bus /sierra_2: Setting Powered False 03:25:43.781772 run create_hlr_db(pid=2883): Terminated: ok {rc=0} 03:25:44.192476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2885): Launched 03:25:44.497316 run osmo-hlr_10.42.42.2(pid=2886): Launched 03:25:44.614084 run osmo-stp_10.42.42.5: Starting osmo-stp 03:25:45.114228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2888): Launched 03:25:45.420841 run osmo-stp_10.42.42.5(pid=2889): Launched 03:25:45.537233 run osmo-msc_10.42.42.6: Starting osmo-msc 03:25:46.084365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2891): Launched 03:25:46.421458 run osmo-msc_10.42.42.6(pid=2892): Launched 03:25:46.911701 run osmo-stp_10.42.42.5(pid=2889): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2889)] 03:25:47.269916 run osmo-stp_10.42.42.5(pid=2889): stdout: | (launched: 2022-12-14_03:25:45.364316) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:47.399786 run osmo-stp_10.42.42.5(pid=2889): stderr: | [0;m[38;5;43m20221214032545538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032545538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032545538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032545538 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032545539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032545539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032545539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:47.530770 run osmo-stp_10.42.42.5(pid=2889): stdout: | (launched: 2022-12-14_03:25:45.364316) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:47.652042 run osmo-stp_10.42.42.5(pid=2889): stderr: | [0;m[38;5;43m20221214032545538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032545538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032545538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032545538 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032545539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032545539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032545539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:47.798054 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2889): Process ended prematurely: osmo-stp_10.42.42.5(pid=2889) [trial-2398↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2889)] [trial-2398↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 03:25:47.806325 tst handover.py:18: Test FAILED (7.0 sec) 03:25:47.832220 run osmo-hlr_10.42.42.2(pid=2886): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2886)] 03:25:47.879432 run osmo-hlr_10.42.42.2(pid=2886): stdout: | (launched: 2022-12-14_03:25:44.440922) 03:25:47.928390 run osmo-hlr_10.42.42.2(pid=2886): stderr: | [0;m[1;31m20221214032544620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032544620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032544620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032544620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032544620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032544620 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032544632 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032544641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032544641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032544641 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:25:47.996700 run osmo-msc_10.42.42.6(pid=2892): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2892)] 03:25:48.043720 run osmo-msc_10.42.42.6(pid=2892): stdout: | (launched: 2022-12-14_03:25:46.362863) 03:25:48.092305 run osmo-msc_10.42.42.6(pid=2892): stderr: | [0;m[38;5;43m20221214032546844 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032546845 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc7f524cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032546846 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032546846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032546846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032546847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032546851 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032546852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032546852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032546852 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:25:48.141625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2885): Terminating (SIGTERM) 03:25:48.181005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2888): Terminating (SIGTERM) 03:25:48.220521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2891): Terminating (SIGTERM) 03:25:48.260445 --- ParallelTerminationStrategy: PID 2885 died... 03:25:48.279469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2885): Terminated: ok {rc=0} 03:25:48.323172 --- ParallelTerminationStrategy: PID 2888 died... 03:25:48.341733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2888): Terminated: ok {rc=0} 03:25:48.385914 --- ParallelTerminationStrategy: PID 2891 died... 03:25:48.404321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2891): Terminated: ok {rc=0} 03:25:48.488052 bus /sierra_3: Setting Powered False 03:25:49.586596 bus /sierra_3: Setting Powered False 03:25:50.704862 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 03:25:51.975113 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:25:51.980630 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:25:52.024640 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:25:52.052018 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:25:52.104255 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:25:52.145274 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:25:52.171672 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:25:52.722015 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 03:25:52.728357 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:25:52.740532 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 03:25:52.778805 tst handover.py: using LAC 38212 03:25:52.906233 tst handover.py: using RAC 217 03:25:53.036256 tst handover.py: using CellId 38212 03:25:53.164831 tst handover.py: using BVCI 38213 03:25:53.283869 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 03:25:53.323253 tst handover.py: using LAC 38213 03:25:53.450938 tst handover.py: using RAC 218 03:25:53.577809 tst handover.py: using CellId 38213 03:25:53.706117 tst handover.py: using BVCI 38214 03:25:53.825818 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:25:53.837246 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:25:53.848257 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:25:53.859347 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:25:53.870918 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:25:53.882390 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 03:25:53.998616 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 03:25:54.119623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:25:54.566938 run create_hlr_db(pid=2898): Launched 03:25:54.693463 bus /sierra_2: Setting Powered False 03:25:55.754938 run create_hlr_db(pid=2898): Terminated: ok {rc=0} 03:25:56.174355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2900): Launched 03:25:56.502094 run osmo-hlr_10.42.42.2(pid=2901): Launched 03:25:56.630298 run osmo-stp_10.42.42.5: Starting osmo-stp 03:25:57.170115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2903): Launched 03:25:57.496658 run osmo-stp_10.42.42.5(pid=2904): Launched 03:25:57.623166 run osmo-msc_10.42.42.6: Starting osmo-msc 03:25:58.187050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2906): Launched 03:25:58.517110 run osmo-msc_10.42.42.6(pid=2907): Launched 03:25:58.703499 run osmo-stp_10.42.42.5(pid=2904): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2904)] 03:25:58.843298 run osmo-stp_10.42.42.5(pid=2904): stdout: | (launched: 2022-12-14_03:25:57.437217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:58.983008 run osmo-stp_10.42.42.5(pid=2904): stderr: | [0;m[38;5;43m20221214032557631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032557631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032557631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032557631 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032557632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032557632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032557632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:59.120676 run osmo-stp_10.42.42.5(pid=2904): stdout: | (launched: 2022-12-14_03:25:57.437217) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:25:59.250934 run osmo-stp_10.42.42.5(pid=2904): stderr: | [0;m[38;5;43m20221214032557631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032557631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032557631 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032557631 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032557632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032557632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032557632 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:25:59.407186 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2904): Process ended prematurely: osmo-stp_10.42.42.5(pid=2904) [trial-2398↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2904)] [trial-2398↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 03:25:59.416148 tst handover.py:18: Test FAILED (6.7 sec) 03:25:59.443416 run osmo-hlr_10.42.42.2(pid=2901): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2901)] 03:25:59.494088 run osmo-hlr_10.42.42.2(pid=2901): stdout: | (launched: 2022-12-14_03:25:56.442501) 03:25:59.546037 run osmo-hlr_10.42.42.2(pid=2901): stderr: | [0;m[1;31m20221214032556641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032556641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032556641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032556641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032556641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032556641 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032556653 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032556662 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032556663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032556663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:25:59.618725 run osmo-msc_10.42.42.6(pid=2907): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2907)] 03:25:59.668344 run osmo-msc_10.42.42.6(pid=2907): stdout: | (launched: 2022-12-14_03:25:58.457505) 03:25:59.719759 run osmo-msc_10.42.42.6(pid=2907): stderr: | [0;m[38;5;43m20221214032558780 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032558780 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7f540a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032558780 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032558780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032558780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032558781 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032558784 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032558785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032558785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032558785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:25:59.771511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2900): Terminating (SIGTERM) 03:25:59.813315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2903): Terminating (SIGTERM) 03:25:59.855730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2906): Terminating (SIGTERM) 03:25:59.897665 --- ParallelTerminationStrategy: PID 2900 died... 03:25:59.917758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2900): Terminated: ok {rc=0} 03:25:59.963455 --- ParallelTerminationStrategy: PID 2903 died... 03:25:59.983156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2903): Terminated: ok {rc=0} 03:26:00.028631 --- ParallelTerminationStrategy: PID 2906 died... 03:26:00.048223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2906): Terminated: ok {rc=0} 03:26:00.134743 bus /sierra_3: Setting Powered False 03:26:01.240418 bus /sierra_3: Setting Powered False 03:26:02.356551 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 03:26:03.606892 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:26:03.612815 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:26:03.667844 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:26:03.694798 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:26:03.746661 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:26:03.801367 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:26:03.828776 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:26:04.381040 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 03:26:04.386648 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:26:04.398209 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:26:04.437474 tst handover.py: using LAC 38214 03:26:04.559117 tst handover.py: using RAC 219 03:26:04.681311 tst handover.py: using CellId 38214 03:26:04.807542 tst handover.py: using BVCI 38215 03:26:04.919489 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:26:04.966410 tst handover.py: using LAC 38215 03:26:05.086957 tst handover.py: using RAC 220 03:26:05.207856 tst handover.py: using CellId 38215 03:26:05.328057 tst handover.py: using BVCI 38216 03:26:05.445809 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:26:05.456765 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:26:05.467383 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:26:05.478213 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:26:05.489059 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:26:05.499828 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:26:05.621139 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:26:05.741571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:26:06.220588 run create_hlr_db(pid=2912): Launched 03:26:06.347246 bus /sierra_2: Setting Powered False 03:26:07.411503 run create_hlr_db(pid=2912): Terminated: ok {rc=0} 03:26:07.838912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2914): Launched 03:26:08.168634 run osmo-hlr_10.42.42.2(pid=2915): Launched 03:26:08.294847 run osmo-stp_10.42.42.5: Starting osmo-stp 03:26:08.830097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2917): Launched 03:26:09.158741 run osmo-stp_10.42.42.5(pid=2918): Launched 03:26:09.283909 run osmo-msc_10.42.42.6: Starting osmo-msc 03:26:09.848510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2920): Launched 03:26:10.177507 run osmo-msc_10.42.42.6(pid=2921): Launched 03:26:10.360710 run osmo-stp_10.42.42.5(pid=2918): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2918)] 03:26:10.499446 run osmo-stp_10.42.42.5(pid=2918): stdout: | (launched: 2022-12-14_03:26:09.097857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:10.639075 run osmo-stp_10.42.42.5(pid=2918): stderr: | [0;m[38;5;43m20221214032609292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032609292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032609293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032609293 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032609293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032609294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032609294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:10.776230 run osmo-stp_10.42.42.5(pid=2918): stdout: | (launched: 2022-12-14_03:26:09.097857) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:10.907109 run osmo-stp_10.42.42.5(pid=2918): stderr: | [0;m[38;5;43m20221214032609292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032609292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032609293 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032609293 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032609293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032609294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032609294 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:11.063087 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2918): Process ended prematurely: osmo-stp_10.42.42.5(pid=2918) [trial-2398↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2918)] [trial-2398↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 03:26:11.071862 tst handover.py:18: Test FAILED (6.7 sec) 03:26:11.099559 run osmo-hlr_10.42.42.2(pid=2915): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2915)] 03:26:11.150974 run osmo-hlr_10.42.42.2(pid=2915): stdout: | (launched: 2022-12-14_03:26:08.108853) 03:26:11.203237 run osmo-hlr_10.42.42.2(pid=2915): stderr: | [0;m[1;31m20221214032608306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032608306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032608306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032608306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032608306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032608306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032608323 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032608331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032608331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032608331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:26:11.276197 run osmo-msc_10.42.42.6(pid=2921): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2921)] 03:26:11.326382 run osmo-msc_10.42.42.6(pid=2921): stdout: | (launched: 2022-12-14_03:26:10.117667) 03:26:11.378384 run osmo-msc_10.42.42.6(pid=2921): stderr: | [0;m[38;5;43m20221214032610438 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032610438 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff7b9745c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032610439 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032610439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032610439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032610439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032610441 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032610441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032610441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032610441 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:26:11.431753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2914): Terminating (SIGTERM) 03:26:11.473750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2917): Terminating (SIGTERM) 03:26:11.516413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2920): Terminating (SIGTERM) 03:26:11.559355 --- ParallelTerminationStrategy: PID 2914 died... 03:26:11.579870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2914): Terminated: ok {rc=0} 03:26:11.627111 --- ParallelTerminationStrategy: PID 2917 died... 03:26:11.647063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2917): Terminated: ok {rc=0} 03:26:11.693425 --- ParallelTerminationStrategy: PID 2920 died... 03:26:11.713378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2920): Terminated: ok {rc=0} 03:26:11.802028 bus /sierra_3: Setting Powered False 03:26:12.898873 bus /sierra_3: Setting Powered False 03:26:14.014218 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 03:26:15.279252 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:26:15.284769 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:26:15.339455 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:26:15.366516 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:26:15.418361 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:26:15.472711 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:26:15.499909 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:26:16.070510 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 03:26:16.077701 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:16.090019 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:26:16.132470 tst handover.py: using LAC 38216 03:26:16.264803 tst handover.py: using RAC 221 03:26:16.390317 tst handover.py: using CellId 38216 03:26:16.512673 tst handover.py: using BVCI 38217 03:26:16.635440 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:26:16.686448 tst handover.py: using LAC 38217 03:26:16.845956 tst handover.py: using RAC 222 03:26:17.009225 tst handover.py: using CellId 38217 03:26:17.167315 tst handover.py: using BVCI 38218 03:26:17.304114 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:17.316166 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:17.327914 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:17.340032 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:17.352431 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:26:17.364213 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:26:17.483039 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:26:17.599045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:26:18.046952 run create_hlr_db(pid=2926): Launched 03:26:18.172544 bus /sierra_2: Setting Powered False 03:26:19.233723 run create_hlr_db(pid=2926): Terminated: ok {rc=0} 03:26:19.633653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2928): Launched 03:26:19.939250 run osmo-hlr_10.42.42.2(pid=2929): Launched 03:26:20.055448 run osmo-stp_10.42.42.5: Starting osmo-stp 03:26:20.553120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2931): Launched 03:26:20.858121 run osmo-stp_10.42.42.5(pid=2932): Launched 03:26:20.974429 run osmo-msc_10.42.42.6: Starting osmo-msc 03:26:21.518794 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2934): Launched 03:26:21.825293 run osmo-msc_10.42.42.6(pid=2935): Launched 03:26:21.997984 run osmo-stp_10.42.42.5(pid=2932): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2932)] 03:26:22.127674 run osmo-stp_10.42.42.5(pid=2932): stdout: | (launched: 2022-12-14_03:26:20.801551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:22.256455 run osmo-stp_10.42.42.5(pid=2932): stderr: | [0;m[38;5;43m20221214032620974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032620974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032620974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032620975 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032620975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032620975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032620975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:22.383227 run osmo-stp_10.42.42.5(pid=2932): stdout: | (launched: 2022-12-14_03:26:20.801551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:22.504182 run osmo-stp_10.42.42.5(pid=2932): stderr: | [0;m[38;5;43m20221214032620974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032620974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032620974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032620975 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032620975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032620975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032620975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:22.649847 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2932): Process ended prematurely: osmo-stp_10.42.42.5(pid=2932) [trial-2398↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2932)] [trial-2398↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 03:26:22.658157 tst handover.py:18: Test FAILED (6.6 sec) 03:26:22.684354 run osmo-hlr_10.42.42.2(pid=2929): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2929)] 03:26:22.732282 run osmo-hlr_10.42.42.2(pid=2929): stdout: | (launched: 2022-12-14_03:26:19.882974) 03:26:22.781959 run osmo-hlr_10.42.42.2(pid=2929): stderr: | [0;m[1;31m20221214032620061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032620061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032620061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032620061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032620061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032620061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032620073 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032620082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032620082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032620082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:26:22.851078 run osmo-msc_10.42.42.6(pid=2935): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2935)] 03:26:22.898555 run osmo-msc_10.42.42.6(pid=2935): stdout: | (launched: 2022-12-14_03:26:21.769209) 03:26:22.947694 run osmo-msc_10.42.42.6(pid=2935): stderr: | [0;m[38;5;43m20221214032622040 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032622040 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f13d61fcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032622041 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032622041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032622041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032622041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032622043 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032622043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032622043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032622043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:26:22.997527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2928): Terminating (SIGTERM) 03:26:23.037270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2931): Terminating (SIGTERM) 03:26:23.076887 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2934): Terminating (SIGTERM) 03:26:23.116785 --- ParallelTerminationStrategy: PID 2928 died... 03:26:23.135980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2928): Terminated: ok {rc=0} 03:26:23.179879 --- ParallelTerminationStrategy: PID 2931 died... 03:26:23.198540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2931): Terminated: ok {rc=0} 03:26:23.242144 --- ParallelTerminationStrategy: PID 2934 died... 03:26:23.260824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2934): Terminated: ok {rc=0} 03:26:23.344537 bus /sierra_3: Setting Powered False 03:26:24.443025 bus /sierra_3: Setting Powered False 03:26:25.560090 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 03:26:26.816748 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:26:26.821853 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 03:26:26.857660 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 03:26:26.884254 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 03:26:26.934781 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 03:26:26.970879 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 03:26:26.997079 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 03:26:27.547952 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 03:26:27.553319 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:27.564107 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 03:26:27.597736 tst handover.py: using LAC 38218 03:26:27.718866 tst handover.py: using RAC 223 03:26:27.839866 tst handover.py: using CellId 38218 03:26:27.961398 tst handover.py: using BVCI 38219 03:26:28.082265 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 03:26:28.117386 tst handover.py: using LAC 38219 03:26:28.245590 tst handover.py: using RAC 224 03:26:28.366782 tst handover.py: using CellId 38219 03:26:28.489503 tst handover.py: using BVCI 38220 03:26:28.600653 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:28.611544 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:28.622249 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:28.632925 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:28.643906 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 03:26:28.655100 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 03:26:28.775936 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 03:26:28.896910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:26:29.378038 run create_hlr_db(pid=2940): Launched 03:26:29.504796 bus /sierra_2: Setting Powered False 03:26:30.570025 run create_hlr_db(pid=2940): Terminated: ok {rc=0} 03:26:30.999864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2942): Launched 03:26:31.327622 run osmo-hlr_10.42.42.2(pid=2943): Launched 03:26:31.587243 run osmo-stp_10.42.42.5: Starting osmo-stp 03:26:32.243317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2945): Launched 03:26:32.578825 run osmo-stp_10.42.42.5(pid=2946): Launched 03:26:32.704251 run osmo-msc_10.42.42.6: Starting osmo-msc 03:26:33.270392 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2948): Launched 03:26:33.599644 run osmo-msc_10.42.42.6(pid=2949): Launched 03:26:33.783746 run osmo-stp_10.42.42.5(pid=2946): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2946)] 03:26:33.923759 run osmo-stp_10.42.42.5(pid=2946): stdout: | (launched: 2022-12-14_03:26:32.518906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:34.063403 run osmo-stp_10.42.42.5(pid=2946): stderr: | [0;m[38;5;43m20221214032632711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032632711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032632711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032632712 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032632712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032632712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032632712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:34.202172 run osmo-stp_10.42.42.5(pid=2946): stdout: | (launched: 2022-12-14_03:26:32.518906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:34.333263 run osmo-stp_10.42.42.5(pid=2946): stderr: | [0;m[38;5;43m20221214032632711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032632711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032632711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032632712 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032632712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032632712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032632712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:34.490041 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2946): Process ended prematurely: osmo-stp_10.42.42.5(pid=2946) [trial-2398↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2946)] [trial-2398↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 03:26:34.498908 tst handover.py:18: Test FAILED (6.9 sec) 03:26:34.526441 run osmo-hlr_10.42.42.2(pid=2943): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2943)] 03:26:34.577596 run osmo-hlr_10.42.42.2(pid=2943): stdout: | (launched: 2022-12-14_03:26:31.270244) 03:26:34.630379 run osmo-hlr_10.42.42.2(pid=2943): stderr: | [0;m[1;31m20221214032631495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032631495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032631495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032631495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032631495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032631495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032631516 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032631539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032631539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032631539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:26:34.703209 run osmo-msc_10.42.42.6(pid=2949): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2949)] 03:26:34.753103 run osmo-msc_10.42.42.6(pid=2949): stdout: | (launched: 2022-12-14_03:26:33.539359) 03:26:34.805258 run osmo-msc_10.42.42.6(pid=2949): stderr: | [0;m[38;5;43m20221214032633861 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032633861 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f91822d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032633861 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032633861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032633861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032633861 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032633863 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032633863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032633864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032633864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:26:34.858115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2942): Terminating (SIGTERM) 03:26:34.900141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2945): Terminating (SIGTERM) 03:26:34.942599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2948): Terminating (SIGTERM) 03:26:34.985189 --- ParallelTerminationStrategy: PID 2942 died... 03:26:35.005645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2942): Terminated: ok {rc=0} 03:26:35.052238 --- ParallelTerminationStrategy: PID 2945 died... 03:26:35.072006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2945): Terminated: ok {rc=0} 03:26:35.118333 --- ParallelTerminationStrategy: PID 2948 died... 03:26:35.138286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2948): Terminated: ok {rc=0} 03:26:35.226899 bus /sierra_3: Setting Powered False 03:26:36.324881 bus /sierra_3: Setting Powered False 03:26:37.440571 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 03:26:38.684103 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:26:38.689771 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 03:26:38.741644 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 03:26:38.768664 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 03:26:38.820594 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 03:26:38.872103 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 03:26:38.899204 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 03:26:39.451802 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 03:26:39.457548 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:26:39.468800 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:26:39.504250 tst handover.py: using LAC 38220 03:26:39.626311 tst handover.py: using RAC 225 03:26:39.748481 tst handover.py: using CellId 38220 03:26:39.879972 tst handover.py: using BVCI 38221 03:26:39.991768 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:26:40.040030 tst handover.py: using LAC 38221 03:26:40.163274 tst handover.py: using RAC 226 03:26:40.285087 tst handover.py: using CellId 38221 03:26:40.404930 tst handover.py: using BVCI 38222 03:26:40.527237 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:26:40.538881 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:26:40.550220 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:26:40.561630 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:26:40.573528 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:26:40.585179 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:26:40.703190 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:26:40.819899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:26:41.302277 run create_hlr_db(pid=2954): Launched 03:26:41.429454 bus /sierra_2: Setting Powered False 03:26:42.493959 run create_hlr_db(pid=2954): Terminated: ok {rc=0} 03:26:42.923170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2956): Launched 03:26:43.253437 run osmo-hlr_10.42.42.2(pid=2957): Launched 03:26:43.379281 run osmo-stp_10.42.42.5: Starting osmo-stp 03:26:43.913387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2959): Launched 03:26:44.241652 run osmo-stp_10.42.42.5(pid=2960): Launched 03:26:44.367192 run osmo-msc_10.42.42.6: Starting osmo-msc 03:26:44.931441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2962): Launched 03:26:45.260481 run osmo-msc_10.42.42.6(pid=2963): Launched 03:26:45.444343 run osmo-stp_10.42.42.5(pid=2960): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2960)] 03:26:45.583185 run osmo-stp_10.42.42.5(pid=2960): stdout: | (launched: 2022-12-14_03:26:44.181780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:45.722414 run osmo-stp_10.42.42.5(pid=2960): stderr: | [0;m[38;5;43m20221214032644375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032644375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032644375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032644376 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032644376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032644376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032644376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:45.861653 run osmo-stp_10.42.42.5(pid=2960): stdout: | (launched: 2022-12-14_03:26:44.181780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:45.995396 run osmo-stp_10.42.42.5(pid=2960): stderr: | [0;m[38;5;43m20221214032644375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032644375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032644375 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032644376 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032644376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032644376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032644376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:46.156230 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2960): Process ended prematurely: osmo-stp_10.42.42.5(pid=2960) [trial-2398↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2960)] [trial-2398↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 03:26:46.166294 tst handover.py:18: Test FAILED (6.7 sec) 03:26:46.194844 run osmo-hlr_10.42.42.2(pid=2957): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2957)] 03:26:46.249454 run osmo-hlr_10.42.42.2(pid=2957): stdout: | (launched: 2022-12-14_03:26:43.193931) 03:26:46.303659 run osmo-hlr_10.42.42.2(pid=2957): stderr: | [0;m[1;31m20221214032643393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032643393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032643393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032643393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032643393 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032643394 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032643406 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032643415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032643415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032643415 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:26:46.379642 run osmo-msc_10.42.42.6(pid=2963): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2963)] 03:26:46.432280 run osmo-msc_10.42.42.6(pid=2963): stdout: | (launched: 2022-12-14_03:26:45.200605) 03:26:46.486643 run osmo-msc_10.42.42.6(pid=2963): stderr: | [0;m[38;5;43m20221214032645524 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032645524 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9bad4c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032645524 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032645524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032645524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032645525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032645526 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032645527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032645527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032645527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:26:46.541691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2956): Terminating (SIGTERM) 03:26:46.584592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2959): Terminating (SIGTERM) 03:26:46.628699 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2962): Terminating (SIGTERM) 03:26:46.673230 --- ParallelTerminationStrategy: PID 2956 died... 03:26:46.695234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2956): Terminated: ok {rc=0} 03:26:46.744182 --- ParallelTerminationStrategy: PID 2959 died... 03:26:46.765541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2959): Terminated: ok {rc=0} 03:26:46.815211 --- ParallelTerminationStrategy: PID 2962 died... 03:26:46.835629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2962): Terminated: ok {rc=0} 03:26:46.929381 bus /sierra_3: Setting Powered False 03:26:48.028507 bus /sierra_3: Setting Powered False 03:26:49.143355 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 03:26:50.400850 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:26:50.406259 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 03:26:50.452116 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:26:50.478387 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:26:50.528701 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 03:26:50.574773 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:26:50.601171 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:26:51.153545 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 03:26:51.158844 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:26:51.170108 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:26:51.204635 tst handover.py: using LAC 38222 03:26:51.334816 tst handover.py: using RAC 227 03:26:51.466250 tst handover.py: using CellId 38222 03:26:51.594394 tst handover.py: using BVCI 38223 03:26:51.716011 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:26:51.761371 tst handover.py: using LAC 38223 03:26:51.882186 tst handover.py: using RAC 228 03:26:52.004827 tst handover.py: using CellId 38223 03:26:52.127070 tst handover.py: using BVCI 38224 03:26:52.241657 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:26:52.252669 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:26:52.263714 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:26:52.274758 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:26:52.285932 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:26:52.296874 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:26:52.417365 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:26:52.535546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:26:52.983474 run create_hlr_db(pid=2968): Launched 03:26:53.107903 bus /sierra_2: Setting Powered False 03:26:54.168342 run create_hlr_db(pid=2968): Terminated: ok {rc=0} 03:26:54.589095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2970): Launched 03:26:54.918811 run osmo-hlr_10.42.42.2(pid=2971): Launched 03:26:55.044332 run osmo-stp_10.42.42.5: Starting osmo-stp 03:26:55.581589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2973): Launched 03:26:55.910074 run osmo-stp_10.42.42.5(pid=2974): Launched 03:26:56.037187 run osmo-msc_10.42.42.6: Starting osmo-msc 03:26:56.604370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2976): Launched 03:26:56.934788 run osmo-msc_10.42.42.6(pid=2977): Launched 03:26:57.118467 run osmo-stp_10.42.42.5(pid=2974): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2974)] 03:26:57.257928 run osmo-stp_10.42.42.5(pid=2974): stdout: | (launched: 2022-12-14_03:26:55.850354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:57.398504 run osmo-stp_10.42.42.5(pid=2974): stderr: | [0;m[38;5;43m20221214032656045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032656045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032656045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032656046 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032656046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032656046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032656046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:57.536070 run osmo-stp_10.42.42.5(pid=2974): stdout: | (launched: 2022-12-14_03:26:55.850354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:26:57.667368 run osmo-stp_10.42.42.5(pid=2974): stderr: | [0;m[38;5;43m20221214032656045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032656045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032656045 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032656046 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032656046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032656046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032656046 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:26:57.824028 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2974): Process ended prematurely: osmo-stp_10.42.42.5(pid=2974) [trial-2398↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2974)] [trial-2398↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 03:26:57.833266 tst handover.py:18: Test FAILED (6.7 sec) 03:26:57.861253 run osmo-hlr_10.42.42.2(pid=2971): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2971)] 03:26:57.912316 run osmo-hlr_10.42.42.2(pid=2971): stdout: | (launched: 2022-12-14_03:26:54.859036) 03:26:57.964933 run osmo-hlr_10.42.42.2(pid=2971): stderr: | [0;m[1;31m20221214032655058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032655058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032655058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032655058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032655058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032655058 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032655075 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032655083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032655083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032655083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:26:58.037897 run osmo-msc_10.42.42.6(pid=2977): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2977)] 03:26:58.087946 run osmo-msc_10.42.42.6(pid=2977): stdout: | (launched: 2022-12-14_03:26:56.874658) 03:26:58.140444 run osmo-msc_10.42.42.6(pid=2977): stderr: | [0;m[38;5;43m20221214032657196 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032657196 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f38c33d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032657196 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032657196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032657196 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032657197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032657198 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032657199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032657199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032657199 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:26:58.193352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2970): Terminating (SIGTERM) 03:26:58.235292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2973): Terminating (SIGTERM) 03:26:58.277736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2976): Terminating (SIGTERM) 03:26:58.320193 --- ParallelTerminationStrategy: PID 2970 died... 03:26:58.340674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2970): Terminated: ok {rc=0} 03:26:58.387512 --- ParallelTerminationStrategy: PID 2973 died... 03:26:58.407557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2973): Terminated: ok {rc=0} 03:26:58.454055 --- ParallelTerminationStrategy: PID 2976 died... 03:26:58.474060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2976): Terminated: ok {rc=0} 03:26:58.562477 bus /sierra_3: Setting Powered False 03:26:59.660214 bus /sierra_3: Setting Powered False 03:27:00.779076 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 03:27:02.080804 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:27:02.089688 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 03:27:02.151094 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 03:27:02.183333 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 03:27:02.240650 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 03:27:02.298030 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 03:27:02.325225 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 03:27:02.866046 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 03:27:02.871693 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:27:02.883217 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:27:02.919756 tst handover.py: using LAC 38224 03:27:03.041390 tst handover.py: using RAC 229 03:27:03.161592 tst handover.py: using CellId 38224 03:27:03.284514 tst handover.py: using BVCI 38225 03:27:03.414422 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:27:03.466458 tst handover.py: using LAC 38225 03:27:03.590752 tst handover.py: using RAC 230 03:27:03.712448 tst handover.py: using CellId 38225 03:27:03.834038 tst handover.py: using BVCI 38226 03:27:03.945318 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:27:03.956326 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:27:03.967261 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:27:03.978172 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:27:03.989300 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:27:04.000342 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:27:04.120866 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:27:04.240068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:27:04.690693 run create_hlr_db(pid=2982): Launched 03:27:04.815956 bus /sierra_2: Setting Powered False 03:27:05.876382 run create_hlr_db(pid=2982): Terminated: ok {rc=0} 03:27:06.294907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2984): Launched 03:27:06.624285 run osmo-hlr_10.42.42.2(pid=2985): Launched 03:27:06.750946 run osmo-stp_10.42.42.5: Starting osmo-stp 03:27:07.291675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2987): Launched 03:27:07.621678 run osmo-stp_10.42.42.5(pid=2988): Launched 03:27:07.748101 run osmo-msc_10.42.42.6: Starting osmo-msc 03:27:08.314540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2990): Launched 03:27:08.646093 run osmo-msc_10.42.42.6(pid=2991): Launched 03:27:08.831458 run osmo-stp_10.42.42.5(pid=2988): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2988)] 03:27:08.970956 run osmo-stp_10.42.42.5(pid=2988): stdout: | (launched: 2022-12-14_03:27:07.561563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:09.110565 run osmo-stp_10.42.42.5(pid=2988): stderr: | [0;m[38;5;43m20221214032707754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032707754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032707754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032707755 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032707756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032707756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032707756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:09.248097 run osmo-stp_10.42.42.5(pid=2988): stdout: | (launched: 2022-12-14_03:27:07.561563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:09.379039 run osmo-stp_10.42.42.5(pid=2988): stderr: | [0;m[38;5;43m20221214032707754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032707754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032707754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032707755 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032707756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032707756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032707756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:09.535175 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=2988): Process ended prematurely: osmo-stp_10.42.42.5(pid=2988) [trial-2398↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2988)] [trial-2398↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 03:27:09.544281 tst handover.py:18: Test FAILED (6.7 sec) 03:27:09.571920 run osmo-hlr_10.42.42.2(pid=2985): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2985)] 03:27:09.622642 run osmo-hlr_10.42.42.2(pid=2985): stdout: | (launched: 2022-12-14_03:27:06.564574) 03:27:09.674824 run osmo-hlr_10.42.42.2(pid=2985): stderr: | [0;m[1;31m20221214032706764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032706764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032706764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032706764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032706764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032706764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032706778 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032706788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032706788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032706788 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:27:09.747131 run osmo-msc_10.42.42.6(pid=2991): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2991)] 03:27:09.797301 run osmo-msc_10.42.42.6(pid=2991): stdout: | (launched: 2022-12-14_03:27:08.586477) 03:27:09.850319 run osmo-msc_10.42.42.6(pid=2991): stderr: | [0;m[38;5;43m20221214032708906 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032708907 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7fc12b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032708907 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032708907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032708907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032708907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032708909 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032708909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032708909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032708909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:27:09.902976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2984): Terminating (SIGTERM) 03:27:09.944834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2987): Terminating (SIGTERM) 03:27:09.987545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2990): Terminating (SIGTERM) 03:27:10.029885 --- ParallelTerminationStrategy: PID 2984 died... 03:27:10.050190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2984): Terminated: ok {rc=0} 03:27:10.096841 --- ParallelTerminationStrategy: PID 2987 died... 03:27:10.116825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2987): Terminated: ok {rc=0} 03:27:10.163186 --- ParallelTerminationStrategy: PID 2990 died... 03:27:10.183051 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2990): Terminated: ok {rc=0} 03:27:10.271336 bus /sierra_3: Setting Powered False 03:27:11.370084 bus /sierra_3: Setting Powered False 03:27:12.488364 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 03:27:13.751784 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:27:13.757560 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:27:13.797056 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:27:13.824470 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:27:13.877904 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:27:13.917292 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:27:13.944686 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:27:14.494340 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 03:27:14.500001 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:14.511410 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 03:27:14.547465 tst handover.py: using LAC 38226 03:27:14.678587 tst handover.py: using RAC 231 03:27:14.809560 tst handover.py: using CellId 38226 03:27:14.940107 tst handover.py: using BVCI 38227 03:27:15.059427 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 03:27:15.094285 tst handover.py: using LAC 38227 03:27:15.228027 tst handover.py: using RAC 232 03:27:15.356171 tst handover.py: using CellId 38227 03:27:15.483927 tst handover.py: using BVCI 38228 03:27:15.603025 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:15.614296 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:15.625260 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:15.636214 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:15.647519 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:27:15.658833 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 03:27:15.776921 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 03:27:15.920326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:27:16.440514 run create_hlr_db(pid=2996): Launched 03:27:16.572214 bus /sierra_2: Setting Powered False 03:27:17.637104 run create_hlr_db(pid=2996): Terminated: ok {rc=0} 03:27:18.048464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2998): Launched 03:27:18.354930 run osmo-hlr_10.42.42.2(pid=2999): Launched 03:27:18.471551 run osmo-stp_10.42.42.5: Starting osmo-stp 03:27:18.977072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3001): Launched 03:27:19.282447 run osmo-stp_10.42.42.5(pid=3002): Launched 03:27:19.399832 run osmo-msc_10.42.42.6: Starting osmo-msc 03:27:19.926148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3004): Launched 03:27:20.231587 run osmo-msc_10.42.42.6(pid=3005): Launched 03:27:20.404015 run osmo-stp_10.42.42.5(pid=3002): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3002)] 03:27:20.534390 run osmo-stp_10.42.42.5(pid=3002): stdout: | (launched: 2022-12-14_03:27:19.226773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:20.663625 run osmo-stp_10.42.42.5(pid=3002): stderr: | [0;m[38;5;43m20221214032719396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032719396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032719397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032719397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032719398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032719398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032719398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:20.790586 run osmo-stp_10.42.42.5(pid=3002): stdout: | (launched: 2022-12-14_03:27:19.226773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:20.911785 run osmo-stp_10.42.42.5(pid=3002): stderr: | [0;m[38;5;43m20221214032719396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032719396 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032719397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032719397 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032719398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032719398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032719398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:21.056495 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3002): Process ended prematurely: osmo-stp_10.42.42.5(pid=3002) [trial-2398↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3002)] [trial-2398↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 03:27:21.064767 tst handover.py:18: Test FAILED (6.6 sec) 03:27:21.090884 run osmo-hlr_10.42.42.2(pid=2999): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2999)] 03:27:21.138409 run osmo-hlr_10.42.42.2(pid=2999): stdout: | (launched: 2022-12-14_03:27:18.298634) 03:27:21.187660 run osmo-hlr_10.42.42.2(pid=2999): stderr: | [0;m[1;31m20221214032718474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032718474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032718474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032718474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032718474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032718474 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032718486 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032718494 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032718495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032718495 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:27:21.256391 run osmo-msc_10.42.42.6(pid=3005): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3005)] 03:27:21.303603 run osmo-msc_10.42.42.6(pid=3005): stdout: | (launched: 2022-12-14_03:27:20.175351) 03:27:21.352513 run osmo-msc_10.42.42.6(pid=3005): stderr: | [0;m[38;5;43m20221214032720447 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032720447 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7e9c0d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032720447 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032720447 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032720448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032720448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032720450 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032720450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032720450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032720450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:27:21.401795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2998): Terminating (SIGTERM) 03:27:21.440898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3001): Terminating (SIGTERM) 03:27:21.480281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3004): Terminating (SIGTERM) 03:27:21.520047 --- ParallelTerminationStrategy: PID 2998 died... 03:27:21.539325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2998): Terminated: ok {rc=0} 03:27:21.582977 --- ParallelTerminationStrategy: PID 3001 died... 03:27:21.601662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3001): Terminated: ok {rc=0} 03:27:21.644899 --- ParallelTerminationStrategy: PID 3004 died... 03:27:21.663970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3004): Terminated: ok {rc=0} 03:27:21.746993 bus /sierra_3: Setting Powered False 03:27:22.846298 bus /sierra_3: Setting Powered False 03:27:23.963523 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 03:27:25.205365 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:27:25.211345 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:27:25.264025 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:27:25.291103 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:27:25.343965 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:27:25.396202 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:27:25.423305 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:27:25.972161 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 03:27:25.977707 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:25.988526 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:27:26.021497 tst handover.py: using LAC 38228 03:27:26.152718 tst handover.py: using RAC 233 03:27:26.274237 tst handover.py: using CellId 38228 03:27:26.396635 tst handover.py: using BVCI 38229 03:27:26.508018 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:27:26.570361 tst handover.py: using LAC 38229 03:27:26.694887 tst handover.py: using RAC 234 03:27:26.816228 tst handover.py: using CellId 38229 03:27:26.942554 tst handover.py: using BVCI 38230 03:27:27.054779 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:27.065574 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:27.076236 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:27.086818 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:27.097677 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:27:27.108385 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:27:27.228439 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:27:27.347964 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:27:27.828147 run create_hlr_db(pid=3010): Launched 03:27:27.955556 bus /sierra_2: Setting Powered False 03:27:29.020356 run create_hlr_db(pid=3010): Terminated: ok {rc=0} 03:27:29.447881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3012): Launched 03:27:29.775079 run osmo-hlr_10.42.42.2(pid=3013): Launched 03:27:29.902765 run osmo-stp_10.42.42.5: Starting osmo-stp 03:27:30.441958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3015): Launched 03:27:30.770136 run osmo-stp_10.42.42.5(pid=3016): Launched 03:27:30.908179 run osmo-msc_10.42.42.6: Starting osmo-msc 03:27:31.547288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3018): Launched 03:27:31.877760 run osmo-msc_10.42.42.6(pid=3019): Launched 03:27:32.326346 run osmo-stp_10.42.42.5(pid=3016): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3016)] 03:27:32.498995 run osmo-stp_10.42.42.5(pid=3016): stdout: | (launched: 2022-12-14_03:27:30.710239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:32.637909 run osmo-stp_10.42.42.5(pid=3016): stderr: | [0;m[38;5;43m20221214032731031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032731032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032731032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032731032 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032731033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032731033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032731033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:32.774330 run osmo-stp_10.42.42.5(pid=3016): stdout: | (launched: 2022-12-14_03:27:30.710239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:32.905424 run osmo-stp_10.42.42.5(pid=3016): stderr: | [0;m[38;5;43m20221214032731031 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032731032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032731032 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032731032 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032731033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032731033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032731033 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:33.061674 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3016): Process ended prematurely: osmo-stp_10.42.42.5(pid=3016) [trial-2398↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3016)] [trial-2398↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 03:27:33.070577 tst handover.py:18: Test FAILED (7.1 sec) 03:27:33.097856 run osmo-hlr_10.42.42.2(pid=3013): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3013)] 03:27:33.148449 run osmo-hlr_10.42.42.2(pid=3013): stdout: | (launched: 2022-12-14_03:27:29.715817) 03:27:33.200746 run osmo-hlr_10.42.42.2(pid=3013): stderr: | [0;m[1;31m20221214032729917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032729917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032729917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032729917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032729917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032729917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032729930 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032729940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032729941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032729941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:27:33.273171 run osmo-msc_10.42.42.6(pid=3019): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3019)] 03:27:33.322948 run osmo-msc_10.42.42.6(pid=3019): stdout: | (launched: 2022-12-14_03:27:31.819882) 03:27:33.375211 run osmo-msc_10.42.42.6(pid=3019): stderr: | [0;m[38;5;43m20221214032732167 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032732167 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdd452fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032732168 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032732168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032732168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032732168 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032732170 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032732170 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032732171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032732171 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:27:33.427213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3012): Terminating (SIGTERM) 03:27:33.469094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3015): Terminating (SIGTERM) 03:27:33.511460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3018): Terminating (SIGTERM) 03:27:33.553747 --- ParallelTerminationStrategy: PID 3012 died... 03:27:33.574105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3012): Terminated: ok {rc=0} 03:27:33.620561 --- ParallelTerminationStrategy: PID 3015 died... 03:27:33.640399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3015): Terminated: ok {rc=0} 03:27:33.686622 --- ParallelTerminationStrategy: PID 3018 died... 03:27:33.706446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3018): Terminated: ok {rc=0} 03:27:33.795940 bus /sierra_3: Setting Powered False 03:27:34.894348 bus /sierra_3: Setting Powered False 03:27:36.009475 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 03:27:37.265709 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:27:37.271507 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:27:37.323528 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:27:37.350536 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:27:37.403529 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:27:37.455015 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:27:37.482159 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:27:38.030873 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 03:27:38.036513 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:27:38.047720 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:27:38.082892 tst handover.py: using LAC 38230 03:27:38.215831 tst handover.py: using RAC 235 03:27:38.346024 tst handover.py: using CellId 38230 03:27:38.466208 tst handover.py: using BVCI 38231 03:27:38.579518 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:27:38.625894 tst handover.py: using LAC 38231 03:27:38.744389 tst handover.py: using RAC 236 03:27:38.862371 tst handover.py: using CellId 38231 03:27:38.982115 tst handover.py: using BVCI 38232 03:27:39.092530 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:27:39.103413 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:27:39.114150 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:27:39.124661 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:27:39.135368 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:27:39.145991 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:27:39.267708 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:27:39.385563 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:27:39.833986 run create_hlr_db(pid=3024): Launched 03:27:39.960921 bus /sierra_2: Setting Powered False 03:27:41.020331 run create_hlr_db(pid=3024): Terminated: ok {rc=0} 03:27:41.438833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3026): Launched 03:27:41.769361 run osmo-hlr_10.42.42.2(pid=3027): Launched 03:27:41.895653 run osmo-stp_10.42.42.5: Starting osmo-stp 03:27:42.435450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3029): Launched 03:27:42.766065 run osmo-stp_10.42.42.5(pid=3030): Launched 03:27:42.891619 run osmo-msc_10.42.42.6: Starting osmo-msc 03:27:43.459517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3032): Launched 03:27:43.788296 run osmo-msc_10.42.42.6(pid=3033): Launched 03:27:43.972758 run osmo-stp_10.42.42.5(pid=3030): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3030)] 03:27:44.111902 run osmo-stp_10.42.42.5(pid=3030): stdout: | (launched: 2022-12-14_03:27:42.705028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:44.251264 run osmo-stp_10.42.42.5(pid=3030): stderr: | [0;m[38;5;43m20221214032742900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032742900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032742900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032742900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032742901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032742901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032742901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:44.383565 run osmo-stp_10.42.42.5(pid=3030): stdout: | (launched: 2022-12-14_03:27:42.705028) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:44.505366 run osmo-stp_10.42.42.5(pid=3030): stderr: | [0;m[38;5;43m20221214032742900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032742900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032742900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032742900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032742901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032742901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032742901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:44.652547 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3030): Process ended prematurely: osmo-stp_10.42.42.5(pid=3030) [trial-2398↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3030)] [trial-2398↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 03:27:44.661239 tst handover.py:18: Test FAILED (6.6 sec) 03:27:44.688034 run osmo-hlr_10.42.42.2(pid=3027): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3027)] 03:27:44.736225 run osmo-hlr_10.42.42.2(pid=3027): stdout: | (launched: 2022-12-14_03:27:41.709645) 03:27:44.785889 run osmo-hlr_10.42.42.2(pid=3027): stderr: | [0;m[1;31m20221214032741909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032741909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032741909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032741909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032741909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032741909 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032741921 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032741930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032741930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032741930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:27:44.855388 run osmo-msc_10.42.42.6(pid=3033): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3033)] 03:27:44.902976 run osmo-msc_10.42.42.6(pid=3033): stdout: | (launched: 2022-12-14_03:27:43.728388) 03:27:44.952343 run osmo-msc_10.42.42.6(pid=3033): stderr: | [0;m[38;5;43m20221214032744051 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032744052 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5a86b25c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032744052 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032744052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032744052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032744052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032744054 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032744054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032744054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032744054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:27:45.002110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3026): Terminating (SIGTERM) 03:27:45.042082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3029): Terminating (SIGTERM) 03:27:45.082168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3032): Terminating (SIGTERM) 03:27:45.122320 --- ParallelTerminationStrategy: PID 3026 died... 03:27:45.141589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3026): Terminated: ok {rc=0} 03:27:45.185758 --- ParallelTerminationStrategy: PID 3029 died... 03:27:45.204548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3029): Terminated: ok {rc=0} 03:27:45.248367 --- ParallelTerminationStrategy: PID 3032 died... 03:27:45.267247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3032): Terminated: ok {rc=0} 03:27:45.353629 bus /sierra_3: Setting Powered False 03:27:46.460555 bus /sierra_3: Setting Powered False 03:27:47.590050 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 03:27:48.842812 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:27:48.848101 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 03:27:48.896505 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 03:27:48.922651 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 03:27:48.973582 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 03:27:49.022207 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 03:27:49.048462 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 03:27:49.597910 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 03:27:49.603214 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:49.614297 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:27:49.647008 tst handover.py: using LAC 38232 03:27:49.768001 tst handover.py: using RAC 237 03:27:49.889277 tst handover.py: using CellId 38232 03:27:50.008228 tst handover.py: using BVCI 38233 03:27:50.118741 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 03:27:50.166914 tst handover.py: using LAC 38233 03:27:50.296263 tst handover.py: using RAC 238 03:27:50.425149 tst handover.py: using CellId 38233 03:27:50.554814 tst handover.py: using BVCI 38234 03:27:50.676482 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:50.687747 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:50.698829 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:50.709903 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:50.721334 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 03:27:50.732672 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:27:50.850447 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 03:27:50.972652 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:27:51.453764 run create_hlr_db(pid=3038): Launched 03:27:51.580272 bus /sierra_2: Setting Powered False 03:27:52.645239 run create_hlr_db(pid=3038): Terminated: ok {rc=0} 03:27:53.073695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3040): Launched 03:27:53.402573 run osmo-hlr_10.42.42.2(pid=3041): Launched 03:27:53.529151 run osmo-stp_10.42.42.5: Starting osmo-stp 03:27:54.067700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3043): Launched 03:27:54.396095 run osmo-stp_10.42.42.5(pid=3044): Launched 03:27:54.522142 run osmo-msc_10.42.42.6: Starting osmo-msc 03:27:55.091095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3046): Launched 03:27:55.422431 run osmo-msc_10.42.42.6(pid=3047): Launched 03:27:55.606420 run osmo-stp_10.42.42.5(pid=3044): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3044)] 03:27:55.745649 run osmo-stp_10.42.42.5(pid=3044): stdout: | (launched: 2022-12-14_03:27:54.336293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:55.885494 run osmo-stp_10.42.42.5(pid=3044): stderr: | [0;m[38;5;43m20221214032754530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032754530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032754530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032754531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032754531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032754531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032754531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:56.024216 run osmo-stp_10.42.42.5(pid=3044): stdout: | (launched: 2022-12-14_03:27:54.336293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:27:56.155214 run osmo-stp_10.42.42.5(pid=3044): stderr: | [0;m[38;5;43m20221214032754530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032754530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032754530 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032754531 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032754531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032754531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032754531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:27:56.311716 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3044): Process ended prematurely: osmo-stp_10.42.42.5(pid=3044) [trial-2398↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3044)] [trial-2398↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 03:27:56.320854 tst handover.py:18: Test FAILED (6.7 sec) 03:27:56.348316 run osmo-hlr_10.42.42.2(pid=3041): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3041)] 03:27:56.400072 run osmo-hlr_10.42.42.2(pid=3041): stdout: | (launched: 2022-12-14_03:27:53.342922) 03:27:56.452583 run osmo-hlr_10.42.42.2(pid=3041): stderr: | [0;m[1;31m20221214032753542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032753542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032753542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032753542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032753542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032753542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032753556 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032753566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032753566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032753566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:27:56.525673 run osmo-msc_10.42.42.6(pid=3047): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3047)] 03:27:56.575366 run osmo-msc_10.42.42.6(pid=3047): stdout: | (launched: 2022-12-14_03:27:55.362236) 03:27:56.627230 run osmo-msc_10.42.42.6(pid=3047): stderr: | [0;m[38;5;43m20221214032755683 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032755684 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1d59266c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032755684 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032755684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032755684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032755684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032755687 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032755688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032755688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032755688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:27:56.679672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3040): Terminating (SIGTERM) 03:27:56.721743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3043): Terminating (SIGTERM) 03:27:56.764483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3046): Terminating (SIGTERM) 03:27:56.806836 --- ParallelTerminationStrategy: PID 3040 died... 03:27:56.827493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3040): Terminated: ok {rc=0} 03:27:56.874380 --- ParallelTerminationStrategy: PID 3043 died... 03:27:56.894563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3043): Terminated: ok {rc=0} 03:27:56.940940 --- ParallelTerminationStrategy: PID 3046 died... 03:27:56.961011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3046): Terminated: ok {rc=0} 03:27:57.049007 bus /sierra_3: Setting Powered False 03:27:58.147524 bus /sierra_3: Setting Powered False 03:27:59.264659 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 03:28:00.516744 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:28:00.522015 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 03:28:00.566643 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:28:00.592789 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:28:00.643217 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 03:28:00.687287 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:28:00.713360 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:28:01.273825 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 03:28:01.281444 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:01.294004 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:28:01.331102 tst handover.py: using LAC 38234 03:28:01.469418 tst handover.py: using RAC 239 03:28:01.605301 tst handover.py: using CellId 38234 03:28:01.726765 tst handover.py: using BVCI 38235 03:28:01.862793 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:28:01.908409 tst handover.py: using LAC 38235 03:28:02.081180 tst handover.py: using RAC 240 03:28:02.224223 tst handover.py: using CellId 38235 03:28:02.355637 tst handover.py: using BVCI 38236 03:28:02.476181 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:02.487832 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:02.499279 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:02.510886 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:02.523402 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:02.535712 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:28:02.656668 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:28:02.777684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:28:03.259185 run create_hlr_db(pid=3052): Launched 03:28:03.385096 bus /sierra_2: Setting Powered False 03:28:04.450218 run create_hlr_db(pid=3052): Terminated: ok {rc=0} 03:28:04.864668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3054): Launched 03:28:05.173109 run osmo-hlr_10.42.42.2(pid=3055): Launched 03:28:05.291853 run osmo-stp_10.42.42.5: Starting osmo-stp 03:28:05.798132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3057): Launched 03:28:06.103572 run osmo-stp_10.42.42.5(pid=3058): Launched 03:28:06.220449 run osmo-msc_10.42.42.6: Starting osmo-msc 03:28:06.746853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3060): Launched 03:28:07.056243 run osmo-msc_10.42.42.6(pid=3061): Launched 03:28:07.227896 run osmo-stp_10.42.42.5(pid=3058): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3058)] 03:28:07.357345 run osmo-stp_10.42.42.5(pid=3058): stdout: | (launched: 2022-12-14_03:28:06.047596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:07.485938 run osmo-stp_10.42.42.5(pid=3058): stderr: | [0;m[38;5;43m20221214032806219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032806219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032806219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032806219 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032806222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032806222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032806222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:07.613098 run osmo-stp_10.42.42.5(pid=3058): stdout: | (launched: 2022-12-14_03:28:06.047596) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:07.734261 run osmo-stp_10.42.42.5(pid=3058): stderr: | [0;m[38;5;43m20221214032806219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032806219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032806219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032806219 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032806222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032806222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032806222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:07.880015 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3058): Process ended prematurely: osmo-stp_10.42.42.5(pid=3058) [trial-2398↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3058)] [trial-2398↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 03:28:07.888348 tst handover.py:18: Test FAILED (6.6 sec) 03:28:07.914400 run osmo-hlr_10.42.42.2(pid=3055): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3055)] 03:28:07.962501 run osmo-hlr_10.42.42.2(pid=3055): stdout: | (launched: 2022-12-14_03:28:05.116662) 03:28:08.012227 run osmo-hlr_10.42.42.2(pid=3055): stderr: | [0;m[1;31m20221214032805294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032805294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032805294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032805294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032805294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032805294 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032805307 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032805315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032805315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032805315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:28:08.080862 run osmo-msc_10.42.42.6(pid=3061): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3061)] 03:28:08.128133 run osmo-msc_10.42.42.6(pid=3061): stdout: | (launched: 2022-12-14_03:28:07.000068) 03:28:08.177155 run osmo-msc_10.42.42.6(pid=3061): stderr: | [0;m[38;5;43m20221214032807270 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032807270 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2f2b56bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032807270 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032807270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032807270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032807270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032807272 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032807272 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032807273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032807273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:28:08.226297 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3054): Terminating (SIGTERM) 03:28:08.265820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3057): Terminating (SIGTERM) 03:28:08.305458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3060): Terminating (SIGTERM) 03:28:08.345232 --- ParallelTerminationStrategy: PID 3054 died... 03:28:08.364026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3054): Terminated: ok {rc=0} 03:28:08.407757 --- ParallelTerminationStrategy: PID 3057 died... 03:28:08.426298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3057): Terminated: ok {rc=0} 03:28:08.469818 --- ParallelTerminationStrategy: PID 3060 died... 03:28:08.488286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3060): Terminated: ok {rc=0} 03:28:08.571469 bus /sierra_3: Setting Powered False 03:28:09.669228 bus /sierra_3: Setting Powered False 03:28:10.785576 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 03:28:12.042222 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:28:12.048211 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 03:28:12.099259 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 03:28:12.126232 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 03:28:12.179999 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 03:28:12.232287 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 03:28:12.259619 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 03:28:12.805725 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 03:28:12.811971 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:12.823391 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:28:12.855907 tst handover.py: using LAC 38236 03:28:12.979597 tst handover.py: using RAC 241 03:28:13.099577 tst handover.py: using CellId 38236 03:28:13.218820 tst handover.py: using BVCI 38237 03:28:13.330926 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:28:13.378447 tst handover.py: using LAC 38237 03:28:13.499756 tst handover.py: using RAC 242 03:28:13.618433 tst handover.py: using CellId 38237 03:28:13.739760 tst handover.py: using BVCI 38238 03:28:13.853095 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:13.863960 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:13.874759 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:13.885607 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:13.897013 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:28:13.908405 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:28:14.029352 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:28:14.146657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:28:14.595106 run create_hlr_db(pid=3066): Launched 03:28:14.719983 bus /sierra_2: Setting Powered False 03:28:15.781432 run create_hlr_db(pid=3066): Terminated: ok {rc=0} 03:28:16.229657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3068): Launched 03:28:16.579185 run osmo-hlr_10.42.42.2(pid=3069): Launched 03:28:16.837281 run osmo-stp_10.42.42.5: Starting osmo-stp 03:28:17.462516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3071): Launched 03:28:17.792549 run osmo-stp_10.42.42.5(pid=3072): Launched 03:28:17.918264 run osmo-msc_10.42.42.6: Starting osmo-msc 03:28:18.481394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3074): Launched 03:28:18.809721 run osmo-msc_10.42.42.6(pid=3075): Launched 03:28:18.995372 run osmo-stp_10.42.42.5(pid=3072): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3072)] 03:28:19.134830 run osmo-stp_10.42.42.5(pid=3072): stdout: | (launched: 2022-12-14_03:28:17.732860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:19.275303 run osmo-stp_10.42.42.5(pid=3072): stderr: | [0;m[38;5;43m20221214032817927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032817927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032817927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032817928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032817928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032817928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032817929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:19.412660 run osmo-stp_10.42.42.5(pid=3072): stdout: | (launched: 2022-12-14_03:28:17.732860) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:19.543221 run osmo-stp_10.42.42.5(pid=3072): stderr: | [0;m[38;5;43m20221214032817927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032817927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032817927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032817928 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032817928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032817928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032817929 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:19.699597 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3072): Process ended prematurely: osmo-stp_10.42.42.5(pid=3072) [trial-2398↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3072)] [trial-2398↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 03:28:19.708435 tst handover.py:18: Test FAILED (6.9 sec) 03:28:19.735712 run osmo-hlr_10.42.42.2(pid=3069): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3069)] 03:28:19.786304 run osmo-hlr_10.42.42.2(pid=3069): stdout: | (launched: 2022-12-14_03:28:16.517839) 03:28:19.838737 run osmo-hlr_10.42.42.2(pid=3069): stderr: | [0;m[1;31m20221214032816765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032816765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032816765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032816765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032816765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032816765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032816783 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032816795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032816796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032816796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:28:19.911438 run osmo-msc_10.42.42.6(pid=3075): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3075)] 03:28:19.961280 run osmo-msc_10.42.42.6(pid=3075): stdout: | (launched: 2022-12-14_03:28:18.750172) 03:28:20.013417 run osmo-msc_10.42.42.6(pid=3075): stderr: | [0;m[38;5;43m20221214032819070 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032819070 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6eef979c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032819070 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032819070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032819070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032819071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032819072 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032819073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032819073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032819073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:28:20.065960 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3068): Terminating (SIGTERM) 03:28:20.107445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3071): Terminating (SIGTERM) 03:28:20.149919 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3074): Terminating (SIGTERM) 03:28:20.192606 --- ParallelTerminationStrategy: PID 3068 died... 03:28:20.213005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3068): Terminated: ok {rc=0} 03:28:20.259500 --- ParallelTerminationStrategy: PID 3071 died... 03:28:20.279542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3071): Terminated: ok {rc=0} 03:28:20.326176 --- ParallelTerminationStrategy: PID 3074 died... 03:28:20.346343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3074): Terminated: ok {rc=0} 03:28:20.434004 bus /sierra_3: Setting Powered False 03:28:21.532422 bus /sierra_3: Setting Powered False 03:28:22.647364 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 03:28:23.913349 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:28:23.919062 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:28:23.957765 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:28:23.985202 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:28:24.039220 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:28:24.078097 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:28:24.105796 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:28:24.654495 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 03:28:24.660300 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:24.672806 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 03:28:24.705463 tst handover.py: using LAC 38238 03:28:24.827423 tst handover.py: using RAC 243 03:28:24.947992 tst handover.py: using CellId 38238 03:28:25.070374 tst handover.py: using BVCI 38239 03:28:25.183413 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 03:28:25.217019 tst handover.py: using LAC 38239 03:28:25.337516 tst handover.py: using RAC 244 03:28:25.458751 tst handover.py: using CellId 38239 03:28:25.579040 tst handover.py: using BVCI 38240 03:28:25.690952 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:25.701970 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:25.712786 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:25.723600 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:25.734640 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:28:25.745546 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 03:28:25.866745 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 03:28:25.984021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:28:26.434673 run create_hlr_db(pid=3080): Launched 03:28:26.562427 bus /sierra_2: Setting Powered False 03:28:27.623561 run create_hlr_db(pid=3080): Terminated: ok {rc=0} 03:28:28.044716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3082): Launched 03:28:28.374864 run osmo-hlr_10.42.42.2(pid=3083): Launched 03:28:28.501308 run osmo-stp_10.42.42.5: Starting osmo-stp 03:28:29.038738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3085): Launched 03:28:29.368378 run osmo-stp_10.42.42.5(pid=3086): Launched 03:28:29.495225 run osmo-msc_10.42.42.6: Starting osmo-msc 03:28:30.061271 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3088): Launched 03:28:30.389593 run osmo-msc_10.42.42.6(pid=3089): Launched 03:28:30.573951 run osmo-stp_10.42.42.5(pid=3086): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3086)] 03:28:30.712262 run osmo-stp_10.42.42.5(pid=3086): stdout: | (launched: 2022-12-14_03:28:29.308519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:30.851798 run osmo-stp_10.42.42.5(pid=3086): stderr: | [0;m[38;5;43m20221214032829500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032829500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032829500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032829501 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032829503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032829503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032829503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:31.004691 run osmo-stp_10.42.42.5(pid=3086): stdout: | (launched: 2022-12-14_03:28:29.308519) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:31.154302 run osmo-stp_10.42.42.5(pid=3086): stderr: | [0;m[38;5;43m20221214032829500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032829500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032829500 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032829501 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032829503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032829503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032829503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:31.312656 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3086): Process ended prematurely: osmo-stp_10.42.42.5(pid=3086) [trial-2398↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3086)] [trial-2398↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 03:28:31.322228 tst handover.py:18: Test FAILED (6.7 sec) 03:28:31.350255 run osmo-hlr_10.42.42.2(pid=3083): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3083)] 03:28:31.401671 run osmo-hlr_10.42.42.2(pid=3083): stdout: | (launched: 2022-12-14_03:28:28.315173) 03:28:31.454491 run osmo-hlr_10.42.42.2(pid=3083): stderr: | [0;m[1;31m20221214032828516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032828516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032828516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032828516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032828516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032828516 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032828529 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032828537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032828537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032828537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:28:31.527435 run osmo-msc_10.42.42.6(pid=3089): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3089)] 03:28:31.578209 run osmo-msc_10.42.42.6(pid=3089): stdout: | (launched: 2022-12-14_03:28:30.329916) 03:28:31.630809 run osmo-msc_10.42.42.6(pid=3089): stderr: | [0;m[38;5;43m20221214032830652 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032830652 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff130317c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032830653 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032830653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032830653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032830653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032830655 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032830655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032830655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032830655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:28:31.683600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3082): Terminating (SIGTERM) 03:28:31.726065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3085): Terminating (SIGTERM) 03:28:31.768880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3088): Terminating (SIGTERM) 03:28:31.813134 --- ParallelTerminationStrategy: PID 3082 died... 03:28:31.833675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3082): Terminated: ok {rc=0} 03:28:31.880283 --- ParallelTerminationStrategy: PID 3085 died... 03:28:31.900834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3085): Terminated: ok {rc=0} 03:28:31.947657 --- ParallelTerminationStrategy: PID 3088 died... 03:28:31.967882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3088): Terminated: ok {rc=0} 03:28:32.063098 bus /sierra_3: Setting Powered False 03:28:33.161447 bus /sierra_3: Setting Powered False 03:28:34.277154 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 03:28:35.518920 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:28:35.524541 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:28:35.575107 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:28:35.602230 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:28:35.655038 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:28:35.705525 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:28:35.732473 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:28:36.279409 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 03:28:36.285702 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:28:36.296931 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:28:36.330251 tst handover.py: using LAC 38240 03:28:36.451360 tst handover.py: using RAC 245 03:28:36.581985 tst handover.py: using CellId 38240 03:28:36.711961 tst handover.py: using BVCI 38241 03:28:36.831519 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:28:36.881111 tst handover.py: using LAC 38241 03:28:37.001116 tst handover.py: using RAC 246 03:28:37.124061 tst handover.py: using CellId 38241 03:28:37.252981 tst handover.py: using BVCI 38242 03:28:37.364411 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:28:37.375449 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:28:37.386055 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:28:37.396498 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:28:37.407125 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:28:37.417681 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:28:37.533201 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:28:37.651662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:28:38.099662 run create_hlr_db(pid=3095): Launched 03:28:38.223741 bus /sierra_2: Setting Powered False 03:28:39.284110 run create_hlr_db(pid=3095): Terminated: ok {rc=0} 03:28:39.703319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3097): Launched 03:28:40.033650 run osmo-hlr_10.42.42.2(pid=3098): Launched 03:28:40.159730 run osmo-stp_10.42.42.5: Starting osmo-stp 03:28:40.699910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3100): Launched 03:28:41.028427 run osmo-stp_10.42.42.5(pid=3101): Launched 03:28:41.154217 run osmo-msc_10.42.42.6: Starting osmo-msc 03:28:41.718940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3103): Launched 03:28:42.049555 run osmo-msc_10.42.42.6(pid=3104): Launched 03:28:42.234740 run osmo-stp_10.42.42.5(pid=3101): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3101)] 03:28:42.374129 run osmo-stp_10.42.42.5(pid=3101): stdout: | (launched: 2022-12-14_03:28:40.968713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:42.514239 run osmo-stp_10.42.42.5(pid=3101): stderr: | [0;m[38;5;43m20221214032841163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032841163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032841164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032841164 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032841165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032841165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032841165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:42.652247 run osmo-stp_10.42.42.5(pid=3101): stdout: | (launched: 2022-12-14_03:28:40.968713) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:42.783597 run osmo-stp_10.42.42.5(pid=3101): stderr: | [0;m[38;5;43m20221214032841163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032841163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032841164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032841164 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032841165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032841165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032841165 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:42.940586 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3101): Process ended prematurely: osmo-stp_10.42.42.5(pid=3101) [trial-2398↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3101)] [trial-2398↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 03:28:42.949984 tst handover.py:18: Test FAILED (6.7 sec) 03:28:42.977406 run osmo-hlr_10.42.42.2(pid=3098): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3098)] 03:28:43.028197 run osmo-hlr_10.42.42.2(pid=3098): stdout: | (launched: 2022-12-14_03:28:39.973525) 03:28:43.081539 run osmo-hlr_10.42.42.2(pid=3098): stderr: | [0;m[1;31m20221214032840175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032840175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032840175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032840175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032840175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032840175 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032840191 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032840200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032840201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032840201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:28:43.154629 run osmo-msc_10.42.42.6(pid=3104): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3104)] 03:28:43.204425 run osmo-msc_10.42.42.6(pid=3104): stdout: | (launched: 2022-12-14_03:28:41.989823) 03:28:43.256871 run osmo-msc_10.42.42.6(pid=3104): stderr: | [0;m[38;5;43m20221214032842311 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032842311 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2442aa7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032842311 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032842311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032842311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032842311 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032842313 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032842314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032842314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032842314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:28:43.309796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3097): Terminating (SIGTERM) 03:28:43.351508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3100): Terminating (SIGTERM) 03:28:43.394316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3103): Terminating (SIGTERM) 03:28:43.436566 --- ParallelTerminationStrategy: PID 3097 died... 03:28:43.457037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3097): Terminated: ok {rc=0} 03:28:43.503311 --- ParallelTerminationStrategy: PID 3100 died... 03:28:43.523239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3100): Terminated: ok {rc=0} 03:28:43.569507 --- ParallelTerminationStrategy: PID 3103 died... 03:28:43.589310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3103): Terminated: ok {rc=0} 03:28:43.676809 bus /sierra_3: Setting Powered False 03:28:44.775891 bus /sierra_3: Setting Powered False 03:28:45.922950 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 03:28:47.194077 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:28:47.199669 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:28:47.251475 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:28:47.279722 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:28:47.333650 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:28:47.383679 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:28:47.410706 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:28:47.961210 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 03:28:47.966762 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:47.978338 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:28:48.012559 tst handover.py: using LAC 38242 03:28:48.142312 tst handover.py: using RAC 247 03:28:48.273160 tst handover.py: using CellId 38242 03:28:48.402986 tst handover.py: using BVCI 38243 03:28:48.524204 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:28:48.572220 tst handover.py: using LAC 38243 03:28:48.702804 tst handover.py: using RAC 248 03:28:48.832887 tst handover.py: using CellId 38243 03:28:48.963749 tst handover.py: using BVCI 38244 03:28:49.075312 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:49.086227 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:49.096747 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:49.107783 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:49.118625 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:28:49.129350 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:28:49.244228 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:28:49.368740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:28:49.817669 run create_hlr_db(pid=3109): Launched 03:28:49.942317 bus /sierra_2: Setting Powered False 03:28:51.004321 run create_hlr_db(pid=3109): Terminated: ok {rc=0} 03:28:51.424052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3111): Launched 03:28:51.754036 run osmo-hlr_10.42.42.2(pid=3112): Launched 03:28:51.882266 run osmo-stp_10.42.42.5: Starting osmo-stp 03:28:52.420198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3114): Launched 03:28:52.748459 run osmo-stp_10.42.42.5(pid=3115): Launched 03:28:52.874542 run osmo-msc_10.42.42.6: Starting osmo-msc 03:28:53.447610 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3117): Launched 03:28:53.777139 run osmo-msc_10.42.42.6(pid=3118): Launched 03:28:53.961124 run osmo-stp_10.42.42.5(pid=3115): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3115)] 03:28:54.100606 run osmo-stp_10.42.42.5(pid=3115): stdout: | (launched: 2022-12-14_03:28:52.688803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:54.239815 run osmo-stp_10.42.42.5(pid=3115): stderr: | [0;m[38;5;43m20221214032852884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032852884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032852884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032852885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032852885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032852885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032852885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:54.378518 run osmo-stp_10.42.42.5(pid=3115): stdout: | (launched: 2022-12-14_03:28:52.688803) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:28:54.509937 run osmo-stp_10.42.42.5(pid=3115): stderr: | [0;m[38;5;43m20221214032852884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032852884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032852884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032852885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032852885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032852885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032852885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:28:54.667213 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3115): Process ended prematurely: osmo-stp_10.42.42.5(pid=3115) [trial-2398↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3115)] [trial-2398↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 03:28:54.676283 tst handover.py:18: Test FAILED (6.7 sec) 03:28:54.703870 run osmo-hlr_10.42.42.2(pid=3112): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3112)] 03:28:54.754973 run osmo-hlr_10.42.42.2(pid=3112): stdout: | (launched: 2022-12-14_03:28:51.694267) 03:28:54.807969 run osmo-hlr_10.42.42.2(pid=3112): stderr: | [0;m[1;31m20221214032851896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032851896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032851896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032851896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032851896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032851896 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032851909 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032851917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032851917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032851917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:28:54.881217 run osmo-msc_10.42.42.6(pid=3118): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3118)] 03:28:54.931506 run osmo-msc_10.42.42.6(pid=3118): stdout: | (launched: 2022-12-14_03:28:53.716695) 03:28:54.984030 run osmo-msc_10.42.42.6(pid=3118): stderr: | [0;m[38;5;43m20221214032854041 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032854042 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f757ea92c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032854042 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032854042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032854042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032854042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032854044 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032854044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032854044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032854044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:28:55.036439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3111): Terminating (SIGTERM) 03:28:55.078580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3114): Terminating (SIGTERM) 03:28:55.120880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3117): Terminating (SIGTERM) 03:28:55.163738 --- ParallelTerminationStrategy: PID 3111 died... 03:28:55.184411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3111): Terminated: ok {rc=0} 03:28:55.231334 --- ParallelTerminationStrategy: PID 3114 died... 03:28:55.251405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3114): Terminated: ok {rc=0} 03:28:55.297724 --- ParallelTerminationStrategy: PID 3117 died... 03:28:55.317880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3117): Terminated: ok {rc=0} 03:28:55.406698 bus /sierra_3: Setting Powered False 03:28:56.504730 bus /sierra_3: Setting Powered False 03:28:57.622787 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 03:28:58.874472 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:28:58.879579 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 03:28:58.937477 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 03:28:58.963648 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 03:28:59.015438 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 03:28:59.075930 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 03:28:59.102866 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 03:28:59.649612 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 03:28:59.655668 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:28:59.667264 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:28:59.720073 tst handover.py: using LAC 38244 03:28:59.839195 tst handover.py: using RAC 249 03:28:59.959019 tst handover.py: using CellId 38244 03:29:00.077515 tst handover.py: using BVCI 38245 03:29:00.190544 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 03:29:00.233774 tst handover.py: using LAC 38245 03:29:00.353823 tst handover.py: using RAC 250 03:29:00.472455 tst handover.py: using CellId 38245 03:29:00.590413 tst handover.py: using BVCI 38246 03:29:00.702087 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:29:00.713142 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:29:00.723964 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:29:00.734797 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:29:00.745597 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 03:29:00.756297 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:29:00.878818 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 03:29:01.007796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:29:01.511124 run create_hlr_db(pid=3123): Launched 03:29:01.680028 bus /sierra_2: Setting Powered False 03:29:02.744399 run create_hlr_db(pid=3123): Terminated: ok {rc=0} 03:29:03.155504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3125): Launched 03:29:03.463143 run osmo-hlr_10.42.42.2(pid=3126): Launched 03:29:03.579823 run osmo-stp_10.42.42.5: Starting osmo-stp 03:29:04.094609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3128): Launched 03:29:04.400859 run osmo-stp_10.42.42.5(pid=3129): Launched 03:29:04.518153 run osmo-msc_10.42.42.6: Starting osmo-msc 03:29:05.043837 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3131): Launched 03:29:05.351010 run osmo-msc_10.42.42.6(pid=3132): Launched 03:29:05.522021 run osmo-stp_10.42.42.5(pid=3129): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3129)] 03:29:05.651570 run osmo-stp_10.42.42.5(pid=3129): stdout: | (launched: 2022-12-14_03:29:04.344788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:05.780397 run osmo-stp_10.42.42.5(pid=3129): stderr: | [0;m[38;5;43m20221214032904517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032904517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032904518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032904518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032904518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032904519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032904519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:05.907684 run osmo-stp_10.42.42.5(pid=3129): stdout: | (launched: 2022-12-14_03:29:04.344788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:06.028810 run osmo-stp_10.42.42.5(pid=3129): stderr: | [0;m[38;5;43m20221214032904517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032904517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032904518 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032904518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032904518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032904519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032904519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:06.174178 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3129): Process ended prematurely: osmo-stp_10.42.42.5(pid=3129) [trial-2398↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3129)] [trial-2398↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 03:29:06.182686 tst handover.py:18: Test FAILED (6.5 sec) 03:29:06.208553 run osmo-hlr_10.42.42.2(pid=3126): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3126)] 03:29:06.255927 run osmo-hlr_10.42.42.2(pid=3126): stdout: | (launched: 2022-12-14_03:29:03.406384) 03:29:06.304909 run osmo-hlr_10.42.42.2(pid=3126): stderr: | [0;m[1;31m20221214032903583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032903583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032903583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032903583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032903583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032903583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032903596 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032903606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032903606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032903606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:29:06.373392 run osmo-msc_10.42.42.6(pid=3132): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3132)] 03:29:06.420304 run osmo-msc_10.42.42.6(pid=3132): stdout: | (launched: 2022-12-14_03:29:05.294494) 03:29:06.469169 run osmo-msc_10.42.42.6(pid=3132): stderr: | [0;m[38;5;43m20221214032905567 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032905567 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9b80589c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032905567 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032905567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032905567 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032905568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032905569 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032905570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032905570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032905570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:29:06.518195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3125): Terminating (SIGTERM) 03:29:06.557554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3128): Terminating (SIGTERM) 03:29:06.597016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3131): Terminating (SIGTERM) 03:29:06.636525 --- ParallelTerminationStrategy: PID 3125 died... 03:29:06.655690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3125): Terminated: ok {rc=0} 03:29:06.699499 --- ParallelTerminationStrategy: PID 3128 died... 03:29:06.718155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3128): Terminated: ok {rc=0} 03:29:06.761523 --- ParallelTerminationStrategy: PID 3131 died... 03:29:06.780162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3131): Terminated: ok {rc=0} 03:29:06.865026 bus /sierra_3: Setting Powered False 03:29:07.963864 bus /sierra_3: Setting Powered False 03:29:09.077073 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 03:29:10.342440 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:29:10.347695 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 03:29:10.411188 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 03:29:10.437211 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 03:29:10.488155 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 03:29:10.552140 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 03:29:10.578447 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 03:29:11.133403 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 03:29:11.139817 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:11.151733 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:29:11.202797 tst handover.py: using LAC 38246 03:29:11.331461 tst handover.py: using RAC 251 03:29:11.460792 tst handover.py: using CellId 38246 03:29:11.591665 tst handover.py: using BVCI 38247 03:29:11.713613 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:29:11.762621 tst handover.py: using LAC 38247 03:29:11.889318 tst handover.py: using RAC 252 03:29:12.025305 tst handover.py: using CellId 38247 03:29:12.146212 tst handover.py: using BVCI 38248 03:29:12.256447 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:12.267454 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:12.278233 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:12.288898 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:12.299569 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:12.310339 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:29:12.431160 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:29:12.553200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:29:13.033704 run create_hlr_db(pid=3137): Launched 03:29:13.161090 bus /sierra_2: Setting Powered False 03:29:14.225465 run create_hlr_db(pid=3137): Terminated: ok {rc=0} 03:29:14.636871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3139): Launched 03:29:14.943277 run osmo-hlr_10.42.42.2(pid=3140): Launched 03:29:15.059451 run osmo-stp_10.42.42.5: Starting osmo-stp 03:29:15.563098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3142): Launched 03:29:15.897698 run osmo-stp_10.42.42.5(pid=3143): Launched 03:29:16.090232 run osmo-msc_10.42.42.6: Starting osmo-msc 03:29:16.757650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3145): Launched 03:29:17.079444 run osmo-msc_10.42.42.6(pid=3146): Launched 03:29:17.363946 run osmo-stp_10.42.42.5(pid=3143): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3143)] 03:29:17.493161 run osmo-stp_10.42.42.5(pid=3143): stdout: | (launched: 2022-12-14_03:29:15.813366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:17.620451 run osmo-stp_10.42.42.5(pid=3143): stderr: | [0;m[38;5;43m20221214032916159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032916159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032916159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032916160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032916160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032916160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032916160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:17.748030 run osmo-stp_10.42.42.5(pid=3143): stdout: | (launched: 2022-12-14_03:29:15.813366) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:17.869671 run osmo-stp_10.42.42.5(pid=3143): stderr: | [0;m[38;5;43m20221214032916159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032916159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032916159 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032916160 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032916160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032916160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032916160 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:18.015340 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3143): Process ended prematurely: osmo-stp_10.42.42.5(pid=3143) [trial-2398↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3143)] [trial-2398↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 03:29:18.023619 tst handover.py:18: Test FAILED (6.9 sec) 03:29:18.049709 run osmo-hlr_10.42.42.2(pid=3140): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3140)] 03:29:18.097441 run osmo-hlr_10.42.42.2(pid=3140): stdout: | (launched: 2022-12-14_03:29:14.887513) 03:29:18.146991 run osmo-hlr_10.42.42.2(pid=3140): stderr: | [0;m[1;31m20221214032915062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032915062 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032915063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032915063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032915063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032915063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032915075 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032915084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032915084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032915084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:29:18.216333 run osmo-msc_10.42.42.6(pid=3146): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3146)] 03:29:18.263922 run osmo-msc_10.42.42.6(pid=3146): stdout: | (launched: 2022-12-14_03:29:17.020748) 03:29:18.313402 run osmo-msc_10.42.42.6(pid=3146): stderr: | [0;m[38;5;43m20221214032917373 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032917373 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa7b1692c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032917373 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032917373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032917373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032917373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032917377 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032917377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032917377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032917377 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:29:18.363105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3139): Terminating (SIGTERM) 03:29:18.403120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3142): Terminating (SIGTERM) 03:29:18.442985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3145): Terminating (SIGTERM) 03:29:18.483082 --- ParallelTerminationStrategy: PID 3139 died... 03:29:18.502158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3139): Terminated: ok {rc=0} 03:29:18.546209 --- ParallelTerminationStrategy: PID 3142 died... 03:29:18.564718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3142): Terminated: ok {rc=0} 03:29:18.608709 --- ParallelTerminationStrategy: PID 3145 died... 03:29:18.627404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3145): Terminated: ok {rc=0} 03:29:18.713154 bus /sierra_3: Setting Powered False 03:29:19.810756 bus /sierra_3: Setting Powered False 03:29:20.925863 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 03:29:22.195793 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:29:22.201047 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:29:22.251043 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:29:22.277581 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:29:22.328226 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:29:22.380759 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:29:22.408078 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:29:22.954969 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 03:29:22.960094 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:22.970906 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 03:29:23.017054 tst handover.py: using LAC 38248 03:29:23.135791 tst handover.py: using RAC 253 03:29:23.253884 tst handover.py: using CellId 38248 03:29:23.372448 tst handover.py: using BVCI 38249 03:29:23.483135 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 03:29:23.516609 tst handover.py: using LAC 38249 03:29:23.634880 tst handover.py: using RAC 254 03:29:23.754856 tst handover.py: using CellId 38249 03:29:23.873481 tst handover.py: using BVCI 38250 03:29:23.986478 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:23.997233 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:24.007747 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:24.018420 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:24.029031 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:29:24.039542 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 03:29:24.158676 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 03:29:24.278204 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:29:24.758903 run create_hlr_db(pid=3151): Launched 03:29:24.884121 bus /sierra_2: Setting Powered False 03:29:25.949249 run create_hlr_db(pid=3151): Terminated: ok {rc=0} 03:29:26.377104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3154): Launched 03:29:26.705653 run osmo-hlr_10.42.42.2(pid=3155): Launched 03:29:26.831173 run osmo-stp_10.42.42.5: Starting osmo-stp 03:29:27.368408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3157): Launched 03:29:27.697455 run osmo-stp_10.42.42.5(pid=3158): Launched 03:29:27.824088 run osmo-msc_10.42.42.6: Starting osmo-msc 03:29:28.389136 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3160): Launched 03:29:28.718141 run osmo-msc_10.42.42.6(pid=3161): Launched 03:29:28.902845 run osmo-stp_10.42.42.5(pid=3158): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3158)] 03:29:29.042591 run osmo-stp_10.42.42.5(pid=3158): stdout: | (launched: 2022-12-14_03:29:27.637788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:29.181900 run osmo-stp_10.42.42.5(pid=3158): stderr: | [0;m[38;5;43m20221214032927832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032927832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032927833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032927833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032927834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032927834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032927834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:29.319163 run osmo-stp_10.42.42.5(pid=3158): stdout: | (launched: 2022-12-14_03:29:27.637788) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:29.450743 run osmo-stp_10.42.42.5(pid=3158): stderr: | [0;m[38;5;43m20221214032927832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032927832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032927833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032927833 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032927834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032927834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032927834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:29.607752 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3158): Process ended prematurely: osmo-stp_10.42.42.5(pid=3158) [trial-2398↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3158)] [trial-2398↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 03:29:29.617016 tst handover.py:18: Test FAILED (6.6 sec) 03:29:29.644668 run osmo-hlr_10.42.42.2(pid=3155): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3155)] 03:29:29.695863 run osmo-hlr_10.42.42.2(pid=3155): stdout: | (launched: 2022-12-14_03:29:26.645360) 03:29:29.748487 run osmo-hlr_10.42.42.2(pid=3155): stderr: | [0;m[1;31m20221214032926844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032926844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032926844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032926844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032926844 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032926845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032926856 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032926864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032926864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032926864 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:29:29.821546 run osmo-msc_10.42.42.6(pid=3161): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3161)] 03:29:29.871487 run osmo-msc_10.42.42.6(pid=3161): stdout: | (launched: 2022-12-14_03:29:28.658241) 03:29:29.924478 run osmo-msc_10.42.42.6(pid=3161): stderr: | [0;m[38;5;43m20221214032928980 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032928981 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1f32507c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032928981 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032928981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032928981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032928981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032928983 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032928983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032928983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032928983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:29:29.977646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3154): Terminating (SIGTERM) 03:29:30.019725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3157): Terminating (SIGTERM) 03:29:30.062133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3160): Terminating (SIGTERM) 03:29:30.104542 --- ParallelTerminationStrategy: PID 3154 died... 03:29:30.124864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3154): Terminated: ok {rc=0} 03:29:30.171889 --- ParallelTerminationStrategy: PID 3157 died... 03:29:30.191673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3157): Terminated: ok {rc=0} 03:29:30.237966 --- ParallelTerminationStrategy: PID 3160 died... 03:29:30.257798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3160): Terminated: ok {rc=0} 03:29:30.346061 bus /sierra_3: Setting Powered False 03:29:31.451510 bus /sierra_3: Setting Powered False 03:29:32.581420 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 03:29:33.834759 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:29:33.839987 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:29:33.901541 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:29:33.927755 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:29:33.979546 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:29:34.044690 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:29:34.072012 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:29:34.616736 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 03:29:34.622257 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:34.633218 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:29:34.679960 tst handover.py: using LAC 38250 03:29:34.800584 tst handover.py: using RAC 255 03:29:34.921979 tst handover.py: using CellId 38250 03:29:35.041980 tst handover.py: using BVCI 38251 03:29:35.152190 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:29:35.200170 tst handover.py: using LAC 38251 03:29:35.325141 tst handover.py: using RAC 1 03:29:35.444709 tst handover.py: using CellId 38251 03:29:35.562933 tst handover.py: using BVCI 38252 03:29:35.673506 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:35.684255 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:35.694817 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:35.705465 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:35.716219 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:29:35.726980 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:29:35.847665 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:29:35.971039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:29:36.451874 run create_hlr_db(pid=3166): Launched 03:29:36.580544 bus /sierra_2: Setting Powered False 03:29:37.645223 run create_hlr_db(pid=3166): Terminated: ok {rc=0} 03:29:38.074424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3168): Launched 03:29:38.405170 run osmo-hlr_10.42.42.2(pid=3169): Launched 03:29:38.533886 run osmo-stp_10.42.42.5: Starting osmo-stp 03:29:39.074258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3171): Launched 03:29:39.402782 run osmo-stp_10.42.42.5(pid=3172): Launched 03:29:39.528523 run osmo-msc_10.42.42.6: Starting osmo-msc 03:29:40.098515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3174): Launched 03:29:40.428407 run osmo-msc_10.42.42.6(pid=3175): Launched 03:29:40.612620 run osmo-stp_10.42.42.5(pid=3172): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3172)] 03:29:40.751577 run osmo-stp_10.42.42.5(pid=3172): stdout: | (launched: 2022-12-14_03:29:39.342961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:40.891058 run osmo-stp_10.42.42.5(pid=3172): stderr: | [0;m[38;5;43m20221214032939537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032939537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032939537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032939537 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032939538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032939538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032939538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:41.030326 run osmo-stp_10.42.42.5(pid=3172): stdout: | (launched: 2022-12-14_03:29:39.342961) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:41.161578 run osmo-stp_10.42.42.5(pid=3172): stderr: | [0;m[38;5;43m20221214032939537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032939537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032939537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032939537 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032939538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032939538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032939538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:41.318672 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3172): Process ended prematurely: osmo-stp_10.42.42.5(pid=3172) [trial-2398↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3172)] [trial-2398↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 03:29:41.327640 tst handover.py:18: Test FAILED (6.7 sec) 03:29:41.355020 run osmo-hlr_10.42.42.2(pid=3169): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3169)] 03:29:41.405423 run osmo-hlr_10.42.42.2(pid=3169): stdout: | (launched: 2022-12-14_03:29:38.345274) 03:29:41.457609 run osmo-hlr_10.42.42.2(pid=3169): stderr: | [0;m[1;31m20221214032938544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032938544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032938544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032938544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032938544 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032938545 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032938560 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032938570 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032938571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032938571 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:29:41.530227 run osmo-msc_10.42.42.6(pid=3175): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3175)] 03:29:41.579940 run osmo-msc_10.42.42.6(pid=3175): stdout: | (launched: 2022-12-14_03:29:40.368388) 03:29:41.632412 run osmo-msc_10.42.42.6(pid=3175): stderr: | [0;m[38;5;43m20221214032940690 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032940690 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd975a41c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032940691 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032940691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032940691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032940691 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032940693 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032940693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032940693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032940693 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:29:41.684547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3168): Terminating (SIGTERM) 03:29:41.726316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3171): Terminating (SIGTERM) 03:29:41.769175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3174): Terminating (SIGTERM) 03:29:41.811412 --- ParallelTerminationStrategy: PID 3168 died... 03:29:41.831746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3168): Terminated: ok {rc=0} 03:29:41.878142 --- ParallelTerminationStrategy: PID 3171 died... 03:29:41.898194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3171): Terminated: ok {rc=0} 03:29:41.944697 --- ParallelTerminationStrategy: PID 3174 died... 03:29:41.964493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3174): Terminated: ok {rc=0} 03:29:42.052891 bus /sierra_3: Setting Powered False 03:29:43.151177 bus /sierra_3: Setting Powered False 03:29:44.267013 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 03:29:45.537833 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:29:45.543113 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:29:45.605100 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:29:45.631364 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:29:45.683488 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:29:45.746179 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:29:45.772390 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:29:46.327140 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 03:29:46.333551 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:46.346083 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:29:46.396319 tst handover.py: using LAC 38252 03:29:46.547665 tst handover.py: using RAC 2 03:29:46.670654 tst handover.py: using CellId 38252 03:29:46.791336 tst handover.py: using BVCI 38253 03:29:46.968579 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:29:47.043936 tst handover.py: using LAC 38253 03:29:47.176468 tst handover.py: using RAC 3 03:29:47.309228 tst handover.py: using CellId 38253 03:29:47.438604 tst handover.py: using BVCI 38254 03:29:47.559372 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:47.570869 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:47.581978 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:47.593360 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:47.605587 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:29:47.617455 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:29:47.734553 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:29:47.856188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:29:48.337694 run create_hlr_db(pid=3181): Launched 03:29:48.463445 bus /sierra_2: Setting Powered False 03:29:49.529189 run create_hlr_db(pid=3181): Terminated: ok {rc=0} 03:29:49.940802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3183): Launched 03:29:50.246854 run osmo-hlr_10.42.42.2(pid=3184): Launched 03:29:50.364105 run osmo-stp_10.42.42.5: Starting osmo-stp 03:29:50.864802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3186): Launched 03:29:51.172355 run osmo-stp_10.42.42.5(pid=3187): Launched 03:29:51.289364 run osmo-msc_10.42.42.6: Starting osmo-msc 03:29:51.817139 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3189): Launched 03:29:52.122924 run osmo-msc_10.42.42.6(pid=3190): Launched 03:29:52.294032 run osmo-stp_10.42.42.5(pid=3187): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3187)] 03:29:52.423728 run osmo-stp_10.42.42.5(pid=3187): stdout: | (launched: 2022-12-14_03:29:51.115334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:52.552830 run osmo-stp_10.42.42.5(pid=3187): stderr: | [0;m[38;5;43m20221214032951286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032951286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032951286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032951286 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032951287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032951287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032951287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:52.679699 run osmo-stp_10.42.42.5(pid=3187): stdout: | (launched: 2022-12-14_03:29:51.115334) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:29:52.800685 run osmo-stp_10.42.42.5(pid=3187): stderr: | [0;m[38;5;43m20221214032951286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214032951286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214032951286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214032951286 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214032951287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214032951287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214032951287 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:29:52.946046 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3187): Process ended prematurely: osmo-stp_10.42.42.5(pid=3187) [trial-2398↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3187)] [trial-2398↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 03:29:52.954360 tst handover.py:18: Test FAILED (6.6 sec) 03:29:52.980351 run osmo-hlr_10.42.42.2(pid=3184): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3184)] 03:29:53.028243 run osmo-hlr_10.42.42.2(pid=3184): stdout: | (launched: 2022-12-14_03:29:50.190759) 03:29:53.077556 run osmo-hlr_10.42.42.2(pid=3184): stderr: | [0;m[1;31m20221214032950368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214032950368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214032950368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214032950368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214032950368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214032950368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214032950380 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214032950391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214032950391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214032950391 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:29:53.146386 run osmo-msc_10.42.42.6(pid=3190): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3190)] 03:29:53.193842 run osmo-msc_10.42.42.6(pid=3190): stdout: | (launched: 2022-12-14_03:29:52.066646) 03:29:53.242819 run osmo-msc_10.42.42.6(pid=3190): stderr: | [0;m[38;5;43m20221214032952339 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214032952340 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f710e131c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214032952340 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214032952340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214032952340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214032952340 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214032952342 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214032952342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214032952343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214032952343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:29:53.292571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3183): Terminating (SIGTERM) 03:29:53.332024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3186): Terminating (SIGTERM) 03:29:53.371595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3189): Terminating (SIGTERM) 03:29:53.411611 --- ParallelTerminationStrategy: PID 3183 died... 03:29:53.430871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3183): Terminated: ok {rc=0} 03:29:53.474809 --- ParallelTerminationStrategy: PID 3186 died... 03:29:53.493448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3186): Terminated: ok {rc=0} 03:29:53.537282 --- ParallelTerminationStrategy: PID 3189 died... 03:29:53.555850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3189): Terminated: ok {rc=0} 03:29:53.641207 bus /sierra_3: Setting Powered False 03:29:54.740425 bus /sierra_3: Setting Powered False 03:29:55.853527 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 03:29:57.128076 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:29:57.133861 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 03:29:57.194778 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 03:29:57.221791 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 03:29:57.275641 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 03:29:57.338457 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 03:29:57.365680 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 03:29:57.915026 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 03:29:57.920741 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:57.932612 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:29:57.978709 tst handover.py: using LAC 38254 03:29:58.109595 tst handover.py: using RAC 4 03:29:58.229930 tst handover.py: using CellId 38254 03:29:58.349382 tst handover.py: using BVCI 38255 03:29:58.460201 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 03:29:58.509107 tst handover.py: using LAC 38255 03:29:58.630512 tst handover.py: using RAC 5 03:29:58.752689 tst handover.py: using CellId 38255 03:29:58.873349 tst handover.py: using BVCI 38256 03:29:58.985326 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:58.996488 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:59.007621 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:59.018810 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:59.030561 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 03:29:59.042150 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:29:59.158912 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 03:29:59.276722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:29:59.726433 run create_hlr_db(pid=3196): Launched 03:29:59.851770 bus /sierra_2: Setting Powered False 03:30:00.936723 run create_hlr_db(pid=3196): Terminated: ok {rc=0} 03:30:01.376725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3198): Launched 03:30:01.740415 run osmo-hlr_10.42.42.2(pid=3202): Launched 03:30:01.994780 run osmo-stp_10.42.42.5: Starting osmo-stp 03:30:02.636634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3204): Launched 03:30:02.966383 run osmo-stp_10.42.42.5(pid=3205): Launched 03:30:03.094845 run osmo-msc_10.42.42.6: Starting osmo-msc 03:30:03.663254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3207): Launched 03:30:03.993081 run osmo-msc_10.42.42.6(pid=3208): Launched 03:30:04.178624 run osmo-stp_10.42.42.5(pid=3205): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3205)] 03:30:04.317337 run osmo-stp_10.42.42.5(pid=3205): stdout: | (launched: 2022-12-14_03:30:02.906026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:04.456301 run osmo-stp_10.42.42.5(pid=3205): stderr: | [0;m[38;5;43m20221214033003097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033003097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033003098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033003098 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033003100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033003101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033003101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:04.587710 run osmo-stp_10.42.42.5(pid=3205): stdout: | (launched: 2022-12-14_03:30:02.906026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:04.709240 run osmo-stp_10.42.42.5(pid=3205): stderr: | [0;m[38;5;43m20221214033003097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033003097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033003098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033003098 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033003100 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033003101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033003101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:04.855316 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3205): Process ended prematurely: osmo-stp_10.42.42.5(pid=3205) [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3205)] [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 03:30:04.863768 tst handover.py:18: Test FAILED (6.9 sec) 03:30:04.890018 run osmo-hlr_10.42.42.2(pid=3202): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3202)] 03:30:04.937758 run osmo-hlr_10.42.42.2(pid=3202): stdout: | (launched: 2022-12-14_03:30:01.675122) 03:30:04.987428 run osmo-hlr_10.42.42.2(pid=3202): stderr: | [0;m[1;31m20221214033001998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033001998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033001998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033001998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033001998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033001998 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033002010 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033002023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033002024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033002024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:30:05.056466 run osmo-msc_10.42.42.6(pid=3208): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3208)] 03:30:05.103917 run osmo-msc_10.42.42.6(pid=3208): stdout: | (launched: 2022-12-14_03:30:03.932724) 03:30:05.153094 run osmo-msc_10.42.42.6(pid=3208): stderr: | [0;m[38;5;43m20221214033004254 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033004254 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6c24816c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033004254 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033004254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033004254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033004255 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033004256 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033004257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033004257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033004257 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:30:05.202659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3198): Terminating (SIGTERM) 03:30:05.242303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3204): Terminating (SIGTERM) 03:30:05.281903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3207): Terminating (SIGTERM) 03:30:05.321895 --- ParallelTerminationStrategy: PID 3198 died... 03:30:05.341209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3198): Terminated: ok {rc=0} 03:30:05.385150 --- ParallelTerminationStrategy: PID 3204 died... 03:30:05.403843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3204): Terminated: ok {rc=0} 03:30:05.447669 --- ParallelTerminationStrategy: PID 3207 died... 03:30:05.466253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3207): Terminated: ok {rc=0} 03:30:05.550826 bus /sierra_3: Setting Powered False 03:30:06.648467 bus /sierra_3: Setting Powered False 03:30:07.760057 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 03:30:09.033986 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:30:09.039496 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:30:09.087318 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:30:09.114264 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:30:09.164517 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:30:09.212531 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:30:09.239752 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:30:09.793807 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 03:30:09.799456 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:09.811070 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 03:30:09.856438 tst handover.py: using LAC 38256 03:30:09.989178 tst handover.py: using RAC 6 03:30:10.117650 tst handover.py: using CellId 38256 03:30:10.237392 tst handover.py: using BVCI 38257 03:30:10.350670 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 03:30:10.384541 tst handover.py: using LAC 38257 03:30:10.502545 tst handover.py: using RAC 7 03:30:10.622211 tst handover.py: using CellId 38257 03:30:10.740352 tst handover.py: using BVCI 38258 03:30:10.850745 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:10.861744 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:10.872545 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:10.883370 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:10.894204 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:10.904830 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 03:30:11.019807 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 03:30:11.140184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:30:11.621537 run create_hlr_db(pid=3213): Launched 03:30:11.749989 bus /sierra_2: Setting Powered False 03:30:12.814256 run create_hlr_db(pid=3213): Terminated: ok {rc=0} 03:30:13.224603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3215): Launched 03:30:13.529596 run osmo-hlr_10.42.42.2(pid=3216): Launched 03:30:13.646810 run osmo-stp_10.42.42.5: Starting osmo-stp 03:30:14.150863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3218): Launched 03:30:14.456466 run osmo-stp_10.42.42.5(pid=3219): Launched 03:30:14.573571 run osmo-msc_10.42.42.6: Starting osmo-msc 03:30:15.099948 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3221): Launched 03:30:15.405893 run osmo-msc_10.42.42.6(pid=3222): Launched 03:30:15.577216 run osmo-stp_10.42.42.5(pid=3219): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3219)] 03:30:15.706286 run osmo-stp_10.42.42.5(pid=3219): stdout: | (launched: 2022-12-14_03:30:14.400253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:15.835855 run osmo-stp_10.42.42.5(pid=3219): stderr: | [0;m[38;5;43m20221214033014573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033014573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033014573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033014574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033014574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033014574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033014574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:15.995395 run osmo-stp_10.42.42.5(pid=3219): stdout: | (launched: 2022-12-14_03:30:14.400253) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:16.119790 run osmo-stp_10.42.42.5(pid=3219): stderr: | [0;m[38;5;43m20221214033014573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033014573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033014573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033014574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033014574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033014574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033014574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:16.268580 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3219): Process ended prematurely: osmo-stp_10.42.42.5(pid=3219) [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3219)] [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 03:30:16.278147 tst handover.py:18: Test FAILED (6.5 sec) 03:30:16.305581 run osmo-hlr_10.42.42.2(pid=3216): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3216)] 03:30:16.357193 run osmo-hlr_10.42.42.2(pid=3216): stdout: | (launched: 2022-12-14_03:30:13.473866) 03:30:16.408271 run osmo-hlr_10.42.42.2(pid=3216): stderr: | [0;m[1;31m20221214033013651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033013651 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033013652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033013652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033013652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033013652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033013664 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033013672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033013673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033013673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:30:16.479474 run osmo-msc_10.42.42.6(pid=3222): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3222)] 03:30:16.528842 run osmo-msc_10.42.42.6(pid=3222): stdout: | (launched: 2022-12-14_03:30:15.349682) 03:30:16.581104 run osmo-msc_10.42.42.6(pid=3222): stderr: | [0;m[38;5;43m20221214033015619 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033015619 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f41fc607c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033015619 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033015619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033015619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033015620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033015621 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033015622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033015622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033015622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:30:16.632433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3215): Terminating (SIGTERM) 03:30:16.673844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3218): Terminating (SIGTERM) 03:30:16.714546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3221): Terminating (SIGTERM) 03:30:16.756111 --- ParallelTerminationStrategy: PID 3215 died... 03:30:16.777150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3215): Terminated: ok {rc=0} 03:30:16.822741 --- ParallelTerminationStrategy: PID 3218 died... 03:30:16.842343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3218): Terminated: ok {rc=0} 03:30:16.887549 --- ParallelTerminationStrategy: PID 3221 died... 03:30:16.907175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3221): Terminated: ok {rc=0} 03:30:16.994592 bus /sierra_3: Setting Powered False 03:30:18.093947 bus /sierra_3: Setting Powered False 03:30:19.206052 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 03:30:20.462619 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:30:20.468876 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:30:20.526884 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:30:20.553210 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:30:20.605555 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:30:20.666442 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:30:20.693869 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:30:21.242003 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 03:30:21.248623 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:21.261150 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:30:21.305710 tst handover.py: using LAC 38258 03:30:21.436482 tst handover.py: using RAC 8 03:30:21.566171 tst handover.py: using CellId 38258 03:30:21.688544 tst handover.py: using BVCI 38259 03:30:21.800059 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:30:21.848299 tst handover.py: using LAC 38259 03:30:21.968567 tst handover.py: using RAC 9 03:30:22.094776 tst handover.py: using CellId 38259 03:30:22.215512 tst handover.py: using BVCI 38260 03:30:22.328666 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:22.340007 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:22.351113 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:22.362245 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:22.373519 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:22.384701 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:30:22.500357 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:30:22.616518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:30:23.064636 run create_hlr_db(pid=3227): Launched 03:30:23.189922 bus /sierra_2: Setting Powered False 03:30:24.250891 run create_hlr_db(pid=3227): Terminated: ok {rc=0} 03:30:24.672177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3229): Launched 03:30:25.001782 run osmo-hlr_10.42.42.2(pid=3230): Launched 03:30:25.129417 run osmo-stp_10.42.42.5: Starting osmo-stp 03:30:25.670409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3232): Launched 03:30:26.001723 run osmo-stp_10.42.42.5(pid=3233): Launched 03:30:26.129536 run osmo-msc_10.42.42.6: Starting osmo-msc 03:30:26.696081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3235): Launched 03:30:27.025932 run osmo-msc_10.42.42.6(pid=3236): Launched 03:30:27.210219 run osmo-stp_10.42.42.5(pid=3233): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3233)] 03:30:27.350198 run osmo-stp_10.42.42.5(pid=3233): stdout: | (launched: 2022-12-14_03:30:25.941354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:27.489367 run osmo-stp_10.42.42.5(pid=3233): stderr: | [0;m[38;5;43m20221214033026135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033026135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033026135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033026135 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033026136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033026136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033026136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:27.627612 run osmo-stp_10.42.42.5(pid=3233): stdout: | (launched: 2022-12-14_03:30:25.941354) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:27.758713 run osmo-stp_10.42.42.5(pid=3233): stderr: | [0;m[38;5;43m20221214033026135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033026135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033026135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033026135 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033026136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033026136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033026136 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:27.915280 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3233): Process ended prematurely: osmo-stp_10.42.42.5(pid=3233) [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3233)] [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 03:30:27.924307 tst handover.py:18: Test FAILED (6.7 sec) 03:30:27.952252 run osmo-hlr_10.42.42.2(pid=3230): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3230)] 03:30:28.003173 run osmo-hlr_10.42.42.2(pid=3230): stdout: | (launched: 2022-12-14_03:30:24.941525) 03:30:28.055393 run osmo-hlr_10.42.42.2(pid=3230): stderr: | [0;m[1;31m20221214033025142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033025142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033025142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033025142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033025142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033025142 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033025155 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033025164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033025164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033025164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:30:28.127902 run osmo-msc_10.42.42.6(pid=3236): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3236)] 03:30:28.177580 run osmo-msc_10.42.42.6(pid=3236): stdout: | (launched: 2022-12-14_03:30:26.965850) 03:30:28.229228 run osmo-msc_10.42.42.6(pid=3236): stderr: | [0;m[38;5;43m20221214033027286 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033027286 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2ab22d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033027286 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033027286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033027286 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033027287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033027288 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033027289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033027289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033027289 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:30:28.281753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3229): Terminating (SIGTERM) 03:30:28.323319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3232): Terminating (SIGTERM) 03:30:28.365484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3235): Terminating (SIGTERM) 03:30:28.407703 --- ParallelTerminationStrategy: PID 3229 died... 03:30:28.428306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3229): Terminated: ok {rc=0} 03:30:28.474769 --- ParallelTerminationStrategy: PID 3232 died... 03:30:28.494868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3232): Terminated: ok {rc=0} 03:30:28.541230 --- ParallelTerminationStrategy: PID 3235 died... 03:30:28.561169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3235): Terminated: ok {rc=0} 03:30:28.649778 bus /sierra_3: Setting Powered False 03:30:29.746935 bus /sierra_3: Setting Powered False 03:30:30.887198 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 03:30:32.184192 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:30:32.190196 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:30:32.251804 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:30:32.279674 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:30:32.337718 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:30:32.395936 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:30:32.421895 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:30:32.968308 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 03:30:32.973765 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:32.984886 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:30:33.029394 tst handover.py: using LAC 38260 03:30:33.148828 tst handover.py: using RAC 10 03:30:33.267921 tst handover.py: using CellId 38260 03:30:33.386429 tst handover.py: using BVCI 38261 03:30:33.497979 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:30:33.544567 tst handover.py: using LAC 38261 03:30:33.673322 tst handover.py: using RAC 11 03:30:33.800785 tst handover.py: using CellId 38261 03:30:33.927791 tst handover.py: using BVCI 38262 03:30:34.049063 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:34.060683 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:34.072142 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:34.083824 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:34.095913 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:30:34.107883 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:30:34.225452 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:30:34.346862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:30:34.828220 run create_hlr_db(pid=3241): Launched 03:30:34.954983 bus /sierra_2: Setting Powered False 03:30:36.020028 run create_hlr_db(pid=3241): Terminated: ok {rc=0} 03:30:36.449099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3243): Launched 03:30:36.778446 run osmo-hlr_10.42.42.2(pid=3244): Launched 03:30:36.906617 run osmo-stp_10.42.42.5: Starting osmo-stp 03:30:37.442153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3246): Launched 03:30:37.772478 run osmo-stp_10.42.42.5(pid=3247): Launched 03:30:37.898825 run osmo-msc_10.42.42.6: Starting osmo-msc 03:30:38.464477 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3249): Launched 03:30:38.793302 run osmo-msc_10.42.42.6(pid=3250): Launched 03:30:38.978137 run osmo-stp_10.42.42.5(pid=3247): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3247)] 03:30:39.116705 run osmo-stp_10.42.42.5(pid=3247): stdout: | (launched: 2022-12-14_03:30:37.712664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:39.255706 run osmo-stp_10.42.42.5(pid=3247): stderr: | [0;m[38;5;43m20221214033037903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033037903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033037903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033037903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033037904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033037904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033037904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:39.393813 run osmo-stp_10.42.42.5(pid=3247): stdout: | (launched: 2022-12-14_03:30:37.712664) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:39.525102 run osmo-stp_10.42.42.5(pid=3247): stderr: | [0;m[38;5;43m20221214033037903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033037903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033037903 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033037903 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033037904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033037904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033037904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:39.681651 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3247): Process ended prematurely: osmo-stp_10.42.42.5(pid=3247) [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3247)] [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 03:30:39.690822 tst handover.py:18: Test FAILED (6.7 sec) 03:30:39.718466 run osmo-hlr_10.42.42.2(pid=3244): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3244)] 03:30:39.769603 run osmo-hlr_10.42.42.2(pid=3244): stdout: | (launched: 2022-12-14_03:30:36.718787) 03:30:39.822182 run osmo-hlr_10.42.42.2(pid=3244): stderr: | [0;m[1;31m20221214033036915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033036915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033036915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033036915 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033036916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033036916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033036928 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033036936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033036936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033036936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:30:39.894755 run osmo-msc_10.42.42.6(pid=3250): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3250)] 03:30:39.944662 run osmo-msc_10.42.42.6(pid=3250): stdout: | (launched: 2022-12-14_03:30:38.733497) 03:30:39.997839 run osmo-msc_10.42.42.6(pid=3250): stderr: | [0;m[38;5;43m20221214033039057 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033039057 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd06f4f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033039057 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033039057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033039057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033039057 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033039059 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033039059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033039060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033039060 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:30:40.050585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3243): Terminating (SIGTERM) 03:30:40.092221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3246): Terminating (SIGTERM) 03:30:40.134571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3249): Terminating (SIGTERM) 03:30:40.177062 --- ParallelTerminationStrategy: PID 3243 died... 03:30:40.197386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3243): Terminated: ok {rc=0} 03:30:40.243693 --- ParallelTerminationStrategy: PID 3246 died... 03:30:40.263431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3246): Terminated: ok {rc=0} 03:30:40.309247 --- ParallelTerminationStrategy: PID 3249 died... 03:30:40.329019 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3249): Terminated: ok {rc=0} 03:30:40.417219 bus /sierra_3: Setting Powered False 03:30:41.515690 bus /sierra_3: Setting Powered False 03:30:42.631442 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 03:30:43.906345 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:30:43.911949 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 03:30:43.964775 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 03:30:43.991918 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 03:30:44.043604 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 03:30:44.096455 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 03:30:44.123728 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 03:30:44.673319 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 03:30:44.678594 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:44.689705 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 03:30:44.738371 tst handover.py: using LAC 38262 03:30:44.859163 tst handover.py: using RAC 12 03:30:44.989211 tst handover.py: using CellId 38262 03:30:45.116755 tst handover.py: using BVCI 38263 03:30:45.237854 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 03:30:45.271845 tst handover.py: using LAC 38263 03:30:45.401170 tst handover.py: using RAC 13 03:30:45.528499 tst handover.py: using CellId 38263 03:30:45.656930 tst handover.py: using BVCI 38264 03:30:45.777389 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:45.788711 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:45.799899 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:45.811068 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:45.823221 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 03:30:45.835404 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 03:30:45.967292 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 03:30:46.097983 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:30:46.565418 run create_hlr_db(pid=3255): Launched 03:30:46.730111 bus /sierra_2: Setting Powered False 03:30:47.793996 run create_hlr_db(pid=3255): Terminated: ok {rc=0} 03:30:48.206546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3257): Launched 03:30:48.513163 run osmo-hlr_10.42.42.2(pid=3258): Launched 03:30:48.630250 run osmo-stp_10.42.42.5: Starting osmo-stp 03:30:49.132110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3260): Launched 03:30:49.438310 run osmo-stp_10.42.42.5(pid=3261): Launched 03:30:49.554665 run osmo-msc_10.42.42.6: Starting osmo-msc 03:30:50.082246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3263): Launched 03:30:50.389598 run osmo-msc_10.42.42.6(pid=3264): Launched 03:30:50.561210 run osmo-stp_10.42.42.5(pid=3261): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3261)] 03:30:50.691192 run osmo-stp_10.42.42.5(pid=3261): stdout: | (launched: 2022-12-14_03:30:49.382268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:50.820179 run osmo-stp_10.42.42.5(pid=3261): stderr: | [0;m[38;5;43m20221214033049553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033049553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033049553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033049553 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033049556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033049556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033049556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:50.947564 run osmo-stp_10.42.42.5(pid=3261): stdout: | (launched: 2022-12-14_03:30:49.382268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:30:51.069385 run osmo-stp_10.42.42.5(pid=3261): stderr: | [0;m[38;5;43m20221214033049553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033049553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033049553 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033049553 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033049556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033049556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033049556 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:30:51.215097 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3261): Process ended prematurely: osmo-stp_10.42.42.5(pid=3261) [trial-2398↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3261)] [trial-2398↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 03:30:51.223533 tst handover.py:18: Test FAILED (6.5 sec) 03:30:51.249753 run osmo-hlr_10.42.42.2(pid=3258): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3258)] 03:30:51.297769 run osmo-hlr_10.42.42.2(pid=3258): stdout: | (launched: 2022-12-14_03:30:48.456860) 03:30:51.347295 run osmo-hlr_10.42.42.2(pid=3258): stderr: | [0;m[1;31m20221214033048636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033048636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033048636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033048636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033048636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033048636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033048648 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033048659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033048659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033048659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:30:51.416399 run osmo-msc_10.42.42.6(pid=3264): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3264)] 03:30:51.463727 run osmo-msc_10.42.42.6(pid=3264): stdout: | (launched: 2022-12-14_03:30:50.333111) 03:30:51.512801 run osmo-msc_10.42.42.6(pid=3264): stderr: | [0;m[38;5;43m20221214033050606 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033050606 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0957cedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033050606 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033050606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033050606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033050606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033050608 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033050608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033050609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033050609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:30:51.562470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3257): Terminating (SIGTERM) 03:30:51.602374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3260): Terminating (SIGTERM) 03:30:51.642193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3263): Terminating (SIGTERM) 03:30:51.682305 --- ParallelTerminationStrategy: PID 3257 died... 03:30:51.701667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3257): Terminated: ok {rc=0} 03:30:51.745668 --- ParallelTerminationStrategy: PID 3260 died... 03:30:51.764437 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3260): Terminated: ok {rc=0} 03:30:51.808314 --- ParallelTerminationStrategy: PID 3263 died... 03:30:51.827246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3263): Terminated: ok {rc=0} 03:30:51.914015 bus /sierra_3: Setting Powered False 03:30:53.013597 bus /sierra_3: Setting Powered False 03:30:54.130293 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 03:30:55.387724 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:30:55.393200 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:30:55.455268 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:30:55.481422 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:30:55.531979 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:30:55.597788 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:30:55.623947 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:30:56.173961 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 03:30:56.180725 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:56.192406 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:30:56.242939 tst handover.py: using LAC 38264 03:30:56.372126 tst handover.py: using RAC 14 03:30:56.501093 tst handover.py: using CellId 38264 03:30:56.631826 tst handover.py: using BVCI 38265 03:30:56.751726 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:30:56.801369 tst handover.py: using LAC 38265 03:30:56.924540 tst handover.py: using RAC 15 03:30:57.055858 tst handover.py: using CellId 38265 03:30:57.186701 tst handover.py: using BVCI 38266 03:30:57.308047 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:57.319695 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:57.331139 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:57.342695 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:57.354795 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:30:57.366594 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:30:57.483230 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:30:57.603796 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:30:58.054553 run create_hlr_db(pid=3270): Launched 03:30:58.181442 bus /sierra_2: Setting Powered False 03:30:59.242465 run create_hlr_db(pid=3270): Terminated: ok {rc=0} 03:30:59.663440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3272): Launched 03:30:59.994466 run osmo-hlr_10.42.42.2(pid=3273): Launched 03:31:00.121729 run osmo-stp_10.42.42.5: Starting osmo-stp 03:31:00.662013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3275): Launched 03:31:01.005987 run osmo-stp_10.42.42.5(pid=3276): Launched 03:31:01.312437 run osmo-msc_10.42.42.6: Starting osmo-msc 03:31:02.185898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3278): Launched 03:31:02.529739 run osmo-msc_10.42.42.6(pid=3279): Launched 03:31:02.715985 run osmo-stp_10.42.42.5(pid=3276): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3276)] 03:31:02.855323 run osmo-stp_10.42.42.5(pid=3276): stdout: | (launched: 2022-12-14_03:31:00.940607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:02.996290 run osmo-stp_10.42.42.5(pid=3276): stderr: | [0;m[38;5;43m20221214033101419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033101420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033101422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033101424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033101426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033101427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033101427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:03.134698 run osmo-stp_10.42.42.5(pid=3276): stdout: | (launched: 2022-12-14_03:31:00.940607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:03.266434 run osmo-stp_10.42.42.5(pid=3276): stderr: | [0;m[38;5;43m20221214033101419 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033101420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033101422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033101424 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033101426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033101427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033101427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:03.423132 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3276): Process ended prematurely: osmo-stp_10.42.42.5(pid=3276) [trial-2398↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3276)] [trial-2398↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 03:31:03.432213 tst handover.py:18: Test FAILED (7.2 sec) 03:31:03.460085 run osmo-hlr_10.42.42.2(pid=3273): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3273)] 03:31:03.511058 run osmo-hlr_10.42.42.2(pid=3273): stdout: | (launched: 2022-12-14_03:30:59.933770) 03:31:03.563719 run osmo-hlr_10.42.42.2(pid=3273): stderr: | [0;m[1;31m20221214033100134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033100134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033100134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033100134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033100134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033100134 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033100146 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033100156 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033100157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033100157 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:31:03.636206 run osmo-msc_10.42.42.6(pid=3279): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3279)] 03:31:03.685737 run osmo-msc_10.42.42.6(pid=3279): stdout: | (launched: 2022-12-14_03:31:02.469764) 03:31:03.737979 run osmo-msc_10.42.42.6(pid=3279): stderr: | [0;m[38;5;43m20221214033102790 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033102790 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0692099c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033102790 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033102791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033102791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033102791 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033102794 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033102795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033102795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033102795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:31:03.790426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3272): Terminating (SIGTERM) 03:31:03.832161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3275): Terminating (SIGTERM) 03:31:03.874322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3278): Terminating (SIGTERM) 03:31:03.916692 --- ParallelTerminationStrategy: PID 3272 died... 03:31:03.937294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3272): Terminated: ok {rc=0} 03:31:03.984187 --- ParallelTerminationStrategy: PID 3275 died... 03:31:04.004485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3275): Terminated: ok {rc=0} 03:31:04.050979 --- ParallelTerminationStrategy: PID 3278 died... 03:31:04.071100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3278): Terminated: ok {rc=0} 03:31:04.159170 bus /sierra_3: Setting Powered False 03:31:05.257666 bus /sierra_3: Setting Powered False 03:31:06.373880 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 03:31:07.648740 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:31:07.654772 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:31:07.719218 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:31:07.746344 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:31:07.799021 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:31:07.863897 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:31:07.890789 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:31:08.438824 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 03:31:08.444222 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:08.455351 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:31:08.502771 tst handover.py: using LAC 38266 03:31:08.624651 tst handover.py: using RAC 16 03:31:08.745833 tst handover.py: using CellId 38266 03:31:08.868685 tst handover.py: using BVCI 38267 03:31:08.981081 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:31:09.027590 tst handover.py: using LAC 38267 03:31:09.158872 tst handover.py: using RAC 17 03:31:09.280136 tst handover.py: using CellId 38267 03:31:09.405118 tst handover.py: using BVCI 38268 03:31:09.517271 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:09.528182 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:09.538972 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:09.549825 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:09.560660 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:09.571407 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:09.691987 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:09.809831 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:31:10.259182 run create_hlr_db(pid=3285): Launched 03:31:10.385462 bus /sierra_2: Setting Powered False 03:31:11.446731 run create_hlr_db(pid=3285): Terminated: ok {rc=0} 03:31:11.866346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3287): Launched 03:31:12.197393 run osmo-hlr_10.42.42.2(pid=3288): Launched 03:31:12.325167 run osmo-stp_10.42.42.5: Starting osmo-stp 03:31:12.867160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3290): Launched 03:31:13.197857 run osmo-stp_10.42.42.5(pid=3291): Launched 03:31:13.325053 run osmo-msc_10.42.42.6: Starting osmo-msc 03:31:13.894143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3293): Launched 03:31:14.226321 run osmo-msc_10.42.42.6(pid=3294): Launched 03:31:14.412032 run osmo-stp_10.42.42.5(pid=3291): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3291)] 03:31:14.551610 run osmo-stp_10.42.42.5(pid=3291): stdout: | (launched: 2022-12-14_03:31:13.137825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:14.691371 run osmo-stp_10.42.42.5(pid=3291): stderr: | [0;m[38;5;43m20221214033113333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033113333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033113333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033113334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033113334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033113334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033113334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:14.829063 run osmo-stp_10.42.42.5(pid=3291): stdout: | (launched: 2022-12-14_03:31:13.137825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:14.960303 run osmo-stp_10.42.42.5(pid=3291): stderr: | [0;m[38;5;43m20221214033113333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033113333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033113333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033113334 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033113334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033113334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033113334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:15.117978 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3291): Process ended prematurely: osmo-stp_10.42.42.5(pid=3291) [trial-2398↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3291)] [trial-2398↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 03:31:15.127002 tst handover.py:18: Test FAILED (6.7 sec) 03:31:15.154687 run osmo-hlr_10.42.42.2(pid=3288): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3288)] 03:31:15.205389 run osmo-hlr_10.42.42.2(pid=3288): stdout: | (launched: 2022-12-14_03:31:12.137415) 03:31:15.258092 run osmo-hlr_10.42.42.2(pid=3288): stderr: | [0;m[1;31m20221214033112337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033112337 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033112338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033112338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033112338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033112338 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033112351 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033112361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033112361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033112361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:31:15.330970 run osmo-msc_10.42.42.6(pid=3294): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3294)] 03:31:15.380858 run osmo-msc_10.42.42.6(pid=3294): stdout: | (launched: 2022-12-14_03:31:14.166184) 03:31:15.433426 run osmo-msc_10.42.42.6(pid=3294): stderr: | [0;m[38;5;43m20221214033114488 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033114488 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f96b4347c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033114489 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033114489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033114489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033114489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033114491 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033114491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033114491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033114491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:31:15.486024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3287): Terminating (SIGTERM) 03:31:15.527781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3290): Terminating (SIGTERM) 03:31:15.570425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3293): Terminating (SIGTERM) 03:31:15.613106 --- ParallelTerminationStrategy: PID 3287 died... 03:31:15.633891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3287): Terminated: ok {rc=0} 03:31:15.680850 --- ParallelTerminationStrategy: PID 3290 died... 03:31:15.701335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3290): Terminated: ok {rc=0} 03:31:15.747809 --- ParallelTerminationStrategy: PID 3293 died... 03:31:15.767876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3293): Terminated: ok {rc=0} 03:31:15.856243 bus /sierra_3: Setting Powered False 03:31:16.968188 bus /sierra_3: Setting Powered False 03:31:18.083755 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 03:31:19.358490 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:31:19.363776 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 03:31:19.413936 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 03:31:19.440065 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 03:31:19.490708 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 03:31:19.540750 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 03:31:19.567033 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 03:31:20.119526 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 03:31:20.124552 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:20.135436 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:31:20.169347 tst handover.py: using LAC 38268 03:31:20.298618 tst handover.py: using RAC 18 03:31:20.428687 tst handover.py: using CellId 38268 03:31:20.558770 tst handover.py: using BVCI 38269 03:31:20.680079 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 03:31:20.729633 tst handover.py: using LAC 38269 03:31:20.850282 tst handover.py: using RAC 19 03:31:20.972224 tst handover.py: using CellId 38269 03:31:21.094004 tst handover.py: using BVCI 38270 03:31:21.204669 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:21.215444 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:21.226083 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:21.236589 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:21.247202 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 03:31:21.257890 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:31:21.379413 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 03:31:21.501785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:31:21.982875 run create_hlr_db(pid=3299): Launched 03:31:22.110810 bus /sierra_2: Setting Powered False 03:31:23.176041 run create_hlr_db(pid=3299): Terminated: ok {rc=0} 03:31:23.603894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3301): Launched 03:31:23.932576 run osmo-hlr_10.42.42.2(pid=3302): Launched 03:31:24.059694 run osmo-stp_10.42.42.5: Starting osmo-stp 03:31:24.602389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3304): Launched 03:31:24.932035 run osmo-stp_10.42.42.5(pid=3305): Launched 03:31:25.059032 run osmo-msc_10.42.42.6: Starting osmo-msc 03:31:25.625869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3307): Launched 03:31:25.955143 run osmo-msc_10.42.42.6(pid=3308): Launched 03:31:26.139813 run osmo-stp_10.42.42.5(pid=3305): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3305)] 03:31:26.279101 run osmo-stp_10.42.42.5(pid=3305): stdout: | (launched: 2022-12-14_03:31:24.871952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:26.418820 run osmo-stp_10.42.42.5(pid=3305): stderr: | [0;m[38;5;43m20221214033125068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033125069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033125069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033125069 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033125070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033125070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033125070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:26.557316 run osmo-stp_10.42.42.5(pid=3305): stdout: | (launched: 2022-12-14_03:31:24.871952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:26.688498 run osmo-stp_10.42.42.5(pid=3305): stderr: | [0;m[38;5;43m20221214033125068 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033125069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033125069 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033125069 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033125070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033125070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033125070 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:26.845439 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3305): Process ended prematurely: osmo-stp_10.42.42.5(pid=3305) [trial-2398↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3305)] [trial-2398↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 03:31:26.854419 tst handover.py:18: Test FAILED (6.7 sec) 03:31:26.881638 run osmo-hlr_10.42.42.2(pid=3302): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3302)] 03:31:26.932077 run osmo-hlr_10.42.42.2(pid=3302): stdout: | (launched: 2022-12-14_03:31:23.872575) 03:31:26.984517 run osmo-hlr_10.42.42.2(pid=3302): stderr: | [0;m[1;31m20221214033124076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033124076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033124076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033124076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033124076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033124076 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033124091 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033124101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033124101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033124101 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:31:27.057101 run osmo-msc_10.42.42.6(pid=3308): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3308)] 03:31:27.106911 run osmo-msc_10.42.42.6(pid=3308): stdout: | (launched: 2022-12-14_03:31:25.894968) 03:31:27.158737 run osmo-msc_10.42.42.6(pid=3308): stderr: | [0;m[38;5;43m20221214033126217 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033126217 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f60f2243c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033126218 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033126218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033126218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033126218 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033126220 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033126220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033126220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033126220 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:31:27.211519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3301): Terminating (SIGTERM) 03:31:27.253294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3304): Terminating (SIGTERM) 03:31:27.295723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3307): Terminating (SIGTERM) 03:31:27.338315 --- ParallelTerminationStrategy: PID 3301 died... 03:31:27.358665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3301): Terminated: ok {rc=0} 03:31:27.405066 --- ParallelTerminationStrategy: PID 3304 died... 03:31:27.424784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3304): Terminated: ok {rc=0} 03:31:27.470826 --- ParallelTerminationStrategy: PID 3307 died... 03:31:27.490700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3307): Terminated: ok {rc=0} 03:31:27.578728 bus /sierra_3: Setting Powered False 03:31:28.676415 bus /sierra_3: Setting Powered False 03:31:29.790203 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 03:31:31.074825 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:31:31.082655 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:31:31.142123 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:31:31.174890 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:31:31.233210 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:31:31.286982 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:31:31.315447 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:31:31.868875 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 03:31:31.876159 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:31.887617 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:31:31.928594 tst handover.py: using LAC 38270 03:31:32.050650 tst handover.py: using RAC 20 03:31:32.209283 tst handover.py: using CellId 38270 03:31:32.330490 tst handover.py: using BVCI 38271 03:31:32.442492 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:31:32.487759 tst handover.py: using LAC 38271 03:31:32.607410 tst handover.py: using RAC 21 03:31:32.727478 tst handover.py: using CellId 38271 03:31:32.850413 tst handover.py: using BVCI 38272 03:31:32.962626 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:32.973462 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:32.983978 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:32.994507 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:33.005214 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:33.015711 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:33.136246 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:33.258798 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:31:33.740756 run create_hlr_db(pid=3313): Launched 03:31:33.869233 bus /sierra_2: Setting Powered False 03:31:34.934336 run create_hlr_db(pid=3313): Terminated: ok {rc=0} 03:31:35.363833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3315): Launched 03:31:35.692930 run osmo-hlr_10.42.42.2(pid=3316): Launched 03:31:35.819143 run osmo-stp_10.42.42.5: Starting osmo-stp 03:31:36.355121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3318): Launched 03:31:36.685654 run osmo-stp_10.42.42.5(pid=3319): Launched 03:31:36.813544 run osmo-msc_10.42.42.6: Starting osmo-msc 03:31:37.379807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3321): Launched 03:31:37.710649 run osmo-msc_10.42.42.6(pid=3322): Launched 03:31:37.894794 run osmo-stp_10.42.42.5(pid=3319): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3319)] 03:31:38.034213 run osmo-stp_10.42.42.5(pid=3319): stdout: | (launched: 2022-12-14_03:31:36.625772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:38.173529 run osmo-stp_10.42.42.5(pid=3319): stderr: | [0;m[38;5;43m20221214033136820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033136820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033136821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033136821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033136821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033136822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033136822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:38.311896 run osmo-stp_10.42.42.5(pid=3319): stdout: | (launched: 2022-12-14_03:31:36.625772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:38.442912 run osmo-stp_10.42.42.5(pid=3319): stderr: | [0;m[38;5;43m20221214033136820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033136820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033136821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033136821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033136821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033136822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033136822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:38.599383 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3319): Process ended prematurely: osmo-stp_10.42.42.5(pid=3319) [trial-2398↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3319)] [trial-2398↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 03:31:38.608293 tst handover.py:18: Test FAILED (6.7 sec) 03:31:38.635758 run osmo-hlr_10.42.42.2(pid=3316): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3316)] 03:31:38.686136 run osmo-hlr_10.42.42.2(pid=3316): stdout: | (launched: 2022-12-14_03:31:35.632603) 03:31:38.737936 run osmo-hlr_10.42.42.2(pid=3316): stderr: | [0;m[1;31m20221214033135833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033135833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033135833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033135833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033135833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033135833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033135890 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033135899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033135899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033135899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:31:38.810712 run osmo-msc_10.42.42.6(pid=3322): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3322)] 03:31:38.860397 run osmo-msc_10.42.42.6(pid=3322): stdout: | (launched: 2022-12-14_03:31:37.650645) 03:31:38.912408 run osmo-msc_10.42.42.6(pid=3322): stderr: | [0;m[38;5;43m20221214033137973 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033137973 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f664c12ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033137973 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033137973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033137973 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033137974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033137976 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033137977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033137977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033137977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:31:38.964066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3315): Terminating (SIGTERM) 03:31:39.006500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3318): Terminating (SIGTERM) 03:31:39.049705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3321): Terminating (SIGTERM) 03:31:39.091897 --- ParallelTerminationStrategy: PID 3315 died... 03:31:39.112315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3315): Terminated: ok {rc=0} 03:31:39.158843 --- ParallelTerminationStrategy: PID 3318 died... 03:31:39.178659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3318): Terminated: ok {rc=0} 03:31:39.224857 --- ParallelTerminationStrategy: PID 3321 died... 03:31:39.245208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3321): Terminated: ok {rc=0} 03:31:39.333413 bus /sierra_3: Setting Powered False 03:31:40.431704 bus /sierra_3: Setting Powered False 03:31:41.548757 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2398 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 03:31:42.804360 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 03:31:42.809892 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 03:31:42.871019 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 03:31:42.897086 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 03:31:42.947639 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 03:31:43.009948 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 03:31:43.035968 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 03:31:43.590487 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2398 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 03:31:43.596109 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:43.607575 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:31:43.656941 tst handover.py: using LAC 38272 03:31:43.777381 tst handover.py: using RAC 22 03:31:43.899926 tst handover.py: using CellId 38272 03:31:44.021991 tst handover.py: using BVCI 38273 03:31:44.133437 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 03:31:44.180711 tst handover.py: using LAC 38273 03:31:44.305896 tst handover.py: using RAC 23 03:31:44.435534 tst handover.py: using CellId 38273 03:31:44.564718 tst handover.py: using BVCI 38274 03:31:44.678346 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:44.689222 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:44.699792 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:44.710459 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:44.721623 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 03:31:44.732755 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:44.854458 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 03:31:44.975398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 03:31:45.459427 run create_hlr_db(pid=3327): Launched 03:31:45.587622 bus /sierra_2: Setting Powered False 03:31:46.648721 run create_hlr_db(pid=3327): Terminated: ok {rc=0} 03:31:47.062037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3329): Launched 03:31:47.383759 run osmo-hlr_10.42.42.2(pid=3330): Launched 03:31:47.504230 run osmo-stp_10.42.42.5: Starting osmo-stp 03:31:48.006709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3332): Launched 03:31:48.315109 run osmo-stp_10.42.42.5(pid=3333): Launched 03:31:48.432366 run osmo-msc_10.42.42.6: Starting osmo-msc 03:31:48.960688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3335): Launched 03:31:49.273963 run osmo-msc_10.42.42.6(pid=3336): Launched 03:31:49.446565 run osmo-stp_10.42.42.5(pid=3333): ERR: Terminated: ERROR {rc=1} [trial-2398↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3333)] 03:31:49.575962 run osmo-stp_10.42.42.5(pid=3333): stdout: | (launched: 2022-12-14_03:31:48.259097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:49.705557 run osmo-stp_10.42.42.5(pid=3333): stderr: | [0;m[38;5;43m20221214033148430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033148430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033148431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033148431 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033148432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033148432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033148432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:49.832744 run osmo-stp_10.42.42.5(pid=3333): stdout: | (launched: 2022-12-14_03:31:48.259097) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 03:31:49.954587 run osmo-stp_10.42.42.5(pid=3333): stderr: | [0;m[38;5;43m20221214033148430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221214033148430 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221214033148431 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221214033148431 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214033148432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214033148432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214033148432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 03:31:50.100277 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=3333): Process ended prematurely: osmo-stp_10.42.42.5(pid=3333) [trial-2398↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3333)] [trial-2398↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 03:31:50.108526 tst handover.py:18: Test FAILED (6.5 sec) 03:31:50.134842 run osmo-hlr_10.42.42.2(pid=3330): ERR: Terminated: ERROR {rc=237} [trial-2398↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3330)] 03:31:50.182818 run osmo-hlr_10.42.42.2(pid=3330): stdout: | (launched: 2022-12-14_03:31:47.326929) 03:31:50.232756 run osmo-hlr_10.42.42.2(pid=3330): stderr: | [0;m[1;31m20221214033147503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221214033147503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221214033147503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221214033147503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221214033147503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221214033147503 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221214033147516 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221214033147524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214033147524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214033147524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 03:31:50.301625 run osmo-msc_10.42.42.6(pid=3336): ERR: Terminated: ERROR {rc=2} [trial-2398↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3336)] 03:31:50.349601 run osmo-msc_10.42.42.6(pid=3336): stdout: | (launched: 2022-12-14_03:31:49.213608) 03:31:50.399225 run osmo-msc_10.42.42.6(pid=3336): stderr: | [0;m[38;5;43m20221214033149483 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221214033149483 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f89e8317c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221214033149483 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221214033149483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221214033149483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221214033149483 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221214033149485 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221214033149485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214033149486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214033149486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 03:31:50.448856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3329): Terminating (SIGTERM) 03:31:50.488826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3332): Terminating (SIGTERM) 03:31:50.528655 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3335): Terminating (SIGTERM) 03:31:50.569444 --- ParallelTerminationStrategy: PID 3329 died... 03:31:50.588729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3329): Terminated: ok {rc=0} 03:31:50.632676 --- ParallelTerminationStrategy: PID 3332 died... 03:31:50.651336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3332): Terminated: ok {rc=0} 03:31:50.695195 --- ParallelTerminationStrategy: PID 3335 died... 03:31:50.714022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3335): Terminated: ok {rc=0} 03:31:50.799794 bus /sierra_3: Setting Powered False 03:31:51.900463 bus /sierra_3: Setting Powered False 03:31:53.017070 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2398 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 03:31:54.291914 tst trial-2398: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398/run.2022-12-14_02-07-46/trial-2398.xml -------------------------------------------------------------------------------------------- trial-2398 FAIL -------------------------------------------------------------------------------------------- 03:31:56.232412 tst trial-2398: trial-2398: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.9 sec) Error: osmo-nitb_10.42.42.2(pid=28072): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28072) [trial-2398↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28072)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.6 sec) Error: osmo-stp_10.42.42.5(pid=28087): Process ended prematurely: osmo-stp_10.42.42.5(pid=28087) [trial-2398↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28087)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=28096): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28096) [trial-2398↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28096)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28107): Process ended prematurely: osmo-stp_10.42.42.5(pid=28107) [trial-2398↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28107)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28121): Process ended prematurely: osmo-stp_10.42.42.5(pid=28121) [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28121)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28132): Process ended prematurely: osmo-stp_10.42.42.5(pid=28132) [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28132)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28147): Process ended prematurely: osmo-stp_10.42.42.5(pid=28147) [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28147)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28158): Process ended prematurely: osmo-stp_10.42.42.5(pid=28158) [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28158)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28172): Process ended prematurely: osmo-stp_10.42.42.5(pid=28172) [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28172)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28183): Process ended prematurely: osmo-stp_10.42.42.5(pid=28183) [trial-2398↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28183)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28197): Process ended prematurely: osmo-stp_10.42.42.5(pid=28197) [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28197)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28208): Process ended prematurely: osmo-stp_10.42.42.5(pid=28208) [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28208)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28222): Process ended prematurely: osmo-stp_10.42.42.5(pid=28222) [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28222)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28233): Process ended prematurely: osmo-stp_10.42.42.5(pid=28233) [trial-2398↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28233)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28249): Process ended prematurely: osmo-stp_10.42.42.5(pid=28249) [trial-2398↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28249)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28260): Process ended prematurely: osmo-stp_10.42.42.5(pid=28260) [trial-2398↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28260)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28274): Process ended prematurely: osmo-stp_10.42.42.5(pid=28274) [trial-2398↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28274)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28285): Process ended prematurely: osmo-stp_10.42.42.5(pid=28285) [trial-2398↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28285)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28299): Process ended prematurely: osmo-stp_10.42.42.5(pid=28299) [trial-2398↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28299)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28310): Process ended prematurely: osmo-stp_10.42.42.5(pid=28310) [trial-2398↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28310)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.3 sec) Error: osmo-stp_10.42.42.5(pid=28329): Process ended prematurely: osmo-stp_10.42.42.5(pid=28329) [trial-2398↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28329)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=28341): Process ended prematurely: osmo-stp_10.42.42.5(pid=28341) [trial-2398↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28341)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=28363): Process ended prematurely: osmo-stp_10.42.42.5(pid=28363) [trial-2398↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28363)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28373): Process ended prematurely: osmo-stp_10.42.42.5(pid=28373) [trial-2398↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28373)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28383): Process ended prematurely: osmo-stp_10.42.42.5(pid=28383) [trial-2398↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28383)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=28401): Process ended prematurely: osmo-stp_10.42.42.5(pid=28401) [trial-2398↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28401)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28413): Process ended prematurely: osmo-stp_10.42.42.5(pid=28413) [trial-2398↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28413)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=28434): Process ended prematurely: osmo-stp_10.42.42.5(pid=28434) [trial-2398↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28434)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28444): Process ended prematurely: osmo-stp_10.42.42.5(pid=28444) [trial-2398↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28444)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28454): Process ended prematurely: osmo-stp_10.42.42.5(pid=28454) [trial-2398↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28454)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=28472): Process ended prematurely: osmo-stp_10.42.42.5(pid=28472) [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28472)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28484): Process ended prematurely: osmo-stp_10.42.42.5(pid=28484) [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28484)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=28504): Process ended prematurely: osmo-stp_10.42.42.5(pid=28504) [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28504)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28514): Process ended prematurely: osmo-stp_10.42.42.5(pid=28514) [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28514)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28524): Process ended prematurely: osmo-stp_10.42.42.5(pid=28524) [trial-2398↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28524)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=28541): Process ended prematurely: osmo-stp_10.42.42.5(pid=28541) [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28541)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28553): Process ended prematurely: osmo-stp_10.42.42.5(pid=28553) [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28553)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=28574): Process ended prematurely: osmo-stp_10.42.42.5(pid=28574) [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28574)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28584): Process ended prematurely: osmo-stp_10.42.42.5(pid=28584) [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28584)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28594): Process ended prematurely: osmo-stp_10.42.42.5(pid=28594) [trial-2398↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28594)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28607): Process ended prematurely: osmo-stp_10.42.42.5(pid=28607) [trial-2398↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28607)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28620): Process ended prematurely: osmo-stp_10.42.42.5(pid=28620) [trial-2398↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28620)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=28629): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28629) [trial-2398↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28629)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=28639): Process ended prematurely: osmo-stp_10.42.42.5(pid=28639) [trial-2398↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28639)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=28649): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28649) [trial-2398↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28649)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=28659): Process ended prematurely: osmo-stp_10.42.42.5(pid=28659) [trial-2398↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28659)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28673): Process ended prematurely: osmo-stp_10.42.42.5(pid=28673) [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28673)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28684): Process ended prematurely: osmo-stp_10.42.42.5(pid=28684) [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28684)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28698): Process ended prematurely: osmo-stp_10.42.42.5(pid=28698) [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28698)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28709): Process ended prematurely: osmo-stp_10.42.42.5(pid=28709) [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28709)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28723): Process ended prematurely: osmo-stp_10.42.42.5(pid=28723) [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28723)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28734): Process ended prematurely: osmo-stp_10.42.42.5(pid=28734) [trial-2398↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28734)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28748): Process ended prematurely: osmo-stp_10.42.42.5(pid=28748) [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28748)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28760): Process ended prematurely: osmo-stp_10.42.42.5(pid=28760) [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28760)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28774): Process ended prematurely: osmo-stp_10.42.42.5(pid=28774) [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28774)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28788): Process ended prematurely: osmo-stp_10.42.42.5(pid=28788) [trial-2398↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28788)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28802): Process ended prematurely: osmo-stp_10.42.42.5(pid=28802) [trial-2398↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28802)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28813): Process ended prematurely: osmo-stp_10.42.42.5(pid=28813) [trial-2398↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28813)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28827): Process ended prematurely: osmo-stp_10.42.42.5(pid=28827) [trial-2398↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28827)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28838): Process ended prematurely: osmo-stp_10.42.42.5(pid=28838) [trial-2398↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28838)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28856): Process ended prematurely: osmo-stp_10.42.42.5(pid=28856) [trial-2398↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28856)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28867): Process ended prematurely: osmo-stp_10.42.42.5(pid=28867) [trial-2398↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28867)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=28885): Process ended prematurely: osmo-stp_10.42.42.5(pid=28885) [trial-2398↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28885)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28897): Process ended prematurely: osmo-stp_10.42.42.5(pid=28897) [trial-2398↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28897)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=28915): Process ended prematurely: osmo-stp_10.42.42.5(pid=28915) [trial-2398↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28915)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28925): Process ended prematurely: osmo-stp_10.42.42.5(pid=28925) [trial-2398↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28925)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28935): Process ended prematurely: osmo-stp_10.42.42.5(pid=28935) [trial-2398↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28935)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=28952): Process ended prematurely: osmo-stp_10.42.42.5(pid=28952) [trial-2398↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28952)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28964): Process ended prematurely: osmo-stp_10.42.42.5(pid=28964) [trial-2398↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28964)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=28982): Process ended prematurely: osmo-stp_10.42.42.5(pid=28982) [trial-2398↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28982)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28992): Process ended prematurely: osmo-stp_10.42.42.5(pid=28992) [trial-2398↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28992)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29002): Process ended prematurely: osmo-stp_10.42.42.5(pid=29002) [trial-2398↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29002)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=29020): Process ended prematurely: osmo-stp_10.42.42.5(pid=29020) [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29020)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29032): Process ended prematurely: osmo-stp_10.42.42.5(pid=29032) [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29032)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=29050): Process ended prematurely: osmo-stp_10.42.42.5(pid=29050) [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29050)] FAIL: ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=29332): Process ended prematurely: osmo-stp_10.42.42.5(pid=29332) [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29332)] FAIL: ping_idle_ping.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=29342): Process ended prematurely: osmo-stp_10.42.42.5(pid=29342) [trial-2398↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29342)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=29359): Process ended prematurely: osmo-stp_10.42.42.5(pid=29359) [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29359)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=29371): Process ended prematurely: osmo-stp_10.42.42.5(pid=29371) [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29371)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=29389): Process ended prematurely: osmo-stp_10.42.42.5(pid=29389) [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29389)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29403): Process ended prematurely: osmo-stp_10.42.42.5(pid=29403) [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29403)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=29414): Process ended prematurely: osmo-stp_10.42.42.5(pid=29414) [trial-2398↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29414)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29427): Process ended prematurely: osmo-stp_10.42.42.5(pid=29427) [trial-2398↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29427)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29442): Process ended prematurely: osmo-stp_10.42.42.5(pid=29442) [trial-2398↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29442)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=29451): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29451) [trial-2398↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29451)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=29461): Process ended prematurely: osmo-stp_10.42.42.5(pid=29461) [trial-2398↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29461)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=29470): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29470) [trial-2398↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29470)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=29480): Process ended prematurely: osmo-stp_10.42.42.5(pid=29480) [trial-2398↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29480)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29494): Process ended prematurely: osmo-stp_10.42.42.5(pid=29494) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29494)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29505): Process ended prematurely: osmo-stp_10.42.42.5(pid=29505) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29505)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29519): Process ended prematurely: osmo-stp_10.42.42.5(pid=29519) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29519)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29530): Process ended prematurely: osmo-stp_10.42.42.5(pid=29530) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29530)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29544): Process ended prematurely: osmo-stp_10.42.42.5(pid=29544) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29544)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29565): Process ended prematurely: osmo-stp_10.42.42.5(pid=29565) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29565)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29579): Process ended prematurely: osmo-stp_10.42.42.5(pid=29579) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29579)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29590): Process ended prematurely: osmo-stp_10.42.42.5(pid=29590) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29590)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29604): Process ended prematurely: osmo-stp_10.42.42.5(pid=29604) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29604)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29615): Process ended prematurely: osmo-stp_10.42.42.5(pid=29615) [trial-2398↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29615)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29629): Process ended prematurely: osmo-stp_10.42.42.5(pid=29629) [trial-2398↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29629)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29640): Process ended prematurely: osmo-stp_10.42.42.5(pid=29640) [trial-2398↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29640)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29654): Process ended prematurely: osmo-stp_10.42.42.5(pid=29654) [trial-2398↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29654)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29665): Process ended prematurely: osmo-stp_10.42.42.5(pid=29665) [trial-2398↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29665)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29680): Process ended prematurely: osmo-stp_10.42.42.5(pid=29680) [trial-2398↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29680)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29691): Process ended prematurely: osmo-stp_10.42.42.5(pid=29691) [trial-2398↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29691)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29705): Process ended prematurely: osmo-stp_10.42.42.5(pid=29705) [trial-2398↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29705)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29716): Process ended prematurely: osmo-stp_10.42.42.5(pid=29716) [trial-2398↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29716)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29730): Process ended prematurely: osmo-stp_10.42.42.5(pid=29730) [trial-2398↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29730)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29741): Process ended prematurely: osmo-stp_10.42.42.5(pid=29741) [trial-2398↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29741)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=29763): Process ended prematurely: osmo-stp_10.42.42.5(pid=29763) [trial-2398↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29763)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=29776): Process ended prematurely: osmo-stp_10.42.42.5(pid=29776) [trial-2398↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29776)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=29794): Process ended prematurely: osmo-stp_10.42.42.5(pid=29794) [trial-2398↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29794)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29804): Process ended prematurely: osmo-stp_10.42.42.5(pid=29804) [trial-2398↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29804)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29814): Process ended prematurely: osmo-stp_10.42.42.5(pid=29814) [trial-2398↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29814)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=29834): Process ended prematurely: osmo-stp_10.42.42.5(pid=29834) [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29834)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=29846): Process ended prematurely: osmo-stp_10.42.42.5(pid=29846) [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29846)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=29864): Process ended prematurely: osmo-stp_10.42.42.5(pid=29864) [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29864)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29874): Process ended prematurely: osmo-stp_10.42.42.5(pid=29874) [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29874)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29884): Process ended prematurely: osmo-stp_10.42.42.5(pid=29884) [trial-2398↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29884)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=29901): Process ended prematurely: osmo-stp_10.42.42.5(pid=29901) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29901)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29913): Process ended prematurely: osmo-stp_10.42.42.5(pid=29913) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29913)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=29932): Process ended prematurely: osmo-stp_10.42.42.5(pid=29932) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29932)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29942): Process ended prematurely: osmo-stp_10.42.42.5(pid=29942) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29942)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29952): Process ended prematurely: osmo-stp_10.42.42.5(pid=29952) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29952)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=29969): Process ended prematurely: osmo-stp_10.42.42.5(pid=29969) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29969)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=29982): Process ended prematurely: osmo-stp_10.42.42.5(pid=29982) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29982)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=30000): Process ended prematurely: osmo-stp_10.42.42.5(pid=30000) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30000)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30010): Process ended prematurely: osmo-stp_10.42.42.5(pid=30010) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30010)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30020): Process ended prematurely: osmo-stp_10.42.42.5(pid=30020) [trial-2398↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30020)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=30038): Process ended prematurely: osmo-stp_10.42.42.5(pid=30038) [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30038)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=30050): Process ended prematurely: osmo-stp_10.42.42.5(pid=30050) [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30050)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=30068): Process ended prematurely: osmo-stp_10.42.42.5(pid=30068) [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30068)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30079): Process ended prematurely: osmo-stp_10.42.42.5(pid=30079) [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30079)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30089): Process ended prematurely: osmo-stp_10.42.42.5(pid=30089) [trial-2398↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30089)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30102): Process ended prematurely: osmo-stp_10.42.42.5(pid=30102) [trial-2398↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30102)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30119): Process ended prematurely: osmo-stp_10.42.42.5(pid=30119) [trial-2398↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30119)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=30127): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30127) [trial-2398↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30127)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=30138): Process ended prematurely: osmo-stp_10.42.42.5(pid=30138) [trial-2398↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30138)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=30147): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30147) [trial-2398↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30147)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30157): Process ended prematurely: osmo-stp_10.42.42.5(pid=30157) [trial-2398↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30157)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30171): Process ended prematurely: osmo-stp_10.42.42.5(pid=30171) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30171)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30183): Process ended prematurely: osmo-stp_10.42.42.5(pid=30183) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30183)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30197): Process ended prematurely: osmo-stp_10.42.42.5(pid=30197) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30197)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30208): Process ended prematurely: osmo-stp_10.42.42.5(pid=30208) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30208)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30222): Process ended prematurely: osmo-stp_10.42.42.5(pid=30222) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30222)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30233): Process ended prematurely: osmo-stp_10.42.42.5(pid=30233) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30233)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30247): Process ended prematurely: osmo-stp_10.42.42.5(pid=30247) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30247)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30258): Process ended prematurely: osmo-stp_10.42.42.5(pid=30258) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30258)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30272): Process ended prematurely: osmo-stp_10.42.42.5(pid=30272) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30272)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30283): Process ended prematurely: osmo-stp_10.42.42.5(pid=30283) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30283)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30297): Process ended prematurely: osmo-stp_10.42.42.5(pid=30297) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30297)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30308): Process ended prematurely: osmo-stp_10.42.42.5(pid=30308) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30308)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30322): Process ended prematurely: osmo-stp_10.42.42.5(pid=30322) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30322)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30333): Process ended prematurely: osmo-stp_10.42.42.5(pid=30333) [trial-2398↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30333)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30347): Process ended prematurely: osmo-stp_10.42.42.5(pid=30347) [trial-2398↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30347)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30358): Process ended prematurely: osmo-stp_10.42.42.5(pid=30358) [trial-2398↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30358)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=30377): Process ended prematurely: osmo-stp_10.42.42.5(pid=30377) [trial-2398↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30377)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=30389): Process ended prematurely: osmo-stp_10.42.42.5(pid=30389) [trial-2398↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30389)] FAIL: iperf3m4.py (11.7 sec) Error: osmo-stp_10.42.42.5(pid=30679): Process ended prematurely: osmo-stp_10.42.42.5(pid=30679) [trial-2398↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30679)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30690): Process ended prematurely: osmo-stp_10.42.42.5(pid=30690) [trial-2398↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30690)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30700): Process ended prematurely: osmo-stp_10.42.42.5(pid=30700) [trial-2398↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30700)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=30717): Process ended prematurely: osmo-stp_10.42.42.5(pid=30717) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30717)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=30732): Process ended prematurely: osmo-stp_10.42.42.5(pid=30732) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30732)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=30750): Process ended prematurely: osmo-stp_10.42.42.5(pid=30750) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30750)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30761): Process ended prematurely: osmo-stp_10.42.42.5(pid=30761) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30761)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30771): Process ended prematurely: osmo-stp_10.42.42.5(pid=30771) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30771)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=30792): Process ended prematurely: osmo-stp_10.42.42.5(pid=30792) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30792)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=30807): Process ended prematurely: osmo-stp_10.42.42.5(pid=30807) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30807)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=30825): Process ended prematurely: osmo-stp_10.42.42.5(pid=30825) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30825)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30835): Process ended prematurely: osmo-stp_10.42.42.5(pid=30835) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30835)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30845): Process ended prematurely: osmo-stp_10.42.42.5(pid=30845) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30845)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=30862): Process ended prematurely: osmo-stp_10.42.42.5(pid=30862) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30862)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=30876): Process ended prematurely: osmo-stp_10.42.42.5(pid=30876) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30876)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=30894): Process ended prematurely: osmo-stp_10.42.42.5(pid=30894) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30894)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30904): Process ended prematurely: osmo-stp_10.42.42.5(pid=30904) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30904)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30914): Process ended prematurely: osmo-stp_10.42.42.5(pid=30914) [trial-2398↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30914)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=30927): Process ended prematurely: osmo-stp_10.42.42.5(pid=30927) [trial-2398↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30927)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30940): Process ended prematurely: osmo-stp_10.42.42.5(pid=30940) [trial-2398↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30940)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=30948): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30948) [trial-2398↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30948)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=30958): Process ended prematurely: osmo-stp_10.42.42.5(pid=30958) [trial-2398↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30958)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=30967): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30967) [trial-2398↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30967)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=30977): Process ended prematurely: osmo-stp_10.42.42.5(pid=30977) [trial-2398↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30977)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30991): Process ended prematurely: osmo-stp_10.42.42.5(pid=30991) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30991)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31002): Process ended prematurely: osmo-stp_10.42.42.5(pid=31002) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31002)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31016): Process ended prematurely: osmo-stp_10.42.42.5(pid=31016) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31016)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31027): Process ended prematurely: osmo-stp_10.42.42.5(pid=31027) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31027)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31042): Process ended prematurely: osmo-stp_10.42.42.5(pid=31042) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31042)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31053): Process ended prematurely: osmo-stp_10.42.42.5(pid=31053) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31053)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31067): Process ended prematurely: osmo-stp_10.42.42.5(pid=31067) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31067)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31078): Process ended prematurely: osmo-stp_10.42.42.5(pid=31078) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31078)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31096): Process ended prematurely: osmo-stp_10.42.42.5(pid=31096) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31096)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31107): Process ended prematurely: osmo-stp_10.42.42.5(pid=31107) [trial-2398↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31107)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31121): Process ended prematurely: osmo-stp_10.42.42.5(pid=31121) [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31121)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31132): Process ended prematurely: osmo-stp_10.42.42.5(pid=31132) [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31132)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31148): Process ended prematurely: osmo-stp_10.42.42.5(pid=31148) [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31148)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31159): Process ended prematurely: osmo-stp_10.42.42.5(pid=31159) [trial-2398↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31159)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31173): Process ended prematurely: osmo-stp_10.42.42.5(pid=31173) [trial-2398↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31173)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31184): Process ended prematurely: osmo-stp_10.42.42.5(pid=31184) [trial-2398↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31184)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31198): Process ended prematurely: osmo-stp_10.42.42.5(pid=31198) [trial-2398↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31198)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31209): Process ended prematurely: osmo-stp_10.42.42.5(pid=31209) [trial-2398↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31209)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=31227): Process ended prematurely: osmo-stp_10.42.42.5(pid=31227) [trial-2398↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31227)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31239): Process ended prematurely: osmo-stp_10.42.42.5(pid=31239) [trial-2398↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31239)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=31257): Process ended prematurely: osmo-stp_10.42.42.5(pid=31257) [trial-2398↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31257)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31267): Process ended prematurely: osmo-stp_10.42.42.5(pid=31267) [trial-2398↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31267)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31277): Process ended prematurely: osmo-stp_10.42.42.5(pid=31277) [trial-2398↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31277)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=31296): Process ended prematurely: osmo-stp_10.42.42.5(pid=31296) [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31296)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31308): Process ended prematurely: osmo-stp_10.42.42.5(pid=31308) [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31308)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=31326): Process ended prematurely: osmo-stp_10.42.42.5(pid=31326) [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31326)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31336): Process ended prematurely: osmo-stp_10.42.42.5(pid=31336) [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31336)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31346): Process ended prematurely: osmo-stp_10.42.42.5(pid=31346) [trial-2398↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31346)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=31363): Process ended prematurely: osmo-stp_10.42.42.5(pid=31363) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31363)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=31375): Process ended prematurely: osmo-stp_10.42.42.5(pid=31375) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31375)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=31393): Process ended prematurely: osmo-stp_10.42.42.5(pid=31393) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31393)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31403): Process ended prematurely: osmo-stp_10.42.42.5(pid=31403) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31403)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31413): Process ended prematurely: osmo-stp_10.42.42.5(pid=31413) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31413)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=31430): Process ended prematurely: osmo-stp_10.42.42.5(pid=31430) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31430)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=31445): Process ended prematurely: osmo-stp_10.42.42.5(pid=31445) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31445)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=31463): Process ended prematurely: osmo-stp_10.42.42.5(pid=31463) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31463)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31473): Process ended prematurely: osmo-stp_10.42.42.5(pid=31473) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31473)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31483): Process ended prematurely: osmo-stp_10.42.42.5(pid=31483) [trial-2398↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31483)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=31501): Process ended prematurely: osmo-stp_10.42.42.5(pid=31501) [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31501)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=31513): Process ended prematurely: osmo-stp_10.42.42.5(pid=31513) [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31513)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=31531): Process ended prematurely: osmo-stp_10.42.42.5(pid=31531) [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31531)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31541): Process ended prematurely: osmo-stp_10.42.42.5(pid=31541) [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31541)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31551): Process ended prematurely: osmo-stp_10.42.42.5(pid=31551) [trial-2398↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31551)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31566): Process ended prematurely: osmo-stp_10.42.42.5(pid=31566) [trial-2398↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31566)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31579): Process ended prematurely: osmo-stp_10.42.42.5(pid=31579) [trial-2398↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31579)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=31587): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31587) [trial-2398↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31587)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31598): Process ended prematurely: osmo-stp_10.42.42.5(pid=31598) [trial-2398↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31598)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=31607): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31607) [trial-2398↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31607)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=31617): Process ended prematurely: osmo-stp_10.42.42.5(pid=31617) [trial-2398↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31617)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31631): Process ended prematurely: osmo-stp_10.42.42.5(pid=31631) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31631)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31642): Process ended prematurely: osmo-stp_10.42.42.5(pid=31642) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31642)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31656): Process ended prematurely: osmo-stp_10.42.42.5(pid=31656) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31656)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31667): Process ended prematurely: osmo-stp_10.42.42.5(pid=31667) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31667)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31681): Process ended prematurely: osmo-stp_10.42.42.5(pid=31681) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31681)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31692): Process ended prematurely: osmo-stp_10.42.42.5(pid=31692) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31692)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=31708): Process ended prematurely: osmo-stp_10.42.42.5(pid=31708) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31708)] FAIL: mo_mt_call_osmux.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31990): Process ended prematurely: osmo-stp_10.42.42.5(pid=31990) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31990)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=32004): Process ended prematurely: osmo-stp_10.42.42.5(pid=32004) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32004)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32016): Process ended prematurely: osmo-stp_10.42.42.5(pid=32016) [trial-2398↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32016)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32030): Process ended prematurely: osmo-stp_10.42.42.5(pid=32030) [trial-2398↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32030)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32041): Process ended prematurely: osmo-stp_10.42.42.5(pid=32041) [trial-2398↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32041)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32058): Process ended prematurely: osmo-stp_10.42.42.5(pid=32058) [trial-2398↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32058)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=32069): Process ended prematurely: osmo-stp_10.42.42.5(pid=32069) [trial-2398↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32069)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32083): Process ended prematurely: osmo-stp_10.42.42.5(pid=32083) [trial-2398↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32083)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32094): Process ended prematurely: osmo-stp_10.42.42.5(pid=32094) [trial-2398↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32094)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=32115): Process ended prematurely: osmo-stp_10.42.42.5(pid=32115) [trial-2398↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32115)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=32128): Process ended prematurely: osmo-stp_10.42.42.5(pid=32128) [trial-2398↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32128)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=32146): Process ended prematurely: osmo-stp_10.42.42.5(pid=32146) [trial-2398↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32146)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32156): Process ended prematurely: osmo-stp_10.42.42.5(pid=32156) [trial-2398↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32156)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32166): Process ended prematurely: osmo-stp_10.42.42.5(pid=32166) [trial-2398↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32166)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=32183): Process ended prematurely: osmo-stp_10.42.42.5(pid=32183) [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32183)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=32195): Process ended prematurely: osmo-stp_10.42.42.5(pid=32195) [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32195)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=32213): Process ended prematurely: osmo-stp_10.42.42.5(pid=32213) [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32213)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=32223): Process ended prematurely: osmo-stp_10.42.42.5(pid=32223) [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32223)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32233): Process ended prematurely: osmo-stp_10.42.42.5(pid=32233) [trial-2398↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32233)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=32253): Process ended prematurely: osmo-stp_10.42.42.5(pid=32253) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32253)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=32265): Process ended prematurely: osmo-stp_10.42.42.5(pid=32265) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32265)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=32283): Process ended prematurely: osmo-stp_10.42.42.5(pid=32283) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32283)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32293): Process ended prematurely: osmo-stp_10.42.42.5(pid=32293) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32293)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32303): Process ended prematurely: osmo-stp_10.42.42.5(pid=32303) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32303)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=32320): Process ended prematurely: osmo-stp_10.42.42.5(pid=32320) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32320)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=32332): Process ended prematurely: osmo-stp_10.42.42.5(pid=32332) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32332)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=32350): Process ended prematurely: osmo-stp_10.42.42.5(pid=32350) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32350)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32361): Process ended prematurely: osmo-stp_10.42.42.5(pid=32361) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32361)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32371): Process ended prematurely: osmo-stp_10.42.42.5(pid=32371) [trial-2398↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32371)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=32384): Process ended prematurely: osmo-stp_10.42.42.5(pid=32384) [trial-2398↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32384)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=32419): Process ended prematurely: osmo-stp_10.42.42.5(pid=32419) [trial-2398↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32419)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=32437): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32437) [trial-2398↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32437)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=331): Process ended prematurely: osmo-stp_10.42.42.5(pid=331) [trial-2398↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=331)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=529): Process ended prematurely: osmo-nitb_10.42.42.2(pid=529) [trial-2398↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=529)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=540): Process ended prematurely: osmo-stp_10.42.42.5(pid=540) [trial-2398↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=540)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=554): Process ended prematurely: osmo-stp_10.42.42.5(pid=554) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=554)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=567): Process ended prematurely: osmo-stp_10.42.42.5(pid=567) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=567)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=581): Process ended prematurely: osmo-stp_10.42.42.5(pid=581) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=581)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=593): Process ended prematurely: osmo-stp_10.42.42.5(pid=593) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=593)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=607): Process ended prematurely: osmo-stp_10.42.42.5(pid=607) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=607)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=618): Process ended prematurely: osmo-stp_10.42.42.5(pid=618) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=618)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=632): Process ended prematurely: osmo-stp_10.42.42.5(pid=632) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=632)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=643): Process ended prematurely: osmo-stp_10.42.42.5(pid=643) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=643)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=660): Process ended prematurely: osmo-stp_10.42.42.5(pid=660) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=660)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=671): Process ended prematurely: osmo-stp_10.42.42.5(pid=671) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=671)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=685): Process ended prematurely: osmo-stp_10.42.42.5(pid=685) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=685)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=696): Process ended prematurely: osmo-stp_10.42.42.5(pid=696) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=696)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=710): Process ended prematurely: osmo-stp_10.42.42.5(pid=710) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=710)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=722): Process ended prematurely: osmo-stp_10.42.42.5(pid=722) [trial-2398↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=722)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=736): Process ended prematurely: osmo-stp_10.42.42.5(pid=736) [trial-2398↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=736)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=747): Process ended prematurely: osmo-stp_10.42.42.5(pid=747) [trial-2398↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=747)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=765): Process ended prematurely: osmo-stp_10.42.42.5(pid=765) [trial-2398↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=765)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=777): Process ended prematurely: osmo-stp_10.42.42.5(pid=777) [trial-2398↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=777)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=795): Process ended prematurely: osmo-stp_10.42.42.5(pid=795) [trial-2398↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=795)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=806): Process ended prematurely: osmo-stp_10.42.42.5(pid=806) [trial-2398↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=806)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=816): Process ended prematurely: osmo-stp_10.42.42.5(pid=816) [trial-2398↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=816)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=838): Process ended prematurely: osmo-stp_10.42.42.5(pid=838) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=838)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=851): Process ended prematurely: osmo-stp_10.42.42.5(pid=851) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=851)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=882): Process ended prematurely: osmo-stp_10.42.42.5(pid=882) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=882)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=896): Process ended prematurely: osmo-stp_10.42.42.5(pid=896) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=896)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=906): Process ended prematurely: osmo-stp_10.42.42.5(pid=906) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=906)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=923): Process ended prematurely: osmo-stp_10.42.42.5(pid=923) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=923)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=936): Process ended prematurely: osmo-stp_10.42.42.5(pid=936) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=936)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=955): Process ended prematurely: osmo-stp_10.42.42.5(pid=955) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=955)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=966): Process ended prematurely: osmo-stp_10.42.42.5(pid=966) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=966)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=977): Process ended prematurely: osmo-stp_10.42.42.5(pid=977) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=977)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=999): Process ended prematurely: osmo-stp_10.42.42.5(pid=999) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=999)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=1011): Process ended prematurely: osmo-stp_10.42.42.5(pid=1011) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1011)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=1029): Process ended prematurely: osmo-stp_10.42.42.5(pid=1029) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1029)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1041): Process ended prematurely: osmo-stp_10.42.42.5(pid=1041) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1041)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1051): Process ended prematurely: osmo-stp_10.42.42.5(pid=1051) [trial-2398↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1051)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1065): Process ended prematurely: osmo-stp_10.42.42.5(pid=1065) [trial-2398↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1065)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1078): Process ended prematurely: osmo-stp_10.42.42.5(pid=1078) [trial-2398↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1078)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=1086): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1086) [trial-2398↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1086)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=1096): Process ended prematurely: osmo-stp_10.42.42.5(pid=1096) [trial-2398↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1096)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=1105): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1105) [trial-2398↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1105)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1117): Process ended prematurely: osmo-stp_10.42.42.5(pid=1117) [trial-2398↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1117)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1141): Process ended prematurely: osmo-stp_10.42.42.5(pid=1141) [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1141)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1153): Process ended prematurely: osmo-stp_10.42.42.5(pid=1153) [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1153)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=1167): Process ended prematurely: osmo-stp_10.42.42.5(pid=1167) [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1167)] FAIL: mo_mt_call_osmux.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=1452): Process ended prematurely: osmo-stp_10.42.42.5(pid=1452) [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1452)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=1466): Process ended prematurely: osmo-stp_10.42.42.5(pid=1466) [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1466)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1478): Process ended prematurely: osmo-stp_10.42.42.5(pid=1478) [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1478)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1492): Process ended prematurely: osmo-stp_10.42.42.5(pid=1492) [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1492)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1503): Process ended prematurely: osmo-stp_10.42.42.5(pid=1503) [trial-2398↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1503)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1524): Process ended prematurely: osmo-stp_10.42.42.5(pid=1524) [trial-2398↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1524)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1535): Process ended prematurely: osmo-stp_10.42.42.5(pid=1535) [trial-2398↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1535)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1549): Process ended prematurely: osmo-stp_10.42.42.5(pid=1549) [trial-2398↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1549)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1560): Process ended prematurely: osmo-stp_10.42.42.5(pid=1560) [trial-2398↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1560)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=1579): Process ended prematurely: osmo-stp_10.42.42.5(pid=1579) [trial-2398↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1579)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=1591): Process ended prematurely: osmo-stp_10.42.42.5(pid=1591) [trial-2398↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1591)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=1609): Process ended prematurely: osmo-stp_10.42.42.5(pid=1609) [trial-2398↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1609)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1619): Process ended prematurely: osmo-stp_10.42.42.5(pid=1619) [trial-2398↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1619)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1629): Process ended prematurely: osmo-stp_10.42.42.5(pid=1629) [trial-2398↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1629)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=1646): Process ended prematurely: osmo-stp_10.42.42.5(pid=1646) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1646)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=1658): Process ended prematurely: osmo-stp_10.42.42.5(pid=1658) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1658)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=1676): Process ended prematurely: osmo-stp_10.42.42.5(pid=1676) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1676)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1686): Process ended prematurely: osmo-stp_10.42.42.5(pid=1686) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1686)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1696): Process ended prematurely: osmo-stp_10.42.42.5(pid=1696) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1696)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=1720): Process ended prematurely: osmo-stp_10.42.42.5(pid=1720) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1720)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=1732): Process ended prematurely: osmo-stp_10.42.42.5(pid=1732) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1732)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=1750): Process ended prematurely: osmo-stp_10.42.42.5(pid=1750) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1750)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1760): Process ended prematurely: osmo-stp_10.42.42.5(pid=1760) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1760)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1770): Process ended prematurely: osmo-stp_10.42.42.5(pid=1770) [trial-2398↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1770)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1785): Process ended prematurely: osmo-stp_10.42.42.5(pid=1785) [trial-2398↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1785)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1800): Process ended prematurely: osmo-stp_10.42.42.5(pid=1800) [trial-2398↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1800)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=1809): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1809) [trial-2398↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1809)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=1821): Process ended prematurely: osmo-stp_10.42.42.5(pid=1821) [trial-2398↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1821)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1835): Process ended prematurely: osmo-stp_10.42.42.5(pid=1835) [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1835)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1846): Process ended prematurely: osmo-stp_10.42.42.5(pid=1846) [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1846)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1861): Process ended prematurely: osmo-stp_10.42.42.5(pid=1861) [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1861)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1872): Process ended prematurely: osmo-stp_10.42.42.5(pid=1872) [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1872)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1889): Process ended prematurely: osmo-stp_10.42.42.5(pid=1889) [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1889)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1900): Process ended prematurely: osmo-stp_10.42.42.5(pid=1900) [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1900)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1915): Process ended prematurely: osmo-stp_10.42.42.5(pid=1915) [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1915)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1926): Process ended prematurely: osmo-stp_10.42.42.5(pid=1926) [trial-2398↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1926)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1944): Process ended prematurely: osmo-stp_10.42.42.5(pid=1944) [trial-2398↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1944)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1955): Process ended prematurely: osmo-stp_10.42.42.5(pid=1955) [trial-2398↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1955)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1970): Process ended prematurely: osmo-stp_10.42.42.5(pid=1970) [trial-2398↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1970)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1981): Process ended prematurely: osmo-stp_10.42.42.5(pid=1981) [trial-2398↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1981)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=1995): Process ended prematurely: osmo-stp_10.42.42.5(pid=1995) [trial-2398↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1995)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2006): Process ended prematurely: osmo-stp_10.42.42.5(pid=2006) [trial-2398↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2006)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=2027): Process ended prematurely: osmo-stp_10.42.42.5(pid=2027) [trial-2398↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2027)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=2039): Process ended prematurely: osmo-stp_10.42.42.5(pid=2039) [trial-2398↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2039)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=2057): Process ended prematurely: osmo-stp_10.42.42.5(pid=2057) [trial-2398↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2057)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2076): Process ended prematurely: osmo-stp_10.42.42.5(pid=2076) [trial-2398↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2076)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2090): Process ended prematurely: osmo-stp_10.42.42.5(pid=2090) [trial-2398↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2090)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=2108): Process ended prematurely: osmo-stp_10.42.42.5(pid=2108) [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2108)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=2121): Process ended prematurely: osmo-stp_10.42.42.5(pid=2121) [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2121)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=2141): Process ended prematurely: osmo-stp_10.42.42.5(pid=2141) [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2141)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2152): Process ended prematurely: osmo-stp_10.42.42.5(pid=2152) [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2152)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2162): Process ended prematurely: osmo-stp_10.42.42.5(pid=2162) [trial-2398↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2162)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=2180): Process ended prematurely: osmo-stp_10.42.42.5(pid=2180) [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2180)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=2192): Process ended prematurely: osmo-stp_10.42.42.5(pid=2192) [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2192)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=2211): Process ended prematurely: osmo-stp_10.42.42.5(pid=2211) [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2211)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=2222): Process ended prematurely: osmo-stp_10.42.42.5(pid=2222) [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2222)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2235): Process ended prematurely: osmo-stp_10.42.42.5(pid=2235) [trial-2398↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2235)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=2255): Process ended prematurely: osmo-stp_10.42.42.5(pid=2255) [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2255)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=2267): Process ended prematurely: osmo-stp_10.42.42.5(pid=2267) [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2267)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=2285): Process ended prematurely: osmo-stp_10.42.42.5(pid=2285) [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2285)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2295): Process ended prematurely: osmo-stp_10.42.42.5(pid=2295) [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2295)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2305): Process ended prematurely: osmo-stp_10.42.42.5(pid=2305) [trial-2398↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2305)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2318): Process ended prematurely: osmo-stp_10.42.42.5(pid=2318) [trial-2398↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2318)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=2327): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2327) [trial-2398↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2327)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=2329): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2329) [trial-2398↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2329)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=2331): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2331) [trial-2398↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2331)] FAIL: esme_ms_sms_transaction.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=2333): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2333) [trial-2398↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2333)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.9 sec) Error: osmo-hlr_10.42.42.2(pid=2342): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2342) [trial-2398↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2342)] FAIL: esme_connect_policy_closed.py (6.0 sec) Error: osmo-hlr_10.42.42.2(pid=2353): Process ended prematurely: osmo-hlr_10.42.42.2(pid=2353) [trial-2398↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2353)] FAIL: esme_ms_sms_storeforward.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2365): Process ended prematurely: osmo-stp_10.42.42.5(pid=2365) [trial-2398↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2365)] FAIL: esme_ms_sms_transaction.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2376): Process ended prematurely: osmo-stp_10.42.42.5(pid=2376) [trial-2398↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2376)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2390): Process ended prematurely: osmo-stp_10.42.42.5(pid=2390) [trial-2398↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2390)] FAIL: register_a5_0_authreq.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2401): Process ended prematurely: osmo-stp_10.42.42.5(pid=2401) [trial-2398↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2401)] FAIL: register_a5_1_authreq.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2412): Process ended prematurely: osmo-stp_10.42.42.5(pid=2412) [trial-2398↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2412)] FAIL: register_a5_3_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2423): Process ended prematurely: osmo-stp_10.42.42.5(pid=2423) [trial-2398↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2423)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.3 sec) Error: srsepc(pid=2443): Process ended prematurely: srsepc(pid=2443) [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2443)] FAIL: iperf3_bidir.py (18.9 sec) Error: srsepc(pid=2459): Process ended prematurely: srsepc(pid=2459) [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2459)] FAIL: iperf3_dl.py (19.1 sec) Error: srsepc(pid=2475): Process ended prematurely: srsepc(pid=2475) [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2475)] FAIL: iperf3_ul.py (18.8 sec) Error: srsepc(pid=2491): Process ended prematurely: srsepc(pid=2491) [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2491)] FAIL: ping.py (19.2 sec) Error: srsepc(pid=2782): Process ended prematurely: srsepc(pid=2782) [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2782)] FAIL: rrc_idle_mo_ping.py (18.9 sec) Error: srsepc(pid=2798): Process ended prematurely: srsepc(pid=2798) [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2798)] FAIL: rrc_idle_mt_ping.py (18.3 sec) Error: srsepc(pid=2814): Process ended prematurely: srsepc(pid=2814) [trial-2398↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=2814)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2829): Process ended prematurely: osmo-stp_10.42.42.5(pid=2829) [trial-2398↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2829)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2846): Process ended prematurely: osmo-stp_10.42.42.5(pid=2846) [trial-2398↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2846)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2861): Process ended prematurely: osmo-stp_10.42.42.5(pid=2861) [trial-2398↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2861)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2875): Process ended prematurely: osmo-stp_10.42.42.5(pid=2875) [trial-2398↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2875)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=2889): Process ended prematurely: osmo-stp_10.42.42.5(pid=2889) [trial-2398↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2889)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2904): Process ended prematurely: osmo-stp_10.42.42.5(pid=2904) [trial-2398↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2904)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2918): Process ended prematurely: osmo-stp_10.42.42.5(pid=2918) [trial-2398↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2918)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2932): Process ended prematurely: osmo-stp_10.42.42.5(pid=2932) [trial-2398↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2932)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=2946): Process ended prematurely: osmo-stp_10.42.42.5(pid=2946) [trial-2398↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2946)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2960): Process ended prematurely: osmo-stp_10.42.42.5(pid=2960) [trial-2398↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2960)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2974): Process ended prematurely: osmo-stp_10.42.42.5(pid=2974) [trial-2398↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2974)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2988): Process ended prematurely: osmo-stp_10.42.42.5(pid=2988) [trial-2398↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2988)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3002): Process ended prematurely: osmo-stp_10.42.42.5(pid=3002) [trial-2398↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3002)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=3016): Process ended prematurely: osmo-stp_10.42.42.5(pid=3016) [trial-2398↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3016)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3030): Process ended prematurely: osmo-stp_10.42.42.5(pid=3030) [trial-2398↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3030)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3044): Process ended prematurely: osmo-stp_10.42.42.5(pid=3044) [trial-2398↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3044)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3058): Process ended prematurely: osmo-stp_10.42.42.5(pid=3058) [trial-2398↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3058)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=3072): Process ended prematurely: osmo-stp_10.42.42.5(pid=3072) [trial-2398↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3072)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3086): Process ended prematurely: osmo-stp_10.42.42.5(pid=3086) [trial-2398↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3086)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3101): Process ended prematurely: osmo-stp_10.42.42.5(pid=3101) [trial-2398↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3101)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3115): Process ended prematurely: osmo-stp_10.42.42.5(pid=3115) [trial-2398↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3115)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3129): Process ended prematurely: osmo-stp_10.42.42.5(pid=3129) [trial-2398↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3129)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=3143): Process ended prematurely: osmo-stp_10.42.42.5(pid=3143) [trial-2398↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3143)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3158): Process ended prematurely: osmo-stp_10.42.42.5(pid=3158) [trial-2398↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3158)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3172): Process ended prematurely: osmo-stp_10.42.42.5(pid=3172) [trial-2398↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3172)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3187): Process ended prematurely: osmo-stp_10.42.42.5(pid=3187) [trial-2398↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3187)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=3205): Process ended prematurely: osmo-stp_10.42.42.5(pid=3205) [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3205)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3219): Process ended prematurely: osmo-stp_10.42.42.5(pid=3219) [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3219)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3233): Process ended prematurely: osmo-stp_10.42.42.5(pid=3233) [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3233)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3247): Process ended prematurely: osmo-stp_10.42.42.5(pid=3247) [trial-2398↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3247)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3261): Process ended prematurely: osmo-stp_10.42.42.5(pid=3261) [trial-2398↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3261)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=3276): Process ended prematurely: osmo-stp_10.42.42.5(pid=3276) [trial-2398↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3276)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3291): Process ended prematurely: osmo-stp_10.42.42.5(pid=3291) [trial-2398↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3291)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3305): Process ended prematurely: osmo-stp_10.42.42.5(pid=3305) [trial-2398↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3305)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3319): Process ended prematurely: osmo-stp_10.42.42.5(pid=3319) [trial-2398↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3319)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3333): Process ended prematurely: osmo-stp_10.42.42.5(pid=3333) [trial-2398↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3333)] + rm -rf trial-2398/inst + cd trial-2398 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-14 02:07:35 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398-run.tgz run.2022-12-14_02-07-46 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2398-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17685.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6694.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2993.tgz osmo-mgw.build-8964.tgz osmo-msc.build-29315.tgz osmo-nitb.build-12994.tgz osmo-pcu-oc2g.build-3911.tgz osmo-pcu-sysmo.build-5194.tgz osmo-pcu.build-5155.tgz osmo-sgsn.build-30100.tgz osmo-stp.build-9260.tgz osmo-trx.build-4686.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE